In your parish development efforts you'll want to give special attention to the Sunday experience of the congregations in the parish -- graceful and grounding Liturgy, good preaching, and a relaxed social time. In general you want a climate that is centered and not rushed, anxious, or overloaded with things to do.
This is about improving your preaching
Things that don't help
1. Assuming that what you hear as they shake your hand and leave is the whole truth.
Most clergy know to not understand politeness as feedback. Newer or pugnacious clergy may make the mistake of asking the person to "say more." It's just not the time or place.
2. Open gatherings to discuss the sermon
These may be very useful for educational purposes. Also, as a way for people who are naturally more articulate to have an opportunity to bring that capacity to bear in relationship to biblical and theological issues. Such sessions work best when the purpose is limited and clear -- to explore the content of the sermon and the associated propers. We muddle that if we are also seeking feedback.
It's also an example of a practice that because it's a "hit" when done the first few times the rector decides to make it a frequent event. One parish I know did it every Sunday. Overkill! A caution - you can undercut the receptive stance of those listening if they know that at coffee hour their going to be asked to discuss the sermon.
3. Clergy gatherings to critique last week's and prepare next week's sermon
These are mostly done in larger parishes. The sessions are likely to have some positive impact on the preaching. That's especially true if the sessions are primarily focused preparing for the upcoming sermons.
However, if you're seeking constructive feedback it helps to keep in mind that clergy who work together will have a necessary hesitation in offering any "negative" feedback. Bring a lay person into the conversation on occasion isn't likely to be much help either. If it's open to anyone things can easily turn contentious as someone with a bone-to-pick turns things augmentative. If it's restricted then the message is, well "restricted."
Things to try
1. Use a structured feedback process.
a. Occasionally ask everyone at the Eucharist (or a smaller group) to fill out a feedback form.
b. Have a four week process in which you use a coach/facilitator to gather and present the feedback of a selected group.
c. Don't do the above too frequently. You can cut across the needed receptivity in the congregation. You can also overwhelm your own ability to receive the feedback.
d. There are two processes offered below and several feedback forms.
2. If the parish has several celebrations of the Eucharist during the week -- consider dropping the practice of offering a homily at all celebrations. In most parishes they simply aren't that good. Allow the focus to be on the Eucharist itself. Consider varying the masses a bit -- Wednesday with healing liturgy, Thursday with more contemplative style (longer silence at beginning and after readings), Friday with a brief homily and the expectation that it will be well done.
Two processes for feedback
Four feedback forms
rag+