Survey Myths Debunked: Low Response Rates



By Bob Kobek

One common myth I often hear about surveys is that “response rates are declining.” There are always variables that might cause this, and there are certainly solutions. However making  a blanket statement like this is at best a misnomer,  and is often a self-serving comment made by alternative feedback programs.  

There is one very important question that needs to be asked: what is the purpose of the survey? To capture the voice of the customer, gain information for process improvement, and measure experiences (customer, patient, employee, etc.)? Each one of these will carry very different variables.

In political campaigns, there is a bloc of voters who do not vote. That seems a bit incongruous, but it is a number, expressed in a percentage, of people who ‘vote with their feet’ and they are calculated into election day projections. 

That bloc can be higher or lower than estimated, but not by much. Patterns don’t make abrupt turns and when they do, they are anomalies. And there are an unlimited number of variables that can cause those variances. 

In some ways, election day is much like a survey (not to be confused with a poll) where the voter preference turns into the ultimate Net Promoter Score – NPS. They would be referred to as ‘passives.’

In fact – there is no empirical data that I am aware of that proves response rates are declining across the board for survey response. They may decline for one hospital, but increase for a hotel;  decline for an auto dealer, and increase for a bank. I am also not aware of any data that demonstrates a decline in ‘industry-wide’ surveys. 

Certainly, some industries/businesses  create ‘survey fatigue’ of their own through increased incidences of invitations but that is a creation of an amateur survey deployment. In healthcare, fatigue can be very real if a patient is being treated by an organization that bills Medicare as a form of payment. Those surveys are mandated to protect the cost of health care. I can argue the way they are deployed is the most expensive method of delivery, but that is another topic for another time. 

First, determine if there is a solution in search of a problem or a problem in search of a solution, and look for as many variables as possible. Examples: 

Affinity

A high response rate is driven by high levels of motivation to complete the survey or a strong personal relationship between business and customer. Survey response rates in the 5% to 30% range are far more typical.

What is the business relationship between you and your customers? Is it purely transactional? That can contribute to lower response rates.

Delivery vehicle

Are you deploying the survey online, over the phone, or via snail mail?

The CMS survey has expanded its delivery vehicles to include ‘web’ to increase the response rate. This, along with phone and mail will certainly increase the Medicare mandated survey.

Invitation information

What information are you collecting? Address, email, phone number? Is your invitation verbiage  inviting?

Delivery rates

There is a difference between delivery and response.

B2B or B2C

B2B will be lower by the nature of security protocols at the corporate level.

There are many, many reasons for the perception of low response rates, but there is another factor to consider as well. The difference between response rates and completion rates. 

Some people believe the terms response rate and completion rate are synonymous. But, in online survey research, these two terms have different meanings. Where response rate is meant to identify the percentage of your sample who respond to your survey, completion rate determines the percentage of respondents who completed your survey.

So, are ‘response rates’ declining? It depends and, if so, some reasons  can explain it when you take a closer look. If your organization is looking to meaningfully capture customer, patient, and employee feedback, you need a professional to help you consider these factors and craft surveys that work.

Bob Kobek is the President of Patients-Count© by Mobius Vendor Partners

For more information, visit www.Patients-Count.com.