When it comes to gathering insights and data, surveys play a pivotal role. However, not all questions within these surveys are created equal. Some questions, despite good intentions, can lead to skewed results, confuse respondents, or simply provide little value. Let's dive into what makes a survey question bad, using real-world examples.
Good survey questions should be clear, unbiased, and relevant. They should encourage honest and thoughtful responses, and help achieve the survey's objectives. Unfortunately, this isn't always the case. So, let's explore some common pitfalls and examples of bad survey questions.
Leading Questions
Leading questions subtly guide respondents towards a particular answer, often tainting the results. They might use loaded language or assume information that isn't known.
Example: "Would you say our customer service is excellent?" This question assumes that the service is indeed excellent, which might not be the case. A more neutral question could be: "How would you rate our customer service?"
Double-Barreled Questions
Double-barreled questions ask for responses to two distinct ideas in a single question, making it hard for respondents to give clear answers.
Example: "How satisfied are you with our product's quality and the customer service you received?" This question mixes two separate aspects. It would be better to ask these as two distinct questions.
Ambiguous Questions
Ambiguous questions can be interpreted in multiple ways, leading to varied responses and less reliable data.
Example: "What do you think of our company?" This question could mean anything from the respondent's opinion of the products, services, or the company as a whole. A more specific question could be: "How satisfied are you with our product range?"
Irrelevant or Redundant Questions
Surveys that include irrelevant or redundant questions waste respondents' time and can annoy them, potentially leading to incomplete or biased responses.
Example: If you're surveying customers about a recent purchase, asking their age will likely provide little valuable insight. However, asking about their occupation might provide context for how they use your product.
Questions Without Answer Choices
Some surveys forget to include answer choices, leaving respondents unsure of how to respond or leading to blank responses.
Example: "Please comment on your experience with our new service:" While this question encourages free-form feedback, without any provided answer choices, some respondents might not know how to respond.
Questions With Too Many Answer Choices
On the other hand, some surveys overwhelm respondents with too many answer choices, making it difficult for them to pick the most appropriate one.
Example: "How often do you use our app? ( Never, Rarely, Sometimes, Often, Always, Very Often, Extremely Often)" This question could be simplified to: "How often do you use our app? ( Never, Rarely, Sometimes, Often)"
In conclusion, creating effective survey questions requires careful thought and a clear understanding of what you want to achieve. By avoiding these common pitfalls and striving for clarity, relevance, and neutrality, you'll be well on your way to gaining valuable insights from your surveys. So, next time you draft a survey, remember: keep questions simple, specific, and relevant to maximize the quality of your data.