Principles of Marketing: Marketing Research - Questionnaire Design, Scales Wording Sequence Pretesting

What It Is

Questionnaire design is the process of creating surveys, polls, or other research instruments to collect data from customers, prospects, or other stakeholders. Effective questionnaire design is crucial in marketing as it directly impacts the accuracy and reliability of the data collected, which in turn influences business decisions. For instance, Coca-Cola uses questionnaire design to understand consumer preferences and tailor its marketing strategies accordingly.

Key Concepts & Frameworks

• Scale: A scale is a set of questions that measure a specific attribute or attitude, such as satisfaction or willingness to pay. Example: A 5-point Likert scale (1-5) to measure customer satisfaction.
• Wording: The language used in questionnaire questions can significantly impact responses. Example: "How satisfied are you with our product?" vs. "How dissatisfied are you with our product?"
• Sequence: The order in which questions are presented can influence responses. Example: Asking about demographics before sensitive topics like income.
• Pre-testing: Pre-testing involves pilot-testing questionnaires with a small group of respondents to identify issues and refine the design. Example: Conducting a pilot study with 20 customers before launching a national survey.
• Reliability: Reliability refers to the consistency of responses across different questionnaires or administrations. Example: Using the same questions and scales across multiple surveys to measure customer satisfaction.
• Validity: Validity refers to the accuracy of the data collected, ensuring that the questionnaire measures what it's intended to measure. Example: Using a validated scale to measure customer satisfaction.
• Response bias: Response bias occurs when respondents provide answers that are not accurate or truthful. Example: Social desirability bias, where respondents answer questions in a way that they think is socially acceptable.
• Sampling bias: Sampling bias occurs when the sample selected is not representative of the population. Example: Conducting a survey only among customers who have responded to previous surveys.

How to Apply It

• To design an effective questionnaire, start by defining the research objectives and identifying the target audience.
• Use clear and concise language, avoiding jargon and technical terms.
• Pilot-test the questionnaire with a small group of respondents to identify issues and refine the design.
• Use validated scales and measures to ensure the accuracy of the data collected.
• Consider using online survey tools to collect data efficiently and cost-effectively.

Common Mistakes

• Mistake: Asking leading questions that influence respondents' answers.
• Correction: Use neutral language and avoid asking questions that suggest a particular answer.
• Mistake: Failing to pilot-test the questionnaire before launching it nationally.
• Correction: Conduct a pilot study with a small group of respondents to identify issues and refine the design.
• Mistake: Using a questionnaire that is too long or complex.
• Correction: Keep the questionnaire concise and focused on the research objectives.

Exam / Interview Tips

• Be prepared to explain the difference between reliability and validity.
• Understand the concept of response bias and how to mitigate it.
• Be able to describe the importance of pilot-testing a questionnaire.
• Be prepared to discuss the advantages and disadvantages of online survey tools.

Quick Practice

Scenario: A marketing researcher wants to measure customer satisfaction with a new product. What type of scale should they use?

A) 5-point Likert scale B) 10-point Likert scale C) Semantic differential scale D) Rank-order scale

Answer: A) 5-point Likert scale

Explanation: A 5-point Likert scale is a common and effective way to measure customer satisfaction, as it provides a clear and concise way to measure attitudes and opinions.

Scenario: A marketer wants to understand the demographics of their target audience. What type of question should they ask?

A) Open-ended question B) Multiple-choice question C) Rating scale question D) Demographic question

Answer: D) Demographic question

Explanation: Demographic questions are used to collect information about respondents' characteristics, such as age, income, and education level.

Scenario: A researcher wants to measure the effectiveness of a marketing campaign. What type of validity should they aim for?

A) Face validity B) Content validity C) Criterion validity D) Construct validity

Answer: C) Criterion validity

Explanation: Criterion validity refers to the accuracy of the data collected, ensuring that the questionnaire measures what it's intended to measure.

Last-Minute Cram Sheet

• Questionnaire design: The process of creating surveys, polls, or other research instruments to collect data.
• Scale: A set of questions that measure a specific attribute or attitude.
• Wording: The language used in questionnaire questions can significantly impact responses.
• Sequence: The order in which questions are presented can influence responses.
• Pre-testing: Pilot-testing questionnaires with a small group of respondents to identify issues and refine the design.
• Reliability: Consistency of responses across different questionnaires or administrations.
• Validity: Accuracy of the data collected, ensuring that the questionnaire measures what it's intended to measure.
• Response bias: Respondents providing answers that are not accurate or truthful.
• Sampling bias: The sample selected is not representative of the population.
• Pilot study: A small-scale test of a questionnaire or survey to identify issues and refine the design.
• Online survey tools: Software used to collect data efficiently and cost-effectively.
• Leading questions: Questions that influence respondents' answers.
• Semantic differential scale: A scale that measures attitudes or opinions by asking respondents to rate statements on a bipolar scale (e.g., good-bad).
• Rank-order scale: A scale that asks respondents to rank-order options in order of preference.
• Criterion validity: The accuracy of the data collected, ensuring that the questionnaire measures what it's intended to measure.
• Construct validity: The extent to which a questionnaire measures a theoretical construct or concept.
• Face validity: The extent to which a questionnaire appears to measure what it's intended to measure.
• Content validity: The extent to which a questionnaire measures the entire range of a construct or concept.
• 'Marketing Myopia' = focusing on the product instead of the customer need