Intro to Marketing Research: Quantitative Research - Questionnaire Flow and Layout, Funnel Approach Filter Questions Skip Patterns Question Order Bias

What It Is

Questionnaire flow and layout refer to the strategic arrangement of questions in a survey to optimize response rates, reduce respondent burden, and increase data quality. A well-designed questionnaire flow can prevent respondent fatigue, minimize item non-response, and enhance the validity of the collected data. A notable example of a questionnaire flow is the funnel approach, used in the American Community Survey (ACS) conducted by the US Census Bureau. The ACS uses a hierarchical structure, starting with broad questions and gradually narrowing down to more specific ones, allowing respondents to provide more accurate and detailed information.

Key Terms & Concepts

• Funnel Approach: A questionnaire design where questions are arranged in a hierarchical structure, starting with broad questions and gradually narrowing down to more specific ones.
  • Example: American Community Survey (ACS) conducted by the US Census Bureau.
• Filter Questions: Questions used to determine whether a respondent should be asked additional questions or not.
  • Example: In a survey about consumer behavior, a filter question might ask about the respondent's age to determine whether they should be asked about specific product preferences.
• Skip Patterns: The rules that determine which questions to skip or not, based on previous responses.
  • Example: In a survey about health habits, a skip pattern might direct respondents to skip questions about exercise habits if they report not engaging in any physical activity.
• Question Order Bias: The effect of the order in which questions are asked on the respondent's answers.
  • Example: Asking about income before asking about education level can lead to biased responses, as respondents may perceive their income as more or less relevant based on their educational background.
• Reliability: The consistency of a measure or instrument across different administrations or conditions.
  • Example: A survey with high reliability would produce similar results when administered to the same respondents at different times.
• Validity: The extent to which a measure or instrument measures what it is supposed to measure.
  • Example: A survey with high validity would accurately capture the intended construct or concept.
• Cronbach's Alpha: A statistical measure of reliability, calculated as the average correlation between items in a scale.
  • Formula: Cronbach's Alpha = (k / (k - 1)) * (1 - (^2_x / ?^2_T)), where k is the number of items, ?^2_x is the variance of each item, and ?^2_T is the total variance.
• Sample Size: The number of respondents in a survey.
  • Example: A survey with a sample size of 1,000 respondents is generally considered sufficient for estimating population parameters.
• Response Rate: The proportion of respondents who complete a survey out of those who are invited to participate.
  • Example: A survey with a high response rate (e.g., 80%) is generally considered more reliable than one with a low response rate (e.g., 20%).

Common Misunderstandings

Misunderstanding: Questionnaire flow and layout are only important for large-scale surveys. Correction: Questionnaire flow and layout are crucial for all surveys, regardless of size, to ensure accurate and reliable data collection.

Misunderstanding: Filter questions are only used to determine whether a respondent should be asked additional questions or not. Correction: Filter questions can also be used to determine whether a respondent should be asked any questions at all, based on their demographic characteristics or previous responses.

Misunderstanding: Skip patterns are only used to skip questions that are not relevant to the respondent. Correction: Skip patterns can also be used to skip questions that are relevant to the respondent, but have already been answered in a previous survey or questionnaire.

Quick Application / Identification

A marketing researcher is designing a survey to understand consumer preferences for eco-friendly products. The survey includes a question about the respondent's age, followed by a series of questions about their environmental concerns. What is the purpose of the question about age?

Answer: The question about age is a filter question, used to determine whether the respondent should be asked additional questions about their environmental concerns.

Last?Minute Revision

• A survey with a sample size of 100 respondents is generally considered too small for estimating population parameters.
• A questionnaire with a high Cronbach's alpha (e.g., 0.9) indicates high reliability.
• The funnel approach is a type of questionnaire design that starts with broad questions and gradually narrows down to more specific ones.
• A survey with a low response rate (e.g., 20%) is generally considered less reliable than one with a high response rate (e.g., 80%).
• Filter questions can be used to determine whether a respondent should be asked additional questions or not, based on their demographic characteristics or previous responses.
• Skip patterns can be used to skip questions that are relevant to the respondent, but have already been answered in a previous survey or questionnaire.
• Question order bias can occur when questions are asked in a specific order, leading to biased responses.
• A survey with high validity would accurately capture the intended construct or concept.
• A survey with a high response rate (e.g., 80%) is generally considered more reliable than one with a low response rate (e.g., 20%).
• The American Community Survey (ACS) uses a funnel approach to collect data from respondents.
• A survey with a low reliability (e.g., Cronbach's alpha = 0.2) indicates that the measure or instrument is not consistent across different administrations or conditions.