Intro to Marketing Research: Data Collection Data Quality Issues NonResponse Bias Social Desirability Bias Interviewer Bias Acquiescence Bias Extreme Responding

Data Quality Issues

What It Is

Data quality issues refer to the problems that arise when collecting, analyzing, or interpreting data, which can lead to inaccurate or misleading conclusions. One notable example is the 2013 survey conducted by the Pew Research Center, which found that 53% of Americans believed that the government was hiding information about UFOs. However, when the survey was re-administered with a more neutral interviewer, the percentage dropped to 27%. This highlights the importance of interviewer bias in data collection and the need for researchers to be aware of potential data quality issues.

Key Terms & Concepts

• Non-Response Bias: The error that occurs when a sample of respondents does not accurately represent the population due to non-response or refusal to participate.
  • Example: A survey of customers who visit a store's website but do not make a purchase may not accurately represent the store's target audience.
• Social Desirability Bias: The tendency of respondents to answer questions in a way that they think is socially acceptable, rather than truthfully.
  • Example: A survey question asking about smoking habits may elicit more negative responses than actual behavior due to social stigma.
• Interviewer Bias: The influence of the interviewer on the respondent's answers, which can lead to biased or inaccurate data.
  • Example: A survey conducted by a researcher with a strong opinion on a particular topic may elicit more extreme responses from respondents.
• Acquiescence Bias: The tendency of respondents to agree with statements or questions, regardless of their actual opinions or behaviors.
  • Example: A survey question asking about the importance of environmental issues may elicit more positive responses than actual concern due to social pressure.
• Extreme Responding: The tendency of respondents to choose extreme answers, such as "strongly agree" or "strongly disagree," rather than more moderate responses.
  • Example: A survey question asking about the importance of a particular product feature may elicit more extreme responses than actual opinions due to the presence of a "strongly agree" option.
• Reliability: The consistency of a measure or instrument over time or across different samples.
  • Example: A survey question that consistently elicits the same responses from a sample of respondents is considered reliable.
• Validity: The accuracy of a measure or instrument in measuring what it is intended to measure.
  • Example: A survey question that accurately measures a respondent's opinions or behaviors is considered valid.
• Type I Error: The error of rejecting a true null hypothesis.
  • Example: A researcher concludes that a new product is effective when, in fact, it is not.
• Type II Error: The error of failing to reject a false null hypothesis.
  • Example: A researcher concludes that a new product is not effective when, in fact, it is.
• Cronbach's Alpha: A statistical measure of reliability, which ranges from 0 to 1.
  • Example: A survey instrument with a Cronbach's alpha of 0.8 is considered reliable.
• Regression Equation: A statistical model that predicts a continuous outcome variable based on one or more predictor variables.
  • Example: A regression equation that predicts sales based on advertising spend and price is a common application in marketing research.

Common Misunderstandings

• Misunderstanding: Non-response bias is the same as social desirability bias.
• Correction: Non-response bias refers to the error that occurs when a sample of respondents does not accurately represent the population due to non-response or refusal to participate, whereas social desirability bias refers to the tendency of respondents to answer questions in a way that they think is socially acceptable.
• Misunderstanding: Acquiescence bias is the same as extreme responding.
• Correction: Acquiescence bias refers to the tendency of respondents to agree with statements or questions, regardless of their actual opinions or behaviors, whereas extreme responding refers to the tendency of respondents to choose extreme answers, such as "strongly agree" or "strongly disagree."
• Misunderstanding: Cronbach's alpha is a measure of validity.
• Correction: Cronbach's alpha is a measure of reliability, not validity.

Quick Application / Identification

Scenario: A marketing researcher is conducting a survey to measure customer satisfaction with a new product. However, the survey is administered by a researcher who has a strong opinion about the product's quality. Which data quality issue is most likely to occur?

Answer: Interviewer bias. Explanation: The researcher's strong opinion may influence the respondents' answers, leading to biased or inaccurate data.

Last-Minute Revision

• Non-response bias can occur due to ⚠️ non-response or refusal to participate.
• Social desirability bias can lead to overreporting of socially desirable behaviors.
• Interviewer bias can be minimized by using neutral or blind interviewers.
• Acquiescence bias can be reduced by using reverse-coded questions.
• Extreme responding can be addressed by using Likert scales with more moderate options.
• Cronbach's alpha ranges from 0 to 1, with a value of 0.7 or higher indicating good reliability.
• A regression equation can be used to predict a continuous outcome variable based on one or more predictor variables.
• Type I error occurs when a true null hypothesis is rejected, while Type II error occurs when a false null hypothesis is not rejected.
• Validity is the accuracy of a measure or instrument in measuring what it is intended to measure.
• Reliability is the consistency of a measure or instrument over time or across different samples.