Pew finds regular non-coverage bias in landline-only phone samples

US— With one in four American homes cell-only, Pew Research warns that “non-coverage bias is now appearing regularly in landline telephone samples”.

Pew sounded the alarm in an update to its ongoing study comparing the results of surveys fielded to landline-only samples and combined landline and cellphone samples.

The latest report, published this week, analyses a host of surveys conducted in the second half of 2009 and in the first half of this year.

Of 72 questions examined, Pew says 43 show differences between the two samples of up to two percentage points. A further 29 differences are of three percentage points or more – “all of which are statistically significant”, says Pew.

“For some estimates, even a small amount of bias may have important substantive consequences for the political or social implications of the research,” say report authors Leah Christian, Scott Keeter, Kristen Purcell and Aaron Smith. “Since the decline of landline coverage has not been uniform across demographic groups, non-coverage bias among certain subgroups may be even larger than for the full sample.”

Pew gives the example of a survey of wireless internet use. In landline surveys, wireless usage is underestimated by two percentage points, but the bias is eight points among African Americans.

Other differences include a tendency towards more liberal views on social values and certain lifestyle behaviours in the dual landline and cellphone sample, while estimates of gun ownership are four points higher in the landline sample.

Pew’s research is available for download here. The latest report from the National Centre for Health Statistics, which revealed that the numbers of cell-only homes had risen from 22.7% in the first half of 2009 to 25% in the second half, was published last week.

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

0 Comments


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts