ComScore hits out at Quantcast methodology

Web audience measurement firms clash over approaches

US— Web audience researcher ComScore has criticised the server-centric measurement methodology of its rival Quantcast, which it says is unable to accurately count individual users.

In a newly published paper, ComScore sets out what it sees as the shortcomings in the methodology behind the free services provided by its competitor. It says that Quantcast’s technique, through which participating publishers attach ‘tags’ to their web pages to allow impressions to be counted, is unable to account for the many users who delete cookies from their web browsers, or share computers with other people.

ComScore also raised questions about the transparency surrounding Quantcast’s use of third-party data to provide demographic information.

The seven-page paper on ‘Why panels are essential to counting people’ consists of a lengthy critique of Quantcast’s methods, and a shorter defence of ComScore’s own panel-based ‘hybrid’ approach, which it says comes closer to measuring real people rather than just browsers or computers.

The firm points to the Interactive Advertising Bureau’s audience reach measurement guidelines, which state that any measure of unique users must incorporate data that is “attributable directly to a person”.

Quantcast, which was set up in 2006 and currently provides audience measurement tools for free, claims that its server-centric approach is better suited to the fragmented world of digital media than panel-centric methodologies such as that used by ComScore, which struggle to provide reliable results for sites with smaller audiences.

Speaking to Research, Quantcast’s chief marketing officer Adam Gerber responded to ComScore’s claims about the company’s openness regarding its use of demographic data, saying: “Our methodology documentation provides very clear descriptions of how our data is collected, modelled and inferred… We leverage multiple sample-based reference points as part of our unique inference model, and the agreements we have in place with them do not allow us to name them.”

Quantcast’s tools were developed with the specific aim in mind of supporting “scalable, real-time targeting”, said Gerber. The firm is looking at using its free audience research tools to provide a basis for paid-for addressable advertising services.

Gerber added: “I’d ask you to think about why ComScore is so focused on us – a two-year-old start-up – and our methodology. What are they so worried about?”

Back in 2007, ComScore’s methods came in for criticism from Randall Rothenberg, president of the US IAB, who said the use of “outdated” panel methodology by both ComScore and its main rival NetRatings (now part of Nielsen Online) could lead to audiences being undercounted.

Later that year, Nielsen Online’s Asia Pacific boss Allan Dib was quoted as saying that the Australian IAB’s focus on accrediting panel measurement techniques was a ‘step backwards’ because of the difficulties of measuring smaller sites – although the company later insisted Dib’s remarks were taken out of context.

Author: Robert Bain

Related links:

Quantcast bags big-name support from MTV

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

1 Comment

johnny

Hi! I’ve found another site valuation tool and it seems to provide competitive analysis for free. I'm talking about www.estimix.com .The estimation provided by estimix is the result of a complex analysis based on factors like: the age of the website, the demographic structure of the traffic, the countries where the website is popular and sources of the traffic.

Like Report

Display name

Email

Join the discussion


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts