Skip to content

The problems of deliberative polls: Representativeness

Published:
The academic debate
The academic debate

As the academic debate over the merits of deliberative democracy and deliberative polling heats up following Professor Lupia's initial criticisms (and the response of deliberative polling masterminds Professors Fishkin and Luskin - and part 2), Lupia continues to expand on the need for representativeness:

On the Tomorrow's Europe website, the representativeness of the sample is claimed as a legitimating factor. Here is an instance where, ex ante, you can commit to credible measures of "representativeness."

As leaders of the DP well know, many people decline the invitation to participate in DPs. In some cases, such as DPs held in New Haven, CT, the rate of decline approached 85%. If those who accept the invitation differ systematically in key attributes (demographic, interest in politics, etc.) from people who reject the invitation, claims about sample representativeness can lose their credibility.

Tomorrow's Europe should commit up front to documenting every invitation made and then to a publicized aggregate analysis of the relationship between those who agree to participate and those who do not.

It is particularly important that they be prepared to conduct short interviews with those who decline the invitation so that such inferences about differences between those who accept and those who reject can be based on evidence. To do otherwise, will be to reduce the basis of "representativeness" claims to speculation.

Alternatively, the credibility of the project may be helped by scaling back the claims about representativeness and simply be transparent about how recruitment will work and then offer the best statistics you have about who agrees to participate. That way observers can draw their own opinions about the quality of the sample.

openDemocracy Author

Arthur Lupia

Hal R. Varian Collegiate Professor of Political Science at the University of Michigan, Research Professor at the Institute for Social Research, Principal Investigator, American National Election Studies, and Co-Principal Investigator of the TESS Project, Arthur Lupia's work focuses on how information and institutions affect policy and politics, and particularly on how people make decisions when they lack information.

His work provides insights on voting, civic competence, legislative-bureaucratic relations, parliamentary governance, and political communication. His books include The Democratic Dilemma: Can Citizens Learn What They Need to Know? (1998), Elements of Reason: Cognition, Choice, and the Bounds of Rationality (2000), Stealing the Initiative: How State Government Reacts to Direct Democracy (2001), and Positive Changes in Political Science: The Legacy of Richard D. McKelvey's Most Influential Writings (2007).
His articles and editorials have appeared in many respected journals and newspapers.

He is a John Simon Guggenheim Foundation Fellow (2006-2007) and was previously a fellow at the Center for Advanced Study in the Behavioral Sciences (1999-2000). He was elected a Fellow of the American Association for the Advancement of Science in 2003 and as a Member of the American Academy of Arts and Sciences in 2007.

Now, as a Principal Investigator of the American National Election Studies (www.electionstudies.org), he is helping to introduce many new procedural and methodological innovations to one of the world's best-known scientific studies of elections. 

All articles
Tags:

More from Arthur Lupia

See all