Skip to content

The problems of deliberative polls: Outcomes

Published:
logo
logo

As the academic debate over the Tomorrow's Europe deliberative poll begins to take off, Professor Arthur Lupia of the University of Michigan's Institute for Social Research presents the first in a four-part series on some of his concerns about the methods and theories behind deliberative polling:

There are many contested and unresolved issues relevant to the effectiveness of deliberative polls (DP) and related deliberative mechanisms. I happen to believe that deliberative ventures such as DPs can have beneficial effects, but only under specific conditions and with rather limited goals in mind.

I am concerned with the basic credibility of a number of the claims made about the Tomorrow's Europe poll on its website. Part of this problem is caused by the fact that the leading DP advocates do not share their data (even in common privacy-protected forms), so to the best of my knowledge no independent third party has ever been able to verify their causal claims.

This lack of transparency has led to broad and deep skepticism about this endeavor within the social sciences. As such, I would caution you and your readers about a very large scientific literature about the consequences of DP-like communications. (For example, the January/February 2004 edition of Legal Affairs magazine alone featured three alternative takes - one from deliberation advocates Bruce Ackerman and James Fishkin, one by Judge Richard Posner of the University of Chicago, and another by me.)

While deliberation can lead citizens to more refined opinions, it can also lead to enflamed stereotypes and an amplification of social inequalities. Gender and class, for example, often correspond to important patterns of interruption and deference which lead to outcomes that are very unlike those that many deliberation advocates hope for in theory. In fact, it is arguable that these negative outcomes are just as likely, if not more likely, than the ones espoused by DP advocates.

There is a fast-growing literature on actual experiences with deliberation - so your readers should not fall prey to the illusion of consensus on this topic. Right now, the presentation of the Tomorrow's Europe poll is extraordinarily one-sided and, I think, misleading.

Update: Professors Fishkin and Luskin respond , looking at the transparency issue- and part two of the response, looking at methodology

openDemocracy Author

Arthur Lupia

Hal R. Varian Collegiate Professor of Political Science at the University of Michigan, Research Professor at the Institute for Social Research, Principal Investigator, American National Election Studies, and Co-Principal Investigator of the TESS Project, Arthur Lupia's work focuses on how information and institutions affect policy and politics, and particularly on how people make decisions when they lack information.

His work provides insights on voting, civic competence, legislative-bureaucratic relations, parliamentary governance, and political communication. His books include The Democratic Dilemma: Can Citizens Learn What They Need to Know? (1998), Elements of Reason: Cognition, Choice, and the Bounds of Rationality (2000), Stealing the Initiative: How State Government Reacts to Direct Democracy (2001), and Positive Changes in Political Science: The Legacy of Richard D. McKelvey's Most Influential Writings (2007).
His articles and editorials have appeared in many respected journals and newspapers.

He is a John Simon Guggenheim Foundation Fellow (2006-2007) and was previously a fellow at the Center for Advanced Study in the Behavioral Sciences (1999-2000). He was elected a Fellow of the American Association for the Advancement of Science in 2003 and as a Member of the American Academy of Arts and Sciences in 2007.

Now, as a Principal Investigator of the American National Election Studies (www.electionstudies.org), he is helping to introduce many new procedural and methodological innovations to one of the world's best-known scientific studies of elections. 

All articles
Tags:

More from Arthur Lupia

See all