Skip to content

The problems of deliberative polls: Legitimacy

Published:
The academic debate
The academic debate

As the academic debate over the merits of deliberative democracy and deliberative polling heats up following Professor Lupia's initial criticisms (and the response of deliberative polling masterminds Professors Fishkin and Luskin - and part 2), Lupia returns to expand on the need for transparency:

The key premise is: procedural transparency fuels legitimacy. There are changes that could be made that would be helpful towards making the Tomorrow's Europe deliberative poll (DP) more transparent in its aims and methods. I would begin by using more precise language about key points.

On several parts of their website, Tomorrow's Europe refers to the DP as an "experiment" and as having a foundation in social science. If scientific credibility is an important attribute of the venture, then the site should use the term "experiment" properly rather than colloquially.

Throughout the sciences , an experiment refers to an endeavor with random assignment of participants to treatment and control groups. Best practices in experimental design mandate that everything except one variable of interest (or in some cases a very small number of variables) be held constant among control and treatment groups. By so doing, a researcher can document how the variable of interest corresponds to differences in observed behavior. Such practices often allow credible causal statements to be made.

There is no mention on the Tomorrow's Europe website of a control group and, if one exists, the nature of the stimulus to which it would be exposed. Use of the term experiment similar to that appearing on their site has been problematic for DPs in the past.

Following Habermas, the legitimacy of this project requires procedural transparency. Calling this venture an experiment -- if it is not -- and not documenting the nature of the experimental treatments -- if it is -- eat away at the prospect of this study having a lasting impact. Complete transparency about procedures is a must.

openDemocracy Author

Arthur Lupia

Hal R. Varian Collegiate Professor of Political Science at the University of Michigan, Research Professor at the Institute for Social Research, Principal Investigator, American National Election Studies, and Co-Principal Investigator of the TESS Project, Arthur Lupia's work focuses on how information and institutions affect policy and politics, and particularly on how people make decisions when they lack information.

His work provides insights on voting, civic competence, legislative-bureaucratic relations, parliamentary governance, and political communication. His books include The Democratic Dilemma: Can Citizens Learn What They Need to Know? (1998), Elements of Reason: Cognition, Choice, and the Bounds of Rationality (2000), Stealing the Initiative: How State Government Reacts to Direct Democracy (2001), and Positive Changes in Political Science: The Legacy of Richard D. McKelvey's Most Influential Writings (2007).
His articles and editorials have appeared in many respected journals and newspapers.

He is a John Simon Guggenheim Foundation Fellow (2006-2007) and was previously a fellow at the Center for Advanced Study in the Behavioral Sciences (1999-2000). He was elected a Fellow of the American Association for the Advancement of Science in 2003 and as a Member of the American Academy of Arts and Sciences in 2007.

Now, as a Principal Investigator of the American National Election Studies (www.electionstudies.org), he is helping to introduce many new procedural and methodological innovations to one of the world's best-known scientific studies of elections. 

All articles
Tags:

More from Arthur Lupia

See all