Quote of the day

It will be interesting to see exactly which customs the Vatican is going to allow from the past rich five centuries of Anglican worship, life and thought.

Syndicate content

Email & RSS

Sign up to oD's editorial summaries email:


Enter your Email


Powered by FeedBlitz


Follow oD on Twitter:


Join our Facebook group:
Add oD to your Netvibes: Add to Netvibes

Demotix witness*upload*share

Navigation

dLiberation

The difficulties of analysis

The European Parliament, Brussels

To make sense of the results of the Tomorrow's Europe poll, we need:

1) The results for the 3,500 sample

2) The results for the 362 participants before deliberation

3) The results for the 362 participants after deliberation

However, so far the only results given out don't quite make clear what they actually are. This PDF of opinion changes, for example, gives before and after figures, but doesn't make clear if the "before" is the entire sample of 3,500 or merely the 362 who took part in the deliberation.

My guess is it is of the 362 (largely thanks to the very high proportion of people who look favourably on the EU, because my guess is that people willing to take part in a poll about the EU are more likely to be loosely pro) - but as it isn't made clear what is being compared, it's hard to tell. If it is only the 362, however, then where are the figures for the 3,500?

There are so far two more sets of results - one showing that (surprise surprise!) access to information leads to increased knowledge (PDF), the other comparing the attitudes of old and new member states (PDF).

Herein, as far as I can see, lies another problem. According to this PDF, thanks to the relative population sizes (or, more accurately, thanks to the relative numbers of seats held in the European Parliament), the old member states (the fifteen members of the EU before 2004) had 257 participants, compared to the new member states' 105.

Is a sample of 105 really large enough to count as representative of the alleged groupthink of 12 countries? Where, in any case, is the justification for lumping together countries as diverse as Cyprus and Poland, Malta and Estonia?

And surely if the sample is merely 105 people, then to claim that a change in opinion of a few percentage points is significant when a 6% swing could merely indicate that just six people changed their minds, is somewhat misguided at best? Even a 10% change in opinion could, with these numbers, represent ten or eleven people in just one of the 18 small discussion groups.

In other words, without access to the raw data, it is very hard to analyse the significance of these figures. Nonetheless, I'll continue to give it a pop - and help and advice is still very much appreciated.

This article adheres to the openDemocracy.net principles.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

jack thurston said:



Fri, 2007-10-19 17:19
I was involved in the drafting of the surveys and I am pretty certain that the before/after figures released relate to the sample of 362, surveyed on their arrival in Brussels on Friday and before their departure on Sunday. As for the results of the telephone survey of 3500, I'm can't find the data anywhere on the Tomorrow's Europe website. I'm not sure whether it's been released. As contributors to this blog have previously observed, lack of transparency and a proprietorial attitude towards the data is one of the weak points in the Fishkin/Luskin approach. The results of the Deliberative Polling method involve something of a 'black box'. I'm sure all will be made public eventually, though when that will be is anyone's guess.

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd><b> <i> <br> <p> <div> <img> <map>
  • Lines and paragraphs break automatically.
  • You may quote other posts using [quote] tags.
More information about formatting options