What polling strategy means for Afrobarometer survey findings
“Most Ugandans favour proposed reforms to improve elections and Parliament, new Afrobarometer survey shows.”
That was the title of a statement to journalists from Afrobarometer’s agent in Uganda, Hatchile Consult Ltd, on April 28 when the results of the survey were released. It was also the message Afrobarometer hoped would make the headline the next morning.
As has become the norm in Uganda, and world over, Afrobarometer’s report titled: “Outcry versus disdain? Understanding public support for proposals to improve Parliament and elections in Uganda” has sparked debate on the relevance, reliability and objectivity of opinion polls.
The survey had 12 questions; two on presidential terms and age limits, five on quality of elections, two on post-election issues, and three on cars for MPs, their number, and whether they should be appointed ministers.
The latest survey was released after another Afrobarometer report released on April 24 titled “Social services rank tops in Ugandans’ priorities, but not in national budget”. In this report respondents were asked: “In your opinion, what are the most important problems facing this country that government should address?”
The respondents, who could give up to three responses, put social services as their top priority. This comprises health (53% of respondents) and education (36%). This was followed by infrastructure/roads/transport (34%), water supply (28%), poverty/destitution (21%), corruption (19%), unemployment (19%), agriculture/food shortage (19%), electricity (10%), and finally crime and security (8%).
The difference between what Ugandans list as their priorities and the issues that Afrobarometer chose to focus on have become major talking points since the latest report was released.
Questions are being asked during debates on radio about how the pollsters decide which issues to focus on and how they frame the questions on issues that they want Ugandans to form opinions on. Questions are also asked about how the way Afrobarometer frames the questions could influence the outcome of the surveys.
At the launch of the latest survey, the public ambivalence towards the polls became an issue. Guests; including outspoken former Ethics and Integrity Minister Miria Matembe, said it would have been better if officials who had been invited from the Ministry of Justice and Constitutional Affairs and the opposition political parties had been around to debate the issues.
Without this, she said, there is a tendency for people to “keep talking to themselves”. Generally, however, it could be that the issues polling agencies focus on are not the issues most people are interested in.
But Dr. Frederick Golooba Mutebi, Afrobarometer’s national investigator for Uganda, told The Independent on May 4 that research teams in each of the 36 countries where Afrobarometer does similar survey rounds identify the issues in their country and these are normally issues that are of public interest or are very much in the public domain.
“We have no interest in projecting our views, and we only project the views of the public,” Golooba said.
Dr. Patrick Wakida, the executive director of Research World International, a Kampala-based polling agency, also told The Independent that the themes for polling are normally developed from the public domain.
“At the time of the polling, you should be polling issues for which people are engaged and the whole objective is to redirect the discussion so that it becomes an informed discussion.”
Wakida says “at the moment, discussion in Uganda is about (presidential) succession, age limit for the president, term limits and constitutional amendments”.
These views mirror the opinion of one of the most respected and experienced polling agencies in the world, the Washington-based Pew Research Centre, which says the most important part of the survey process, is the creation of questions that accurately measure the opinions, experiences, and behaviours of the public.
The first step in this is selecting what topics would be covered in the survey. For Pew Research Centre surveys, this involves thinking about what is happening in the country and what would be relevant to the public, policy makers, and the media.
But Paul Nyende, a lecturer of psychology at Makerere University says he would be more concerned about the polling agency’s sampling strategy when looking for potential influences on the outcome of polls.
Nyende is referring to how a pollster determines the subset sample of the population to participate in the survey to ensure it represents the population from which the sample is picked.
In this case, Afrobarometer chooses the random sampling strategy which covers the whole population. Between December 26, 2016 and Jan.08, it interviewed 1,200 adult Ugandans to represent the demographic composition of Uganda basing on the 2014 National Population and Housing Census. It picked 50% women and a similar number of men.
The majority, 75% of respondents were villagers and only 25% were from towns. They were also not educated; 13% had zero formal education and 45% had only been to primary school. It means 58% of those interviewed could possibly not write or read yet they were required to respond to fairly complex questions. One such question was: “The quality of Uganda’s elections have been described by many stakeholders including the opposition, ruling party, civil society, media, and voters, as poor due to allegations of election irregularities and mismanagement. I am going to read from a list of proposals aimed at improving the quality of Uganda’s elections. For each of the following proposals, please tell me whether you disagree or agree.”
This question had five proposals including; improve transparency during tallying, transmission, and declaration of election results, tighten law on campaign financing and accountability for all political parties, and increase the time within which to complete the hearing of and ruling on presidential election petitions from 30 to 60 days as proposed by court?