TY - JOUR
T1 - Methodological challenges in cross-comparative surveys
T2 - The case of understanding attitudes towards democracy in Hungary
AU - Messing, Vera
AU - Ságvári, Bence
AU - Simon, Dávid
N1 - Publisher Copyright:
© 2019 Intersections. East European Journal of Society and Politics.
PY - 2019/5/1
Y1 - 2019/5/1
N2 - Our paper examines the validity of the rotating questionnaire block about perceptions about and attitudes towards democracy included in the sixth round of the European Social Survey (ESS). The preliminary assumptions that inspired our analysis were that respondents' understanding of the questions formulated in such an internationally comparative survey may be challenged due to diverging theoretical constructions and narratives that feed historically developed notions of 'democracy.' Moreover, even within the same country people with a different socioeconomic, ethnic, and educational background may have different perceptions about the same questionnaire 'items.' We applied a multi-method approach to analyze the above metho-dological puzzle: a complex statistical analysis of the Hungarian ESS data served to help examine the consistency of answers to individual items and the entirety of the questionnaire block, while supplementary focus group research helped us apprehend the variety of interpretations of and perceptions about the individual items, as well as problems with understanding various terms included in the questions that assessed attitudes towards democracy. Our findings support the initial hypothesis: respondents had obvious difficulties understanding some of the items designed to assess attitudes towards democracy, while many others had differing interpretations. We conclude that even though the ESS is one of the most refined, well-prepared and validated comparative surveys in Europe, the related data cannot be analyzed without careful consideration of what the individual questions might mean in different contexts.
AB - Our paper examines the validity of the rotating questionnaire block about perceptions about and attitudes towards democracy included in the sixth round of the European Social Survey (ESS). The preliminary assumptions that inspired our analysis were that respondents' understanding of the questions formulated in such an internationally comparative survey may be challenged due to diverging theoretical constructions and narratives that feed historically developed notions of 'democracy.' Moreover, even within the same country people with a different socioeconomic, ethnic, and educational background may have different perceptions about the same questionnaire 'items.' We applied a multi-method approach to analyze the above metho-dological puzzle: a complex statistical analysis of the Hungarian ESS data served to help examine the consistency of answers to individual items and the entirety of the questionnaire block, while supplementary focus group research helped us apprehend the variety of interpretations of and perceptions about the individual items, as well as problems with understanding various terms included in the questions that assessed attitudes towards democracy. Our findings support the initial hypothesis: respondents had obvious difficulties understanding some of the items designed to assess attitudes towards democracy, while many others had differing interpretations. We conclude that even though the ESS is one of the most refined, well-prepared and validated comparative surveys in Europe, the related data cannot be analyzed without careful consideration of what the individual questions might mean in different contexts.
KW - Attitudes
KW - Cross-national survey
KW - Democracy
KW - European Social Survey (ESS)
KW - Hungary
KW - Reliability
KW - Validity
UR - http://www.scopus.com/inward/record.url?scp=85066052056&partnerID=8YFLogxK
U2 - 10.17356/ieejsp.v5i1.530
DO - 10.17356/ieejsp.v5i1.530
M3 - Article
AN - SCOPUS:85066052056
SN - 2416-089X
VL - 5
SP - 8
EP - 26
JO - Intersections. East European Journal of Society and Politics
JF - Intersections. East European Journal of Society and Politics
IS - 1
ER -