Improving Surveys by Sharing Knowledge
Abstract: This report is a product of a multi-national testing project conducted by the Comparative Cognitive Test Workgroup. The workgroup is a coordinated, international effort organized to develop and implement an evidence-based methodology for testing survey questions in cross-cultural or multinational contexts. For this project, the coalition consisted of representatives from 7 different nations and incorporates 6 different languages: the US (in English and Spanish), the UK, Bulgaria, Portugal, Switzerland (in French), Germany, and Spain. In Fall 2007, workgroup members met in London to discuss project goals and to determine the process and protocol for conducting the study. In the next 5 months, 135 cognitive interviews were conducted by participating countries. Interviews were structured around questions provided by the Budapest Initiative (a UNECE/Eurostat task convened to develop global measures of health states) and the European Social Survey. In February, 2008, the group held a joint analysis meeting whereby a process was developed to conduct a systematic, comparative analysis of those interviews. Through this process, the group was able to identify various interpretive patterns resulting from socio-cultural and language-related differences among countries as well as other patterns of error that could potentially undermine the comparability of survey data. This report summarizes the process and findings of the Budapest Initiative component.
Miller, K., 2008, Results of the Comparative Cognitive Test Workgroup Budapest Initiative Model, Hyattsville, MD: National Center for Health Statistics. https://wwwn.cdc.gov/QBank/Report.aspx?1048