Article Collection Editors: Marco Paccagnella (Organisation for Economic Co-operation and Development, OECD, France), Michele Pellizzari (University of Geneva, Switzerland), Matthias von Davier (Boston College, USA)
The Use of Test Scores in Secondary Analysis
The increasing availability of data on the cognitive skills of students and adults from large-scale national and international assessments (including NAEP, TIMSS, PIRLS, PISA or PIAAC) has facilitated research on issues such as the wage returns to skills or the estimation of skills production functions in diverse fields in the social sciences, including economics, sociology, education, and public policy.
The use of these data for any analysis that aims at going beyond a description of the level of proficiency of the target population poses however some methodological challenges that researchers working with these data do not always acknowledge or are aware of.
First, the psychometric models used to generate test scores from the raw responses to assessment items are not designed to provide an unbiased estimate of the skills of any individual, but rather to obtain unbiased estimates of proficiency at the population level. In other words, the measurement error surrounding individual test scores cannot be assumed to be classical, and this has consequences on the choice of the statistical models that secondary researchers should use when estimating the relationships between latent skills and individual or context-level factors.
Second, test scores are estimates of a latent (unobserved) trait, and are expressed on a (necessarily arbitrary) scale that may or may not possess the properties commonly attributed to observed quantitative variables. This, again, has implications for researchers interested for example in comparing the magnitude and the evolution over time of skill differences between population subgroups.
Measurement Instruments for the Social Sciences (MISS) is launching a special article collection on the Use of Test Scores in Secondary Analysis in order to promote an inter-disciplinary dialogue between scholars who design the psychometric models used to estimate latent skills and researchers that use these data to investigate policy-relevant questions related to skills formation, skill utilisation and returns to skill.
We invite researchers to submit theoretical and empirical work related to the following topics:
- Methods to estimate proficiency in large-scale assessments
- Methodological aspects related to the use of test scores in secondary analyses
- The use of latent class models and factor analysis in education and economics research
- Potential and limitations of causal inferences with cross sectional large scale survey data
- The scaling of cognitive assessments: implications for interpretation and comparability
We are particularly interested in papers that offer a critical review of common empirical practices and provide guidance and suggestions on alternative approaches to the estimation of latent skills in view of their use in secondary analysis.
For inquiries regarding the Call for Papers, the suitability of specific submissions, and any other concerns, please contact the Lead Guest Editor, Marco Paccagnella.
The complete manuscript should be submitted through the journal submission system. Before submitting your manuscript, please ensure you have carefully read the submission guidelines for Measurement Instruments for the Social Sciences (MISS). Manuscripts submitted in response to this call for papers will most likely represent the article type called "Advances in Methodology". In addition, indicate within your cover letter and upon submission that you wish your manuscript to be considered as part of the article collection on the Use of Test Scores in Secondary Analysis. All submissions will undergo rigorous peer review and accepted articles will be published within the journal as a collection. MISS supports open science standards and strongly encourages authors to supplement their submission by statistical analysis code (R code, Mplus code, Stata code, etc.).
Read articles already published in this collection:
The Use of Test Scores in Secondary Analyses (Article Collection)