Alexander Coppock and Donald P. Green (2015). “Assessing the Correspondence between
Experimental Results Obtained in the Lab and Field: A Review of Recent Social Science
Research.” Political Science Research and Methods, 3, pp 113-131
A small but growing social science literature examines the correspondence between experimental results obtained in lab and field settings. This article reviews this literature and reanalyzes a set of recent experiments carried out in parallel in both the lab and field. Using a standardized format that calls attention to both the experimental estimates and the statistical uncertainty surrounding them, the study analyzes the overall pattern of lab-field correspondence, which is found to be quite strong (Spearman’s ρ = 0.73). Recognizing that this correlation may be distorted by the ad hoc manner in which lab-field comparisons are constructed (as well as the selective manner in which results are reported and published), the article concludes by suggesting directions for future research, stressing in particular the need for more systematic investigation of treatment effect heterogeneity.
Link to article here.
Full text available here.
Replication data available here.