Crowdsourcing and personality measurement equivalence: A warning about countries whose primary language is not English |
| |
| Affiliation: | 1. University of Central Florida, Institute for Simulation and Training, 3100 Technology Parkway, Orlando, FL 32826, United States;2. University of Central Florida, Department of Psychology, 4000 Central Florida Blvd., Orlando, FL 32816, United States;3. University of Illinois at Urbana-Champaign, Department of Psychology, 603 East Daniel Street, Champaign, IL 61820, United States;1. Cincinnati Children''s Hospital Medical Center, Cincinnati, OH;2. Division of Endocrinology, University of Louisville, Louisville, KY;3. Department of Pediatrics, University of Cincinnati, Cincinnati, OH;4. Division of Endocrinology, Children''s National Health System, Washington, DC;5. Department of Pediatrics, George Washington School of Medicine and Health Sciences, Washington, DC;1. Louisiana State University Health Sciences Center, University Medical Center, New Orleans, LA;2. Louisiana State University Health Sciences Center, Lafayette, LA;3. Ochsner Medical Center-Kenner, Kenner, LA;4. University of Kentucky Markey Cancer Center, Lexington, KY;1. Penn Medicine Social Media and Health Innovation Lab, University of Pennsylvania, Philadelphia, PA 19104, USA;2. Department of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA;1. Department of Trauma & Orthopaedics, Morriston Hospital, College of Medicine, Swansea SA6 6NL, United Kingdom;2. Department of Trauma, Morriston Hospital, College of Medicine, Swansea SA6 6NL, United Kingdom;3. F1 Doctor, Wales, United Kingdom;4. Plastic Surgery SpR, Welsh Centre for Burns & Plastic Surgery, Morriston Hospital, Swansea, United Kingdom;5. Frenchay Hospital, Bristol, United Kingdom;6. Morriston Hospital, United Kingdom;7. Institute of Life Science, College of Medicine, Swansea University SA2 8PP, United Kingdom |
| |
| Abstract: | In the search to find cheaper, faster approaches for data collection, crowdsourcing methods (i.e., online labor portals that allow independent workers to complete surveys for compensation) have risen in popularity as a tool for personality researchers, despite a lack of evidence regarding the equivalence of crowdsourcing with traditional data collection methods. The purpose of this study was to evaluate crowdsourcing as a data collection tool by examining the measurement equivalence of crowdsourced data (i.e., from Amazon.com’s MTurk) with more traditional samples (i.e., an undergraduate sample and a sample of organizational employees). Our results (using a popular measure of Big Five personality) provided evidence of measurement equivalence across all three samples, with one important exception: crowdsourced data (from MTurk) only exhibited measurement invariance with traditional data collection methods when responses were restricted to participants from native-English speaking countries. Although MTurk appears to be an easy, cost-effective data collection tool, our results suggest that MTurk data are similar to traditionally-collected data only when the MTurk sample is restricted to IP addresses from English-speaking countries. |
| |
| Keywords: | Crowdsourcing Measurement Data collection techniques Survey methods Invariance testing |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
