Related Experiment Video
Updated: Jun 28, 2025
08:53
Integrating Computerized Linguistic and Social Network Analyses to Capture Addiction Recovery Capital in an Online Community
Published on: May 31, 2019
5.2K
The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms.
Christine Cuskley1, Justin Sulik2
1Language Evolution, Acquisition, and Development Group, Newcastle University.
Summary
Critiquing a study
Area of Science:
- Psychological Science
- Online Research Methods
Background:
- A recent study reported low participant validity (2.6%) on Amazon's Mechanical Turk (MTurk).
- The study's claims of MTurk's inadequacy have been widely disseminated.
- This commentary addresses misconceptions regarding MTurk's utility in research.
Purpose of the Study:
- To correct the record regarding MTurk data quality.
- To propose a revised perspective on conducting high-quality online research.
- To emphasize researcher responsibility for data integrity.
Main Methods:
- Analysis of data collection approaches influencing participant validity.
- Review of existing literature on effective MTurk recruitment strategies.
- Discussion of platform-specific constraints and researcher expertise.
Main Results:
- The original study's low validity rates stemmed from its specific data collection methodology.
- MTurk's suitability for research is contingent on study design and researcher expertise.
- Effective online research requires careful consideration of the chosen platform's limitations.
Conclusions:
- MTurk can yield high-quality data when used appropriately.
- Researchers must possess specific expertise to optimize online data collection.
- Ensuring data quality is an inherent researcher responsibility, irrespective of the platform.
Related Concept Videos
01:56Ethics in Research
23.0K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.0K
02:16Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
01:08Data Collection by Observations
12.0K
Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
12.0K
01:40Archival Research
16.0K
Some researchers gain access to large amounts of data without interacting with a single research participant. Instead, they use existing records to answer various research questions. This type of research approach is known as archival research. Archival research relies on looking at past records or data sets to look for interesting patterns or relationships. For example, a researcher might access the academic records of all individuals who enrolled in college within the past ten years and...
16.0K
01:30Data Collection I
6.2K
Data collection gathers information needed to make accurate judgments about a patient's present condition. During a health history interview, subjective data is collected from the patient, their caregivers, or family members, and objective data is collected through observations and physical assessment. Patients are the primary source of subjective data. Thus information gathered from patients through interviews, observations, and physical examination is primary data. Secondary sources of...
6.2K
02:20Longitudinal Research
12.0K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
12.0K