Methodological variables in Web-based research that may affect results: sample type, monetary incentives, and...

Area of Science:

• Legal Psychology
• Online Research Methodology

Background:

• Web-based studies offer convenience but harbor methodological variations.
• These variations can introduce bias and affect research outcomes, particularly in sensitive areas like jury decision-making.

Purpose of the Study:

• To examine how specific methodological choices in online research influence participant behavior and study findings.
• Investigate the impact of sample type, payment incentives (lottery vs. direct), and personal information requirements on dropout rates and substantive results in capital jury decision-making studies.

Main Methods:

• Online jury decision-making simulation in capital cases.
• Manipulation of payment methods (lottery vs. direct) and data collection requirements (email address entry).
• Analysis of dropout rates and verdict outcomes across different experimental conditions.

Main Results:

• Requiring participants to enter email addresses significantly increased dropout rates.
• Offering payment via a lottery tended to increase dropout rates compared to direct payment.
• Participants offered payment were less likely to impose death sentences.
• The influence of participants' attitudes toward the death penalty on their verdicts was moderated by sample type.

Conclusions:

• Methodological decisions in web-based research, such as requiring personal information and using lottery-based incentives, can substantially affect participant retention and study results.
• Researchers must carefully consider these factors to ensure the validity and reliability of online studies, especially those concerning legal judgments and sensitive topics.