Research methodology for the Internet: external validity (generalizability)

Area of Science:

• Nursing Research
• Internet-based Studies
• Health Informatics

Background:

• The increasing reliance on internet-based data collection in nursing research.
• The need to re-evaluate traditional research validity frameworks for online environments.
• The 1963 work of Campbell and Stanley on research validity.

Purpose of the Study:

• To examine the characteristics of electronic populations in nursing research.
• To assess the applicability of traditional validity concepts to internet populations.
• To propose new threats to external validity in online research.

Main Methods:

• Revisiting the 1963 work of Campbell and Stanley.
• Analyzing internal and external differences in internet populations.
• Identifying and defining new threats to external validity.

Main Results:

• Traditional validity concepts require adaptation for internet-based nursing research.
• A new threat to external validity, termed "Networked Effects," is identified.
• Networked Effects comprises four subfactors: Co-occurring Interferences to Testing, Self-selection Mechanisms, Electronic Group Environments, and Cultural Differences.

Conclusions:

• Understanding the unique characteristics and threats of internet populations is crucial for robust nursing research.
• The proposed "Networked Effects" must be considered when designing research methodology for online studies.
• Adapting research methodologies is essential to ensure the validity and reliability of internet-based nursing research.