Related Experiment Video
Updated: Jun 7, 2026
10:26
Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Handle with care: the impact of using Java applets in Web-based studies on dropout and sample composition.
Stefan Stieger1, Anja S Göritz, Martin Voracek
1Department of Basic Psychological Research, School of Psychology, University of Vienna, Liebiggasse 5, Vienna, Austria. stefan.stieger@univie.ac.at
Cyberpsychology, Behavior and Social Networking
|October 26, 2010
Summary
Using Java applets in online studies increases participant dropout, particularly among women and older individuals. This technology can bias study samples, impacting research validity and generalizability.
Area of Science:
- Computer-mediated research
- Online survey methodology
- Human-computer interaction
Background:
- Web-based studies commonly use online questionnaires displayed via web browsers.
- Non-standard technologies like Java applets may require browser plug-in installations.
- Technical difficulties or unwillingness to install plug-ins can cause participant dropout.
Purpose of the Study:
- To analyze the impact of Java applets on dropout rates in online studies.
- To investigate demographic distortions in samples using Java applets.
- To assess the risks associated with non-standard technologies in web-based research.
Main Methods:
- Two thematically identical online studies were conducted with different participant pools (N=1,527 and N=805).
- Dropout rates were compared between pages using Java applets and standard pages.
- Demographic data of participants who completed the study were analyzed for potential biases.
Main Results:
- Significantly higher dropout rates were observed on the Java applet questionnaire page compared to other pages.
- Age-specific dropout effects were noted in one sample (older participants dropped out more).
- Sex-specific dropout effects were found in both samples (women dropped out more frequently).
Conclusions:
- The use of Java applets in online studies can lead to technically induced participant dropout.
- Java applets can introduce demographic biases, skewing samples towards younger and male respondents.
- Researchers should avoid non-standard technologies like Java applets to ensure sample representativeness and study validity.
Related Concept Videos
02:16Surveys
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
00:55Convenience Sampling Method
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population.
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:22Case Studies
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
02:20Longitudinal Research
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
01:20Cluster Sampling Method
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...