Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Surveys02:16

Surveys

14.9K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.9K
Errors and Mistakes in Surveying01:19

Errors and Mistakes in Surveying

138
Errors and mistakes in surveying refer to inaccuracies in measurements and data recording. The errors are deviations from the actual value caused by human sensory limitations, equipment flaws, or environmental effects. These errors are typically unintentional and can result from the inherent imperfections in the instruments used, atmospheric conditions, or the observer’s inability to perceive exact measurements. On the other hand, mistakes are caused by the surveyor's lack of...
138
Survey Safety01:28

Survey Safety

69
Surveying near highways, rough terrain, or power lines involves significant risks. Working along highways is particularly dangerous and requires the use of warning signs and flagmen. It is safest to avoid working directly on roads and use offsets whenever possible. When highway work is unavoidable, it must follow all safety guidelines. Surveyors should wear bright clothing, such as orange reflective vests, to ensure visibility to motorists, coworkers, and hunters. In construction zones, wearing...
69
Censoring Survival Data01:09

Censoring Survival Data

168
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
168
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

1.6K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.6K
Ethics in Research01:56

Ethics in Research

23.1K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Comparing Health Survey Data Cost and Quality Between Amazon's Mechanical Turk and Ipsos' KnowledgePanel: Observational Study.

Journal of medical Internet research·2024
Same author

Large-scale evaluation efforts and their implications for the field.

New directions for evaluation·2023
Same author

The manifestations of politics in evaluation: An exploratory study across the evaluation process.

Evaluation and program planning·2021
Same author

The role of titles in enhancing data visualization.

Evaluation and program planning·2020
Same author

Incorporating public values into evaluative criteria: Using crowdsourcing to identify criteria and standards.

Evaluation and program planning·2018
Same author

The effects of stakeholder involvement on perceptions of an evaluation's credibility.

Evaluation and program planning·2018

Related Experiment Video

Updated: Aug 6, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K

Consequences of survey modification in a program evaluation: An exploratory research on evaluation study.

Colin Braman1, Tarek Azzam2

  • 1Claremont Graduate University, USA.

Evaluation and Program Planning
|March 22, 2023
PubMed
Summary

Modifying evaluation surveys can yield similar reliability but may lead to contradictory findings. Careful consideration of scale strengths and limitations is crucial for accurate program evaluation.

Keywords:
EvaluationEvaluative conclusionsModified surveysResearch on evaluationScalesStandardized surveys

More Related Videos

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.3K
Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
07:40

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design

Published on: May 31, 2021

3.4K

Related Experiment Videos

Last Updated: Aug 6, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.3K
Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
07:40

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design

Published on: May 31, 2021

3.4K

Area of Science:

  • Educational Research
  • Psychometrics
  • Program Evaluation

Background:

  • Program evaluation surveys are often modified to fit specific contexts.
  • Modifications can impact the psychometric properties and results of original scales.

Purpose of the Study:

  • To investigate the effect of modified versus unmodified scales on evaluation conclusions.
  • To compare critical thinking and science career interest scales in evaluation contexts.

Main Methods:

  • Exploratory research design.
  • Comparison of modified and unmodified survey scales.
  • Analysis of reliability and evaluation findings.

Main Results:

  • Modified and unmodified scales demonstrated similar reliability.
  • One scale modification resulted in contradictory evaluation findings.
  • Reliability did not fully predict evaluation outcome consistency.

Conclusions:

  • Survey scales can be modified for program evaluation with caution.
  • Balancing technical psychometric needs with contextual relevance is essential.
  • Potential limitations of modified scales must be carefully addressed.