Related Experiment Video

Updated: May 5, 2026

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA

Published on: August 28, 2021

Method of administration of PROMIS scales did not significantly impact score level, reliability, or validity

Jakob B Bjorner¹, Matthias Rose, Barbara Gandek

¹National Research Centre for the Working Environment Lersø Park Alle 105, DK-2100 Copenhagen Ø, Denmark; QualityMetric, Optum PatientInsight, 24 Albion Road, Lincoln, RI 02865, USA; Department of Public Health, University of Copenhagen, Øster Farimagsgade 5, DK-1014 Copenhagen K, Denmark.

Journal of Clinical Epidemiology

|November 23, 2013

Abstract

Objectives:

To test the impact of the method of administration (MOA) on score level, reliability, and validity of scales developed in the Patient Reported Outcomes Measurement Information System (PROMIS).

Study Design And Setting:

Two nonoverlapping parallel forms each containing eight items from each of three PROMIS item banks (Physical Function, Fatigue, and Depression) were completed by 923 adults with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized crossover design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) and a second form by PC, in the same administration. Method equivalence was evaluated through analyses of difference scores, intraclass correlations (ICCs), and convergent/discriminant validity.

Results:

In difference score analyses, no significant mode differences were found and all confidence intervals were within the prespecified minimal important difference of 0.2 standard deviation. Parallel-forms reliabilities were very high (ICC = 0.85-0.93). Only one across-mode ICC was significantly lower than the same-mode ICC. Tests of validity showed no differential effect by MOA. Participants preferred screen interface over PQ and IVR.

Conclusion:

We found no statistically or clinically significant differences in score levels or psychometric properties of IVR, PQ, or PDA administration compared with PC.

Keywords:

Item response theory Method of administration Mode of administration Patient-reported outcomes Quality of life Questionnaire

More Related Videos

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Ratio Level of Measurement

Ratio Level of Measurement

The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....

Ordinal Level of Measurement

Ordinal Level of Measurement

The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...

Measures of Intelligence

Measures of Intelligence

Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...

Self-Report Tests of Personality

Self-Report Tests of Personality

Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.

Dosage Interval and Administration Route: Determination Methods

Dosage Interval and Administration Route: Determination Methods

A medication’s effectiveness largely depends on its appropriate dosage and the route of administration. Dosage ensures that a sufficient drug concentration is maintained in the bloodstream to elicit the desired therapeutic effect without causing toxicity. The route of administration affects the drug's bioavailability, rate of absorption, and onset of action, which are crucial for achieving optimal therapeutic outcomes. Drug dosage calculations are critical to tailoring therapy to...

Articles linked to this work by shared authors, journal, and citation graph.

Atypical survey response patterns as early indicators of dementia onset: A coordinated analysis across longitudinal aging cohorts.

The journals of gerontology. Series B, Psychological sciences and social sciences·2026

Development of the Physical Distancing Scale for COVID-19 Avoidance (PDS-C19©) in immunocompromised and non-immunocompromised individuals and its validation in the EAGLE Study.

Journal of patient-reported outcomes·2026

Low-burden AI approach for cross-national early identification of cognitive impairment using real-world questionnaire response behaviours.

Nature communications·2026

Validation of within-person associations with coverage and momentary EMA self-reports using an objective standard (physical activity).

Scientific reports·2026

Strain and recovery activities over a week predict short-term changes in processing speed measured in everyday environments: A survey response-time study in workers from a large internet panel.

Neuropsychology·2026

Assessing the association of physical distancing to avoid COVID-19 with health-related quality of life in immunocompromised adults: results from the cross-sectional observational EAGLE study.

BMJ public health·2026

See all related articles