Related Experiment Video
Updated: Nov 1, 2025
04:12
Mixed Reality for Education MRE Implementation and Results in Online Classes for Engineering
Published on: June 23, 2023
843
The revised Approved Instructional Resources score: An improved quality evaluation tool for online educational
Andrew Grock1,2, Jaime Jordan2,3, Fareen Zaver4
1Division of Emergency Medicine Greater Los Angeles VA Healthcare System Los Angeles California USA.
AEM Education and Training
|June 18, 2021
Summary
The revised Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) shows improved usability for assessing Free Open-Access Medical education (FOAM) resources. Further reliability testing is needed in diverse populations.
Area of Science:
- Medical Education
- Emergency Medicine
- Digital Health Resources
Background:
- Free Open-Access Medical education (FOAM) is increasingly used by residents, but lacks quality assurance and guidance.
- The Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) was developed for expert appraisal of FOAM but needed evaluation in broader populations.
Purpose of the Study:
- To assess the usability of the AAT in a diverse group of emergency medicine (EM) physicians, residents, and medical students.
- To gather feedback for revising the AAT and improve its utility for appraising FOAM resources.
Main Methods:
- A diverse group of 309 international participants (medical students, EM residents, EM attendings) evaluated five FOAM posts using the AAT.
- Quantitative and qualitative feedback was collected via online surveys.
- Thematic analysis informed the revision of the AAT, followed by pilot testing and reliability reassessment.
Main Results:
- The Best Evidence in Emergency Medicine (BEEM) score was identified as difficult to use.
- Key themes for usability included understandability, logical structure, conciseness, and alignment with educational value.
- The revised AAT demonstrated moderate to high reliability, with an average measure ICC of 0.88.
Conclusions:
- A revised AAT was developed based on usability feedback, significantly enhancing its ease of use.
- The updated tool shows increased usability for appraising FOAM resources.
- Further reassessment of the revised AAT's reliability in a broad population is recommended.
Related Concept Videos
01:29Reliability and Validity
13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.5K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.5K
01:20Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
2.2K
Evaluation of the teaching process enables the nurse to determine if the patient's learning needs were met and if training was effective. If the expected outcomes are not met, the care plan is revised, and additional education or reinforcement is provided. Nurses can ask questions after the session or obtain feedback to assess the patient's understanding of the topic.
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
2.2K
01:29Self-Evaluation Maintenance Model
92
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
92
01:19Quality Assurance
403
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
403
01:29Protein Folding Quality Check in the RER
4.5K
ER is the primary site for the maturation and folding of soluble and transmembrane secretory proteins. The calnexin cycle is a specific chaperone system that folds and assesses the confirmation of N-glycosylated proteins before they can exit the ER lumen. The primary players of this quality check pipeline are the lectins, ER-resident chaperones, and a glucosyl transferase enzyme. In case the calnexin system in the lumen fails to salvage a misfolded protein, it is transported to the cytoplasm...
4.5K