Related Experiment Video
Updated: Jul 6, 2025
A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Assessing unConventional Evidence (ACE) tool: development and content of a tool to assess the strengths and
Simon Lewin1,2,3, Etienne V Langlois4, Özge Tunçalp5
1Department of Health Sciences Ålesund, Norwegian University of Science and Technology, Ålesund, Norway. simon.lewin@ntnu.no.
Background:
When deciding whether to implement an intervention, decision-makers typically have questions on feasibility and acceptability and on factors affecting implementation. Descriptions of programme implementation and of policies and systems are rich sources of information for these questions. However, this information is often not based on empirical data collected using explicit methods. To use the information in unconventional source materials in syntheses or other decision support products, we need methods of assessing their strengths and limitations. This paper describes the development and content of the Assessing unConventional Evidence (ACE) tool, a new tool to assess the strengths and limitations of these sources.
Methods:
We developed the ACE tool in four stages: first, we examined existing tools to identify potentially relevant assessment criteria. Second, we drew on these criteria and team discussions to create a first draft of the tool. Third, we obtained feedback on the draft from potential users and methodologists, and through piloting the tool in evidence syntheses. Finally, we used this feedback to iteratively refine the assessment criteria and to improve our guidance for undertaking the assessment.
Results:
The tool is made up of 11 criteria including the purpose and context of the source; the completeness of the information presented; and the extent to which evidence is provided to support the findings made. Users are asked to indicate whether each of the criteria have been addressed. On the basis of their judgements for each criterion, users then make an overall assessment of the limitations of the source, ranging from no or very minor concerns to serious concerns. These assessments can then facilitate appropriate use of the evidence in decision support products.
Conclusions:
Through focussing on unconventional source materials, the ACE tool fills an important gap in the range of tools for assessing the strengths and limitations of policy-relevant evidence and supporting evidence-informed decision-making.
More Related Videos
16:02Demonstration of the Sequence Alignment to Predict Across Species Susceptibility Tool for Rapid Assessment of Protein Conservation
Published on: February 10, 2023
10:22Split Point Analysis and Uncertainty Quantification of Thermal-Optical Organic/Elemental Carbon Measurements
Published on: September 7, 2019
Related Concept Videos
01:18Methods of Documentation I: Source-Oriented Records
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:
01:23Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
01:20Atomic Emission Spectroscopy: Overview
01:18Effects of EDTA on End-Point Detection Methods
In the visual method, metal-ion indicators (metallochromic dyes), which have distinct colors in their free and complex forms, are added to the mixture to signal the titration's end point. They form stable complexes with metal ions, but these complexes are weaker than the corresponding metal–EDTA complexes. As a...
01:26Methods of Documentation IV: Focus Charting
It typically involves three columns for recording information:
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...