Related Experiment Video
Updated: Jan 7, 2026
04:19
A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis
Published on: May 10, 2022
4.3K
Development of an Evaluation Index System for Health Recommender Systems Based on the Health Technology Assessment
Yue Sun1, Shijie Hou2, Siye Chen2
1School of Nursing, Health Science Center, Xi'an Jiaotong University, Xi'an, Shaanxi Province, China.
JMIR Formative Research
|December 22, 2025
Summary
A new evaluation index system for health recommender systems (HRSs) was developed using expert consensus. This framework provides a validated, hierarchical approach to assessing HRSs, improving their design and implementation.
Area of Science:
- Digital Health
- Health Technology Assessment
- Health Informatics
Background:
- Current health recommender systems (HRSs) evaluations primarily focus on algorithmic performance, lacking user-centered assessment and defined metrics.
- A unified, scientifically validated framework for HRS evaluation is absent, hindering cross-study comparability and decision-making.
Purpose of the Study:
- To develop a comprehensive, consensus-based evaluation index system for HRSs.
- To ground the evaluation system within the established health technology assessment (HTA) framework.
Main Methods:
- A 2-round Delphi process involving 18 experts (clinicians, researchers, policymakers) in HRSs.
- Literature analysis and HTA principles informed an initial indicator set, refined through expert ratings and qualitative feedback.
- Analytic hierarchy process (AHP) was used to determine indicator weights and assess consistency.
Main Results:
- A final evaluation index system with 5 first-level indicators (performance, effectiveness, safety, economy, social appropriateness) and 18 second-level indicators.
- Safety received the highest weight (0.289), followed by social appropriateness (0.251) and effectiveness (0.193).
- Mean importance scores for second-level indicators ranged from 4.25 to 5.00, indicating strong expert consensus.
Conclusions:
- An expert-validated evaluation index system for HRSs, based on the HTA framework, has been established.
- This framework offers quantifiable, hierarchical indicators with validated weighting, addressing a methodological gap in HRS evaluation.
- The system provides actionable guidance for HRS design, optimization, and implementation, paving the way for unified evaluation standards.
Related Concept Videos
01:30Health Information Technology and Healthcare Information System
3.2K
Health Information Technology (HIT)
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
3.2K
01:29Issues And Trends In Healthcare Delivery System
6.1K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
6.1K
01:26Methods Of Healthcare Delivery System
3.9K
At the different levels of the healthcare system, we see varying methods of healthcare used. These methods include managed care systems, case management, and primary healthcare.
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is...
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is...
3.9K
01:15Nursing Evaluation
4.1K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
4.1K
01:03Data Validation
6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
01:13Therapeutic Index
6.3K
The therapeutic index of a drug is a key parameter in pharmacology that quantifies the relative safety of a drug by calculating the ratio between the dose that causes toxicity in half the population (50%) to the dose that proves to be effective for half the population (50%). It provides a spectrum of doses for a particular drug ranging from effective to potentially toxic. To illustrate, consider an anticoagulant agent like warfarin. It possesses a narrow window within its therapeutic index to...
6.3K