Related Experiment Videos
Visible AI assistant outputs in psychosocial risk management: an OHP/OHS-grounded benchmark for governance and
1Department of Occupational Health and Safety, Faculty of Health Sciences, Uşak University, Uşak, Türkiye.
Background:
This study introduces and applies an occupational health psychology (OHP) and occupational health and safety (OHS)-grounded benchmark for evaluating visible artificial intelligence (AI) assistant outputs in psychosocial risk management.
Methods:
Five user-facing general-purpose AI assistant products were evaluated across four locked psychosocial-risk scenarios, three repeated runs, and four fixed tasks per conversation, yielding 60 conversations and 240 task-level outputs. Outputs were scored on risk identification and differentiation, multi-level organizational framing, preventive organizational actionability, and professional boundedness and verification. A blind second-rater layer and focused adjudication were used to test profile stability and resolve profile-changing disagreements.
Results:
Exact agreement was observed in 153 of 240 task rows (63.7%), while 239 rows (99.6%) were exact or within one point. Profile mismatches were concentrated in Gemini and Le Chat/Mistral rather than distributed across scenarios or runs. Under the final consensus structure, 36 conversations were classified as Structurally Usable Support, 23 as Mixed/Partially Usable Support, and 1 as Problematic Support.
Conclusion:
The main contribution is not a generic ranking of assistant products, but a domain-specific evaluation logic for psychosocial risk management, together with a reviewer-facing process model and derived governance and reporting guides for more transparent and responsible organizational use.
Related Concept Videos
01:22Healthcare Associated Infections II: Preventive Measures
The best practices for preventing healthcare-associated infections include hand hygiene, patient risk...
01:09Accountability and Responsibility of a Nurse II
For example, a nurse demonstrating respect and compassion might listen attentively to a patient's concerns, provide comfort...
01:21Types of Reports II: Incident or Occurrence Report
Purposes:
In the healthcare industry, reports play a crucial role in documenting incidents within an agency. The primary objective of these reports is to ensure patient safety, uphold the...
01:18Guidelines and Strategies for Safe Computer Charting
Maintain Confidentiality and Security:
01:30Accountability and Responsibility of a Nurse I
01:19Respiratory Assessment: Purpose and Indications
Objectives and Importance:
The primary goal of respiratory assessment is to evaluate patients at early risk of clinical deterioration. Since respiratory distress often precedes other signs of declining health, breathing patterns and sounds become a...