Related Experiment Video
Updated: Jan 6, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
LLM ethics benchmark: a three-dimensional assessment system for evaluating moral reasoning in large language models
Junfeng Jiao1, Saleh Afroogh2, Abhejay Murali3
1Urban Information Lab, The University of Texas at Austin, Austin, USA.
Abstract:
This study establishes a novel framework for systematically evaluating the moral reasoning capabilities of large language models (LLMs) as they increasingly integrate into critical societal domains. Current assessment methodologies lack the precision needed to evaluate nuanced ethical decision-making in AI systems, creating significant accountability gaps. Our framework addresses this challenge by quantifying alignment with human ethical standards through three dimensions: foundational moral principles, reasoning robustness, and value consistency across diverse scenarios. This approach enables precise identification of ethical strengths and weaknesses in LLMs, facilitating targeted improvements and stronger alignment with societal values. To promote transparency and collaborative advancement in ethical AI development, we are publicly releasing both our benchmark datasets and evaluation codebase at https://github.com/The-Responsible-AI-Initiative/LLM_Ethics_Benchmark.git .
Related Concept Videos
Kohlberg's Theory of Moral Development
Pre-Conventional Level
At the pre-conventional level, morality is primarily driven by personal...
Language and Cognition
Reasoning
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
Deductive Reasoning
For example, a researcher can deduce specific predictions...
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Lazarus's Cognitive Appraisal Theory
Primary Appraisal:...
