A call to join a collective effort on AI evaluation

Irving Torres1,

  • 1Evals-Consensus.AI Coalition, San Bruno, CA, United States.

Summary

Developing community-endorsed guidance for artificial intelligence (AI) evaluations is crucial. This study introduces a Delphi process to create standardized practices for AI evaluation across sectors, fostering trust and responsible deployment.

Related Concept Videos

Self-Evaluation Maintenance Model01:29

Self-Evaluation Maintenance Model

The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
417
Nursing Evaluation01:15

Nursing Evaluation

The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
4.0K
Self-Evaluation: Self-Enhancement and Self-Verification03:00

Self-Evaluation: Self-Enhancement and Self-Verification

Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
4.7K
Social Foundations of Self III: Self-Evaluation01:30

Social Foundations of Self III: Self-Evaluation

Self-evaluation is the process by which individuals assess their abilities, behaviors, and characteristics based on feedback from others. Charles H. Cooley observed that a person’s self-perception is primarily influenced by how others see and judge them. He suggested that individuals form their identities based on their interpretations of others' reactions. As a result, social interactions play a crucial role in shaping self-esteem and personal identity. These external evaluations often...
262
Quality Assurance01:19

Quality Assurance

Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
4.0K
Social Loafing01:37

Social Loafing

Another way in which a group presence can affect performance is social loafing—the exertion of less effort by a person working together with a group. Social loafing occurs when our individual performance cannot be evaluated separately from the group. Thus, group performance declines on easy tasks (Karau & Williams, 1993). Essentially individual group members loaf and let other group members pick up the slack. Because each individual’s efforts cannot be evaluated,...
29.3K