"Facekit" - - 面向使用机器学习衍生面部识别算法自动化面部分析应用程序
Omri Nachmani1, Tomas Saun2, Minh Huynh3
1Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada.
Plastic surgery (Oakville, Ont.)
|November 2, 2023
概括
智能手机面部分析工具在临床使用中显示的准确性较低. 当前的机器学习算法,比如Facekit中的算法,与直接或数字方法相比,无法可靠地测量面部比例.
科学领域:
- 生物医学工程 生物医学工程
- 计算机视觉 计算机视觉
- 医疗成像医学成像
背景情况:
- 面部识别机器学习为面部特征分析提供了潜力.
- 整形外科的临床应用需要高的测量精度.
- 智能手机应用程序可以加速开发和测试这些工具.
研究的目的:
- 为了比较基于智能手机的面部识别算法 (Facekit) 与直接和数字测量的准确性.
- 评估面部分析的开放式机器学习工具的临床实用性.
主要方法:
- 开发了Facekit,这是一个使用谷歌ML Kit计算机视觉API的Android应用程序.
- 在15名健康受试者身上测量了4个面部比例.
- 将智能手机测量与直接表面和数字测量进行了比较,使用了课内相关性 (ICC) 和皮尔森相关性.
主要成果:
- 鼻面比例最高的ICC为0.321,远低于0.75.75的优秀协议门.
- 在ML Kit,直接和数字测量方法之间发现了显著的差异 (P < .05).
- 面具测量显示,所有测试比率与直接和数字方法的相关性和一致性低 (R < 0.5,ICC < 0.75).
结论:
- 在Facekit应用程序中,与已建立的测量技术的一致性很低.
- 目前预训练的面部识别软件缺乏用于整形外科临床面部分析所需的准确性.
- 在特定的临床里程碑上培训的定制机器学习模型的开发可能会提高性能.
相关概念视频
01:14Muscles for Facial Expressions
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
01:21Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...