从自我中心的图像流中检测屏幕利用多视图视觉语言模型
Xueshen Li1, Sen Shen2, Xinlong Hou1
1Department of Biomedical Engineering, Stevens Institute of Technology.
概括
研究人员开发了一个新的屏幕检测系统,用于儿童使用可穿戴相机和AI. 这种方法准确地跟踪屏幕时间,改进了儿童行为研究和屏幕使用研究.
科学领域:
- 儿童发展 儿童发展
- 人与计算机的互动.
- 可穿戴技术是可穿戴的技术.
背景情况:
- 准确监测儿童的屏幕时间对于研究健康和社会行为的研究至关重要.
- 目前的方法,如自我报告和重的传感器缺乏准确性和效率.
- 现有的技术很难有效地捕获定量屏幕曝光数据.
研究的目的:
- 开发一个有效和准确的监测儿童屏幕曝光的框架.
- 引入一种新的方法,将可穿戴传感器和先进的人工智能结合起来,用于屏幕时间跟踪.
- 改进用于研究屏幕使用及其对儿童发展的影响的方法.
主要方法:
- 开发了一个新的屏幕检测框架,使用来自可穿戴传感器的自我中心图像,称为屏幕时间跟踪器 (STT).
- 使用多视图视觉语言模型 (VLM) 来动态解释多个图像流的屏幕曝光.
- 使用儿童自由生活活动数据集验证了框架.
主要成果:
- 拟议的多视图VLM框架显示了与传统视觉语言模型和对象检测模型相比的显著改进.
- 该系统在获取定量屏幕曝光数据方面实现了更高的准确性和效率.
- STT的轻量级硬件设计与VLM相结合,提供了一个实用的解决方案.
结论:
- 新的屏幕检测框架提供了一个准确而有效的方法来监测儿童的屏幕时间.
- 这项技术具有很大的潜力,可以推进儿童行为,屏幕使用和相关健康结果的研究.
- 可穿戴传感器和VLM的结合为未来的儿童行为研究提供了一个有希望的方向.
相关概念视频
Vision
60.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
60.3K
Stream Function
2.1K
In two-dimensional incompressible fluid flow, the continuity equation is essential for ensuring mass conservation, meaning that any change in fluid entering or exiting a region is balanced by a corresponding change elsewhere. For incompressible flow, where density remains constant, this requirement simplifies to the condition that the divergence of the velocity field must be zero. Mathematically, this is expressed as,
2.1K
Language
921
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
921
Color Vision
1.5K
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
1.5K
Components of Language
831
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
831
Language Development
939
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
939


