对自发视网膜活动的无监督学习导致了高效的神经表征几何学
Andrew Ligeralde1,2, Yilun Kuang2,3, Thomas Edward Yerxa2,4
1Biophysics Graduate Group, University of California, Berkeley.
ArXiv
|December 18, 2023
概括
在视网膜波上预训练神经网络,在眼睛发育中的自发神经活动,提高了它们识别物体和学习空间特征的能力,即使没有自然图像数据.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 发育中的哺乳动物视网膜在视觉开始之前表现出自发的,相关的神经活动,称为视网膜波.
- 视网膜波被假设在塑造早期感官表征和神经电路发展方面发挥关键作用.
- 了解这种视觉前发展阶段可以通过模仿生物学习原则来为人工智能提供信息.
研究的目的:
- 用视网膜波作为神经网络的预训练数据来建模神经回路的早期功能发展.
- 调查视网膜波数据的预训练是否可以提高下游图像相关任务的性能.
主要方法:
- 利用无监督对比学习 (SimCLR) 在模拟和实验性视网膜波电影上预训练ResNet-18模型.
- 评估预训练网络在各种图像分类任务上的表现,包括评估对象不变性到空间转换的任务.
主要成果:
- 对视网膜波的预训练显著提高了对测量对象不变性到空间转换的任务的性能.
- 在更复杂的图像分类任务中观察到轻微的改善,即使在未包括在预训练中的自然图像上也是如此.
- 在视网膜波上预训练的网络显示了图像多元体的更好的分离,特别是那些由空间翻译定义的图像多元体.
结论:
- 视网膜波的时空性质为神经网络做好准备,以便有效地提取更高阶的特征.
- 这种生物启发的预训练方法提供了一种新的方法来增强AI模型的稳定性和学习能力.
- 研究结果表明,早期视觉系统活动模式与强大的视觉表征的发展之间存在直接联系.
更多相关视频
10:50Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches
Published on: June 21, 2022
1.8K
07:12Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss
Published on: April 11, 2025
374
相关概念视频
01:20Anatomy of the Eyeball
7.1K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
7.1K
01:24Vision
53.5K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.5K