大規模なインテリジェントセマンティックビジョン生成のための全光学合成チップ
Yitong Chen1, Xinyue Sun1, Longtao Tan2
1Institute of Image Communication and Network Engineering, Department of Electronic Engineering, School of Information Science and Electronic Engineering, Shanghai Jiao Tong University, Shanghai, China.
まとめ
研究者は,生成型人工知能 (AI) のための全光学チップであるLightGenを開発しました. このフォトニック・コンピューティング・チップは,視覚生成のタスクを大幅に加速し,AIにソリューションを提供しています.
科学分野:
- 光学について
- 人工知能
- コンピュータ・ビジョン
背景:
- 生産性のある人工知能 (AI) は,重要な計算能力の制限に直面しています.
- フォトニック・コンピューティングは意思決定のタスクに優れているが,統合スケール,次元変換,トレーニングの依存性により,ジェネレーティブAIと苦戦している.
研究 の 目的:
- 大規模なインテリジェント・ビジョンを生み出すための全光学チップを開発する.
- 電子チップの限界を克服し 視覚的な生成モデルを加速する
主な方法:
- 何百万もの光子ニューロンを 単一のチップに統合する
- 異なるネットワーク寸法のための光学的な潜伏空間の実装.
- ゲネラティブタスクに対する Bayes ベースのトレーニングアルゴリズムの適用
主要な成果:
- 高解像度セマンティック画像生成,デノイジング,スタイル転送,および3D生成の実験的な実証.
- 最先端の電子チップよりも 2倍の端末端のコンピューティング速度と エネルギー効率を達成しました
結論:
- LightGenチップは,大規模なビジュアル生成モデルを加速するための新しいソリューションを提供します.
- フォトニックコンピューティングは,電子的な限界を超えて,複雑な生成AIタスクに効果的に適用できます.
関連する概念動画
Vision
59.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.2K
Visual System
1.6K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.6K
Depth Perception and Spatial Vision
1.7K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
1.7K
Photoreceptors and Visual Pathways
8.6K
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category,...
8.6K
Imaging Biological Samples with Optical Microscopy
8.7K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
8.7K
Light Acquisition
9.3K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
9.3K


