Related Experiment Video
Updated: Aug 4, 2025

10:09
Evaluation and Manipulation of Neural Activity Using Two-Photon Holographic Microscopy
Published on: September 16, 2022
2.7K
In-memory factorization of holographic perceptual representations
Jovin Langenegger1,2, Geethan Karunaratne1,2, Michael Hersche1,2
1IBM Research-Zurich, Rüschlikon, Switzerland.
Nature Nanotechnology
|March 30, 2023
Summary
This study introduces a novel compute engine for disentangling sensory signal attributes. It efficiently factorizes complex data using brain-inspired computing and memristive devices, solving larger problems faster.
Area of Science:
- Artificial Intelligence
- Cognitive Science
- Materials Science
Background:
- Disentangling sensory signal attributes is crucial for perception, cognition, and AI development.
- Current methods face challenges with high-dimensional data and computational complexity.
Purpose of the Study:
- To present a compute engine for efficient factorization of high-dimensional holographic representations.
- To leverage hyperdimensional computing and analogue in-memory computing for enhanced factorization capabilities.
Main Methods:
- Utilized computation-in-superposition from brain-inspired hyperdimensional computing.
- Employed analogue in-memory computing with nanoscale memristive devices.
- Developed an iterative in-memory factorizer architecture.
Main Results:
- Demonstrated factorization of problems five orders of magnitude larger than previously possible.
- Significantly reduced computational time and space complexity.
- Achieved constant time for matrix-vector multiplication operations, independent of matrix size.
- Successfully factorized visual perceptual representations experimentally.
Conclusions:
- The developed compute engine offers a powerful solution for complex sensory data factorization.
- This approach drastically improves efficiency in terms of scale, time, and space complexity.
- The technology holds promise for advancing artificial intelligence and cognitive systems.
Related Concept Videos
Perceptual Constancy
477
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
477
Factors Affecting Perception
1.7K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.7K
Implicit Memories
161
Implicit memories, also known as non-declarative memories, are long-term memories that function outside of conscious awareness. These memories influence behavior and skills without explicit knowledge. This type of memory is evident in tasks like playing tennis, snowboarding, and texting. Implicit memory has three subsystems: procedural memory, conditioning, and priming. This type of memory is essential in various activities, from everyday tasks to specialized skills.
One key aspect of implicit...
One key aspect of implicit...
161
Parallel Processing
191
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
191
Gestalt Principles of Perception
363
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
363
Chunking and Rehearsal in Sensory Memory
260
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
260

