E-InMeMo:用于视觉上下文学习的增强提示
Jiahao Zhang1, Bowen Wang1, Hong Liu2
1D3 Center, The University of Osaka, Osaka 565-0871, Japan.
Journal of imaging
|July 25, 2025
概括
增强的指令内存 (E-InMeMo) 通过向图像对添加可学习提示来优化视觉上下文学习. 这种方法显著提高了前景细分和对象检测等任务的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 大规模模型在跨任务的概括性方面非常出色.
- 在上下文学习 (ICL) 使用提示没有参数更新,从NLP适应计算机视觉.
- 视觉ICL在很大程度上依赖于输入输出图像对 (上下文对) 的质量.
研究的目的:
- 引入一种新的方法,即增强的指令内存 (E-InMeMo),用于优化视觉ICL提示.
- 提高在计算机视觉任务中的上下文学习的有效性.
主要方法:
- 提议E-InMeMo,它将可学习的扰动集成到上下文对.
- 通过这些扰动优化视觉ICL的提示策略.
主要成果:
- 在标准视觉任务上,E-InMeMo与最先进的方法相比,表现优越.
- 取得了显著的改进:前景细分的mIoU为7.99%,单个物体检测为17.04%.
- 超出基线的方法缺乏可学习的提示.
结论:
- E-InMeMo是一种轻量级和有效的策略,用于增强视觉ICL.
- 可学习扰动为优化计算机视觉中的ICL提示提供了一个有希望的方向.
更多相关视频
07:12Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss
Published on: April 11, 2025
565
05:58Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking
Published on: August 29, 2018
9.0K
相关概念视频
Purposive Learning
207
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
207
Cognitive Learning
526
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
526
Observational Learning
314
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
314
Visual Agnosia
304
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
304
Associative Learning
579
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
579
Implicit Memories
194
Implicit memories, also known as non-declarative memories, are long-term memories that function outside of conscious awareness. These memories influence behavior and skills without explicit knowledge. This type of memory is evident in tasks like playing tennis, snowboarding, and texting. Implicit memory has three subsystems: procedural memory, conditioning, and priming. This type of memory is essential in various activities, from everyday tasks to specialized skills.
One key aspect of implicit...
One key aspect of implicit...
194
