Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement01:23

Reinforcement

454
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
454
Reinforcement Schedules01:24

Reinforcement Schedules

265
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
265
Observational Learning01:12

Observational Learning

383
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
383
Elaborative Rehearsals01:07

Elaborative Rehearsals

147
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
147
Associative Learning01:27

Associative Learning

670
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
670
Purposive Learning01:22

Purposive Learning

233
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
233

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Deep eutectic solvent extraction and AB-8 resin adsorption for rambutan shell polyphenol: Profiling and bioactivity assessments.

Food chemistry: X·2026
Same author

Screening for unconventional pesticides in tropical fruits and vegetables from Hainan, China.

PloS one·2026
Same author

The Microbial Community Succession Drives Stage-Specific Carbon Metabolic Shifts During <i>Agaricus bisporus</i> Fermentation: Multi-Omics Reveals CAZymes Dynamics and Lignocellulose Degradation Mechanisms.

Microorganisms·2025
Same author

Effects of Pesticides on Apis cerana From Passion Fruit in Hainan Island.

Archives of insect biochemistry and physiology·2025
Same author

Flavones in pomelo peel resist fibril formation of human islet amyloid polypeptide.

Chinese herbal medicines·2025
Same author

Glutathione S-Transferase Contributes to the Resistance of Megalurothrips usitatus Against Lambda-Cyhalothrin by Strengthening Its Antioxidant Defense Mechanisms.

Archives of insect biochemistry and physiology·2024
Same journal

Dynamic analysis and reliable mechanical optimization application of ring HNN effected with a memristive neuron.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

DAFF-Net: A detection and search method for small-scale low surface brightness galaxies.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Quasi-synchronization for complex networks with hybrid pinning intermittent control.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Physics-encoded convolutional neural operators for parametric PDEs: A convergence-guaranteed framework via pre-computed kernel fields.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Exploiting audio-visual modalities in videos: Object detection via multi-stage bilateral coupling network.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Reliability-aware modality completion with cross-modal distillation for federated learning with missing modalities.

Neural networks : the official journal of the International Neural Network Society·2026
See all related articles

Related Experiment Video

Updated: Oct 15, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

735

Enriching query semantics for code search with reinforcement learning.

Chaozheng Wang1, Zhenhao Nong1, Cuiyun Gao1

  • 1School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, China.

Neural Networks : the Official Journal of the International Neural Network Society
|October 28, 2021
PubMed
Summary
This summary is machine-generated.

Existing code search models struggle with the gap between code descriptions and user queries. Our new Query-enriched Code search (QueCos) model uses reinforcement learning to enrich queries, significantly improving code search accuracy.

Keywords:
Code searchQuery semanticsReinforcement learningSemantic enrichment

More Related Videos

Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

11.1K
Eye-tracking Technology and Data-mining Techniques used for a Behavioral Analysis of Adults engaged in Learning Processes
10:43

Eye-tracking Technology and Data-mining Techniques used for a Behavioral Analysis of Adults engaged in Learning Processes

Published on: June 10, 2021

5.5K

Related Experiment Videos

Last Updated: Oct 15, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

735
Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

11.1K
Eye-tracking Technology and Data-mining Techniques used for a Behavioral Analysis of Adults engaged in Learning Processes
10:43

Eye-tracking Technology and Data-mining Techniques used for a Behavioral Analysis of Adults engaged in Learning Processes

Published on: June 10, 2021

5.5K

Area of Science:

  • Software Engineering
  • Information Retrieval
  • Artificial Intelligence

Background:

  • Accurate code search is crucial for software development.
  • Deep learning models often rely on code-description pairs, assuming minimal semantic difference between descriptions and user queries.
  • This assumption is flawed, leading to suboptimal performance in real-world code search scenarios.

Purpose of the Study:

  • To address the semantic gap between natural language queries and code descriptions in code search.
  • To propose a novel model, QueCos, that enhances query semantics for more effective code retrieval.
  • To improve the performance of code search systems beyond existing state-of-the-art methods.

Main Methods:

  • Developed QueCos, a Query-enriched Code search model.
  • Utilized reinforcement learning (RL) to train the model to generate semantically enriched queries.
  • Employed code search performance as a reward signal within the RL framework to guide query enrichment.

Main Results:

  • Demonstrated that models trained on code-description pairs perform poorly on user queries due to semantic distance.
  • QueCos successfully generates semantic enriched queries that capture essential query semantics.
  • Experimental results on benchmark datasets show significant performance improvements over state-of-the-art code search models.

Conclusions:

  • The semantic gap between code descriptions and user queries is a significant challenge in code search.
  • QueCos effectively mitigates this gap by enriching queries using reinforcement learning.
  • The proposed approach offers a promising direction for developing more accurate and efficient code search systems.