Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Classification of Signals01:30

Classification of Signals

612
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
612
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

695
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
695
Force Classification01:22

Force Classification

1.3K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.3K
Downsampling01:20

Downsampling

214
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
214
Methods of Classification and Identification01:28

Methods of Classification and Identification

76
Bacterial identification relies on a diverse array of techniques to classify and understand microorganisms, each tailored to uncover specific characteristics. Traditional morphological approaches, while still valuable, are limited for closely related or structurally simple organisms. Modern methods integrate biochemical, serological, genetic, and advanced molecular tools to achieve greater accuracy.Morphological and Biochemical TechniquesMorphological characteristics, such as cell shape and...
76
Aggregates Classification01:29

Aggregates Classification

357
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
357

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Interpretable Short-Term Electrical Load Forecasting Scheme Using Cubist.

Computational intelligence and neuroscience·2022
Same author

A Two-Stage Multistep-Ahead Electricity Load ForecastingScheme Based on LightGBM and Attention-BiLSTM.

Sensors (Basel, Switzerland)·2021
Same author

An Attention-Based Multilayer GRU Model for Multistep-Ahead Short-Term Load Forecasting<sup>†</sup>.

Sensors (Basel, Switzerland)·2021
Same author

Erratum: Jung, S., et al. Cluster-Based Analysis of Infectious Disease Occurrences Using Tensor Decomposition: A Case Study of South Korea. <i>Int. J. Environ. Res. Public Health</i> 2020, <i>17</i>, 4872.

International journal of environmental research and public health·2020
Same author

Cluster-Based Analysis of Infectious Disease Occurrences Using Tensor Decomposition: A Case Study of South Korea.

International journal of environmental research and public health·2020
Same author

Multiple Electric Energy Consumption Forecasting Using a Cluster-Based Strategy for Transfer Learning in Smart Building.

Sensors (Basel, Switzerland)·2020

Related Experiment Video

Updated: Aug 8, 2025

Flying Insect Detection and Classification with Inexpensive Sensors
05:16

Flying Insect Detection and Classification with Inexpensive Sensors

Published on: October 15, 2014

25.2K

DualDiscWaveGAN-Based Data Augmentation Scheme for Animal Sound Classification.

Eunbeen Kim1, Jaeuk Moon1, Jonghwa Shim1

  • 1School of Electrical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea.

Sensors (Basel, Switzerland)
|February 28, 2023
PubMed
Summary
This summary is machine-generated.

This study presents a new method to improve how computers identify animal sounds. By using a specialized generative artificial intelligence system, the researchers created high-quality synthetic audio samples that combine both sound wave patterns and visual frequency representations. This approach helps models learn better when real-world recordings are scarce. The team then filtered these synthetic sounds to ensure only the most reliable data was used for training. This technique significantly boosted the accuracy of sound classification systems compared to existing methods.

Keywords:
GANanimal sound classificationdata augmentationdeep learningGenerative Adversarial NetworksDeep LearningAudio SynthesisWildlife Monitoring

Frequently Asked Questions

More Related Videos

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.2K
Computer-Generated Animal Model Stimuli
26:43

Computer-Generated Animal Model Stimuli

Published on: July 29, 2007

11.0K

Related Experiment Videos

Last Updated: Aug 8, 2025

Flying Insect Detection and Classification with Inexpensive Sensors
05:16

Flying Insect Detection and Classification with Inexpensive Sensors

Published on: October 15, 2014

25.2K
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.2K
Computer-Generated Animal Model Stimuli
26:43

Computer-Generated Animal Model Stimuli

Published on: July 29, 2007

11.0K

Area of Science:

  • Bioacoustics and ecological monitoring within DualDiscWaveGAN computational research
  • Artificial intelligence applications in wildlife conservation

Background:

No prior work had resolved the performance limitations of automated animal sound identification when training datasets remain small. Prior research has shown that deep learning models excel only when provided with extensive labeled audio examples. That uncertainty drove the development of generative adversarial networks to synthesize virtual training samples. Existing approaches often require building individual models for every distinct animal category, which complicates multi-class classification tasks. Furthermore, current techniques frequently ignore the complex relationship between raw audio waves and their visual spectrogram counterparts. This gap motivated the need for a more integrated approach to data synthesis. No previous studies had successfully combined these two distinct data formats to enhance synthetic sound quality. Researchers now recognize that improving data diversity is necessary for robust wildlife monitoring systems.

Purpose Of The Study:

The aim of this study is to introduce a two-step sound augmentation scheme for improving animal sound classification. Researchers sought to address the severe performance drops observed when training data is insufficient. This work focuses on overcoming the limitations of existing generative models in multi-class environments. The authors intended to create a system that does not require separate generative models for every animal category. They also aimed to improve the quality of synthetic audio by considering both waveforms and spectrograms. The study addresses the challenge of generating realistic sounds that can effectively train classification models. By proposing this new framework, the authors intended to provide a more efficient solution for monitoring rare wildlife. This research is motivated by the need for robust automated identification tools in ecological studies.

Main Methods:

Review approach involved developing a two-step augmentation pipeline to synthesize animal audio. The researchers designed a class-conditional generative adversarial network to learn common features across all animal categories. This architecture simultaneously processes raw audio signals and visual frequency representations to enhance synthetic quality. The team then implemented a selection mechanism to refine the generated dataset. They utilized a pretrained classification model to calculate confidence scores for every synthetic sample. Only samples meeting specific reliability thresholds were included in the final training set. This design avoids the need for creating individual generative models for each distinct species. The approach focuses on maximizing the utility of limited real-world recordings for training robust identification systems.

Main Results:

Key findings from the literature show that the proposed method improves basic classification accuracy by up to 18.3 percent. This performance gain represents a 13.4 percent improvement over the second-best augmentation strategy evaluated. The researchers observed that incorporating both waveform and spectrogram features leads to higher quality synthetic audio. Their class-conditional approach successfully generates multiple categories of animal sounds within a single model. The selection process based on model confidence effectively filters out low-quality synthetic data. This filtering step ensures that the final training dataset is more representative of real-world acoustic patterns. The experimental results confirm that the framework performs well in multi-class environments. These findings demonstrate the effectiveness of the two-step augmentation scheme in overcoming data scarcity issues.

Conclusions:

The authors demonstrate that their two-step augmentation strategy significantly enhances the accuracy of basic classification models. Synthesis and implications suggest that integrating waveform and spectrogram features provides a superior foundation for generating synthetic audio. The researchers propose that filtering generated samples based on model confidence ensures higher quality training inputs. This study confirms that their approach outperforms alternative augmentation techniques by a margin of 13.4 percent. The findings indicate that this method effectively addresses the data scarcity problem in multi-class animal sound environments. The authors conclude that their framework serves as a robust solution for monitoring elusive wildlife species. This work highlights the potential of class-conditional generative models to improve ecological audio analysis. The results provide a clear pathway for future developments in automated bioacoustic classification systems.

The researchers propose a two-step augmentation strategy. First, they utilize a class-conditional generative adversarial network to synthesize audio by learning shared features across categories. Second, they filter these synthetic samples using a pretrained model's confidence scores to ensure only high-quality data is used for training.

The study employs a DualDiscWaveGAN framework. This specialized architecture is designed to simultaneously process both raw waveforms and visual spectrograms, allowing the system to capture more comprehensive acoustic information than models that focus on only one of these data formats.

A pretrained sound classification model is necessary to evaluate the generated samples. This component acts as a filter, selecting only the most reliable synthetic data to improve the training set, which is required because raw generative outputs may contain noise or artifacts.

The researchers use both raw waveforms and spectrograms as input data types. By incorporating these dual representations, the model learns a more detailed acoustic structure, which is superior to traditional methods that rely on only one format.

The proposed method achieved an accuracy improvement of up to 18.3 percent for the basic classification model. This result represents a 13.4 percent performance gain over the next best augmentation technique tested by the researchers.

The authors propose that their framework effectively mitigates performance degradation caused by limited training data. They claim this approach provides a scalable solution for multi-class environments, which is more efficient than building separate generative models for every individual category.