Learning to Generate Parameters of ConvNets for Unseen Image Data

Area of Science:

• Computer Science
• Artificial Intelligence
• Machine Learning

Background:

• Traditional Convolutional Neural Networks (ConvNets) require extensive data and time-consuming iterative optimization for parameter learning.
• This intensive training process limits the efficiency and scalability of ConvNet deployment.

Purpose of the Study:

• To develop a new training paradigm that formulates ConvNet parameter learning as a prediction task.
• To enable direct prediction of network parameters for unseen image datasets, bypassing traditional iterative training.

Main Methods:

• Propose PudNet, a hypernetwork-based model that learns a mapping between image datasets and their optimal network parameters.
• Utilize adaptive hyper-recurrent units with shared weights to capture inter-layer parameter dependencies.
• Validate the model's efficacy in both Intra-dataset and Inter-dataset prediction settings.

Main Results:

• PudNet successfully predicts parameters for unseen image datasets with high efficacy.
• Achieved comparable performance to traditional training on large-scale datasets like ImageNet-1K.
• Demonstrated over 2,300x speedup in parameter prediction compared to training ResNet-18 from scratch.

Conclusions:

• PudNet offers a significantly faster and more resource-efficient alternative to conventional ConvNet training.
• The hypernetwork approach effectively captures dataset-parameter correlations for direct parameter prediction.
• PudNet shows strong scalability and potential for real-world applications requiring rapid model adaptation.