Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Types of Errors: Detection and Minimization01:12

Types of Errors: Detection and Minimization

2.6K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
2.6K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

103
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
103
Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

7.9K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.9K
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

2.1K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.1K
Reducing Line Loss01:18

Reducing Line Loss

197
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
197
Accuracy, limits, and approximation01:28

Accuracy, limits, and approximation

555
Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
555

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective.

IEEE transactions on pattern analysis and machine intelligence·2026
Same author

Holistic Invariant Retracing for Distortion-Resilient Multi-Modal Learning in Spatial Transcriptomics.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Demonstration of efficient predictive surrogates for large-scale quantum processors.

Nature communications·2026
Same author

A DeepSeek-powered AI system for automated chest radiograph interpretation in clinical practice.

Nature communications·2026
Same author

NoisePO: Efficient Semantic Noise Generation and Ranking for Diffusion-Based Text-to-Image Synthesis.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Stability and Generalization for Distributed SGDA.

IEEE transactions on pattern analysis and machine intelligence·2026

相关实验视频

Updated: Sep 17, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
07:34

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

Published on: March 25, 2014

10.0K

系统地调查稀疏扰乱的敏度意识最小化优化器.

Peng Mi, Li Shen, Tianhe Ren

    IEEE transactions on pattern analysis and machine intelligence
    |June 27, 2025
    PubMed
    概括

    稀疏SAM (SSAM) 通过将稀疏扰动应用于深度神经网络训练来降低计算开销. 这种高效的方法与50%稀疏度的度意识最小化 (SAM) 相比,保持或提高了性能.

    科学领域:

    • 机器学习 机器学习
    • 深度学习优化优化

    背景情况:

    • 深度神经网络 (DNN) 由于复杂的损失景观,难以进行概括.
    • 敏度意识最小化 (SAM) 可以平滑损失场景,但由于干扰所有权重而导致高计算成本.

    研究的目的:

    • 引入Sparse SAM (SSAM),一个高效的培训方案,可以减少SAM的计算开销.
    • 研究稀疏扰动策略,以提高DNN训练效率和概括性.

    主要方法:

    • 对于稀疏重量扰动,SSAM采用了一个二进制面具.
    • 使用费舍尔信息和动态稀疏训练,衍生了稀疏面具.
    • 调查了各种面具模式 (非结构化,结构化,N:M) 和扰动实现 (明确的,隐含的).

    主要成果:

    • SSAM实现了与SAM相当的收率 ($O(\log T/\sqrt{T}) $).
    • 在CIFAR和ImageNet-1K上的实验表明SSAM的效率优于SAM.
    • 在高达50%的稀疏度下,性能保持或增强.

    结论:

    • 在DNN培训中,SSAM为SAM提供了一种有效且计算效率高的替代方案.

    更多相关视频

    Experimental and Data Analysis Workflow for Soft Matter Nanoindentation
    13:04

    Experimental and Data Analysis Workflow for Soft Matter Nanoindentation

    Published on: January 18, 2022

    4.1K
    Fine-tuning the Size and Minimizing the Noise of Solid-state Nanopores
    09:43

    Fine-tuning the Size and Minimizing the Noise of Solid-state Nanopores

    Published on: October 31, 2013

    13.6K

    相关实验视频

    Last Updated: Sep 17, 2025

    A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
    07:34

    A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

    Published on: March 25, 2014

    10.0K
    Experimental and Data Analysis Workflow for Soft Matter Nanoindentation
    13:04

    Experimental and Data Analysis Workflow for Soft Matter Nanoindentation

    Published on: January 18, 2022

    4.1K
    Fine-tuning the Size and Minimizing the Noise of Solid-state Nanopores
    09:43

    Fine-tuning the Size and Minimizing the Noise of Solid-state Nanopores

    Published on: October 31, 2013

    13.6K
  • 稀疏扰动是优化DNN而不牺牲性能的一种可行的策略.