CycMuNet+:为超高分辨率的时空视频提供循环设计的相互学习

相关实验视频

Updated: Jul 24, 2025

Time Multiplexing Super Resolving Technique for Imaging from a Moving Platform

Time Multiplexing Super Resolving Technique for Imaging from a Moving Platform

Published on: February 12, 2014

Mengshun Hu, Kui Jiang, Zheng Wang

IEEE transactions on pattern analysis and machine intelligence

|July 10, 2023

概括

这项研究介绍了CycMuNet,这是一个新的空间时空视频超分辨率 (ST-VSR) 一级网络. 它有效地利用空间和时间超分辨率任务之间的相互学习来提高视频质量.

科学领域:

计算机视觉计算机视觉
人工智能的人工智能
视频处理视频处理

背景情况:

空间时间视频超分辨率 (ST-VSR) 旨在提高视频分辨率和率.
现有的两阶段方法往往忽略了空间和时间超分辨率子任务之间的关键相互作用.
时间相关性有助于空间细节,而空间信息则完善时间预测.

研究的目的:

为ST-VSR提出一个新的单阶段网络,CycMuNet.
通过相互学习,利用空间视频超分辨率 (S-VSR) 和时间视频超分辨率 (T-VSR) 之间的相互关系.
通过融合和蒸时空特征来改善高质量的视频重建.

主要方法:

引入了ST-VSR的循环设计的相互学习网络 (CycMuNet).
采用代的上下投影来利用S-VSR和T-VSR之间的相互信息.
开发了高效的扩展 (CycMuNet+),具有参数共享,密集连接和反机制.

主要成果:

CycMuNet有效地融合和提炼时空特征,以实现卓越的视频重建.
实验表明,对基准数据集的最先进方法进行显著的性能改进.
该方法在独立的S-VSR和T-VSR任务中表现出强的性能.

结论:

通过整合空间和时间学习,CycMuNet为ST-VSR提供了更有效的方法.
拟议的相互学习框架通过解决子任务之间的相互依赖性来提高视频质量.
CycMuNet及其高效变体代表了视频超分辨率技术的重大进步.

更多相关视频

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques

Published on: December 3, 2013

Super-Resolution Imaging to Study Co-Localization of Proteins and Synaptic Markers in Primary Neurons

Super-Resolution Imaging to Study Co-Localization of Proteins and Synaptic Markers in Primary Neurons

Published on: October 31, 2020

相关概念视频

Super-resolution Fluorescence Microscopy

Super-resolution Fluorescence Microscopy

Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...

Depth Perception and Spatial Vision

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.