RocSync:異質なカメラシステムのミリ秒精度のタイムシンクロネーション
Jaro Meyer1, Frédéric Giraud2, Joschua Wüthrich1
1Department of Computer Science, ETH Zurich, 8092 Zurich, Switzerland.
Sensors (Basel, Switzerland)
|February 13, 2026
まとめ
この研究では,さまざまなカメラシステムを同期するための低コストのLEDクロックを導入し,3D再構築などのアプリケーションでミリ秒レベルのタイムアラインメントを達成します. この方法は,可視 (RGB) および赤外線 (IR) センサーを介して,制限のない環境で動作します.
科学分野:
- コンピュータビジョン コンピュータビジョン
- センサ・フュージョンセンサー
- シグナル処理 信号処理
背景:
- マルチビュービデオの正確な時空的調整は,3D復元とポーズ推定を含むダイナミックなシーンの分析に不可欠です.
- 異質なカメラシステム (例えば,プロフェッショナル/消費者,RGB/IR) の同期は,ハードウェアの同期が利用できないため,特に現実世界のシナリオでは困難です.
研究 の 目的:
- 低コストで汎用的な方法を開発し,さまざまなカメラシステムでミリ秒レベルのタイムアラインメントを実現する.
- 制限のない環境で可視 (RGB) と赤外線 (IR) の両方のモダリティの同期をサポートします.
主な方法:
- オーダーメイドのLEDクロックは,赤と赤外線LEDを用いて時間を暗号化するように設計された.
- LEDクロックのタイムエンコーディングは,記録されたフレームからエクスポージャーウィンドウの開始と終了時間を視覚的にデコードすることができます.
- この方法は,ハードウェア同期および他の同期技術 (光,音声,タイムコード) と比較してベンチマークされました.
主要な成果:
- ハードウェア同期と比較して,複数の録音で1.34msRMSEの残余誤差で,ミリ秒レベルのタイムアラインメントを達成しました.
- 実験的な評価において,光,音声,タイムコードベースの同期方法を上回った.
- マルチビューポーズ推定や3D再構築などの下流コンピュータビジョンタスクの直接改善が実証されています.
結論:
- 提案されているLEDクロックシステムは,制限のない環境でのカメラ同期のための簡素化されたソリューションを提供します.
- この方法は,大規模な外科記録を含む,産業および臨床アプリケーションのための高度な視覚ベースのセンシングへのアクセシビリティを強化します.
- このシステムは,IRおよびRGBモードの25以上の異質なカメラを効果的に同期します.
関連する概念動画
Simplified Synchronous Machine Model
798
The Synchronous Machine Model is a fundamental tool in analyzing and ensuring the transient stability of power systems. This model simplifies the representation of a synchronous machine under balanced three-phase positive-sequence conditions, assuming constant excitation and ignoring losses and saturation. The model is pivotal for understanding the behavior of synchronous generators connected to a power grid, particularly during transient events.
In this model, each generator is connected to a...
In this model, each generator is connected to a...
798
Second Order systems II
414
In an underdamped second-order system, where the damping ratio ζ is between 0 and 1, a unit-step input results in a transfer function that, when transformed using the inverse Laplace method, reveals the output response. The output exhibits a damped sinusoidal oscillation, and the difference between the input and output is termed the error signal. This error signal also demonstrates damped oscillatory behavior. Eventually, as the system reaches a steady state, the error diminishes to zero.
414
First Order Systems
435
First-order systems, such as RC circuits, are foundational in understanding dynamic systems due to their straightforward input-output relationship. Analyzing their responses to different input functions under zero initial conditions reveals significant insights into system behavior.
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
435
Second Order systems I
619
A servo system exemplifies a second-order system, featuring a proportional controller and load elements that ensure the output position aligns with the input position. The relationship between these components is described by a second-order differential equation. Applying the Laplace transform under zero initial conditions yields the transfer function, showing how inputs are converted to outputs in the system.
By reinterpreting the system, one can derive the closed-loop transfer function, which...
By reinterpreting the system, one can derive the closed-loop transfer function, which...
619
Three-Phase Short Circuit—Unloaded Synchronous Machine
719
Conducting a three-phase short circuit test on an unloaded synchronous machine helps understand its impact on the system. The AC fault current's oscillogram, with the DC offset removed, reveals that the waveform amplitude decreases from an initially high value to a steady-state level for one phase of the machine.
This behavior occurs due to the magnetic flux produced by the short-circuit armature currents. Initially, these currents follow high-reluctance paths but eventually shift to...
This behavior occurs due to the magnetic flux produced by the short-circuit armature currents. Initially, these currents follow high-reluctance paths but eventually shift to...
719
¹H NMR of Labile Protons: Temporal Resolution
1.7K
Protons bonded to heteroatoms such as nitrogen and oxygen exhibit a range of chemical shift values. This is due to the varying degree of hydrogen bonding between the proton and the heteroatom in other molecules. The extent of hydrogen bonding affects the electron density around the proton, thereby giving different chemical shift values for the protons in the proton NMR spectrum.
The –OH proton in alcohols typically appears in the range of δ 2 to 5 ppm but can vary depending on the specific...
The –OH proton in alcohols typically appears in the range of δ 2 to 5 ppm but can vary depending on the specific...
1.7K


