Related Experiment Video
Updated: May 9, 2026
06:53
Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation
Published on: March 1, 2017
Free-viewpoint video of human actors using multiple handheld Kinects.
IEEE Transactions on Cybernetics
|July 30, 2013
Summary
This study introduces a new algorithm for generating free-viewpoint video of interacting humans using multiple Kinect cameras. The method reconstructs human geometry and texture even with dynamic backgrounds and moving cameras.
Area of Science:
- Computer Vision
- Computer Graphics
- Human-Computer Interaction
Background:
- Creating realistic free-viewpoint video of humans is challenging.
- Existing methods struggle with dynamic scenes and uncontrolled environments.
Purpose of the Study:
- To develop an algorithm for free-viewpoint video reconstruction of interacting humans.
- To enable reconstruction using multiple handheld Kinect cameras in uncontrolled indoor settings.
Main Methods:
- Jointly estimating human poses and camera poses via energy minimization.
- Utilizing RGBZ data, human shape templates, and image features for alignment.
- Employing matrix completion for spatio-temporal texture recovery.
Main Results:
- Successful reconstruction of deforming human surface geometry and texture.
- Robust performance in general uncontrolled indoor scenes with dynamic backgrounds.
- Effective operation even with moving handheld Kinect cameras.
Conclusions:
- The proposed algorithm advances free-viewpoint video creation for human interaction.
- It offers a practical solution for dynamic, real-world scenarios.
- Demonstrates improved robustness over previous state-of-the-art methods.
Related Concept Videos
01:15Torque Free Motion
The torque-free motion refers to the movement of a rigid body in space when no external torques are acting upon it. This type of motion can be observed in environments where there are no external forces or frictions, like in outer space. For example, a rotation of Mars in space is a torque-free motion. Mars is an axisymmetric object, meaning it has an axis of symmetry along which it rotates, designated as the z-axis. The rotating frame of reference is defined such that the center of mass of...
01:26Kinetic Friction
Consider a truck trying to pull a stationary car. As the truck exerts a force on the car, static friction is created at the point of contact between the two surfaces. This frictional force resists the car's movement and keeps it at rest. However, when the applied force by the truck surpasses the limiting static frictional force, an interesting phenomenon occurs. The frictional force at the interface reduces to a lower value, known as the kinetic frictional force. At this point, the car begins...
01:07Frictional Force
When a body is in motion, it encounters resistance because the body interacts with its surroundings. This resistance is known as friction, a common yet complex force whose behavior is still not completely understood. Friction opposes relative motion between systems in contact, but also allows us to move. Friction arises in part due to the roughness of surfaces in contact. For one object to move along a surface, it must rise to where the peaks of the surface can skip along the bottom of the...
01:24Muscle Coordination and Action
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement.
01:22Planar Rigid-Body Motion
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
01:24One-Degree-of-Freedom System
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...