Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Segmentation in structure from motion: modeling and psychophysics.

C Caudek1, N Rubin

  • 1Center for Neural Science, New York University, 4 Washington Pl., New York, NY 10003, USA. caudek@univ.trieste.it

Vision Research
|October 6, 2001
PubMed
Summary

The human visual system can simultaneously solve structure from motion and object segmentation problems. A new model uses optic flow properties to identify multiple objects, aligning with experimental findings.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Observation of disorder-free localization using a (2+1)D lattice gauge theory on a quantum processor.

Science (New York, N.Y.)·2026
Same author

Risk for stroke and myocardial infarction with abiraterone versus enzalutamide in metastatic prostate cancer patients.

ESMO open·2021
Same author

Screening for second malignancies in mycosis fungoides: non-Hodgkin lymphoma, Hodgkin lymphoma, lung cancer, bladder cancer and melanoma.

Journal of the European Academy of Dermatology and Venereology : JEADV·2021
Same author

Demonstrating a Continuous Set of Two-Qubit Gates for Near-Term Quantum Algorithms.

Physical review letters·2020
Same author

Mycosis fungoides: developments in incidence, treatment and survival.

Journal of the European Academy of Dermatology and Venereology : JEADV·2020
Same author

Predicting post-transarterial chemoembolization outcomes: A comparison of direct and total bilirubin serums levels.

Diagnostic and interventional imaging·2020

Area of Science:

  • Visual perception
  • Computational neuroscience
  • Computer vision

Background:

  • The Structure from Motion (SFM) problem addresses 3D object recovery from 2D motion.
  • Human ability to solve SFM with multiple objects and segmentation remains less understood.
  • Existing SFM models often struggle with complex scenes involving multiple moving objects.

Purpose of the Study:

  • To present a model for concurrent Structure from Motion and Segmentation (SSFM).
  • To investigate how the human visual system segments and reconstructs multiple objects from optic flow.
  • To validate the model's predictions against human experimental data.

Main Methods:

  • Developed a computational model based on the 'def' property of optic flow fields.
  • Computed 'def' values for triplets of moving dots.

Related Experiment Videos

  • Identified multiple objects by detecting peaks in the histogram of 'def' values.
  • Conducted five experiments to test human SSFM performance against model predictions.

    • Main Results:

    • Human SSFM performance aligns with the model's predictions.
    • The model successfully accounts for the segmentation of multiple objects based on optic flow.
    • Experimental data supports the model's mechanism for solving combined SFM and segmentation.

    Conclusions:

    • The proposed SSFM model provides a viable explanation for human visual perception of multiple moving objects.
    • The 'def' property of optic flow is a key computational element for human SSFM.
    • The model offers an alternative to rigidity-based approaches for understanding human multi-object SFM.