Caltech Control and Dynamical Systems Technical Reports

Three Dimensional Transparent Structure Segmentation and Multiple 3D Motion Estimation from Monocular Perspective Image Sequences

Soatto, Stefano and Perona, Pietro (1994) Three Dimensional Transparent Structure Segmentation and Multiple 3D Motion Estimation from Monocular Perspective Image Sequences. Technical Report. California Institute of Technology, Pasadena, CA. [CaltechCDSTR:1993.022]

Full text available as:

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
Postscript - Requires a viewer, such as GhostView

Abstract

A three dimensional scene can be segmented using different cues, such as boundaries, texture, motion, discontinuities of the optical flow, stereo, models for structure etc. We investigate segmentation based upon one of these cues, namely three dimensional motion. If the scene contains transparent objects, the two dimensional (local) cues are inconsistent, since neighboring points with similar optical flow can correspond to different objects. We present a method for performing three dimensional motion-based segmentation of (possibly) transparent scenes together with recursive estimation of the motion of each independent rigid object from monocular perspective images. To our knowledge this problem has never been addressed in the literature. Our algorithm is based on a recently proposed method for rigid motion reconstruction and a validation test which allows us to initialize the scheme and detect outliers during the motion estimation procedure. The scheme is tested on challenging real and synthetic image sequences. Segmentation is performed for the Ullmann's experiment of two transparent cylinders rotating about the same axis in opposite directions.

EPrint Type:Monograph (Technical Report)
Subjects:All Records
ID Code:75
Deposited By:Caltech Library System
Deposited On:31 August 2006
Unique Identifier:CaltechCDSTR:1993.022
Official Persistent URL:http://resolver.caltech.edu/CaltechCDSTR:1993.022
Usage Policy:You are granted permission for individual, educational, research and non-commercial reproduction, distribution, display and performance of this work in any format.

Archive Staff Only: edit this record