Image segmentation by means of temporal parallax difference induction
An image compositing and compression method based on the creation and processing of parallax differences in motion photography. A parallax scanning MOE lens creates discrete parallax differences in the objects in the recorded scene that are perceived by the viewer as enhanced texture and depth when displayed. Using parallax differences in a captured scene, a computer can detect objects for the purpose of creating image compositing mattes. This method allows matte passes to be filmed on location at the time of principal photography, thereby saving costly additional blue/green stage production shoot days associated with traveling matte techniques. In addition, because the mattes are based on parallax scan differences in the recorded scene and not on a uniform color and luminance process, certain conflicting scene subject colors will not have to be avoided. Also, because the matte scenes are recorded on location, the lighting in each of the various elements matches in the final composited image.
1. A method of generating, from a succession of images, a succession of mattes which correspond to scene object layers, respectively, comprising the steps of:
generating a flow map, for one or more of the succession of images, that specifies how pixels move between adjacent images in the succession of images;
separating groups of pixels, for the one or more succession of images, into distinct regions by combining pixels with similar flow values; and
generating a matte for the distinct regions of the one or more of the succession of images to provide the succession of mattes.
2. The method of claim 1 , further comprising selecting and removing selected mattes from the succession of mattes.
3. The method of claim 2 , further comprising using a computer or control device to automatically select the mattes.
4. The method of claim 2 further comprising manually selecting the mattes.
5. The method of claim 1 , further comprising performing region edge processing on at least one matte of the succession of mattes.
6. The method of claim 1 , further comprising:
generating color layers for the one or more of the succession of images by multiplying one or more of the succession of mattes by corresponding original image information.
7. The method of claim 6 , further comprising:
inserting additional image layers into the color layers generated for the one or more of the succession of images.
8. The method of claim 6 , further comprising:
ordering the color layers.
9. The method of claim 6 , further comprising:
generating a composite image by adding together at least two of the color layers corresponding to the one or more of the succession of images.
10. The method of claim 9 , further comprising:
generating a final composite image by adjusting the composite image for brightness or contrast.