SYSTEM AND METHOD FOR USING FEATURE TRACKING TECHNIQUES FOR THE GENERATION OF MASKS IN THE CONVERSION OF TWO-DIMENSIONAL IMAGES TO THREE-DIMENSIONAL IMAGES
The present invention is directed to systems and methods for controlling 2-D to 3-D image conversion and/or generation. The methods and systems use auto-fitting techniques to create a mask based upon tracking features from frame to frame. When features are determined to be missing they are added prior to auto-fitting the mask.
1 . A method of generating a mask for use in generating 2-D to 3-D conversion of an object within an image, said image being present as an image-set across multiple frames of said image; said method comprising:
selecting at least one feature of said image-set; and
tracking selected ones of said features across said image-set so as to determine if said selected feature is missing from certain frames.
2 . The method of claim 1 further comprising:
adding said selected feature into said certain frames when said feature is determined to be missing from said certain frames; and
auto-fitting a mask to fit tracked ones of said features.
3 . The method of claim 2 wherein said adding comprises;
manually adding said feature.
4 . The method of claim 2 wherein said tracking comprises:
establishing a polycurve polygon of said desired object to be masked within a subset of said image set.
5 . The method of claim 4 wherein said subset represents an equal distribution of a total set of said images.
6 . The method of claim 5 wherein said equal distribution comprises at least a first, a middle and a last one of said images.
7 . The method of claim 4 wherein said tracking assumes that every end point of a polycurve of said polygon corresponds to a feature in said image.
8 . The method of claim 7 wherein said tracking comprises:
tracking all endpoints of vertices of said polycurve.
9 . The method of claim 8 further comprising:
refining at least one of said vertices.
10 . The method of claim 9 wherein said refining comprises using image analysis tools.
11 . The method of claim 1 wherein said tracking occurs in a sequential manner from one end of said image set to another end.
12 . Code for use in a processor system, said processor system operable, under control of said code, to establish a mask for use in generating 2-D to 3-D conversion of an object within an image, said image being present as an image-set across multiple frames of said image; said code comprising:
control sequences for selecting at least one feature of said image-set; and
control sequences for tracking selected ones of said features across said image-set so as to determine if said selected feature is missing from certain frames.
13 . The code of claim 12 further comprising:
control sequences for adding said selected feature into said certain frames when said feature is determined to be missing from said certain frames.
14 . The code of claim 13 wherein said t control sequences for racking comprises:
control sequences for establishing a polycurve polygon of said desired object to be masked within a subset of said image set.
15 . The code of claim 12 wherein said control sequences for tracking assumes that every end point of a polycurve of said polygon corresponds to a feature in said image.
16 . The code of claim 12 wherein said control sequences for tracking comprises:
control sequences for tracking all endpoints of vertices of said polycurve.
17 . A method of generating a mask for use in generating 2-D to 3-D conversion of an object within an image, said image being present as an image-set across multiple frames of said image; said method comprising:
selecting at least one feature of said image-set;
tracking selected ones of said features across said image-set; and
auto-fitting a mask to fit tracked ones of said features.
18 . The method of claim 17 further comprising:
determining certain frames in which said feature is missing;
temporarily inhibiting said auto-fitting when said feature is determined to be missing from said certain frames;
adding said feature into said certain frames; and
enabling said auto-fitting when said feature has been added to said certain frames.
19 . The method of claim 18 wherein said tracking comprises:
establishing a polycurve polygon of said desired object to be masked within a subset of said image set.
20 . The method of claim 19 wherein said subset represents an equal distribution of a total set of said images.
21 . The method of claim 20 wherein said equal distribution comprises at least a first, a middle and a last one of said images.
22 . The method of claim 19 wherein said tracking assumes that every end point of a polycurve of said polygon corresponds to a feature in said image.
23 . The method of claim 22 wherein said tracking comprises:
tracking all endpoints of vertices of said polycurve.