System and method for processing video images
Embodiments use point clouds to form a three dimensional image of an object. The point cloud of the object may be formed from analysis of two dimensional images of the object. Various techniques may be used on the point cloud to form a three dimensional model of the object which is then used to create a stereoscopic representation of the object.
1. A method for forming a three dimensional image of an object, the method comprising:
providing, to a processor, at least two images of the object, wherein a first image has a different view of the object than a second image, wherein the first and second images are two dimensional images of a scene;
forming a point cloud for the object using the first image and the second image, wherein the point cloud comprises virtual tracking markers, wherein the virtual tracking markers are associated with movement data of particular pixels of features of the scene;
creating, by said processor, the three dimensional image of the object using the point cloud, wherein the point cloud comprises points that comprise X, Y, Z coordinates and wherein the point cloud comprises points from each of said first and second images; and
placing the three dimensional image of the object into an image of the scene such that the three dimensional image of the object is located in the scene at a different location or where it did not exist in the two dimensional images of the scene.
2. The method of claim 1 , wherein the forming the point cloud comprises:
selecting a plurality of points of the object in the images.
3. The method of claim 2 , wherein the selecting is performed by a user.
4. The method of claim 2 , wherein the selecting is performed by a computer.
5. The method of claim 2 , wherein the plurality of points comprises at least one of a feature of the object, an edge of the object, a shape of the object, a color change of the object, and a change of texture of the object.
6. The method of claim 1 , wherein forming the point cloud comprises:
sweeping the object with an energy emitter; and
recording distance and placement information for a plurality of points of the object.
7. The method of claim 1 , wherein the images are frames of a movie.
8. The method of claim 1 , wherein the point cloud is a static point cloud.
9. The method of claim 1 , wherein the point cloud is a dynamic point cloud and each point comprises movement data for the point.
10. The method of claim 1 , wherein the creating comprises:
using a triangular mesh technique to form the object.
11. The method of claim 1 , wherein the creating comprises:
using a gradient technique to form the object.
12. The method of claim 1 , wherein the creating comprises: using a depth map to form the object.
13. The method of claim 1 , comprising:
recreating a camera that was actually used with the object and took at least the first image of the object.
14. The method of claim 13 ,
wherein the recreating a camera comprises determining a location of the camera based on a known object present in two dimensional images.
15. The method of claim 13 ,
wherein the recreating a camera comprises associating a set of three-dimensional points from the point cloud to two-dimensional tracked points within the first image.
16. A non-transitory tangible machine-readable storage medium comprising machine-readable instructions stored therein, the instructions for performing one or more operations, the instructions comprising:
one or more instructions for providing at least two images of an object, wherein a first image has a different view of the object than a second image, wherein the first and second images are two dimensional images of a scene;
one or more instructions for forming a point cloud for the object using the first image and the second image, wherein the point cloud comprises virtual tracking markers, wherein the virtual tracking markers are associated with movement data of particular pixels of features of the scene;
one or more instructions for creating a three dimensional image of the object using the point cloud, wherein the point cloud comprises points that comprise X, Y, Z coordinates and wherein the point cloud comprises points from each of said first and second images; and
one or more instructions for placing the three dimensional image of the object into an image of the scene such that the three dimensional image of the object is located in the scene at a different location or where it did not exist in the two dimensional images of the scene.
17. An apparatus, comprising:
a processor;
one or more memories storing instructions for performing one or more operations, the instructions comprising:
one or more instructions for providing at least two images of an object, wherein a first image has a different view of the object than a second image, wherein the first and second images are two dimensional images of a scene;
one or more instructions for forming a point cloud for the object using the first image and the second image, wherein the point cloud comprises virtual tracking markers, wherein the virtual tracking markers are associated with movement data of particular pixels of features of the scene;
one or more instructions for creating a three dimensional image of the object using the point cloud, wherein the point cloud comprises points that comprise X, Y, Z coordinates and wherein the point cloud comprises points from each of said first and second images; and
one or more instructions for placing the three dimensional image of the object into an image of the scene such that the three dimensional image of the object is located in the scene at a different location or where it did not exist in the two dimensional images of the scene.