Device and method of creating an augmented interactive virtual reality system
A system for detecting and incorporating three-dimensional objects into a video stream reads an input video data stream. The user specifies areas of attention wherein said areas of attention or hotspots. Tracking movement of the hotspots generating a trajectory of said at least one object. Generating a cloud of points and tracking said points to detect configurations of points most similar to the initially defined hotspot. Obtaining a three dimensional topology defining a volume of interest in a three-dimensional space. Building virtual structures or pseudo objects that are placed within a spherical environment generated on the input video.
1. A system for detecting and incorporating three-dimensional data into a video stream comprising:
reading an input video data stream;
accepting from a user specified areas of attention wherein said areas of attention comprise hotspots defining at least one real-world object of interest shown within the video data stream;
tracking movement of said hotspots generating a trajectory of said at least one object of interest in two-dimensional space of the video;
obtaining a three-dimensional topology defining a three-dimensional volume of interest in a three-dimensional space;
translating the hotspots from the two-dimensional space of the video to the three-dimensional volume;
calculating motion of the hotspots in three-dimensional space;
building virtual structures to relate said hotspots to said three dimensional topology to create a three dimensional geometric shape; and
projecting resulting said shape on a spherical environment.
2. The system of claim 1 wherein said building virtual structures comprises compiling pseudo objects wherein each pseudo object is defined as a group of hotspots.
3. The system of claim 1 wherein said video data stream comprises encoded video.
4. The system of claim 1 wherein said video data stream comprises decoded video stream.
5. The system of claim 2 wherein additional information is added to said pseudo objects.
6. The system of claim 5 wherein a spherical projection of video and pseudo objects is presented to a user.
7. A system for detecting and incorporating three-dimensional objects into a video stream comprising:
reading an input video data stream depicting discernable objects that require modeling and identification along with three-dimensional spatial data aligning the spatial data with the input video data stream;
receiving from a user a specification of areas of attention wherein said areas of attention comprise hotspots defining at least one object of interest shown within the video data stream;
analyzing the user specification of areas of attention to calculate an intermediate format which describes objects of interest specified by the user and wherein the intermediate format comprises a description of movement of the objects of interest specified by the user;
modeling objects and defining movement of the modeled objects within the input video data stream; and
projecting the input video data stream, by combining the intermediate format with the input video data stream and collecting additional information for presentation to an end-user; and
tracing, during the projection, at least one motion curve representing movements of said hotspots in relation to a camera and spatial data source in three-dimensions.
8. The system of claim 7 wherein said video data stream comprises encoded video.
9. The system of claim 7 wherein said video data stream comprises decoded video stream.
10. The system of claim 7 wherein the additional information is associated with said at least one modeled object shown within the video data stream.
11. The system of claim 10 wherein a spherical projection of video and pseudo objects is presented to a user.