360 degree video recording and playback with object tracking
In a system for 360 degree video capture and playback, 360 degree video may be captured, stitched, encoded, decoded, rendered, and played-back. In one or more implementations, a decoding device receives a 360 degree video stream as input and decodes the 360 degree video stream, and a memory device stores the 360 degree video stream and viewing history data associated with the 360 degree video stream. A rendering device may render the decoded stream using view angles from the viewing history data. In one or more implementations, an object tracking device tracks one or more objects in the decoded 360 degree video stream and provides one or more tracking angles associated with the objects. The rendering device may render the decoded 360 degree video stream using the one or more tracking angles to keep at least one object in the 360 degree video stream for one or more rendered frames.
1. A computer-implemented method comprising:
decoding a 360 degree video stream;
tracking and object detected in the decoded 360 degree video stream and providing one or more tracking angles associated with the detected object;
extracting a plurality of predetermined view angles from the decoded 360 degree video stream;
rendering the decoded 360 degree video stream using the one or more tracking angles; and
provide, for display, the rendered 360 degree video stream,
wherein the object is detected as being closest to a center view of the 360 degree video stream.
2. The computer-implemented method of claim 1 , the method further comprising:
receiving a set of user-selected view angles as input; and
rendering one or more video sequences of the decoded 360 degree video stream with the set of user-selected view angles.
3. A system comprising:
a decoding device configured to receive a 360 degree video stream as input and decode the 360 degree video stream;
an object tracking device configured to track an object detected by the object tracking device as being closest to a center of a current view in the decoded 360 degree video stream and provide one or more tracking angles associated with the detected object; and
a rendering device configured to render the decoded 360 degree video stream using the one or more tracking angles from the object tracking device to keep the detected object in a rendered view for one or more rendered frames.
4. The system of claim 3 , wherein the rendering device is further configured to:
receive one or more user-selected view angles as input;
render the decoded 360 degree video stream with the one or more user-selected view angles.
5. The system of claim 3 , wherein the rendering device is further configured to render the decoded 360 degree video stream back with the one or more tracking angles after a predetermined period of time of user inactivity.
6. The method of claim 2 , wherein the one or more video sequences are rendered back with one or more view angles from the plurality of predetermined view angles after a predetermined period of time of user inactivity.
7. The system of claim 3 , wherein the object is detected by the object tracking device in response to user input.
8. The system of claim 7 , wherein the user input is a selection to enter a tracking mode.
9. The system of claim 3 , wherein the detected object is detected by the object tracking device as closest to a center of current view of the rendered 360 degree video stream after a predetermined period of user inactivity.
10. The method of claim 1 , wherein the object is detected by the object tracking device in response to user input.
11. The method of claim 10 , wherein the user input is a selection to enter a tracking mode.
12. The method of claim 1 , wherein the detected object is detected by the object tracking device as closest to a center of current view of the rendered 360 degree video stream after a predetermined period of user inactivity.