Extended scene view
The disclosure provides methods and content consumption devices that enable a scene, for example a 360° scene, that is larger (i.e. has more pixels in at least one dimension) than a display format of the content consumption device to be displayed. Constituent scene views are received individually by the content consumption device, for example as broadcasts, and are combined, for example stitched together, at the content consumption device to output a part of the scene that fits in the display format. The part of the scene (and hence the required constituent streams) to be displayed are determined by a signal, for example a navigational input from a user, enabling the user to navigate in the scene. By, for example, receiving a limited number of scene streams based on the scene streams required to produce the view that fits in the display format based on the signal, bandwidth requirements to view and navigate within the scene.
1 . A content-consumption device comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
receive two or more video streams of a plurality of video streams, each video stream of the plurality of video streams corresponding to a respective field of view of a scene, wherein the plurality of video streams are combinable into a combined stream corresponding to the scene;
receive a signal indicating an output portion of the scene to be output by the content-consumption device, wherein the output portion corresponds to a reduced field of view, the reduced field of view being smaller than a field of view associated with the combined stream;
combine the two or more video streams to produce an output video stream corresponding to the output portion, the output video stream corresponding to the reduced field of view; and
output the output video stream.
2 . The content-consumption device of claim 1 , wherein the at least one processor is configured to:
determine a field of view of a display device; and
determine the output portion of the scene based on the field of view of the display device.
3 . The content-consumption device of claim 2 , wherein the display device comprises a head-mounted display.
4 . The content-consumption device of claim 3 , wherein determining the field of view of the display device comprises tracking an orientation the head-mounted display.
5 . The content-consumption device of claim 2 , wherein the content-consumption device comprises the display device.
6 . The content-consumption device of claim 2 , wherein the display device is separate from the content-consumption device and wherein, to output the output video stream, the at least one processor is configured to cause at least one transmitter to transmit the output video stream to the display device.
7 . A content-consumption device comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
receive two or more video streams of a plurality of video streams, each video stream of the plurality of video streams corresponding to a respective field of view of a scene, wherein the plurality of video streams are combinable into a combined stream corresponding to the scene;
obtain a field of view of a display device, wherein the field of view of the display device is smaller than a field of view associated with the combined stream;
combine the two or more video streams to produce an output video stream corresponding to the field of view of the display device; and
output the output video stream to the display device.
8 . The content-consumption device of claim 7 , wherein the display device comprises a head-mounted display.
9 . The content-consumption device of claim 8 , further comprising determining the field of view of the display device by tracking an orientation the head-mounted display.
10 . The content-consumption device of claim 7 , wherein the content-consumption device comprises the display device.
11 . The content-consumption device of claim 7 , wherein the display device is separate from the content-consumption device and wherein, to output the output video stream to the display device, the at least one processor is configured to cause at least one transmitter to transmit the output video stream to the display device.
12 . A method of processing video streams at a content-consumption device, the method comprising:
receiving two or more video streams of a plurality of video streams, each video stream of the plurality of video streams corresponding to a respective field of view of a scene, wherein the plurality of video streams are combinable into a combined stream corresponding to the scene;
receiving a signal indicating an output portion of the scene to be output by the content-consumption device, wherein the output portion corresponds to a reduced field of view, the reduced field of view being smaller than a field of view associated with the combined stream;
combining the two or more video streams to produce an output video stream corresponding to the output portion, the output video stream corresponding to the reduced field of view; and
outputting the output video stream.
13 . The method of claim 12 , further comprising:
determining a field of view of a display device; and
determining the output portion of the scene based on the field of view of the display device.
14 . The method of claim 13 , wherein the display device comprises a head-mounted display.
15 . The method of claim 14 , wherein determining the field of view of the display device comprises tracking an orientation the head-mounted display.
16 . The method of claim 13 , wherein the content-consumption device comprises the display device.
17 . The method of claim 13 , wherein the display device is separate from the content-consumption device and wherein outputting the output video stream comprises transmitting the output video stream to the display device.
18 . A method of processing video streams at a content-consumption device, the method comprising:
receiving two or more video streams of a plurality of video streams, each video stream of the plurality of video streams corresponding to a respective field of view of a scene, wherein the plurality of video streams are combinable into a combined stream corresponding to the scene;
obtaining a field of view of a display device, wherein the field of view of the display device is smaller than a field of view associated with the combined stream;
combining the two or more video streams to produce an output video stream corresponding to the field of view of the display device; and
outputting the output video stream to the display device.
19 . The method of claim 18 , wherein the display device comprises a head-mounted display.
20 . The method of claim 19 , further comprising determining the field of view of the display device by tracking an orientation the head-mounted display.