Systems and methods for personalized spatial video/light field content delivery
Systems and methods are provided herein for streaming immersive content to a device. This may be accomplished by a system displaying a piece of media on a display in a first format and determining that the piece of media is approaching a segment of the piece of media that is available in a second format (e.g., light field content). In response to determining that the upcoming segment is available in the second format, the system can use one or more sensors to determine a position of a user in relation to the display. The system can then send a request for the piece of media in the second format, wherein the request comprises the position of the user. The system can then receive and display the segment of the piece of media in the second format, wherein the segment is customized according to the position of the user.
1. A method comprising:
displaying, on a device, a first segment of a plurality of segments in a two-dimensional format, wherein:
the plurality of segments correspond to a piece of media; and
each segment of the plurality of segments corresponds to a time period of the piece of media;
determining that the first segment of the plurality of segments can be displayed in a three-dimensional format;
determining that the piece of media is approaching a second segment of the plurality of segments;
displaying, on the device, a selectable option indicating the availability of the first segment in the three-dimensional format based, at least in part, on determining that the piece of media is approaching the second segment of the plurality of segments;
receiving an input from the user corresponding to the selectable option;
determining a position of a user in relation to the device;
sending a request for the first segment of the plurality of segments in the three-dimensional format, wherein:
the request identifies the first segment of the plurality of segments and the position of the user; and
the request is sent based, at least in part, on receiving the input from the user corresponding to the selectable option
receiving the first segment of the plurality of segments in the three-dimensional format; and
replaying, on the device, the first segment of the plurality of segments in the three-dimensional format.
2. The method of claim 1 , further comprising determining a preference corresponding to the user using a database of stored preferences, wherein the preference corresponds to displaying the piece of media in the three-dimensional format, wherein displaying, on the device, the selectable option indicating the availability of the first segment in the three-dimensional format is based, at least in part, on determining the preference.
3. The method of claim 1 , wherein the selectable option also indicates the availability of the first segment in the three-dimensional format from a different point of view.
4. The method of claim 1 , further comprising displaying, on the device, the second segment of the plurality of segments in the two-dimensional format, wherein the second segment of the plurality of segments is displayed in the two-dimensional format after the first segment of the plurality of segments is replayed in the three-dimensional format.
5. The method of claim 1 , further comprising:
receiving the first segment of a plurality of segments in the two-dimensional format using a first protocol; and
receiving the first segment of the plurality of segments in the three-dimensional format using a second protocol.
6. The method of claim 5 , wherein the first protocol is an adaptive streaming protocol.
7. The method of claim 5 , wherein the second protocol is a real-time transport protocol.
8. The method of claim 1 , further comprising:
determining a second position of the user in relation to the device;
sending a second request for the first segment of the plurality of segments in the three-dimensional format, wherein the second request identifies the first segment of the plurality of segments and the second position of the user; and
receiving a second version of the first segment of the plurality of segments in the three-dimensional format relating to the second position; and
displaying the second version of the first segment of the plurality of segments in the three-dimensional format.
9. An apparatus, comprising:
control circuitry; and
at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the control circuitry, cause the apparatus to perform at least the following:
display a first segment of a plurality of segments in a two-dimensional format, wherein:
the plurality of segments correspond to a piece of media; and
each segment of the plurality of segments corresponds to a time period of the piece of media;
determine that the first segment of the plurality of segments can be displayed in a three-dimensional format;
determine that the piece of media is approaching a second segment of the plurality of segments;
display a selectable option indicating the availability of the first segment in the three-dimensional format based, at least in part, on determining that the piece of media is approaching the second segment of the plurality of segments;
receive an input from the user corresponding to the selectable option;
determine a position of a user in relation to the apparatus;
send a request for the first segment of the plurality of segments in the three-dimensional format, wherein;
the request identifies the first segment of the plurality of segments and the position of the user; and
the request is sent based, at least in part, on receiving the input from the user corresponding to the selectable option;
receive the first segment of the plurality of segments in the three-dimensional format; and
replay the first segment of the plurality of segments in the three-dimensional format.
10. The apparatus of claim 9 , wherein the apparatus is further caused to determine a preference corresponding to the user using a database of stored preferences, wherein the preference corresponds to displaying the piece of media in the three-dimensional format, wherein the apparatus is caused to display the selectable option indicating the availability of the first segment in the three-dimensional format based, at least in part, on determining the preference.
11. The apparatus of claim 9 , wherein the selectable option also indicates the availability of the first segment in the three-dimensional format from a different point of view.
12. The apparatus of claim 11 , wherein the apparatus is further caused to display the second segment of the plurality of segments in the two-dimensional format, wherein the second segment of the plurality of segments is displayed in the two-dimensional format after the first segment of the plurality of segments is replayed in the three-dimensional format.
13. The apparatus of claim 9 , wherein the apparatus is further caused to:
receive the first segment of a plurality of segments in the two-dimensional format using a first protocol; and
receive the first segment of the plurality of segments in the three-dimensional format using a second protocol.
14. The apparatus of claim 13 , wherein the first protocol is an adaptive streaming protocol.
15. The apparatus of claim 13 , wherein the second protocol is a real-time transport protocol.
16. The apparatus of claim 9 , wherein the apparatus is further caused to:
determine a second position of the user in relation to the apparatus;
send a second request for the first segment of the plurality of segments in the three-dimensional format, wherein the second request identifies the first segment of the plurality of segments and the second position of the user;
receive a second version of the first segment of the plurality of segments in the three-dimensional format relating to the second position; and
display the second version of the first segment of the plurality of segments in the three-dimensional format.
17. The method of claim 1 , further comprising:
determining that the first segment of the plurality of segments corresponds to a first time period of the piece of media;
determining that the second segment of the plurality of segments corresponds to a second time period of the piece of media; and
displaying the selectable option a first length of time before the second time period.
18. The method of claim 1 , further comprising:
displaying, on the device, a second selectable option indicating a first point of view and a second point, wherein the second selectable option is displayed based, at least in part, on receiving the input from the user corresponding to the selectable option;
receiving a second input from the user corresponding to the first point of view, wherein:
the request identifies the first segment of the plurality of segments, the position of the user, and the first point of view; and
the first segment of the plurality of segments in replayed in the three-dimensional format from the first point of view.
19. A non-transitory computer-readable medium having instructions encoded thereon that, when executed by control circuitry, cause the control circuitry to:
generate for display a first segment of a plurality of segments in a two-dimensional format, wherein the plurality of segments correspond to a piece of media; and
determine that the first segment of the plurality of segments can be displayed in a three-dimensional format;
determine that the piece of media is approaching a second segment of the plurality of segments;
generate for display a selectable option indicating the availability of the first segment in the three-dimensional format based, at least in part, on determining that the piece of media is approaching the second segment of the plurality of segments;
receive an input from the user corresponding to the selectable option;
determine a position of a user in relation to the apparatus;
send a request for the first segment of the plurality of segments in the three-dimensional format, wherein:
the request identifies the first segment of the plurality of segments and the position of the user; and
the request is sent based, at least in part, on receiving the input from the user corresponding to the selectable option;
receive the first segment of the plurality of segments in the three-dimensional format; and
generate for replay the first segment of the plurality of segments in the three-dimensional format.