Virtual reality experience sharing
A UE includes a communication unit, a display, at least one sensor, and a processor. The communication unit receives video from a server and the display renders a portion of the video. The sensor determines a pitch and a yaw of the portion of the video and a processor generates metadata that includes the pitch and the yaw.
1. A user equipment (UE) comprising:
a communication unit configured to receive a video from a server;
a display configured to render a portion of the video including a region of interest (ROI);
at least one sensor configured to determine a pitch and a yaw of the portion of the video; and
a processor configured to generate metadata, the metadata including a flag that represents a value, the pitch, and the yaw, wherein when the value of the flag is a first value, the flag indicates that a frame of the video uses a first set of coordinates for the ROI from a previous frame and when the value of the flag is a second value, the flag indicates that a frame of the video uses a second set of coordinates for the ROI that are interpolated from an anchor frame.
2. The UE of claim 1 , wherein the metadata further includes a frame identification that associates the frame to the pitch and the yaw.
3. The UE of claim 2 , wherein the metadata further includes a user ID that identifies a user of the UE.
4. The UE of claim 3 , wherein the communication unit is configured to transmit the metadata to the server.
5. The UE of claim 1 , wherein the communication unit is configured to receive additional metadata including a second pitch and a second yaw generated by another UE, and
the display is configured to render another portion of the video according to the second pitch and the second yaw.
6. The UE of claim 1 , wherein the metadata further includes a second flag configured to indicate whether a size of the ROI is fixed or dynamic.
7. The UE of claim 6 , wherein when the second flag indicates the size of the ROI is dynamic, the metadata further indicates a width and a height of the ROI in the portion of the video.
8. The UE of claim 6 , wherein when the second flag indicates the ROI is fixed the metadata does not include a width and a height of the ROI in the portion of the video.
9. The UE of claim 1 , further comprising an input button configured to retrieve the pitch and the yaw from the at least one sensor when the input button is actuated.
10. A user equipment (UE) comprising:
a communication unit configured to receive a video from a server;
a display configured to display a graphical user interface (GUI), the GUI including a rendering of a portion of the video including a region of interest (ROI); and
a processor configured to:
determine a pitch and a yaw when the ROI is selected by a user; and
generate metadata, the metadata including a flag that represents a value, the pitch, and the yaw, wherein when the value of the flag is a first value, the flag indicates that a frame of the video uses a first set of coordinates for the ROI from a previous frame and when the value of the flag is a second value, the flag indicates that a frame of the video uses a second set of coordinates for the ROI that are interpolated from an anchor frame.
11. The UE of claim 10 , wherein the metadata further includes a frame identification that associates the frame to the pitch and the yaw.
12. The UE of claim 11 , wherein the metadata further includes a user ID that identifies the user of the UE.
13. The UE of claim 12 , wherein the communication unit is configured to transmit the metadata to the server.
14. The UE of claim 10 , wherein:
the GUI is configured to display at least one ROI corresponding to another user;
the communication unit is configured to receive additional metadata including a second pitch and a second yaw generated by another UE when the at least one ROI is selected; and
the display is configured to render another portion of the video according to the second pitch and the second yaw.
15. The UE of claim 10 , wherein the metadata further includes a second flag configured to indicate whether a size of the ROI is fixed or a dynamic.
16. The UE of claim 15 , wherein when the second flag indicates the size of the ROI is dynamic, the metadata further indicates a width and a height of the ROI in the portion of the video.
17. The UE of claim 15 , wherein when the second flag indicates the ROI is fixed the metadata does not include a width and a height of the ROI in the portion of the video.
18. A method for sharing a portion of a video, the method comprising:
receiving the video from a server;
rendering the portion of the video including a region of interest (ROI);
determining a pitch and a yaw of the portion of the video; and
generating metadata, the metadata including a flag that represents a value, the pitch, and the yaw, wherein when the value of the flag is a first value, the flag indicates that a frame of the video uses a first set of coordinates for the ROI from a previous frame and when the value of the flag is a second value, the flag indicates that a frame of the video uses a second set of coordinates for the ROI that are interpolated from an anchor frame.
19. The method of claim 18 , wherein the metadata further includes a frame identification that associates the frame to the pitch and the yaw.
20. The method of claim 19 , further comprising transmitting the metadata to the server.