IP Library › Granted Patent US 11,205,246
Granted Patent B2
US 11,205,246 · App. 17/033,374 · Granted Dec 21, 2021

Spherical rotation for encoding wide view video

Inventor: Jill M. Boyce (Portland, OR)
Assignee: INTEL CORPORATION
G06T3/4038G06F3/012G06T3/0087G06T3/60G06T7/215H04N5/23238H04N19/70G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,205,246
App. No.
17/033,374
Granted
Dec 21, 2021
Kind
B2
Abstract

Spherical rotation is described for encoding a video that has a wide field of view, such as a spherical or hemispherical video. One example relates to receiving encoded video including rotation orientation metadata, decoding the video, extracting the rotation orientation metadata, rotating the decoded video based on the rotation orientation metadata, generating a view of the rotated decoded video, and buffering the generated view for display.

Claims (54)

1. An encoder comprising:

first circuitry to:

generate a sphere rotation supplemental enhancement information message associated with a video, the sphere rotation supplemental enhancement information message includes information on rotation angles yaw (α), pitch (β), and roll (γ) that are used for conversion between global coordinate axes and local coordinate axes, wherein roll corresponds to a rotation around an x-axis, pitch corresponds to a rotation around a y-axis, and yaw corresponds to a rotation around a z-axis, the sphere rotation supplemental enhancement information message includes:

sphere_rotation_cancel_flag, wherein the sphere_rotation_cancel_flag equals to 1 indicates that the sphere rotation supplemental enhancement information message cancels persistence of any previous sphere rotation supplemental enhancement information message;

sphere_rotation_persistence_flag, the sphere_rotation_persistence_flag specifies persistence of the sphere rotation supplemental enhancement information message for a current layer, wherein the sphere_rotation_persistence_flag equals to 0 to specifies that the sphere rotation supplemental enhancement information message applies to a current decoded picture only, wherein the sphere_rotation_persistence_flag equals to 1 specifies that the sphere rotation supplemental enhancement information message applies persists for the current layer until one or more conditions are met, and

at least one of:

yaw_rotation, wherein yaw_rotation specifies the value of the yaw rotation angle, wherein a 0 for yaw_rotation indicates that there is no yaw rotation,

pitch rotation, wherein pitch rotation specifies the value of the pitch rotation angle, wherein a 0 indicates that there is no pitch rotation, or

roll_rotation, wherein roll_rotation specifies the value of the roll_rotation angle, wherein a 0 for roll rotation indicates that there is no roll rotation; and

second circuitry to output the sphere rotation supplemental enhancement information message.

2. The encoder of claim 1 , wherein the sphere_rotation_cancel_flag equals to 0 indicates that sphere rotation information follows.

3. The encoder of claim 1 , wherein the one or more conditions include: a new coded layer video sequence (CLVS) of the current layer begins, a bitstream ends, or a picture in the current layer associated with a subsequent sphere rotation supplemental enhancement information message is output that follows a current picture in output order.

4. The encoder of claim 1 , wherein at least one of the yaw_rotation, the pitch_rotation, or the roll_rotation is in units of 2 −16 degrees.

5. The encoder of claim 1 , wherein at least one of the value of the yaw_rotation is equal to zero when the value of the yaw_rotation is not present, the value of the pitch_rotation is equal to zero when the value of the pitch_rotation is not present, or the value of the roll_rotation is equal to zero when the value of the roll_rotation is not present.

6. The encoder of claim 1 , wherein the second circuitry is to transmit the sphere rotation supplemental enhancement information message.

7. The encoder of claim 1 , wherein the second circuitry is to store the sphere rotation supplemental enhancement information message.

8. A system comprising:

memory;

at least one sensor;

a display;

a storage device;

communication circuitry; and

at least one processor to:

generate a sphere rotation supplemental enhancement information message associated with a video, the sphere rotation supplemental enhancement information message includes information on rotation angles yaw (α), pitch (β), and roll (γ) that are used for conversion between global coordinate axes and local coordinate axes, wherein roll corresponds to a rotation around an x-axis, pitch corresponds to a rotation around a y-axis, and yaw corresponds to a rotation around a z-axis, the sphere rotation supplemental enhancement information message includes:

sphere_rotation_cancel_flag, wherein the sphere_rotation_cancel_flag equals to 1 indicates that the sphere rotation supplemental enhancement information message cancels persistence of any previous sphere rotation supplemental enhancement information message;

sphere_rotation_persistence_flag, the sphere_rotation_persistence_flag specifies persistence of the sphere rotation supplemental enhancement information message for a current layer, wherein the sphere_rotation_persistence_flag equals to 0 to specifies that the sphere rotation supplemental enhancement information message applies to a current decoded picture only, wherein the sphere_rotation_persistence_flag equals to 1 specifies that the sphere rotation supplemental enhancement information message applies persists for the current layer until one or more conditions are met, and

at least one of:

yaw_rotation, wherein yaw_rotation specifies the value of the yaw rotation angle, wherein a 0 for yaw_rotation indicates that there is no yaw rotation,

pitch rotation, wherein pitch rotation specifies the value of the pitch rotation angle, wherein a 0 indicates that there is no pitch rotation, or

roll_rotation, wherein roll_rotation specifies the value of the roll rotation angle, wherein a 0 for roll_rotation indicates that there is no roll rotation.

9. The system of claim 8 , wherein the sphere_rotation_cancel_flag equals to 0 indicates that sphere rotation information follows.

10. The system of claim 8 , wherein the one or more conditions include: a new coded layer video sequence (CLVS) of the current layer begins, a bitstream ends, or a picture in the current layer associated with a subsequent sphere rotation supplemental enhancement information message is output that follows a current picture in output order.

11. The system of claim 8 , wherein at least one of the yaw_rotation, the pitch_rotation, or the roll_rotation is in units of 2 −16 degrees.

12. The system of claim 8 , wherein at least one of the value of the yaw_rotation is equal to zero when the value of the yaw_rotation is not present, the value of the pitch_rotation is equal to zero when the value of the pitch_rotation is not present, or the value of the roll_rotation is equal to zero when the value of the roll_rotation is not present.

13. The system of claim 8 , wherein the at least one processor is to cause output of the sphere rotation supplemental enhancement information message includes transmitting the sphere rotation supplemental enhancement information message.

14. The system of claim 8 , wherein the at least one processor is to cause the sphere rotation supplemental enhancement information message to be stored.

15. The system of claim 8 , further including a camera.

16. The system of claim 8 , further including a battery.

17. An encoder comprising:

first means for generating a sphere rotation supplemental enhancement information message associated with a video, the sphere rotation supplemental enhancement information message includes information on rotation angles yaw (α), pitch (β), and roll (γ) that are used for conversion between global coordinate axes and local coordinate axes, wherein roll corresponds to a rotation around an x-axis, pitch corresponds to a rotation around a y-axis, and yaw corresponds to a rotation around a z-axis, the sphere rotation supplemental enhancement information message includes:

sphere_rotation_cancel_flag, wherein the sphere_rotation_cancel_flag equals to 1 indicates that the sphere rotation supplemental enhancement information message cancels persistence of any previous sphere rotation supplemental enhancement information message;

sphere_rotation_persistence_flag, the sphere_rotation_persistence_flag specifies persistence of the sphere rotation supplemental enhancement information message for a current layer, wherein the

sphere_rotation_persistence_flag equals to 0 to specifies that the sphere rotation supplemental enhancement information message applies to a current decoded picture only, wherein the sphere_rotation_persistence_flag equals to 1 specifies that the sphere rotation supplemental enhancement information message applies persists for the current layer until one or more conditions are met, and

at least one of:

yaw_rotation, wherein yaw_rotation specifies the value of the yaw rotation angle, wherein a 0 for yaw_rotation indicates that there is no yaw rotation,

pitch_rotation, wherein pitch_rotation specifies the value of the pitch rotation angle, wherein a 0 indicates that there is no pitch rotation, or

roll_rotation, wherein roll rotation specifies the value of the roll rotation angle, wherein a 0 for roll_rotation indicates that there is no roll rotation; and

second means for outputting the sphere rotation supplemental enhancement information message.

18. The encoder of claim 17 , wherein the sphere_rotation_cancel_flag equals to 0 indicates that sphere rotation information follows.

19. The encoder of claim 17 , wherein the one or more conditions include: a new coded layer video sequence (CLVS) of the current layer begins, a bitstream ends, or a picture in the current layer associated with a subsequent sphere rotation supplemental enhancement information message is output that follows a current picture in output order.

20. The encoder of claim 17 , wherein at least one of the yaw_rotation, the pitch_rotation, and the roll_rotation is in units of 2 −16 degrees.

21. The encoder of claim 17 , wherein at least one of the value of the yaw_rotation is equal to zero when the value of the yaw_rotation is not present, the value of the pitch_rotation is equal to zero when the value of the pitch_rotation is not present, or the value of the roll_rotation is equal to zero when the value of the roll_rotation is not present.

22. The encoder of claim 17 , wherein the second means is to transmit the sphere rotation supplemental enhancement information message.

23. The encoder of claim 17 , wherein the second means is to store the sphere rotation supplemental enhancement information message.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2021
From: BOYCE, JILL M.
To: INTEL CORPORATION
Reel/Frame 055345/0299 →
Continuity (3)
Continuation 16341392
Provisional Application 62423319 · Nov 17, 2016
Related Publication 20210012460A1 · Jan 14, 2021