IP Library Granted Patent US 11,044,455
Granted Patent B2
US 11,044,455 · App. 16/372,804 · Granted Jun 22, 2021

Multiple-viewpoints related metadata transmission and reception method and apparatus

Inventor: Sejin Oh (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N13/178H04N5/23238H04N13/117H04N13/161
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,044,455
App. No.
16/372,804
Granted
Jun 22, 2021
Kind
B2
Abstract

Disclosed is a 360-degree video data processing method performed by a 360-degree video transmission apparatus, the method comprising: obtaining 360-degree video data captured by at least one image obtaining device; deriving a two-dimensional (2D) picture comprising omnidirectional image by processing the 360-degree video data; generating metadata for the 360-degree video data; encoding information on the 2D picture; and performing encapsulation based on the encoded picture and the metadata, wherein the metadata comprises information on viewpoint group ID, and wherein multiple-viewpoints related to the 360-degree video data are categorized into at least one viewpoint group based on the viewpoint group ID.

Claims (56)

1. A 360-degree video data processing method performed by a 360-degree video transmission apparatus, the method comprising:

obtaining 360-degree video data;

deriving a two-dimensional (2D) picture by processing the 360-degree video data;

generating metadata;

encoding the 2D picture; and

performing encapsulation based on the encoded picture and the metadata,

wherein:

the metadata comprises information that viewpoints are dynamically switching over time, and

the information comprises a group identification which indicates a group identifier,

the metadata comprises a transition effect flag indicating whether to apply a transition effect when viewpoint switching,

the metadata comprises transition effect type information when the transition effect flag indicates a predetermined value, and the transition effect type information comprises information on a zoom-in effect when a value of a transition effect type is 0 and the transition effect type information comprises information on a walking-through effect when the value of the transition effect type is 1.

2. The method of claim 1 , wherein:

multiple-viewpoints related to the 360-degree video data are categorized into at least one viewpoint group based on the group identification,

the multiple-viewpoints comprise a first viewpoint and a second viewpoint, and

when a group identification of the first viewpoint and a group identification of the second viewpoint are same, the first viewpoint and the second viewpoint are comprised in a first viewpoint group.

3. The method of claim 2 , wherein the first viewpoint and the second viewpoint comprised in the first viewpoint group share a common reference coordinate system.

4. The method of claim 2 , wherein the multiple-viewpoints comprise a third viewpoint which is comprised in a second viewpoint group different from the first viewpoint group, and

wherein a common reference coordinate system for the first viewpoint and a common reference coordinate system for the third viewpoint are different from each other.

5. The method of claim 1 , wherein the metadata comprises description information for one of the at least one viewpoint group.

6. The method of claim 5 , wherein the description information is based on a null-terminated UTF-8 (Universal coded character set+Transformation Format-8 bit) string.

7. The method of claim 1 , wherein the metadata comprises information on location of a center point of a fourth viewpoint comprised in the multiple-viewpoints.

8. The method of claim 7 , wherein the information on the location of the center point of the fourth viewpoint is represented based on a common reference coordinate system of a viewpoint group comprising the fourth viewpoint.

9. The method of claim 3 , wherein viewpoint switching is performed between the first viewpoint and the second viewpoint included in the first viewpoint group.

10. The method of claim 9 , wherein the transition effect is applied when the first view point is switched to the second view point upon the viewpoint switching.

11. A 360-degree video transmission apparatus for processing 360-degree video data, the apparatus comprising:

a projection processor configured to derive a two-dimensional (2D) picture by processing 360-degree video data;

a metadata processor configured to generate metadata;

a data encoder configured to encode the 2D picture; and

an encapsulation processor configured to perform encapsulation based on the 2D picture and the metadata,

wherein:

the metadata comprises information that viewpoints are dynamically switching over time, and

the information comprises a group identification which indicates a group identifier,

the metadata comprises a transition effect flag indicating whether to apply a transition effect when viewpoint switching,

the metadata comprises transition effect type information when the transition effect flag indicates a predetermined value, and

the transition effect type information comprises information on a zoom-in effect when a value of a transition effect type is 0 and the transition effect type information comprises information on a walking-through effect when the value of the transition effect type is 1.

12. A 360-degree video data processing method performed by a 360-degree video reception apparatus, the method comprising:

receiving 360-degree video data including encoded picture;

obtaining metadata of the 360-degree video data;

decoding the encoded picture; and

rendering the decoded picture based on the metadata,

wherein:

the metadata comprises information that viewpoints are dynamically switching over time, and

the information comprises a group identification which indicates a group identifier,

the metadata comprises a transition effect flag indicating whether to apply a transition effect when viewpoint switching,

the metadata comprises transition effect type information when the transition effect flag indicates a predetermined value, and

the transition effect type information comprises information on a zoom-in effect when a value of a transition effect type is 0 and the transition effect type information comprises information on a walking-through effect when the value of the transition effect type is 1.

13. A 360-degree video reception apparatus for processing 360-degree video data, the apparatus comprising:

a receiver configured to receive 360-degree video data including encoded picture;

a data decoder configured to decoded the encoded picture; and

a renderer configured to render the decoded picture based on metadata derived from the 360 -degree video data,

wherein:

the metadata comprises information that viewpoints are dynamically switching over time, and

the information comprises a group identification which indicates a group identifier,

the metadata comprises a transition effect flag indicating whether to apply a transition effect when viewpoint switching,

the metadata comprises transition effect type information when the transition effect flag indicates a predetermined value, and

the transition effect type information comprises information on a zoom-in effect when a value of a transition effect type is 0 and the transition effect type information comprises information on a walking-through effect when the value of the transition effect type is 1.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2019
From: OH, SEJIN
To: LG ELECTRONICS INC.
Reel/Frame 048767/0084 →
Continuity (2)
Provisional Application 62653490 · Apr 5, 2018
Related Publication 20190313081A1 · Oct 10, 2019
Cited By (1)
US 12,711,730