IP Library › Granted Patent US 12,532,019
Granted Patent B2
US 12,532,019 · App. 18/097,037 · Granted Jan 20, 2026

Method for decoding immersive video and method for encoding immersive video

Inventors: Gwang Soon Lee (Daejeon, KR); Kwan Jung Oh (Daejeon, KR); Jun Young Jeong (Daejeon, KR)
Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
H04N19/48H04N19/136H04N19/167H04N19/17H04N19/70G06V20/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,532,019
App. No.
18/097,037
Granted
Jan 20, 2026
Kind
B2
Abstract

A method of processing an immersive video includes classifying each of a plurality of objects included in a view image as one of a first object group and a second object group, acquiring a patch for each of the plurality of objects, and packing patches to generate at least one atlas. In this instance, patches derived from objects belonging to the first object group may be packed in a different region or a different atlas from a region or an atlas of patches derived from objects belonging to the second object group.

Claims (42)

1 . A method of processing an immersive image, the method comprising:

classifying each of a plurality of objects included in a view image into one of a first object group and a second object group;

obtaining first patches for the first object group and second patches for the second object group;

generating one or more atlases by packing the first patches and the second patches; and

encoding the one or more atlases,

wherein the first patches derived from the first object group are packed in a different region or a different atlas from the second patches derived from the second object group, and

wherein a first region or a first atlas in which the first patches are packed and a second region or a second atlas in which the second patches are packed are encoded independently of each other.

2 . The method according to claim 1 , wherein the region represents a tile, a slice, or a subpicture.

3 . The method according to claim 1 , wherein the first atlas and the second atlas are repacked in a third atlas, and

wherein the third atlas is encoded instead of separately encoding the first atlas and the second atlas.

4 . The method according to claim 1 , wherein a first syntax indicating whether information on a first object is included in an atlas is encoded in a bitstream.

5 . The method according to claim 4 , wherein, when the information on the first object is included in the first atlas, a second syntax, indicating whether the information included in the atlas is sufficient to completely represent the first object, is further encoded in the bitstream.

6 . The method according to claim 4 , wherein, when the information on the first object is included in the first atlas, a third syntax, which indicates priority of the first object, is further encoded in the bitstream.

7 . The method according to claim 1 , wherein the first object group comprises a first object included in

a first image of a first type and the second object group comprises a second object included in a second image of a second type,

wherein information indicating a type of an image from which patches are extracted is encoded for each of the first region and the second region, or for each of the first atlas and the second atlas.

8 . The method according to claim 7 , wherein the information indicates one of an MIV type and a V-PCC type.

9 . The method according to claim 1 , wherein identification information for identifying each of the first object group and the second object group is encoded into a bitstream.

10 . A method of rendering an immersive image, the method comprising:

receiving a bitstream;

decoding one or more atlases from the bitstream; and

rendering a viewport image using the decoded one or more atlases,

wherein the first patches for the first object group are present in a different region or a different atlas from the second patches for the second object group, and

wherein a first region or a first atlas in which the first patches are present and a second region or a second atlas in which the second patches are present are decoded independently of each other.

11 . The method according to claim 10 , wherein a first syntax indicating whether information on a first object is present in an atlas is decoded from the bitstream, and

wherein, in response to the first syntax indicating that the information on the first object is present in the atlas, a second syntax indicating whether the information in the atlas is sufficient to completely represent the first object is further decoded from the bitstream.

12 . The method according to claim 10 , wherein, in response to the first syntax indicating that the information on the first object is present in the atlas, a third syntax indicating priority of the first object is further decoded from the bitstream.

13 . The method according to claim 12 , wherein arrangement order of the first object while rendering a viewport image is determined based on the priority of the first object.

14 . The method according to claim 13 , wherein

in a case where the priority of the first object is higher than a priority of a second object, the first object is disposed ahead of the second object while rendering the viewport image, and

wherein in a case where the priority of the first object is lower than the priority of the second object, the second object is disposed ahead of the first object while rendering the viewport image.

15 . The method according to claim 10 , wherein the first object group comprises a first object included in a first image of a first type and the second object group comprises a second object included in a second image of a second type, and

wherein information indicating a type of an image whether an object is derived from is decoded from the bitstream.

16 . The method according to claim 15 , wherein the information indicates one of an MIV type and a V-PCC type.

17 . The method according to claim 14 , wherein a weight of each of pixels for blending is determined based on the priority of each of the first object and the second object while rendering the viewport image.

18 . A non-transitory computer-readable recording medium recording instructions when executed cause a processor or a computer to carry out a method of processing an immersive image, the method comprising:

classifying each of a plurality of objects included in a view image into one of a first object group and a second object group;

obtaining first patches for the first object group and second patches for the second object group;

generating one or more atlases by packing the first patches and the second patches, and

encoding the one or more atlases,

wherein the first patches derived from the first object group are packed in a different region or a different atlas from the second patches derived from the second object group, and

wherein a first region or a first atlas in which the first patches are packed and a second region or a second atlas in which the second patches are packed are encoded independently of each other.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2023
From: LEE, GWANG SOON; OH, KWAN JUNG; JEONG, JUN YOUNG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 062376/0122 →
Priority Claims (3)
KR 10-2022-0006202 · Jan 14, 2022 · national
KR 10-2022-0048527 · Apr 19, 2022 · national
KR 10-2022-0183562 · Dec 23, 2022 · national
Continuity (1)
Related Publication 20230232031A1 · Jul 20, 2023
References Cited (6)
US 20210329209A1 · Lee et al. · 2021 [cited by applicant]
US 20210383122A1 · Jeong et al. · 2021 [cited by applicant]
US 20230042874A1 · Dore · 2023 [cited by examiner]
KR 1020200112737 · 2020 [cited by applicant]
KR 1020210084242 · 2021 [cited by applicant]
“Information technology—Coded representation of immersive media—Part 12: MPEG Immersive video”, ISO/IEC 23090-12:2021(E), 2021, 81 total pages. [cited by applicant]