IP Library › Granted Patent US 12,356,006
Granted Patent B2
US 12,356,006 · App. 18/027,754 · Granted Jul 8, 2025

Method and apparatus for encoding volumetric video represented as a multiplane image

Inventors: Julien Fleureau (Rennes, FR); Renaud Dore (Rennes, FR); Bertrand Chupeau (Rennes, FR); Thierry Tapie (Rennes, FR)
Assignee: InterDigital CE Patent Holdings, SAS
H04N19/597G06T3/053G06T17/00H04N19/124H04N19/126G06T2200/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,006
App. No.
18/027,754
Granted
Jul 8, 2025
Kind
B2
Abstract

A method and a device for generating a data stream representative of a volumetric video generated from a sequence of multi-plane images are disclosed. A quantization law depending on an angular resolution used to generate patches from the multi-plane images is set up. For each intra-periods of the frame sequence, patches are generated for a given angular resolution. If generated patches do not fit in atlas images of a target size, the angular resolution is decreased and patches are generated again according to this new angular resolution.

Claims (18)

1. A method comprising:

generating patches by aggregating not totally transparent parts of a multi-plane image and by using a quantization law depending on an angular resolution, wherein the multi-plane image comprises a number of layers and is representative of a three-dimensional scene;

determining that the generated patches cannot be packed in an atlas image of a given size; and

responsive to the determining, decreasing the angular resolution and repeating generating patches.

2. The method of claim 1 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

3. The method of claim 1 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

4. A method for generating a sequence of atlas images from a sequence of multi-plane images according to claim 1 , wherein the generated sequence of atlas images is encoded as an intra-period of a video stream.

5. A device comprising a processor configured to perform:

generating patches by aggregating non totally transparent parts of a multi-plane image and by using a quantization law depending on an angular resolution, wherein the multi-plane image comprises a number of layers and is representative of a three-dimensional scene;

determining that the generated patches cannot be packed in an atlas image of a given size; and

responsive to the determining, decreasing the angular resolution and repeating generating patches.

6. The device of claim 5 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

7. The device of claim 5 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

8. A device comprising a processor configured to perform generating a sequence of atlas images from a sequence of multi-plane images according to the method of claim 1 , wherein the generated sequence of atlas images is encoded as an intra-period of a video stream.

9. The method of claim 4 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

10. The method of claim 4 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

11. The device of claim 8 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

12. The device of claim 8 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2023
From: FLEUREAU, JULIEN; DORE, RENAUD; CHUPEAU, BERTRAND; TAPIE, THIERRY
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 063064/0337 →
Priority Claims (1)
EP 20306076 · Sep 22, 2020 · regional
Continuity (1)
Related Publication 20230379495A1 · Nov 23, 2023
References Cited (19)
US 20120020549A1 · Lee · 2012 [cited by examiner]
US 20170188002A1 · Chan · 2017 [cited by examiner]
US 20200111237A1 · Tourapis · 2020 [cited by examiner]
US 20210192796A1 · Aflaki Beni · 2021 [cited by examiner]
US 20230362409A1 · Chupeau · 2023 [cited by examiner]
EP 3554074A1 · 2019 [cited by examiner]
GB 2572996A · 2019 [cited by applicant]
Anonymous, “Test model 4 for Immersive video”, International Organization for Standardization, Coding of Moving Pictures and Audio, ISO/IEC JTC 1/SC 29/WG 11, Document: N19002, Brussels, Belgium, Jan. 2020, 45 pages. [cited by applicant]
Thudor et al., “Interdigital CE-1.1.2 experiment”, International Organization for Standardization, Coding of Moving Pictures and Audio, ISO/IEC JTC 1/SC 29/WG 11, Document: MPEG2020/m54419, MPEG131 online, Jul. 2020, 12… [cited by applicant]
Graziosi et al., “An overview of ongoing point cloud compression standardization activities: video-based (V-PCC) and geometry-based (G-PCC)”, Asia Pacific Signal and Information Processing Association (APSIPA), Transact… [cited by applicant]
Zhou et al., “Stereo Magnification: Learning View Synthesis using Multiplane Images”, Association for Computing Machinery, ACM Transactions on Graphics, vol. 37, Issue 4, Article 65, Aug. 2018, 12 pages. [cited by applicant]
De Rivaz et al., “AV1 Bitstream & Decoding Process Specification”, The Alliance for Open Media, Version 1.0.0, Jun. 25, 2018, 677 pages. [cited by applicant]
Ochotta et al., “Image-Based Surface Compression”, Computer Science, Computer Graphics Forum, vol. 27, Issue No. 6, Sep. 1, 2008, 15 pages. [cited by applicant]
Anonymous, “Terminal Equipment and Protocols for Telematic Services”, Information Technology—Digital Compression and Coding of Continuous-Tone Still images—Requirements and Guidelines, International Telecommunication Un… [cited by applicant]
Anonymous, “Information Technology—Coding of Audio-Visual Objects—Part 10: Advanced Video Coding”, International Standard, ISO/IEC 14496-10, Second Edition, Oct. 1, 2004, 280 pages. [cited by applicant]
ITU_T, “Advanced video coding for generic audiovisual services”, ITU-T H.264, International Telecommunication Union, ITU-T Telecommunication Standardization Sector of ITU, Series H: Audiovisual and Multimedia Systems, I… [cited by applicant]
ITU-T, “High Efficiency Video Coding”, Recommendation ITU-T H.265, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Oct. 2014, 540 pages. [cited by applicant]
Anonymous, “High Efficiency Video Coding”, ITU-T Telecommunication Standardization Sector of Itu, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Recommendati… [cited by applicant]
Grange, et al., “VP9 Bitstream & Decoding Process Specification”, Version 0.6, Mar. 31, 2016, 171 pages. [cited by applicant]