Granted Patent B2

US 12,389,034 · App. 18/029,593 · Granted Aug 12, 2025

Inventors: Bertrand Chupeau (Rennes, FR); Franck Thudor (Rennes, FR); Renaud Dore (Rennes, FR)

Assignee: InterDigital CE Patent Holdings, SAS

H04N19/597G06V10/54G06V10/762H04N13/178H04N19/124H04N19/59

Abstract

Claims (47)

1. A method comprising:

obtaining a multiplane image representative of a three-dimensional (3D) scene, wherein layers of the multiplane image have a constant depth value and comprise a texture component, a transparency component, and a depth component, the depth component being determined according to a quantization law relative to the constant depth value of the layer;

generating patch pictures by clustering layers of the multiplane image on a transparency basis;

packing the patch pictures in at least one atlas image;

generating first metadata comprising, for each layer of the multiplane image, the constant depth value of the layer and one or more parameters representative of the quantization law relative to the constant depth value of the layer;

generating second metadata associating a patch picture with a layer of the multiplane image; and

encoding the at least one atlas image, the first metadata, and the second metadata in a data stream.

2. The method of claim 1 , wherein the texture component of the patch pictures is stored in a texture atlas image, wherein the transparency component of the patch pictures is stored in a transparency atlas image, and wherein the depth component of the patch pictures is stored in a depth atlas image.

3. The method of claim 2 , wherein the depth atlas image is downscaled.

4. The method of claim 1 , wherein the patch pictures comprise a texture component, a transparency component, and a depth component.

5. A device comprising circuitry, comprising a processor and a memory, configured for:

obtaining a multiplane image representative of a three-dimensional (3D) scene, wherein layers of the multiplane image have a constant depth value and comprise a texture component, a transparency component, and a depth component, the depth component being determined according to a quantization law relative to the constant depth value of the layer;

generating patch pictures by clustering layers of the multiplane image on a transparency basis;

packing the patch pictures in at least one atlas image;

generating first metadata comprising, for each layer of the multiplane image, the constant depth value of the layer and one or more parameters representative of the quantization law relative to the constant depth value of the layer;

generating second metadata associating a patch picture with a layer of the multiplane image; and

encoding the at least one atlas image, the first metadata, and the second metadata in a data stream.

6. The device of claim 5 , wherein the texture component of the patch pictures is stored in a texture atlas image, wherein the transparency component of the patch pictures is stored in a transparency atlas image, and wherein the depth component of the patch pictures is stored in a depth atlas image.

7. The device of claim 6 , wherein the depth atlas image is downscaled.

8. The device of claim 5 , wherein the patch pictures comprise a texture component, a transparency component, and a depth component.

9. A method comprising:

retrieving, from a data stream, at least one atlas image packing patch pictures comprising a texture component, a transparency component, and a depth component;

retrieving, from the data stream, first metadata comprising, for each layer of a multiplane image representative of a three-dimensional (3D) scene, a constant depth value and one or more parameters representative of a quantization law relative to the constant depth value of the layer;

retrieving, from the data stream, second metadata associating each patch picture with a layer of the multiplane image;

building the multiplane image according to the first metadata and the second metadata; and

rendering a viewport image of the 3D scene with the multiplane image, wherein the depth component of each patch picture is inverse quantized according to the quantization law relative to the constant depth value of the layer associated with the patch picture in the second metadata.

10. The method of claim 9 , wherein the texture component of the patch pictures is retrieved from a texture atlas image, wherein the transparency component of the patch pictures is retrieved from a transparency atlas image, and wherein the depth component of the patch pictures is retrieved from a depth atlas image.

11. The method of claim 10 , wherein the depth atlas image is upscaled.

12. A device comprising circuitry, comprising a processor and a memory, configured for:

retrieving, from a data stream, at least one atlas image packing patch pictures comprising a texture component, a transparency component, and a depth component;

retrieving, from the data stream, first metadata comprising, for each layer of a multiplane image representative of a three-dimensional (3D) scene, a constant depth value and one or more parameters representative of a quantization law relative to the constant depth value of the layer;

retrieving, from the data stream, second metadata associating each patch picture with a layer of the multiplane image;

building the multiplane image according to the first metadata and the second metadata; and

rendering a viewport image of the 3D scene with the multiplane image, wherein the depth component of each patch picture is inverse quantized according to the quantization law relative to the constant depth value of the layer associated with the patch picture in the second metadata.

13. The device of claim 12 , wherein the texture component of the patch pictures is retrieved from a texture atlas image, wherein the transparency component of the patch pictures is retrieved from a transparency atlas image, and wherein the depth component of the patch pictures is retrieved from a depth atlas image.

14. The device of claim 13 , wherein the depth atlas image is upscaled.

15. A non-transitory computer readable medium having stored thereon instructions for causing one or more processors to perform a method comprising:

obtaining a multiplane image representative of a three-dimensional (3D) scene wherein layers of the multiplane image have a constant depth value and comprise a texture component, a transparency component, and a depth component, the depth component being determined according to a quantization law relative to the constant depth value of the layer;

generating patch pictures by clustering layers of the multiplane image on a transparency basis;

packing the patch pictures in at least one atlas image;

generating first metadata comprising, for each layer of the multiplane image, the constant depth value of the layer and one or more parameters representative of the quantization law relative to the constant depth value of the layer;

generating second metadata associating a patch picture with a layer of the multiplane image; and

encoding the at least one atlas image, the first metadata, and the second metadata in a data stream.

16. The non-transitory computer readable medium of claim 15 , wherein the texture component of the patch pictures is stored in a texture atlas image, wherein the transparency component of the patch pictures is stored in a transparency atlas image, and wherein the depth component of the patch pictures is stored in a depth atlas image.

17. The non-transitory computer readable medium of claim 16 , wherein a size of the depth atlas image is smaller than a size of the other atlases.

18. The non-transitory computer readable medium of claim 16 , wherein the patch pictures comprise a texture component, a transparency component, and a depth component.

19. The non-transitory computer readable medium of claim 16 , wherein the depth atlas image is downscaled.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (46)