IP Library Granted Patent US 11,367,247
Granted Patent B2
US 11,367,247 · App. 16/766,355 · Granted Jun 21, 2022

Method, apparatus and stream for encoding/decoding volumetric video

Inventors: Franck Thudor (Cesson-Sevigne, FR); Bertrand Chupeau (Cesson-Sevigne, FR); Renaud Dore (Cesson-Sevigne, FR); Thierry Tapie (Cesson-Sevigne, FR); Julien Fleureau (Cesson-Sevigne, FR)
Assignee: InterDigital VC Holdings, Inc.
G06T15/08G06T7/75G06T15/04G06T17/10H04N19/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,367,247
App. No.
16/766,355
Filed
May 22, 2020
Granted
Jun 21, 2022
Kind
B2
Examiner
MA, TIZE
Art Unit
2613
USPC
345/424
Abstract

Encoding/decoding data representative of a 3D representation of a scene according to a range of points of view can involve generating a depth map associated with a part of the 3D representation according to a parameter representative of a two-dimensional parameterization associated with the part and data associated with a point included in the part, wherein the two-dimensional parameterization can be responsive to geometric information associated with the point and to pose information associated with the range of points of view. A texture map associated with the part can be generated according to the parameter and data associated with the point. First information representative of point density of points in a part of the part can be obtained. The depth map, texture map, parameter, and first information can be included in respective syntax elements of a bitstream.

Claims (28)

1. A method of encoding a three-dimensional point cloud in a bitstream, the method comprising, for at least a part of the three-dimensional point cloud:

determining a depth map and a texture map of the part of the three-dimensional point cloud according to a two-dimensional parametrization responsive to geometric characteristics of the part and pose information associated with a range of points of view used to capture the three-dimensional point cloud;

obtaining a first information comprising an indication of whether the part has a point density below a determined density value; and

encoding, into the bitstream, the depth map, the texture map, the two-dimensional parametrization, the first information, and a second information representative of a mapping between the two-dimensional parametrization and the depth map and the texture map.

2. The method according to claim 1 , wherein the first information is obtained by detecting at least a boundary between objects of the point cloud in at least an image of the point cloud according to a point of view comprised in the range of points of view.

3. The method according to claim 1 , wherein the first information is obtained by calculating a number of points comprised in the part and by comparing the point density with the determined density value.

4. A non-transitory computer readable medium comprising computer-executable instructions to enable a processor to perform the method of claim 1 .

5. A non-transitory computer readable medium storing data content generated according to the method of claim 1 .

6. A device for encoding a three-dimensional point cloud in a bitstream, the device comprising a processor configured to, for at least a part of the three-dimensional point cloud:

determine a depth map and a texture map of the part of a three-dimensional point cloud according to a two-dimensional parametrization responsive to geometric characteristics of the part and pose information associated with a range of points of view used to capture the three-dimensional point cloud;

obtain a first information comprising an indication of whether the part has a point density below a determined density value;

encode, into the bitstream, the depth map, the texture map, the two-dimensional parametrization, the first information, and a second information representative of a mapping between the two-dimensional parametrization and the depth map and the texture map.

7. The device according to claim 6 , wherein the first information is obtained by detecting at least a boundary between objects of the point cloud in at least an image of the point cloud according to a point of view comprised in the range of points of view.

8. The device according to claim 6 , wherein the first information is obtained by calculating a number of points comprised in the part and by comparing the point density with the determined density value.

9. A non-transitory computer readable medium storing data content generated by the device of claim 6 .

10. A method comprising, for at least one part of a three-dimensional point cloud:

decoding, from a bitstream, a two-dimensional parametrization responsive to geometric characteristics of the part and pose information associated with a range of points of view used to capture the three-dimensional point cloud;

decoding, from the bitstream, a texture map and a depth map of the part;

de-projecting the texture map and the depth map according to a first information obtained from the bitstream and comprising an indication of whether the part has a point density below a determined density value, and a second information obtained from the bitstream and representative of a mapping between the two-dimensional parametrization and the texture map and the depth map.

11. The method according to claim 10 , wherein additional points are generated in parts of the three-dimensional point cloud having a point density below the determined density value in addition to the points obtained from the texture map and the depth map.

12. A non-transitory computer readable medium comprising computer-executable instructions to enable a processor to perform the method of claim 10 .

13. A non-transitory computer readable medium storing data content generated according to the method of claim 10 .

14. A device comprising a memory associated with at least one processor configured to, for at least one part of a three-dimensional point cloud:

decode, from a bitstream, a two-dimensional parametrization responsive to geometric characteristics of the part and pose information associated with a range of points of view used to capture the three-dimensional point cloud;

decode, from the bitstream, a texture map and a depth map of the part;

de-project the texture map and the depth map according to a first information obtained from the bitstream and comprising an indication of whether the part has a point density below a determined density value, and a second information obtained from the bitstream and representative of a mapping between the two-dimensional parametrization and the texture map and the depth map.

15. The device according to claim 14 , wherein additional points are generated in parts of the three-dimensional point cloud having a point density below the determined density value in addition to the points obtained from the texture map and the depth map.

16. A non-transitory computer readable medium storing data content generated by the device of claim 14 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2020
From: THUDOR, FRANCK; CHUPEAU, BERTRAND; DORE, RENAUD; TAPIE, THIERRY; FLEUREAU, JULIEN
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 052940/0199 →
Priority Claims (1)
EP 17306629 · Nov 23, 2017 · regional
Continuity (1)
Related Publication 20200380765A1 · Dec 3, 2020
Cited By (3)
US 12,387,417 US 12,519,992 US 12,670,663