IP Library › Granted Patent US 11,430,156

Granted Patent B2

US 11,430,156 · App. 16/755,681 · Granted Aug 30, 2022

Apparatus, a method and a computer program for volumetric video

Inventors: Payman Aflaki Beni (Tampere, FI); Sebastian Schwarz (Unterhaching, DE)

Assignee: Nokia Technologies Oy

G06T9/40 H04N13/161 H04N13/388

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,430,156
App. No.: 16/755,681
Granted: Aug 30, 2022
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

There are disclosed various methods, apparatuses and computer program products for volumetric video encoding and decoding. In some embodiments, projection data generated from a projection geometry of an object in a texture picture of volumetric video data is obtained. One or more property of the projection data is examined to determine whether at least one predetermined condition is fulfilled and if the examining reveals that at least one predetermined condition is fulfilled, at least one compression parameter for the projection data is adapted. The projection data is compressed by using the at least one compression parameter.

Claims (65)

1. A method comprising:

obtaining projection data of a volumetric presentation, the projection data generated from a projection geometry of an object in a texture picture of volumetric video data;

examining at least one property of the projection data to determine whether at least one predetermined condition is fulfilled;

wherein the at least one property comprises a level of detail of the projection data;

in response to the examining revealing that at least one predetermined condition is fulfilled, adapting at least one compression parameter for the projection data;

wherein the at least one compression parameter comprises a number of bits assigned to the projection data;

compressing the projection data based on the at least one adapted compression parameter;

dividing the volumetric presentation into two or more projections, the two or more projections comprising a respective projection geometry;

using the adapted at least one compression parameter in a part of the projection data of the object when the at least one predetermined condition is fulfilled, and using at least one other compression parameter in another part of the projection data of the object when at least one other predetermined condition is fulfilled;

wherein the at least one other compression parameter applies a different degree of compression than the at least one compression parameter; and

signaling, in or along a bitstream, the level of detail of the projection data to a decoder;

wherein the level of detail of the projection data signaled in or along the bitstream to the decoder is configured to be used with the decoder to determine how to reconstruct a three-dimensional position of the projection data from a two-dimensional representation of the projection data using the at least one adapted compression parameter.

2. The method according to claim 1 , wherein the at least one predetermined condition comprises an amount of motion of the object being above or below a threshold.

3. The method according to claim 1 further comprising:

assigning more projection geometries to the object depending on a content of the object.

4. The method according to claim 1 further comprising:

adapting the at least one compression parameter for the projection data based on a preference of a content provider or user.

5. The method according to claim 1 , further comprising:

unfolding the volumetric video data to obtain the two-dimensional projection data;

wherein the signal that includes the level of detail of the projection data is configured to be used to generate the three-dimensional position following obtaining the two-dimensional projection data.

6. The method according to claim 1 , wherein the projection geometry is one of a cylinder projection surface or a cube projection surface.

7. An apparatus comprising at least one processor and at least one non-transitory memory, said at least one memory stored with code thereon, which when executed with said at least one processor, causes the apparatus to perform at least:

obtain projection data of a volumetric presentation, the projection data generated from a projection geometry of an object in a texture picture of volumetric video data;

examine at least one property of the projection data to determine whether at least one predetermined condition is fulfilled;

wherein the at least one property comprises a level of detail of the projection data;

adapt at least one compression parameter for the projection data, in response to the examining revealing that at least one predetermined condition is fulfilled;

wherein the at least one compression parameter comprises a number of bits assigned to the projection data;

compress the projection data based on the at least one adapted compression parameter;

divide the volumetric presentation into two or more projections, the two or more projections comprising a respective projection geometry;

use the adapted at least one compression parameter in a part of the projection data of the object when the at least one predetermined condition is fulfilled, and use at least one other compression parameter in another part of the projection data of the object when at least one other predetermined condition is fulfilled;

wherein the at least one other compression parameter applies a different degree of compression than the at least one compression parameter; and

signal, in or along a bitstream, the level of detail of the projection data to a decoder;

wherein a presence or absence of the level of detail of the projection data signaled in or along the bitstream to the decoder is configured to be used with the decoder to determine how to reconstruct a three-dimensional position of the projection data from a two-dimensional representation of the projection data using the at least one adapted compression parameter.

8. The apparatus according to claim 7 , wherein the at least one predetermined condition comprises an amount of high frequency components of the object being above or below a threshold.

9. The apparatus according to claim 7 , said at least one memory stored with code thereon, which when executed with said at least one processor, further causes the apparatus to:

assign more projection geometries to the object depending on a content of the object.

10. The apparatus according to claim 7 , said at least one memory stored with code thereon, which when executed with said at least one processor, further causes the apparatus to:

adapt the at least one compression parameter for the projection data based on a preference of a content provider or user.

11. The apparatus according to claim 7 , said at least one memory stored with code thereon, which when executed with said at least one processor, further causes the apparatus to:

use the adapted at least one compression parameter for the projection data of the object.

12. The apparatus according to claim 7 , wherein the projection data is a two-dimensional projection of a three-dimensional object.

13. The apparatus according to claim 7 , wherein the projection geometry is one of a cylinder projection surface or a cube projection surface.

14. A non-transitory computer readable storage medium comprising code for use with an apparatus, which when executed with a processor, causes the apparatus to perform at least:

obtain projection data of a volumetric presentation generated from a projection geometry of an object in a texture picture of volumetric video data;