IP Library Granted Patent US 11,910,016
Granted Patent B2
US 11,910,016 · App. 17/678,364 · Granted Feb 20, 2024

Method and device for multi-view video decoding and method and device for image processing

Inventors: Joel Jung (Chatillon, FR); Pavel Nikitin (Chatillon, FR); Patrick Boissonade (Chatillon, FR)
Assignee: ORANGE
H04N19/597H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,910,016
App. No.
17/678,364
Granted
Feb 20, 2024
Kind
B2
Abstract

A method and a device for decoding a data stream representative of a multi-view video. Syntax elements are obtained from at least one part of the stream data, and used to reconstruct at least one image of a view of the video. Then, at least one item of metadata in a predetermined form is obtained from at least one obtained syntax element, and provided to an image processing module. Also, a method and a device for processing images configured to read the at least one item of metadata in the predetermined form and use it to generate at least one image of a virtual view from a reconstructed view of the multi-view video.

Claims (37)

1. A decoding method for decoding a data stream representative of a multi-view video, implemented by a decoding device, the method comprising:

obtaining syntax elements from at least one part of the stream data;

reconstructing at least one image of a view of the video from the syntax elements obtained;

receiving a request from an image synthesis module indicating at least one item of metadata required by the image synthesis module, said at least one item of metadata being associated with said at least one reconstructed image, and said at least one item of metadata corresponding to a map associated to said at least one reconstructed image;

obtaining said at least one item of metadata from at least one syntax element; and

providing said at least one item of metadata to the image synthesis module, said image synthesis module being configured to synthesize at least one virtual view, distinct from the views of the multi-view video, from said at least one reconstructed image and said at least one item of metadata.

2. The decoding method according to claim 1 , wherein obtaining at least one item of metadata further comprises calculating said at least one item of metadata from at least one part of the syntax elements.

3. The decoding method according to claim 1 , wherein said at least one item of metadata is not used for reconstructing the at least one image.

4. The decoding method according to claim 1 , wherein the metadata are obtained in a predetermined form corresponding to an indexed table in which at least one item of metadata is stored in association with an index.

5. The decoding method according to claim 1 , wherein said at least one item of metadata is obtained based on a granularity level specified in the decoding device.

6. The decoding method according to claim 1 , wherein the request comprises at least one index indicating the required item of metadata among a predetermined list of available metadata.

7. A device for decoding a data stream representative of a multi-view video, wherein the device comprises:

a processor; and

a non-transitory computer-readable medium comprising instructions stored thereon which when executed by the processor configure the decoding device to:

obtain syntax elements from at least one part of the stream data;

reconstruct at least one image of a view of the video from the syntax elements obtained;

receive a request from an image synthesis module indicating at least one item of metadata required by the image synthesis module, said at least one item of metadata being associated with said at least one reconstructed image, and said at least one item of metadata corresponding to a map associated to said at least one reconstructed image;

obtain said at least one item of metadata in a predetermined form from at least one syntax element; and

provide said at least one item of metadata to the image synthesis module, said image synthesis module being configured to synthesize at least one virtual view, distinct from the views of the multi-view video, from said at least one reconstructed image and said at least one item of metadata.

8. An image synthesis method implemented by a synthesis device, the method comprising:

generating at least one image of a virtual view, from at least one image of a view of a multi-view video decoded by a decoding device, said virtual view being distinct from views of the multi-view video, by:

sending to the decoding device a request indicating at least one item of metadata required to generate the at least one image of a view, said at least one item of metadata being associated with said at least one image of a view, and said at least one item of metadata corresponding to a map associated to said at least one image of a view;

reading said at least one item of metadata, said at least one item of metadata being obtained by the decoding device from at least one syntax element obtained from a data stream representative of a multi-view video; and

generating said at least one image of a virtual view comprising using said at least one read item of metadata and said decoded image.

9. An image synthesis device configured to generate at least one image of a virtual view, from at least one image of a view of a multi-view video decoded by a decoding device, said virtual view being distinct from views of the multi-view video, the image synthesis device comprising:

a processor; and

a non-transitory computer-readable medium comprising instructions stored thereon which when executed by the processor configure the image synthesis device to:

send to the decoding device a request indicating at least one item of metadata required to generate the at least one image of a view, said at least one item of metadata being associated with said at least one image of a view, and said at least one item of metadata corresponding to a map associated to said at least one image of a view;

read said at least one item of metadata, said at least one item of metadata being obtained by the decoding device from at least one syntax element obtained from a data stream representative of a multi-view video; and

generate said at least one image using said at least one read item of metadata and said decoded image.

10. A non-transitory computer-readable medium comprising a computer program stored thereon comprising instructions for implementing a decoding method when said program is executed by a processor of a decoding device, wherein the instructions configure the decoding device to:

decode a data stream representative of a multi-view video by:

obtaining syntax elements from at least one part of the stream data;

reconstructing at least one image of a view of the video from the syntax elements obtained;

receiving a request from an image synthesis module indicating at least one item of metadata required by the image synthesis module, said at least one item of metadata being associated with said at least one reconstructed image, and said at least one item of metadata corresponding to a map associated to said at least one reconstructed image;

obtaining said at least one item of metadata from at least one syntax element; and

providing said at least one item of metadata to the image synthesis module, said image synthesis module being configured to synthesize at least one virtual view, distinct from the views of the multi-view video, from said at least one reconstructed image and said at least one item of metadata.

Priority Claims (1)
FR 1853829 · May 3, 2018 · national
Continuity (2)
Continuation 17052342
Related Publication 20220182672A1 · Jun 9, 2022