METHOD AND APPARATUS FOR ENCODING, TRANSMITTING AND DECODING VOLUMETRIC VIDEO
Methods, devices and stream for encoding, decoding and transmitting a multi-views frame are disclosed. In a multi-views frame some of the views are more trustable than others. The multi-views frame is encoded in a data stream in association with metadata that comprise, for at least one of the views, a parameter indicating a degree of confidence in the information carried by this view. This information is used at the decoding side to determine the contribution of the view when synthetizing pixels of a viewport frame for a given point of view in the 3D space.
1 . A method comprising:
for a view of a multi-view frame, obtaining a parameter representative of fidelity of depth information carried by said view, wherein the parameter is a Boolean value indicating whether the fidelity of depth information is fully trustable or a numerical value indicating a confidence in the fidelity of depth information of the view; and
encoding said multi-view frame in a data stream in association with metadata comprising said parameters.
2 . The method of claim 1 , wherein the parameter representative of fidelity of depth information of the view is determined according to the intrinsic and extrinsic parameters of a camera having captured the view.
3 . The method of claim 1 , wherein the metadata comprise information indicating whether a parameter is provided for each view of the multi-view frame and, if so, for each view, the parameter associated with each corresponding view.
4 . (canceled)
5 . (canceled)
6 . A device comprising a processor configured to:
for a view of a multi-view frame, obtain a parameter representative of fidelity of depth information carried by said view, wherein the parameter is a Boolean value indicating whether the fidelity of depth information is fully trustable or a numerical value indicating a confidence in the fidelity of depth information of the view; and
encode said multi-view frame in a data stream in association with metadata comprising said parameters.
7 . The device of claim 6 , wherein the processor is configured to determine the parameter representative of fidelity of depth information of the view according to the intrinsic and extrinsic parameters of a camera having captured the view.
8 . The device of claim 6 , wherein the processor is configured to encode metadata comprising information indicating whether a parameter is provided for each view of the multi-view frame and, if so, for each view, the parameter associated with each corresponding view.
9 . (canceled)
10 . (canceled)
11 . A method comprising:
decoding a multi-view frame and associated metadata from a data stream;
from the metadata, obtaining an information indicating whether a parameter representative of fidelity of depth information carried by a view of said multi-view frame is provided and, if so, obtaining a parameter for each corresponding view, wherein the parameter is a Boolean value indicating whether the fidelity of depth information is fully trustable or a numerical value indicating a confidence in the fidelity of depth information of the view; and
generating a viewport frame according to a viewing pose by determining a contribution of each view of said multi-view frame as a function of the parameter associated with the view.
12 . (canceled)
13 . The method of claim 11 , wherein the contribution of a not fully trustable view is ignored.
14 . The method of claim 11 , wherein, on condition that multiple views are fully trustable, the fully trustable view with the lowest depth information is used.
15 . (canceled)
16 . The method of claim 11 , wherein the contribution of each view is proportional to the numerical value associated with the view.
17 . A device comprising a processor configured to:
decode a multi-view frame and associated metadata from a data stream;
from the metadata, obtain an information indicating whether a parameter representative of fidelity of depth information carried by a view of said multi-view frame is provided and, if so, obtaining a parameter for each corresponding view, wherein the parameters is a Boolean value indicating whether fidelity of depth information is fully trustable or a numerical value indicating a confidence in the depth fidelity of the view; and
generate a viewport frame according to a viewing pose by determining a contribution of each view of said multi-view frame as a function of the parameter associated with the view.
18 . (canceled)
19 . The device of claim 17 , wherein the contribution of a not fully trustable view is ignored.
20 . The device of claim 17 , wherein, on condition that multiple views are fully trustable, the fully trustable view with the lowest depth information is used.
21 . (canceled)
22 . The device of claim 17 , wherein the contribution of each view is proportional to the numerical value associated with the view.
23 .- 26 . (canceled)