Multi-view signal codec
A higher compression rate or better rate/distortion ratio is achieved by adopting or predicting second coding parameters used for encoding a second view of the multi-view signal from first coding parameters used in encoding a first view of the multi-view signal. The redundancies between views of a multi-view signal were found to be not restricted to the views themselves, such as the video information thereof. Rather, the coding parameters in parallely encoding these views show similarities which may be exploited in order to further improve the coding rate.
1. A decoder configured for:
extracting, from a data stream, first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal,
receiving the one or more coding parameters, if the first information indicates that the first coding block is to reuse the one or more coding parameters from the second coding block in the second view, and
reconstructing the first coding block in the first view based on the received one or more coding parameters from the second coding block in the second view, wherein
the first and second coding blocks are independently reconstructed based on the one or more coding parameters, and
the decoder is further configured for detecting an edge in the first coding block, when the first coding block corresponds to a depth/disparity coding block, to yield different sub-segments and the different sub-segments are reconstructed based on different sets of coding parameters in an inter-prediction mode.
2. The decoder of claim 1 , wherein each of the first and second views comprises different types of information components.
3. The decoder of claim 2 , wherein the different types of information components include a video and a depth/disparity map corresponding to the video.
4. The decoder of claim 3 , wherein the first coding block comprises video data and is reconstructed based on a first subset of the one or more coding parameters from the second coding block.
5. The decoder of claim 4 , wherein the first coding block comprises depth/disparity data and is reconstructed based on a second subset of the one or more coding parameters from the second coding block.
6. The decoder of claim 3 , wherein the decoder is further configured for:
reconstructing a first depth/disparity coding block in the first view based on a first edge associated with the first depth/disparity coding block;
predicting a second edge associated with a second depth/disparity coding block of the second view based on the first edge; and
reconstructing the second depth/disparity coding block of the second view based on the second edge.
7. The decoder of claim 1 , wherein the reconstructing comprises:
identifying at least one coding parameter from the one or more coding parameters from the second coding block; and
generating the first coding block using the at least one coding parameter.
8. The decoder of claim 1 , wherein the reconstructing comprises:
obtaining, from the data stream, residual data associated with the first coding block;
deriving enhanced at least one coding parameter based on the one or more coding parameters and the residual data; and
generating the first coding block using the enhanced at least one coding parameter.
9. The decoder of claim 1 , wherein the first coding block is reconstructed in accordance with a first spatial resolution and the second coding block is reconstructed in accordance with a second spatial resolution.
10. The decoder of claim 1 , wherein the decoder is further configured to generate an intermediate coding block based on the first and the second coding blocks.
11. The decoder of claim 1 , wherein the decoder is further configured to generate an intermediate view based on the first and second views.
12. A decoding method, comprising:
extracting, from a data stream, first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal,
receiving the one or more coding parameters, if the first information indicates that the first coding block is to reuse the one or more coding parameters from the second coding block in the second view,
reconstructing the first coding block in the first view based on the received one or more coding parameters from the second coding block in the second view, wherein the first and second coding blocks are independently reconstructed based on the one or more coding parameters;
detecting an edge in the first coding block, when the first coding block corresponds to a depth/disparity coding block, to yield different sub-segments; and
reconstructing the different sub-segments based on different sets of coding parameters in an inter-prediction mode.
13. A non-transitory machine readable digital storage medium having computer instructions stored thereon for decoding, wherein the computer instructions, when read by the machine, causing the machine to at least perform:
extracting, from a data stream, first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal,
receiving the one or more coding parameters, if the first information indicates that the first coding block is to reuse the one or more coding parameters from the second coding block in the second view,
reconstructing the first coding block in the first view based on the received one or more coding parameters from the second coding block in the second view, wherein the first and second coding blocks are independently reconstructed based on the one or more coding parameters;
detecting an edge in the first coding block, when the first coding block corresponds to a depth/disparity coding block, to yield different sub-segments; and
reconstructing the different sub-segments based on different sets of coding parameters in an inter-prediction mode.
14. An encoder configured for coding, into a data stream,
first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal, and
the one or more coding parameters from the second coding block in the second view,
so that when the first information indicates that the first coding block is to reuse from the second coding block in the second view, the one or more coding parameters associated with the second coding block are to be received from the data stream and used to reconstruct the first coding block in the first view, wherein
the first and second coding blocks are independently encoded based on the one or more coding parameters, and
when the first coding block corresponds to a depth/disparity coding block, an edge in the first coding block is detected to yield different sub-segments and the different sub-segments are reconstructed based on different sets of coding parameters in an inter-prediction mode.
15. An encoding method, comprising:
encoding, into a data stream, first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal; and
encoding, into the data stream, the one or more coding parameters associated with the second coding block in the second view so that when the first information indicates that the first coding block in the first view is to reuse from the second coding block in the second view, the one or more coding parameters are to be received from the data stream and used to reconstruct the first coding block in the first view, wherein
the first and second coding blocks are independently encoded based on the one or more coding parameters, and
when the first coding block corresponds to a depth/disparity coding block, an edge in the first coding block is detected to yield different sub-segments and the different sub-segments are reconstructed based on different sets of coding parameters in an inter-prediction mode.
16. A non-transitory machine readable digital storage medium having computer instructions stored thereon for encoding, wherein the computer instructions, when read by the machine, causing the machine to at least perform:
encoding, into a data stream, first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal; and
encoding, into the data stream, the one or more coding parameters associated with the second coding block in the second view so that when the first information indicates that the first coding block in the first view is to reuse from the second coding block in the second view, the one or more coding parameters are to be received from the data stream and used to reconstruct the first coding block in the first view, wherein
the first and second coding blocks are independently encoded based on the one or more coding parameters, and
when the first coding block corresponds to a depth/disparity coding block, an edge in the first coding block is detected to yield different sub-segments and the different sub-segments are reconstructed based on different sets of coding parameters in an inter-prediction mode.
17. A data stream stored in a non-transitory storage medium, the data stream comprising encoded first information associated with a first coding block in a first view of a multi-view signal, wherein the first information is indicative of whether the first coding block is to reuse one or more coding parameters from a second coding block located in a second view of the multi-view signal, wherein the data stream further comprises the one or more coding parameters from the second coding block in the second view, so that when the first information indicates that the first coding block is to reuse from the second coding block in the second view, the one or more coding parameters associated with the second coding block are to be received from the data stream and used to reconstruct the first coding block in the first view, wherein
the first and second coding blocks are independently encoded based on the one or more coding parameters, and
when the first coding block corresponds to a depth/disparity coding block, an edge in the first coding block is detected to yield different sub-segments and the different sub-segments are reconstructed based on different sets of coding parameters in an inter-prediction mode.