Perceptual three-dimensional (3D) video coding based on depth information
A method for encoding a multi-view frame in a video encoder is provided that includes computing a depth quality sensitivity measure for a multi-view coding block in the multi-view frame, computing a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block, wherein the depth-based perceptual quantization scale is based on the depth quality sensitive measure and a base quantization scale for the 2D frame including the 2D coding block, and encoding the 2D coding block using the depth-based perceptual quantization scale.
1. A method for encoding a multi-view frame in a video encoder, wherein the multi-view frame includes a plurality of two-dimensional (2D) frames, the method comprising:
determining a depth-quality sensitivity measure for a multi-view coding block in the multi-view frame based on a depth of the multi-view coding block and a depth-quality sensitivity function, the depth-quality sensitivity function defining perceptual quality sensitivity of the multi-view coding block as a function of the depth of the multi-view coding block;
determining a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block based on the depth-quality sensitivity measure and a base quantization scale for the 2D frame including the 2D coding block; and
encoding the 2D coding block using the depth-based perceptual quantization scale.
2. An apparatus configured to perform video encoding of a multi-view frame, wherein the multi-view frame includes a plurality of two-dimensional (2D) frames, the apparatus comprising one or more processors configured to:
determine a depth-quality sensitivity measure for a multi-view coding block in the multi-view frame based on a depth of the multi-view coding block and a depth-quality sensitivity function, the depth-quality sensitivity function defining perceptual quality sensitivity of the multi-view coding block as a function of the depth of the multi-view coding block;
determine a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block based on the depth-quality sensitivity measure and a base quantization scale for the 2D frame including the 2D coding block; and
encode the 2D coding block using the depth-based perceptual quantization scale.
3. A non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause the processor to:
determine a depth-quality sensitivity measure for a multi-view coding block in a multi-view frame based on a depth of the multi-view coding block, the multi-view frame including a plurality of two-dimensional (2D) frames and a depth-quality sensitivity function, the depth-quality sensitivity function defining perceptual quality sensitivity of the multi-view coding block as a function of the depth of the multi-view coding block;
determine a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block based on the depth-quality sensitivity measure and a base quantization scale for the 2D frame including the 2D coding block; and
encode the 2D coding block using the depth-based perceptual quantization scale.