Sparse matrix representation using a boundary of non-zero coefficients
A sparse matrix representation of image or video data for encoding or decoding uses a boundary of non-zero coefficients within the image or video data. A bounding box encloses each non-zero coefficient within an image or video block. The coefficients enclosed within the bounding box are encoded to a bitstream along with dimensional information usable to identify the bounding box within the image or video block during decoding. Coefficients not enclosed within the bounding box are not specifically encoded within the bitstream. The dimensional information represents one or more of a shape, size, or position within the image or video block of the bounding box. The bounding box may be identified according to a scan order used to process the coefficients within the image or video block. The bounding box may be rectangular or non-rectangular.
1. A method for decoding an encoded block of image or video data, the method comprising:
decoding dimensional information of a bounding box of the encoded block from a bitstream;
decoding, from the bitstream using the dimensional information, syntax elements corresponding to non-zero value coefficients enclosed within the bounding box, and wherein the syntax elements are arranged other than in a two-dimensional matrix format;
dequantizing the syntax elements to produce transformed data, wherein the transformed data includes coefficients arranged in the two-dimensional matrix format;
inverse transforming the transformed data to produce decoded data; and
outputting the decoded data for storage or display.
2. The method of claim 1 , wherein decoding the syntax elements comprises:
determining locations of the non-zero coefficients within the encoded block using the dimensional information.
3. The method of claim 1 , comprising:
decoding, from the bitstream, a syntax element indicating that the bounding box was used for encoding the encoded block.
4. The method of claim 3 , wherein the syntax element is decoded from a block header corresponding to the encoded block.
5. The method of claim 3 , wherein the syntax element is decoded from an image header or a video frame header corresponding to an image or a video frame which includes the encoded block.
6. The method of claim 1 , wherein the bounding box is based on locations of the non-zero coefficients according to a scan order used to encode the encoded block.
7. The method of claim 1 , wherein the bounding box has a non-rectangular shape.
8. The method of claim 1 , wherein at least some zero value coefficients of the encoded block are external to the bounding box.
9. The method of claim 1 , wherein the dimensional information corresponds to one or both of a shape of the bounding box or a size of the bounding box.
10. The method of claim 1 , wherein the bounding box only encloses non-zero coefficients of the encoded block.
11. A method for decoding an encoded block of image or video data, the method comprising:
decoding, from a bitstream, dimensional information of a bounding box of the encoded block;
decoding, from the bitstream using the dimensional information, syntax elements including non-zero value coefficients enclosed within the bounding box;
producing decoded data by dequantizing and inverse transforming the syntax elements; and
outputting the decoded data for storage or display.
12. The method of claim 11 , wherein all of the non-zero value coefficients of the encoded block are enclosed within the bounding box and all of the coefficients of the encoded block external to the bounding box are zero value coefficients.
13. The method of claim 11 , wherein the syntax elements are arranged other than in a two-dimensional matrix format and the decoded data are arranged in the two-dimensional matrix format.
14. The method of claim 11 , comprising:
determining whether a value of a syntax element encoded to the bitstream indicates that the bounding box was used for encoding the encoded block; and
decoding the dimensional information from the bitstream responsive to a determination that the value of the syntax element indicates that the bounding box was used for encoding the encoded block.
15. The method of claim 11 , wherein the dimensional information corresponds to one or both of a shape of the bounding box or a size of the bounding box.
16. A method for decoding an encoded block of image or video data, the method comprising:
identifying dimensional information of a bounding box of the encoded block;
identifying syntax elements corresponding to coefficients enclosed within the bounding box, wherein the syntax elements are arranged other than in a two-dimensional matrix format;
decoding the encoded block to produce decoded data by dequantizing and inverse transforming the syntax elements, wherein the decoded data are arranged in the two-dimensional matrix format; and
outputting the decoded data for storage or display.
17. The method of claim 16 , wherein all non-zero value coefficients of the encoded block are enclosed within the bounding box and all coefficients of the encoded block external to the bounding box are zero value coefficients.
18. The method of claim 16 , wherein the dimensional information and the syntax elements are decoded from a bitstream which includes the encoded block.
19. The method of claim 16 , wherein the dimensional information is identified based on a value of a syntax element encoded to a bitstream which includes the encoded block indicating that the bounding box was used for encoding the encoded block.
20. The method of claim 16 , wherein the bounding box is based on locations of non-zero coefficients according to a scan order used to encode the encoded block.