Granted Patent B2

US 12,273,565 · App. 17/635,133 · Granted Apr 8, 2025

Inventor: Jani Lainema (Tampere, FI)

H04N19/70H04N19/12H04N19/176H04N19/18H04N19/184H04N19/60

Abstract

Claims (75)

1. An apparatus comprising at least one processor and at least one memory, said at least one memory having code thereon, which when executed by said at least one processor, causes the apparatus to perform at least:

obtain a block of transform coefficients;

search a position of a last non-zero coefficient in a scan order in the block of transform coefficients;

select a secondary transform mode based on the position of the last non-zero coefficient, wherein the secondary transform mode corresponds to a secondary transform;

encode first syntax elements indicative of the selected secondary transform mode;

select a primary transform mode based on the selected secondary transform mode, wherein a primary transform corresponds to the primary transform mode;

encode second syntax elements indicative of the selected primary transform mode;

encode third syntax elements defining the transform coefficients within the block; and

sending the first, second, and third syntax elements as part of a bit stream, wherein indication of the primary transform mode is in the bit stream when the secondary transform mode is zero and indication of the primary transform mode is not in the bit stream when the secondary transform mode is non-zero, wherein the primary transform is implemented as a discrete cosine transform (DCT) when the secondary transform is used, and when the secondary transform mode is non-zero, a low-frequency non-separable transform is used as the secondary transform coupled with the DCT being used as the primary transform.

2. The apparatus according to claim 1 , wherein said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to perform:

encode the first syntax elements indicative of the secondary transform mode based on the position of the last non-zero coefficient being within a certain range in the scan order in the block.

3. The apparatus according to claim 1 , wherein the said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to select the primary or secondary transform mode at least by performing the following:

test different transform modes;

evaluate cost functions for the tested different transform modes to select a cost function; and

select one of the different transform modes which minimizes the selected cost function.

4. The apparatus according to claim 1 , wherein said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to perform:

omit signaling of some or all syntax elements relating to the primary transform mode based on a non-zero secondary transform mode being included in a bitstream.

5. The apparatus according to claim 1 , wherein said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to perform:

signal a transform skip mode based on both primary and secondary transforms being by-passed before signaling position of a last non-zero coefficient in the block of transform coefficients.

6. The apparatus according to claim 1 , wherein said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to perform:

signal the position of the last non-zero coefficient; and

signal the first syntax elements indicative of the selected secondary transform mode after signaling the position of the last non-zero coefficient.

7. The apparatus according to claim 1 , wherein said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to perform:

signal the secondary transform to be off for the block of transform coefficients; and

signal the second syntax elements indicative of the selected primary transform mode after signaling the first syntax elements indicative of the selected secondary transform mode.

8. The apparatus according to claim 1 , wherein said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to perform:

signal syntax elements defining the transform coefficients of the block of transform coefficients after signaling the second syntax elements indicative of the selected primary transform mode.

9. A method comprising obtaining a block of transform coefficients;

searching a position of a last non-zero coefficient in a scan order in the block of transform coefficients;

selecting a secondary transform mode based on the position of the last non-zero coefficient, wherein the secondary transform mode corresponds to a secondary transform, and encoding first syntax elements indicative of the selected secondary transform mode;

selecting the primary transform mode based on the selected secondary transform mode, wherein a primary transform corresponds to the primary transform mode;

encoding second syntax elements indicative of the selected primary transform mode;

encoding third syntax elements defining the transform coefficients within the block; and

sending the first, second, and third syntax elements as part of a bit stream, wherein indication of the primary transform mode is in the bit stream when the secondary transform mode is zero and indication of the primary transform mode is not in the bit stream when the secondary transform mode is non-zero, wherein the primary transform is implemented as a discrete cosine transform (DCT) when the secondary transform is used, and when the secondary transform mode is non-zero, a low-frequency non-separable transform is used as the secondary transform coupled with the DCT being used as the primary transform.

10. The method according to claim 9 further comprising:

encoding the first syntax elements indicative of the secondary transform mode if the position of the last non-zero coefficient is within a certain range in the scan order in the block.

11. The method according to claim 9 further comprising:

omitting signaling of some or all syntax elements relating to the primary transform mode based on a non-zero secondary transform mode being included in a bitstream.

12. The method according to claim 9 further comprising:

signaling a transform skip mode based on both primary and secondary transforms being by-passed before signaling a position of a last non-zero coefficient in the block of transform coefficients.

13. The method according to claim 9 further comprising:

signaling the position of the last non-zero coefficient; and

signaling the first syntax elements indicative of the selected secondary transform mode after signaling the position of the last non-zero coefficient.

14. An apparatus comprising:

at least one processor and at least one memory, said at least one memory having code thereon, which when executed by said at least one processor, causes the apparatus to perform at least:

receive a bit stream comprising encoded information related to a block of transform coefficients;

decode from the bit stream an indication of a position of a last non-zero coefficient in a scan order in the block of transform coefficients;

use the position of the last non-zero coefficient to determine when an indication of a secondary transform mode is present in the bit stream;

determine an indication of a secondary transform mode is present in the bit stream, and determine the secondary transform mode by decoding first syntax elements indicative of the secondary transform mode;

use the determined secondary transform mode to determine when an indication of a primary transform mode is present in the bit stream, wherein indication of the primary transform mode is in the bit stream when the secondary transform mode is zero and indication of the primary transform mode is not in the bit stream when the secondary transform mode is non-zero;

determine the primary transform mode by decoding second syntax elements indicative of the primary transform mode when the indication of the primary transform mode is in the bit stream;

decode the transform coefficients;

apply the determined primary and secondary transform modes to select corresponding primary and secondary transforms, wherein the primary transform is based on the secondary transform; and

apply the determined primary and secondary transforms to the transform coefficients, wherein indication of the primary transform mode is in the bit stream when the secondary transform mode is zero and indication of the primary transform mode is not in the bit stream when the secondary transform mode is non-zero, the secondary transform is implemented as a low-frequency non-separable transform, and the primary transform is implemented as a discrete cosine transform (DCT) when the secondary transform mode is non-zero.

15. The apparatus according to claim 14 , said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to:

omit decoding coefficient areas that are not applicable for the determined primary transform or a determined primary-secondary transform pair.

16. The apparatus according to claim 14 , said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to:

apply at least one of the primary transform and the secondary transform to one or more transform blocks following the transform block which included indication indicative of the at least one of the primary transform mode and the secondary transform mode.

17. The apparatus according to claim 14 , said at least one memory has code thereon, which when executed by said at least one processor, causes the apparatus to:

decode from the bit stream the indication of the primary transform mode based on a predetermined condition being fulfilled.

18. The apparatus according to claim 17 , wherein said predetermined condition includes one of:

a minimum dimension of the block of transform coefficients; or

a maximum dimension of the block of transform coefficients.

19. A method comprising:

receiving a bit stream comprising encoded information related to a block of transform coefficients;

decoding from the bit stream an indication of a position of a last non-zero coefficient in a scan order in the block of transform coefficients;

using the position of the last non-zero coefficient to determine when an indication of a secondary transform mode is present in the bit stream;

determining an indication of a secondary transform mode is present in the bit stream, and determining the secondary transform mode by decoding first syntax elements indicative of the secondary transform mode;

using the determined secondary transform mode to determine when an indication of a primary transform mode is present in the bit stream, wherein indication of the primary transform mode is in the bit stream when the secondary transform mode is zero and indication of the primary transform mode is not in the bit stream when the secondary transform mode is non-zero;

determining the primary transform mode by decoding second syntax elements indicative of the primary transform mode, when the indication of the primary transform mode is present in the bit stream;

decoding the transform coefficients;

applying the determined primary and secondary transform modes to select corresponding primary and secondary transforms, wherein the primary transform is based on the secondary transform; and

apply the determined primary and secondary transforms to the transform coefficients, wherein indication of the primary transform mode is in the bit stream when the secondary transform mode is zero and indication of the primary transform mode is not in the bit stream when the secondary transform mode is non-zero, wherein the secondary transform is implemented as a low-frequency non-separable transform. and the primary transform is implemented as a discrete cosine transform (DCT) when the secondary transform mode is non-zero.

20. The method according to claim 19 , comprising:

omitting decoding coefficient areas that are not applicable for the determined primary transform or a determined primary-secondary transform pair.

Assignments (1)

Continuity (2)

References Cited (46)