IP Library › Granted Patent US 12,149,691
Granted Patent B2
US 12,149,691 · App. 17/775,311 · Granted Nov 19, 2024

Image processing device and method

Inventor: Takeshi Tsukuba (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/12H04N19/186H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,149,691
App. No.
17/775,311
Granted
Nov 19, 2024
Kind
B2
Abstract

The present disclosure relates to an image processing device and method for enabling suppression of reduction in encoding efficiency. Encoding of secondary transform control information that is control information related to secondary transform is omitted in a case where a transform skip flag of at least one component among valid components in image encoding is true, and the secondary transform control information is encoded in a case where the transform skip flags of all the components among the valid components in image encoding are false. The present disclosure can be applied to, for example, an image processing device, an image encoding device, an image decoding device, a transmission device, a reception device, a transmission/reception device, an information processing device, an imaging device, a reproduction device, an electronic device, an image processing method, an information processing method, or the like.

Claims (102)

1. An image processing device that performs image encoding, the image encoding using a primary transform and selectively using a secondary transform, the image processing device comprising:

circuitry configured to:

determine a tree type of the image encoding from among a plurality of tree types;

determine values of transform skip flags corresponding to valid components of the image encoding corresponding to the determined tree type, the valid components being a subset of all components of the image encoding corresponding the plurality of tree types; and

perform the image encoding based on the determined values and the determined tree type, wherein the image encoding comprises:

omitting encoding of control information related to the secondary transform in a case where a transform skip flag of at least one component of the valid components is determined to be true; and

encoding the control information in a case where the transform skip flags of all components of the valid components in the image encoding are determined to be false,

wherein any transform skip flag having a first binary value is determined to be true, and

wherein any transform skip flag having a second binary value, different from the first binary value, is determined to be false.

2. The image processing device according to claim 1 , wherein,

wherein the determined tree type of the image encoding is a single tree, and the transform skip flags corresponding to the valid components in the image encoding comprise a Y component transform skip flag that is the transform skip flag of a Y component, a Cb component transform skip flag that is the transform skip flag of a Cb component, and a Cr component transform skip flag that is the transform skip flag of a Cr component, and

wherein the image encoding comprises:

omitting the encoding of the control information in a case where at least one of the Y component transform skip flag, the Cb component transform skip flag, or the Cr component transform skip flag is determined to be true, and

encoding the control information in a case where all of the Y component transform skip flag, the Cb component transform skip flag, and the Cr component transform skip flag are determined to be false.

3. The image processing device according to claim 1 , wherein,

wherein the determined tree type of the image encoding is a dual tree luma, and the transform skip flags corresponding to the valid components in the image encoding comprise a Y component transform skip flag that is the transform skip flag of a Y component,

wherein the image encoding comprises:

omitting the encoding of the control information in a case where the Y component transform skip flag is determined to be true, and

encoding the control information in a case where the Y component transform skip flag is determined to be false.

4. The image processing device according to claim 1 , wherein,

wherein the determined tree type of the image encoding is a dual tree chroma, and the transform skip flags corresponding to the valid components in the image encoding comprise a Cb component transform skip flag that is the transform skip flag of a Cb component, and a Cr component transform skip flag that is the transform skip flag of a Cr component, and

wherein the image encoding comprises:

omitting the encoding of the control information in a case where at least one of the Cb component transform skip flag or the Cr component transform skip flag is determined to be true, and

encoding the control information in a case where all of the Cb component transform skip flag and the Cr component transform skip flag are determined to be false.

5. The image processing device according to claim 1 , wherein

the control information includes a secondary transform identifier that is an identifier indicating a type of the secondary transform.

6. The image processing device according to claim 1 , wherein

the secondary transform is low frequency non-separable transform (LFNST).

7. The image processing device according to claim 1 , wherein,

the image encoding comprises:

omitting the encoding of the control information in a case where the transform skip flags of all the components of the valid components in the image encoding are determined to be true, and

encoding the control information in a case where the transform skip flag of at least one component of the valid components in the image the encoding is determined to be false.

8. The image processing device according to claim 1 , wherein,

wherein the determined tree type of the image encoding is a dual tree chroma, and

wherein the image encoding comprises:

omitting the encoding of the control information in a case where the transform skip flags of all the components of the valid components in the dual tree chroma are determined to be true, and

encoding the control information in a case where the transform skip flag of at least one component of the valid components in the dual tree chroma is determined to be false.

9. The image processing device according to claim 1 , wherein,

wherein the determined tree type of the image encoding is a dual tree chroma, and

wherein the image encoding comprises:

omitting the encoding of the control information in a case where the transform skip flag of at least one component of the valid components in the dual tree chroma is determined to be true, and

encoding the control information in a case where the transform skip flags of all the components of the valid components in the dual tree chroma are determined to be false.

10. An image processing method for image encoding that uses a primary transform and that selectively uses a secondary transform, the image processing method performed by an image processing device and comprising:

determining a tree type of the image encoding from among a plurality of tree types;

determining values of transform skip flags corresponding to valid components of the image encoding corresponding to the determined tree type, the valid components being a subset of all components of the image encoding corresponding the plurality of tree types; and

performing the image encoding based on the determined values, wherein the image encoding comprises:

omitting encoding of control information related to the secondary transform in a case where a transform skip flag of at least one component of the valid components is determined to be true; and

encoding the control information in a case where the transform skip flags of all components of the valid components in the image encoding are determined to be false,

wherein any transform skip flag having a first binary value is determined to be true, and

wherein any transform skip flag having a second binary value, different from the first binary value, is determined to be false.

11. An image processing device that performs image decoding, the image decoding using a primary transform and selectively using a secondary transform, the image processing device comprising:

circuitry configured to

determine a tree type of the image decoding from among a plurality of tree types;

determine values of transform skip flags corresponding to valid components of the image decoding corresponding to the determined tree type, the valid components being a subset of all components of the image decoding corresponding the plurality of tree types; and

perform the image decoding based on the determined values and the determined tree type, wherein the image decoding comprises:

omitting decoding related to control information related to the secondary transform and estimating that a value of the control information is a predetermined value in a case where a transform skip flag of at least one component of the valid components is determined to be true,

wherein the predetermined value indicates that the secondary transform is skipped in the image decoding; and

decoding a bitstream to generate the control information in a case where the transform skip flags of all components of the valid components in the image decoding are determined to be false,

wherein any transform skip flag having a first binary value is determined to be true, and

wherein any transform skip flag having a second binary value, different from the first binary value, is determined to be false.

12. The image processing device according to claim 11 , wherein,

wherein the determined tree type of the image decoding is a single tree, and the transform skip flags corresponding to the valid components in the image decoding comprise a Y component transform skip flag that is the transform skip flag of a Y component, a Cb component transform skip flag that is the transform skip flag of a Cb component, and a Cr component transform skip flag that is the transform skip flag of a Cr component, and

wherein the image decoding comprises:

omitting the decoding of the control information and estimating that the value of the control information is the predetermined value in a case where at least one of the Y component transform skip flag, the Cb component transform skip flag, or the Cr component transform skip flag is determined to be true, and

decoding the bitstream to generate the control information in a case where all of the Y component transform skip flag, the Ch component transform skip flag, and the Cr component transform skip flag are determined to be false.

13. The image processing device according to claim 11 , wherein,

wherein the determined tree type of the image decoding is a dual tree luma, and the transform skip flags corresponding to the valid components in the image decoding comprise a Y component transform skip flag that is the transform skip flag of a Y component,

wherein the image decoding comprises:

omitting the decoding related to the control information and estimating that the value of the control information is the predetermined value in a case where the Y component transform skip flag is determined to be true, and

decoding the bitstream to generate the control information in a case where the Y component transform skip flag is determined to be false.

14. The image processing device according to claim 11 , wherein,

wherein the determined tree type of the image decoding is a dual tree chroma, and the transform skip flags corresponding to the valid components in the image decoding comprise a Cb component transform skip flag that is the transform skip flag of a Cb component, and a Cr component transform skip flag that is the transform skip flag of a Cr component, and

wherein the image decoding comprises:

omitting the decoding of the control information and estimating that the value of the control information is the predetermined value in a case where at least one of the Cb component transform skip flag or the Cr component transform skip flag is determined to be true, and

decoding the bitstream to generate the control information in a case where all of the Cb component transform skip flag and the Cr component transform skip flag are determined to be false.

15. The image processing device according to claim 11 , wherein

the control information includes a secondary transform identifier that is an identifier indicating a type of the secondary transform.

16. The image processing device according to claim 11 , wherein

the secondary transform is low frequency non-separable transform (LFNST).

17. The image processing device according to claim 11 , wherein

the image decoding comprises:

omitting the decoding related to the control information and estimating that the value of the control information is the predetermined value in a case where the transform skip flags of all of the components of the valid components in the image decoding are determined to be true, and

decoding the bitstream to generate the control information in a case where the transform skip flag of at least one component of the valid components in the image decoding is determined to be false.

18. The image processing device according to claim 11 , wherein,

wherein the determined tree type of the image decoding is a dual tree chroma, and

wherein the image decoding comprises:

omitting the decoding related to the control information and estimating that the value of the control information is the predetermined value in a case where the transform skip flags of all of the components of the valid components in the dual tree chroma are determined to be true, and

decoding the bitstream to generate the control information in a case where the transform skip flag of at least one component of the valid components in the dual tree chroma is determined to be false.

19. The image processing device according to claim 11 , wherein,

wherein the determined tree type of the image decoding is a dual tree chroma, and

wherein the image decoding comprises:

omitting the decoding related to the control information and estimating that the value of the control information is the predetermined value in a case where the transform skip flag of at least one component of the valid components in the dual tree chroma is determined to be true, and

decoding the bitstream to generate the control information in a case where the transform skip flags of all of the components of the valid components in the dual tree chroma are determined to be false.

20. An image processing method for image decoding that uses a primary transform and that selectively uses a secondary transform, the image processing method performed by an image processing device and comprising:

determining a tree type of the image decoding from among a plurality of tree types;

determining values of transform skip flags corresponding to valid components of the image decoding corresponding to the determined tree type, the valid components being a subset of all components of the image decoding corresponding the plurality of tree types; and

performing the image decoding based on the determined values and the determined tree type, wherein the image decoding comprises:

omitting decoding related to control information related to the secondary transform and estimating that a value of the secondary transform control information is a predetermined value in a case where a transform skip flag of at least one component of the valid components is determined to be true,

wherein the predetermined value indicates that the secondary transform is skipped in the image decoding; and

decoding a bitstream to generate the control information in a case where the transform skip flags of all components of the valid components in the image decoding are determined to be false,

wherein any transform skip flag having a first binary value is determined to be true, and

wherein any transform skip flag having a second binary value, different from the first binary value, is determined to be false.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2022
From: TSUKUBA, TAKESHI
To: SONY GROUP CORPORATION
Reel/Frame 059866/0866 →
Continuity (2)
Provisional Application 62939102 · Nov 22, 2019
Related Publication 20220385904A1 · Dec 1, 2022