IP Library Granted Patent US 10,728,552
Granted Patent B2
US 10,728,552 · App. 16/325,312 · Granted Jul 28, 2020

Image processing apparatus and method

Inventor: Takeshi Tsukuba (Chiba, JP)
Assignee: SONY CORPORATION
H04N19/12H04N19/147H04N19/159H04N19/176H04N19/46H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,728,552
App. No.
16/325,312
Granted
Jul 28, 2020
Kind
B2
Abstract

There is provided an image processing apparatus and method that make it possible to suppress reduction of the encoding efficiency. Encoded data is decoded, and based on a value of a transform skip identifier obtained by the decoding, execution of an inverse primary vertical transform and execution of an inverse primary horizontal transform are controlled. Further, based on a value of a transform skip identifier, execution of a primary horizontal transform and execution of a primary vertical transform are controlled, and the transform skip identifier is encoded. The present disclosure can be applied, for example, to an image processing apparatus, an image encoding apparatus, an image decoding apparatus or the like.

Claims (70)

1. An image processing apparatus, comprising:

a decoding section configured to decode encoded data;

an inverse primary vertical transform controlling section configured to control, based on a value of a transform skip identifier obtained by the decoding of the encoded data by the decoding section, execution of an inverse primary vertical transform that is an inverse primary transform in a vertical direction for transform coefficient data transformed from image data; and

an inverse primary horizontal transform controlling section configured to control, based on the value of the transform skip identifier, execution of an inverse primary horizontal transform that is an inverse primary transform in a horizontal direction for the transform coefficient data transformed from the image data,

wherein the decoding section determines, based on the transform skip identifier indicating that a one-dimensional transform in the vertical direction or the horizontal direction or a two-dimensional transform is not to be skipped, whether or not to decode a secondary transform identifier indicating an inverse secondary transform different than the inverse primary transform, and

wherein the decoding section, the inverse primary vertical transform controlling section, and the inverse primary horizontal transform controlling section are each implemented via at least one processor.

2. The image processing apparatus according to claim 1 , wherein

the inverse primary vertical transform controlling section controls the execution of the inverse primary vertical transform such that,

where the transform skip identifier indicates that the one-dimensional transform in the vertical direction is not to be skipped, the inverse primary vertical transform for the transform coefficient data is executed, and

where the transform skip identifier indicates that the one-dimensional transform in the vertical direction is to be skipped, the inverse primary vertical transform for the transform coefficient data is omitted.

3. The image processing apparatus according to claim 1 , wherein

the inverse primary horizontal transform controlling section controls the execution of the inverse primary horizontal transform such that,

where the transform skip identifier indicates that the one-dimensional transform in the horizontal direction is not to be skipped, the inverse primary horizontal transform for the transform coefficient data is executed, and

where the transform skip identifier indicates that the one-dimensional transform in the horizontal direction is to be skipped, the inverse primary horizontal transform for the transform coefficient data is omitted.

4. The image processing apparatus according to claim 1 , further comprising:

a selection section configured to select an orthogonal transform that is to be applied to the inverse primary vertical transform and the inverse primary horizontal transform,

wherein the selection section is implemented via at least one processor.

5. The image processing apparatus according to claim 4 , wherein the selection section

selects an orthogonal transform to be applied as the inverse primary vertical transform based on a vertical transform set identifier and a primary vertical transform designation flag obtained by the decoding of the encoded data by the decoding section, and

selects an orthogonal transform to be applied as the inverse primary horizontal transform based on a horizontal transform set identifier and a primary horizontal transform designation flag obtained by the decoding of the encoded data by the decoding section.

6. The image processing apparatus according to claim 5 , wherein

the decoding section derives the primary vertical transform designation flag and the primary horizontal transform designation flag from a primary transform identifier in response to the value of the transform skip identifier.

7. The image processing apparatus according to claim 6 , wherein

the decoding section

derives, where the transform skip identifier indicates that the two-dimensional transform is not to be skipped, the primary vertical transform designation flag and the primary horizontal transform designation flag by processing the primary transform identifier as a 2-bit bin string, and

derives, where the transform skip identifier indicates that the one-dimensional transform in the vertical direction or the horizontal direction is not to be skipped, the primary vertical transform designation flag and the primary horizontal transform designation flag by processing the primary transform identifier as a 1-bit bin string.

8. The image processing apparatus according to claim 5 , wherein

the decoding section decodes the primary vertical transform designation flag and the primary horizontal transform designation flag included in the encoded data.

9. The image processing apparatus according to claim 1 , wherein,

where the transform skip identifier indicates that the one-dimensional transform in the vertical direction or the horizontal direction or the two-dimensional transform is not to be skipped, the decoding section omits decoding of the secondary transform identifier and sets the secondary transform identifier to a value that indicates that the secondary transform is not to be performed.

10. An image processing method, comprising:

decoding encoded data;

controlling, based on a value of a transform skip identifier obtained by the decoding of the encoded data, execution of an inverse primary vertical transform that is an inverse primary transform in a vertical direction for transform coefficient data transformed from image data;

controlling, based on the value of the transform skip identifier, execution of an inverse primary horizontal transform that is an inverse primary transform in a horizontal direction for the transform coefficient data transformed from the image data; and

determining, based on the transform skip identifier indicating that a one-dimensional transform in the vertical direction or the horizontal direction or a two-dimensional transform is not to be skipped, whether or not to decode a secondary transform identifier indicating an inverse secondary transform different than the inverse primary transform and whether to set the secondary transform identifier to a value that indicates that the inverse secondary transform is not to be performed.

11. An image processing apparatus, comprising:

a primary horizontal transform controlling section configured to control execution of a primary horizontal transform that is a primary transform in a horizontal direction for residual data between an image and a prediction image based on a value of a transform skip identifier;

a primary vertical transform controlling section configured to control, based on a value of the transform skip identifier, execution of a primary vertical transform that is a primary transform in a vertical direction for the residual data between the image and the prediction image; and

an encoding section configured to encode the transform skip identifier,

wherein the encoding section determines, based on the transform skip identifier indicating that a one-dimensional transform in the vertical direction or the horizontal direction or a two-dimensional transform is not to be skipped, whether or not to encode a secondary transform identifier indicating a secondary transform different than the primary transform, and

wherein the primary horizontal transform controlling section, the primary vertical transform controlling section, and the encoding section are each implemented via at least one processor.

12. The image processing apparatus according to claim 11 , wherein

the primary horizontal transform controlling section controls the execution of the primary horizontal transform such that,

where the transform skip identifier indicates that the one-dimensional transform in the horizontal direction is not to be skipped, the primary horizontal transform for the residual data is executed, and

where the transform skip identifier indicates that the one-dimensional transform in the horizontal direction is to be skipped, the primary horizontal transform for the residual data is omitted.

13. The image processing apparatus according to claim 11 , wherein

the primary vertical transform controlling section controls the execution of the primary horizontal transform such that,

where the transform skip identifier indicates that the one-dimensional transform in the vertical direction is not to be skipped, the primary vertical transform for the residual data is executed, and

where the transform skip identifier indicates that the one-dimensional transform in the vertical direction is to be skipped, the primary vertical transform for the residual data is omitted.

14. The image processing apparatus according to claim 11 , further comprising:

a selection section configured to select an orthogonal transform that is to be applied to the primary horizontal transform and the primary vertical transform,

wherein the selection section is implemented via at least one processor.

15. The image processing apparatus according to claim 14 , wherein the selection section

selects an orthogonal transform to be applied as the primary horizontal transform based on a horizontal transform set identifier and a primary horizontal transform designation flag, and

selects an orthogonal transform to be applied as the primary vertical transform based on a vertical transform set identifier and a primary vertical transform designation flag.

16. The image processing apparatus according to claim 15 , wherein

the encoding section derives a primary transform identifier from the primary horizontal transform designation flag and the primary vertical transform designation flag in response to the value of the transform skip identifier.

17. The image processing apparatus according to claim 16 , wherein

the encoding section

derives, where the transform skip identifier indicates that the two-dimensional transform is not to be skipped, the primary transform identifier of a 2-bit bin string using the primary horizontal transform designation flag and the primary vertical transform designation flag, and

derives, where the transform skip identifier indicates that the one-dimensional transform in the vertical direction or the horizontal direction is not to be skipped, the primary transform identifier of a 1-bit bin string using the primary horizontal transform designation flag or the primary vertical transform designation flag.

18. The image processing apparatus according to claim 15 , wherein

the encoding section encodes the primary horizontal transform designation flag and the primary vertical transform designation flag.

19. The image processing apparatus according to claim 11 , wherein,

where the transform skip identifier indicates that the one-dimensional transform in the vertical direction or the horizontal direction or the two-dimensional transform is not to be skipped, the encoding section omits encoding of the secondary transform identifier.

20. An image processing method, comprising:

controlling execution of a primary horizontal transform that is a primary transform in a horizontal direction for residual data between an image and a prediction image based on a value of a transform skip identifier;

controlling, based on a value of the transform skip identifier, execution of a primary vertical transform that is a primary transform in a vertical direction for the residual data between the image and the prediction image;

encoding the transform skip identifier; and

determining, based on the transform skip identifier indicating that a one-dimensional transform in the vertical direction or the horizontal direction or a two-dimensional transform is not to be skipped, whether or not to encode a secondary transform identifier indicating a secondary transform different than the primary transform.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2019
From: TSUKUBA, TAKESHI
To: SONY CORPORATION
Reel/Frame 048326/0990 →
Priority Claims (1)
JP 2016-193687 · Sep 30, 2016 · national
Continuity (1)
Related Publication 20190208203A1 · Jul 4, 2019
Cited By (6)
US 12,238,314 US 12,262,016 US 12,284,374 US 12,301,793 US 12,389,022 US 12,568,201