IP Library Granted Patent US 11,190,744
Granted Patent B2
US 11,190,744 · App. 16/346,783 · Granted Nov 30, 2021

Image processing device, image processing method, and program for determining a cost function for mode selection

Inventors: Takaaki Fuchie (Kanagawa, JP); Masaki Hirose (Tokyo, JP); Atsuo Yada (Kanagawa, JP)
Assignee: SONY CORPORATION
H04N9/68H04N9/87H04N19/107H04N19/109H04N19/117H04N19/147H04N19/162H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,190,744
App. No.
16/346,783
Granted
Nov 30, 2021
Kind
B2
Abstract

An image processing device is described. The circuitry of the image processing device obtains an image that is generated on a basis of an incident light and a transfer function related to a conversion between the incident light and the image, and determines a cost function for prediction mode selection according to the transfer function. The cost function calculates a cost value based on a first parameter corresponding to a prediction residual code amount and a second parameter corresponding to a prediction mode code amount. The cost function is determined in a manner in favor of increasing the prediction residual code amount or decreasing the prediction mode code amount as a dynamic range of the transfer function increases. The circuitry determines a prediction mode for coding a coding unit of the image according to the determined cost function, and encodes the coding unit according to the determined prediction mode.

Claims (56)

1. An image processing device comprising:

circuitry configured to:

obtain an image that is generated on a basis of an incident light and a transfer function related to a conversion between the incident light and the image;

determine a cost function for prediction mode selection according to a dynamic range of the transfer function, the cost function calculating a cost value of a corresponding candidate prediction mode of candidate prediction modes based on a prediction residual code amount representing distortion of a prediction image in the corresponding candidate prediction mode and a prediction mode code amount representing an overhead code amount in the corresponding candidate prediction mode, and the cost function being determined by increasing a contribution of the prediction residual code amount or decreasing a contribution of the prediction mode code amount in the cost function as the dynamic range of the transfer function increases;

determine a prediction mode from the candidate prediction modes for coding a coding unit of the image according to cost values of the candidate prediction modes calculated according to the determined cost function; and

encode the coding unit of the image according to the determined prediction mode.

2. The image processing device according to claim 1 , wherein the circuitry is configured to:

set the prediction mode code amount of the corresponding candidate prediction mode to a first value in a case in which the transfer function corresponds to a first dynamic range; and

set the prediction mode code amount of the corresponding candidate prediction mode to a second value in a case in which the transfer function corresponds to a second dynamic range,

wherein the second dynamic range is narrower than the first dynamic range, and the first value is smaller than the second value.

3. The image processing device according to claim 1 , wherein the circuitry is configured to:

set the prediction residual code amount of the corresponding candidate prediction mode to a first value in a case in which the transfer function corresponds to a first dynamic range,

set the prediction residual code amount of the corresponding candidate prediction mode to a second value in a case in which the transfer function corresponds to a second dynamic range,

the second dynamic range is narrower than the first dynamic range, and the first value is greater than the second value.

4. The image processing device according to claim 2 , wherein the first dynamic range is a dynamic range for enabling display with luminance of greater than 100 nits.

5. The image processing device according to claim 1 ,

wherein the candidate prediction modes include a plurality of candidate modes in intra-prediction.

6. The image processing device according to claim 1 ,

wherein the candidate prediction modes include a plurality of candidate modes in inter-prediction.

7. The image processing device according to claim 1 ,

wherein the candidate prediction modes are selected from a group including intra-prediction and inter-prediction.

8. The image processing device according to claim 1 ,

wherein the circuitry is configured to determine a type of the transfer function on a basis of input information related to the transfer function applied to the image.

9. The image processing device according to claim 1 ,

wherein the circuitry is configured to select the prediction mode that corresponds to a minimum cost value among the cost values of the candidate prediction modes calculated according to the cost function.

10. The image processing device according to claim 8 , wherein the input information is information acquired via a user interface.

11. The image processing device according to claim 8 , wherein the input information is information acquired from an auxiliary signal to be multiplexed with an input signal that expresses the image.

12. The image processing device according to claim 8 , further comprising:

a storage configured to store sets of prediction mode code amount values associated with respective candidate types of the transfer function,

wherein the circuitry is configured to determine the cost function according to one of the sets of prediction mode code amount values associated with the type of the transfer function.

13. An image processing method comprising:

obtaining an image that is generated on a basis of an incident light and a transfer function related to a conversion between the incident light and the mage;

determining, by a processor of an image processing device, a cost function for prediction mode selection according to a dynamic range of the transfer function, the cost function calculating a cost value of a corresponding candidate prediction mode of candidate prediction modes based on a prediction residual code amount representing distortion of a prediction image in the corresponding candidate prediction mode and a prediction mode code amount representing an overhead code amount in the corresponding candidate prediction mode, and the cost function being determined by increasing a contribution of the prediction residual code amount or decreasing a contribution of the prediction mode code amount in the cost function as the dynamic range of the transfer function increases;

determining, by the processor of the image processing device, a prediction mode from the candidate prediction modes for coding a coding unit of the image according to cost values of the candidate prediction modes calculated according to the determined cost function; and

encoding the coding unit of the image according to the determined prediction mode.

14. The image processing method according to claim 13 , wherein the determining the cost function comprises:

setting the prediction mode code amount of the corresponding candidate prediction mode to a first value in a case in which the transfer function corresponds to a first dynamic range; and

setting the prediction mode code amount of the corresponding candidate prediction mode to a second value in a case in which the transfer function corresponds to a second dynamic range,

wherein the second dynamic range is narrower than the first dynamic range, and the first value is smaller than the second value.

15. The image processing method according to claim 13 , wherein the determining the cost function comprises:

setting the prediction residual code amount of the corresponding candidate prediction mode to a first value in a case in which the transfer function corresponds to a first dynamic range,

setting the prediction residual code amount of the corresponding candidate prediction mode to a second value in a case in which the transfer function corresponds to a second dynamic range,

the second dynamic range is narrower than the first dynamic range, and the first value is greater than the second value.

16. A non-transitory computer-readable medium storing a program which when executed by a processor of an image processing device causes the processor to perform a process comprising:

obtaining an image that is generated on a basis of an incident light and a transfer function related to a conversion between the incident light and the image;

determining a cost function for prediction mode selection according to a dynamic range of the transfer function, the cost function calculating a cost value of a corresponding candidate prediction mode of candidate prediction modes based on a prediction residual code amount representing distortion of a prediction image in the corresponding candidate prediction mode and a prediction mode code amount representing an overhead code amount in the corresponding candidate prediction mode, and the cost function being determined by increasing a contribution of the prediction residual code amount or decreasing a contribution of the prediction mode code amount in the cost function as the dynamic range of the transfer function increases;

determining a prediction mode from the candidate prediction modes for coding a coding unit of the image according to cost values of the candidate prediction modes calculated according to the determined cost function; and

encoding the coding unit of the image according to the determined prediction mode.

17. The non-transitory computer-readable medium according to claim 16 , wherein the determining the cost function comprises:

setting the prediction mode code amount of the corresponding candidate prediction mode to a first value in a case in which the transfer function corresponds to a first dynamic range; and

setting the prediction mode code amount of the corresponding candidate prediction mode to a second value in a case in which the transfer function corresponds to a second dynamic range,

wherein the second dynamic range is narrower than the first dynamic range, and the first value is smaller than the second value.

18. The non-transitory computer-readable medium according to claim 16 , wherein the determining the cost function comprises:

setting the prediction residual code amount of the corresponding candidate prediction mode to a first value in a case in which the transfer function corresponds to a first dynamic range,

setting the prediction residual code amount of the corresponding candidate prediction mode to a second value in a case in which the transfer function corresponds to a second dynamic range,

the second dynamic range is narrower than the first dynamic range, and the first value is greater than the second value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2019
From: FUCHIE, TAKAAKI; HIROSE, MASAKI; YADA, ATSUO
To: SONY CORPORATION
Reel/Frame 049053/0472 →
Priority Claims (1)
JP JP2016-246000 · Dec 19, 2016 · national
Continuity (1)
Related Publication 20190281267A1 · Sep 12, 2019
Cited By (1)
US 12,413,746