IP Library Granted Patent US 12,014,478
Granted Patent B2
US 12,014,478 · App. 17/155,653 · Granted Jun 18, 2024

Image adjustment based on local contrast

Inventors: Liam James O'Neil (Bedale, GB); Yanxiang Wang (Manchester, GB); Güney Kayim (Nottingham, GB); Alexis Leonardo Lluis Gomez (Castle Donington, GB)
Assignee: ARM LIMITED
G06T5/92G06N3/04G06T1/20G06T5/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,014,478
App. No.
17/155,653
Granted
Jun 18, 2024
Kind
B2
Abstract

A method, processor, and computer readable medium for generating blended intensity data for processing by a further processor, the method comprising the steps of generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values. An alpha mask is generated by associating an alpha mask value to each contrast value. First intensity data based on the image data using a first intensity calculation method and second intensity data based on the image data using a second intensity calculation method are also generated. The blended intensity data is generated by blending from at least one of the first intensity data and the second intensity data based on the alpha mask values; and outputted to the further processor.

Claims (61)

1. A method for generating blended intensity data for processing by a processor, the method comprising the steps of:

generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values;

generating an alpha mask by associating an alpha mask value to each of said contrast values, wherein generating the alpha mask comprises:

associating a first alpha mask value for a given contrast value if the given contrast value does not exceed a first threshold;

associating a second alpha mask value for the given contrast value if the given contrast value exceeds a second threshold; and

associating a third alpha mask value, the third alpha mask value being between the first alpha mask value and the second alpha mask value, when the given contrast value exceeds the first threshold and does not exceed the second threshold;

generating first intensity data using a first intensity calculation method and second intensity data using a second intensity calculation method, where the first intensity calculation method and the second intensity calculation method are different;

generating the blended intensity data by blending values from at least one of the first intensity data and the second intensity data based on the alpha mask values; and

outputting the blended intensity data to the processor.

2. The method for generating blended intensity data according to claim 1 , wherein the plurality of contrast values represent a difference between a maximum and minimum of a given group of pixels of the image data.

3. The method for generating blended intensity data according to claim 1 , wherein the third alpha mask value is determined based on at least one of:

a tuneable linear equation;

a look-up table; or

a power curve.

4. The method for generating blended intensity data according to claim 1 , further comprising creating combined intensity data based on a weighting of the first intensity data and the second intensity data associated with the third alpha mask value.

5. The method for generating blended intensity data according to claim 4 , wherein generating the blended intensity data comprises, for each contrast value of the contrast image:

blending from the first intensity data, if contrast value is associated with the first alpha mask value;

blending from the second intensity data if the contrast value is associated with the second alpha mask value; and

blending from the combined intensity data if the contrast value is associated with the third alpha mask value.

6. The method for generating blended intensity data according to claim 1 , wherein at least one of the first intensity calculation method or second intensity calculation method is a Luma intensity calculation method.

7. The method for generating blended intensity data according to claim 1 , wherein at least one of the first intensity calculation method or second intensity calculation method is a MaxRGB intensity calculation method.

8. The method for generating blended intensity data according to claim 1 , wherein the image data uses an RGB color model, and wherein the plurality of contrast values are based on a comparison between individual colour channels of the image data.

9. The method for generating blended intensity data according to claim 1 , wherein the image data uses a RAW or YUV color model.

10. A processor for generating blended intensity data for processing by a further processor, the processor comprising;

an input module for obtaining image data;

a contrast image generation module for generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values;

an alpha mask generation module for generating an alpha mask by associating an alpha mask value to each of said contrast values, wherein the alpha mask generation module:

associates a first alpha mask value for a given contrast value if the given contrast value does not exceed a first threshold;

associates a second alpha mask value for the given contrast value if the given contrast value exceeds a second threshold; and

associates a third alpha mask value, the third alpha mask value being between the first alpha mask value and the second alpha mask value, when the given contrast value exceeds the first threshold and does not exceed the second threshold;

an intensity data generation module for generating first intensity data using a first intensity calculation method and second intensity data using a second intensity calculation method, where the first intensity calculation method and the second intensity calculation method are different;

a blended intensity data calculation module for generating the blended intensity data by blending from at least one of the first intensity data and the second intensity data based on the alpha mask values; and

an output module for outputting the blended intensity data to the further processor.

11. The processor for generating blended intensity data according to claim 10 , wherein the contrast image generation module is arranged to generate the plurality of contrast values by determining a difference between a maximum and minimum of a given group of pixels of the image data.

12. The processor for generating blended intensity data according to claim 10 , wherein the third alpha mask value is determined based on at least one of:

a tuneable linear equation;

a look-up table; or

a power curve.

13. The processor for generating blended intensity data according to claim 10 , wherein the blended intensity data calculation module creates a combined intensity data based on a weighting of the first intensity data and the second intensity data associated with the third alpha mask value.

14. The processor for generating blended intensity data according to claim 13 , wherein the blended intensity data calculation module for each contrast value of the contrast image:

selects from the first intensity data, if contrast value is associated with the first alpha mask value;

selects from the second intensity data if the contrast value is associated with the second alpha mask value; and

selects from the combined intensity data if the contrast value is associated with the third alpha mask value.

15. The processor for generating blended intensity data according to claim 10 , wherein the intensity data generation module comprises at least a Luma intensity calculation unit for generating at least one of the first intensity data or the second intensity data.

16. The processor for generating blended intensity data according to claim 10 , wherein the intensity data generation module comprises at least a MaxRGB calculation unit for generating at least one of the first intensity data or the second intensity data.

17. The processor for generating blended intensity data according to claim 10 , wherein outputting the blended intensity data to the further processor comprises outputting the blended intensity data to at least one of:

a display processor;

an image signal processor;

a central processing unit;

a graphics processing unit;

a neural processing unit; or

a digital signal processor.

18. A non-transitory computer-readable storage medium comprising a set of computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to generate blended intensity data for processing by a further processor, the instructions comprising:

generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values;

generating an alpha mask by associating an alpha mask value to each of said contrast values, wherein generating the alpha mask comprises:

associating a first alpha mask value for a given contrast value if the given contrast value does not exceed a first threshold;

associating a second alpha mask value for the given contrast value if the given contrast value exceeds a second threshold; and

associating a third alpha mask value, the third alpha mask value being between the first alpha mask value and the second alpha mask value, when the given contrast value exceeds the first threshold and does not exceed the second threshold;

generating first intensity data based using a first intensity calculation method and second intensity data using a second intensity calculation method, where the first intensity calculation method and the second intensity calculation method are different;

generating the blended intensity data by blending from at least one of the first intensity data and the second intensity data based on the alpha mask values; and

outputting the blended intensity data to the further processor.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2022
From: APICAL LIMITED
To: ARM LIMITED
Reel/Frame 060620/0954 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2021
From: O'NEIL, LIAM JAMES
To: ARM LIMITED
Reel/Frame 055047/0093 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2021
From: WANG, YANXIANG; KAYIM, GÜNEY; GOMEZ, ALEXIS LEONARDO LLUIS
To: APICAL LIMITED
Reel/Frame 055047/0209 →
Continuity (1)
Related Publication 20220237753A1 · Jul 28, 2022