IP Library › Granted Patent US 9,838,594
Granted Patent B2
US 9,838,594 · App. 15/059,097 · Granted Dec 5, 2017

Irregular-region based automatic image correction

Inventors: Matthew Trusten (San Diego, CA); Narayana Karthik Sadanandam Ravirala (San Diego, CA); Adarsh Abhay Golikeri (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N5/23216G06T5/50H04N5/23212H04N5/23222H04N5/23293G06T2207/10148G06T2207/20104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,838,594
App. No.
15/059,097
Granted
Dec 5, 2017
Kind
B2
Abstract

Methods and apparatuses for irregular-region based automatic image correction are disclosed. In one aspect, the method is operable by an imaging device including a touch sensor, for performing image correction. The method can include obtaining a first image of a scene and receiving, via the touch sensor, a touch input indicating a selected region of the first image and having a shape that corresponds to a shape of the selected region. The method can also include determining statistics indicating visual properties for the selected region, adjusting at least one image correction parameter of the imaging device based on the determined statistics and the shape of the touch input, and obtaining a second image of the scene based on the adjusted at least one image correction parameter of the imaging device.

Claims (83)

1. A method, operable by an imaging device including a touch sensor, for performing image correction, the method comprising:

obtaining a first image of a scene, the first image being divided into a plurality of blocks;

receiving, via the touch sensor, a user-drawn input indicating a selected region of the first image and having a shape that corresponds to a shape of the selected region;

determining statistics indicating visual properties for each of the blocks;

determining that the shape of the user-drawn input comprises an open curve;

weighting the statistics for blocks of the first image that overlap the open curve higher than blocks of the first image that do not overlap the open curve;

adjusting at least one image correction parameter of the imaging device based on the weighted statistics; and

obtaining a second image of the scene based on the adjusted at least one image correction parameter of the imaging device.

2. The method of claim 1 , wherein the at least one image correction parameter of the imaging device comprises one or more of: a position of a lens, a size of an aperture, a shutter speed, and a white balance compensation parameter.

3. The method of claim 1 , wherein the method further comprises defining the selected region as an area of the first image corresponding to the user-drawn input based on the shape of the user-drawn input.

4. The method of claim 1 , further comprising:

receiving, via the touch sensor, a second user-drawn input indicating a second selected region of the first image and having a shape that corresponds to a shape of the second selected region;

determining that the shape of the second user-drawn input comprises a closed loop; and

weighting the statistics for blocks of the grid that are enclosed by the closed loop higher than blocks of the grid that are not enclosed by the selected region.

5. The method of claim 1 , wherein the at least one image correction parameter of the imaging device comprises a position of a lens, the method further comprising:

determining a plurality of positions of the lens respectively corresponding to different focal depths of the selected region; and

receiving a third image at each of the determined positions of the lens.

6. The method of claim 1 , wherein the at least one image correction parameter of the imaging device comprises a position of a lens, the method further comprising:

detecting at least one object within the selected region;

determining the position of the lens corresponding to a focal depth of the object; and

adjusting the position of the lens based on the determined position of the lens.

7. An imaging device, comprising:

an image sensor;

a display;

a touch sensor;

at least one processor; and

a memory storing computer-executable instructions for controlling the at least one processor to:

obtain a first image of a scene from the image sensor, the first image being divided into a plurality of blocks;

control the display to display the first image;

receive, from the touch sensor, a user-drawn input indicating a selected region of the first image and having a shape that corresponds to a shape of the selected region;

determine statistics indicating visual properties for each of the blocks;

determine that the shape of the user-drawn input comprises an open curve;

weight the statistics for blocks of the first image that overlap the open curve higher than blocks of the first image that do not overlap the open curve;

adjust at least one image correction parameter of the imaging device based on the weighted statistics; and

obtain a second image of the scene based on the adjusted at least one image correction parameter of the imaging device.

8. The imaging device of claim 7 , wherein the at least one image correction parameter of the imaging device comprises one or more of: a position of a lens, a size of an aperture, a shutter speed, and a white balance compensation parameter.

9. The imaging device of claim 7 , wherein the computer-executable instructions are further for controlling the at least one processor to define the selected region as an area of the first image corresponding to the user-drawn input based on the shape of the user-drawn input.

10. The imaging device of claim 7 , wherein the computer-executable instructions are further for controlling the at least one processor to:

receive, via the touch sensor, a second user-drawn input indicating a second selected region of the first image and having a shape that corresponds to a shape of the second selected region;

determine that the shape of the second user-drawn input comprises a closed loop; and

weight the statistics for blocks of the grid that are enclosed by the closed loop higher than blocks of the grid that are not enclosed by the selected region.

11. The imaging device of claim 7 , wherein the at least one image correction parameter of the imaging device comprises a position of a lens, the computer-executable instructions being further for controlling the at least one processor to:

determine a plurality of positions of the lens respectively corresponding to different focal depths of the selected region; and

receive a third image at each of the determined positions of the lens.

12. The imaging device of claim 7 , wherein the at least one image correction parameter of the imaging device comprises a position of a lens, the computer-executable instructions being further for controlling the at least one processor to:

detect at least one object within the selected region;

determine the position of the lens corresponding to a focal depth of the object; and

adjust the position of the lens based on the determined position of the lens.

13. An apparatus, comprising:

means for obtaining a first image of a scene, the first image being divided into a plurality of blocks;

means for receiving a user-drawn input indicating a selected region of the first image and having a shape that corresponds to a shape of the selected region;

means for determining statistics indicating visual properties for each of the blocks;

means for determining that the shape of the user-drawn input comprises an open curve;

means for weighting the statistics for blocks of the first image that overlap the open curve higher than blocks of the first image that do not overlap the open curve;

means for adjusting at least one image correction parameter of an imaging device based on the weighted statistics; and

means for obtaining a second image of the scene based on the adjusted at least one image correction parameter of the imaging device.

14. The apparatus of claim 13 , wherein the at least one image correction parameter of the imaging device comprises one or more of: a position of a lens, a size of an aperture, a shutter speed, and a white balance compensation parameter.

15. The apparatus of claim 13 , wherein the apparatus further comprises means for defining the selected region as an area of the first image corresponding to the user-drawn input based on the shape of the user-drawn input.

16. The apparatus of claim 13 , further comprising:

means for receiving, via the touch sensor, a second user-drawn input indicating a second selected region of the first image and having a shape that corresponds to a shape of the second selected region;

means for determining that the shape of the second user-drawn input comprises a closed loop; and

means for weighting the statistics for blocks of the grid that are enclosed by the closed loop higher than blocks of the grid that are not enclosed by the selected region.

17. The apparatus of claim 13 , wherein the at least one image correction parameter of the imaging device comprises a position of a lens, the apparatus further comprising:

means for determining a plurality of positions of the lens respectively corresponding to different focal depths of the selected region; and

means for receiving a third image at each of the determined positions of the lens.

18. The apparatus of claim 13 , wherein the at least one image correction parameter of the imaging device comprises a position of a lens, the apparatus further comprising:

means for detecting at least one object within the selected region;

means for determining the position of the lens corresponding to a focal depth of the object; and

means for adjusting the position of the lens based on the determined position of the lens.

19. A non-transitory computer readable storage medium having stored thereon instructions that, when executed, cause a processor of a device to:

obtain a first image of a scene, the first image being divided into a plurality of blocks;

receive, via a touch sensor, a user-drawn input indicating a selected region of the first image and having a shape that corresponds to a shape of the selected region;

determine statistics indicating visual properties for each of the blocks;

determine that the shape of the user-drawn input comprises an open curve;

weight the statistics for blocks of the first image that overlap the open curve higher than blocks of the first image that do not overlap the open curve;

adjust at least one image correction parameter of an imaging device based on the weighted statistics; and

obtain a second image of the scene based on the adjusted at least one image correction parameter of the imaging device.

20. The non-transitory computer readable storage medium of claim 19 , wherein the at least one image correction parameter of the imaging device comprises one or more of: a position of a lens, a size of an aperture, a shutter speed, and a white balance compensation parameter.

21. The non-transitory computer readable storage medium of claim 19 , wherein the non-transitory computer readable storage medium further has stored thereon instructions that, when executed, cause the processor to define the selected region as an area of the first image corresponding to the user-drawn input based on the shape of the user-drawn input.

22. The non-transitory computer readable storage medium of claim 19 , further having stored thereon instructions that, when executed, cause the processor to:

receive, via the touch sensor, a second user-drawn input indicating a second selected region of the first image and having a shape that corresponds to a shape of the second selected region;

determine that the shape of the second user-drawn input comprises a closed loop; and

weight the statistics for blocks of the grid that are enclosed by the closed loop higher than blocks of the grid that are not enclosed by the selected region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2016
From: TRUSTEN, MATTHEW; RAVIRALA, NARAYANA KARTHIK SADANANDAM; GOLIKERI, ADARSH ABHAY
To: QUALCOMM INCORPORATED
Reel/Frame 038037/0206 →
Continuity (1)
Related Publication 20170257557A1 · Sep 7, 2017