IP Library Granted Patent US 9,270,872
Granted Patent B2
US 9,270,872 · App. 14/089,908 · Granted Feb 23, 2016

Apparatus, systems, and methods for removing shading effect from image

Inventor: David Donohoe (Ontario, CA)
Assignee: LINEAR ALGEBRA TECHNOLOGIES LIMITED
H04N5/2173H04N5/2351H04N5/3572H04N9/045H04N9/735
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,270,872
App. No.
14/089,908
Granted
Feb 23, 2016
Kind
B2
Abstract

The disclosed subject matter includes an apparatus configured to remove a shading effect from an image. The apparatus can include one or more interfaces configured to provide communication with an imaging module that is configured to capture the image, and a processor, in communication with the one or more interfaces, configured to run a module stored in memory. The module is configured to receive the image captured by the imaging module under a first lighting spectrum, receive a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum, determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum, and operate the correction mesh on the image to remove the shading effect from the image.

Claims (50)

1. An apparatus configured to remove a shading effect from an image, the apparatus comprising:

one or more interfaces configured to provide communication with an imaging module that is configured to capture the image; and

a processor, in communication with the one or more interfaces, configured to run a module stored in memory that is configured to:

receive the image captured by the imaging module under a first lighting spectrum;

receive a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum;

determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum; and

operate the correction mesh on the image to remove the shading effect from the image.

2. The apparatus of claim 1 , wherein the module is further configured to determine that the image was captured under the first lighting spectrum using an automated white balance technique.

3. The apparatus of claim 2 , wherein the module is configured to:

determine, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to a linear combination of two or more lighting spectra,

receive prediction functions associated with the two or more lighting spectra,

combine the prediction functions to generate a final prediction function, and

apply the final prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image.

4. The apparatus of claim 2 , wherein the module is further configured to determine the correction mesh for the image based on the first lighting spectrum of the image.

5. The apparatus of claim 2 , wherein the module is configured to:

determine, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to one of a predetermined set of lighting spectra,

receive a prediction function associated with the one of the predetermined set of lighting spectra, and

apply the prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image.

6. The apparatus of claim 5 , wherein the prediction function comprises a linear function.

7. The apparatus of claim 5 , wherein the prediction function is based on characteristics of image sensors having an identical image sensor type as an image sensor in the imaging module.

8. The apparatus of claim 5 , wherein the prediction function is associated only with the portion of the per-unit correction mesh.

9. The apparatus of claim 1 , wherein the apparatus is a part of a camera module in a mobile device.

10. A method for removing a shading effect on an image, the method comprising:

receiving, at a correction module of a computing system, the image captured under a first lighting spectrum from an imaging module over an interface of the computing system;

receiving, at the correction module, a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum;

determining, at the correction module, a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum; and

operating, at the correction module, the correction mesh on the image to remove the shading effect from the image.

11. The method of claim 10 , further comprising determining that the image was captured under the first lighting spectrum using an automated white balance technique.

12. The method of claim 11 , further comprising determining the correction mesh for the image based on the first lighting spectrum of the image.

13. The method of claim 11 , further comprising:

determining, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to one of a predetermined set of lighting spectra,

receiving a prediction function associated with the one of the predetermined set of lighting spectra, and

applying the prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image.

14. The method of claim 13 , wherein the prediction function is based on characteristics of image sensors having an identical image sensor type as an image sensor in the imaging module.

15. The method of claim 11 , further comprising:

determining, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to a linear combination of two or more lighting spectra,

receiving prediction functions associated with the two or more lighting spectra,

combining the prediction functions to generate a final prediction function, and

applying the final prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image.

16. A non-transitory computer readable medium having executable instructions associated with a correction module, operable to cause a data processing apparatus to:

receive an image captured under a first lighting spectrum from an imaging module in communication with the data processing apparatus;

retrieve, from a memory device, a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum;

determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum; and

operate the correction mesh on the image to remove a shading effect from the image.

17. The non-transitory computer readable medium of claim 16 , further comprising executable instructions operable to cause the data processing apparatus to determine that the image was captured under the first lighting spectrum using an automated white balance technique.

18. The non-transitory computer readable medium of claim 17 , further comprising executable instructions operable to cause the data processing apparatus to determine the correction mesh for the image based on the first lighting spectrum of the image.

19. The non-transitory computer readable medium of claim 17 , further comprising executable instructions operable to cause the data processing apparatus to:

receive a prediction function associated with one of a predetermined set of lighting spectra, and

apply the prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image.

20. The non-transitory computer readable medium of claim 17 , wherein the prediction function is based on characteristics of image sensors having an identical image sensor type as an image sensor in the imaging module.

Assignments (2)
MERGER Recorded Oct 26, 2022
From: LINEAR ALGEBRA TECHNOLOGIES LIMITED
To: MOVIDIUS LIMITED
Reel/Frame 061546/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2014
From: DONOHOE, DAVID
To: LINEAR ALGEBRA TECHNOLOGIES LIMITED
Reel/Frame 032624/0263 →
Continuity (1)
Related Publication 20150146038A1 · May 28, 2015