IP Library › Granted Patent US 8,730,356
Granted Patent B2
US 8,730,356 · App. 13/042,381 · Granted May 20, 2014

System and method for automatic flash removal from images

Inventors: Frederick William Ansfield (San Diego, CA); Kirstin Connors (San Diego, CA)
Assignee: Sony Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,730,356
App. No.
13/042,381
Granted
May 20, 2014
Kind
B2
Abstract

A system, method, computer program product, and business method for automatic image glare removal. Glare is often caused by direct reflection of a photographic flash. Images are acquired from at least two different locations, possibly simultaneously, and from one or more cameras, and digitized if necessary. A glare pattern is identified, typically by recognition of a fully overexposed area or known test glare patterns. The images are processed to remove the glare pattern by subtraction of the glare pattern from at least one image and substitution of corresponding data from a related image not identically impacted. The substituted data typically comprises chrominance data, which may be from a luminance-adjusted exposure-bracketed image. The processing may be performed by a camera, a pc, or a networked server, and the processed image is output. The business method includes automated image glare removal via a fee-based per-transaction or subscription service.

Claims (64)

1. A method of automatic image glare removal, comprising:

acquiring a plurality of images from a plurality of locations;

identifying at least one glare pattern in at least one of the images;

processing the images to remove the at least one glare pattern; and

outputting at least one processed image;

wherein identifying the glare pattern comprises:

recording at least one test glare pattern on at least one test image; and

recognizing the glare pattern by comparison against the test glare pattern.

2. The method of claim 1 wherein the images are acquired by at least one of the same camera and multiple cameras.

3. The method of claim 1 wherein the images are acquired substantially simultaneously.

4. The method of claim 1 wherein the images are acquired by at least one of a digital camera, a video camera, an infrared camera, a night vision camera, a camera with crossed polarizing lenses, and a camera on a vehicle including at least one of a car, a truck, an airplane, and an unmanned aerial vehicle.

5. The method of claim 1 further comprising digitizing at least one non-digital image.

6. The method of claim 1 wherein processing the images further comprises:

at least partially subtracting the identified glare pattern from at least one image; and

at least partially importing image content corresponding to the identified glare pattern from a different image not having the same identified glare pattern at the same image region.

7. The method of claim 6 wherein the imported image content includes chrominance data.

8. The method of claim 6 wherein the imported image content includes chrominance data from an exposure-bracketed image.

9. The method of claim 1 wherein the processing is performed by at least one of a camera, a personal computer, and a networked server.

10. A computer program product comprising a non-transitory computer readable medium tangibly embodying non-transitory computer readable code means thereon to cause at least one computing device to automatically remove image glare by:

acquiring a plurality of images from a plurality of locations;

identifying at least one glare pattern in at least one of the images;

processing the images to remove the at least one glare pattern; and

outputting at least one processed image;

wherein identifying the glare pattern comprises:

recording at least one test glare pattern on at least one test image; and

recognizing the glare pattern by comparison against the test glare pattern.

11. The computer program product of claim 10 wherein the images are acquired by at least one of the same camera and multiple cameras.

12. The computer program product of claim 10 wherein the images are acquired substantially simultaneously.

13. The computer program product of claim 10 wherein the images are acquired by at least one of a digital camera, a video camera, an infrared camera, a night vision camera, a camera with crossed polarizing lenses, and a camera on a vehicle including at least one of a car, a truck, an airplane, and an unmanned aerial vehicle.

14. The computer program product of claim 10 wherein the computing device digitizes at least one non-digital image.

15. The computer program product of claim 10 wherein processing the images further comprises:

at least partially subtracting the identified glare pattern from at least one image; and

at least partially importing image content corresponding to the identified glare pattern from a different image not having the same identified glare pattern at the same image region.

16. The computer program product of claim 15 wherein the imported image content includes chrominance data.

17. The computer program product of claim 15 wherein the imported image content includes chrominance data from an exposure-bracketed image.

18. The computer program product of claim 10 wherein the computing device is at least one of a camera, a personal computer, and a networked server.

19. A system for automatic image glare removal, comprising:

at least one image source that acquires a plurality of images from a plurality of locations; and

at least one computing device that

identifies at least one glare pattern in at least one of the images,

processes the images to remove the at least one glare pattern, and

outputs at least one processed image;

wherein identifying the glare pattern comprises:

recording at least one test glare pattern on at least one test image; and

recognizing the glare pattern by comparison against the test glare pattern.

20. The system of claim 19 wherein the image source includes at least one of a single camera and multiple cameras.

21. The system of claim 19 wherein the images are acquired substantially simultaneously.

22. The system of claim 19 wherein the images are acquired by at least one of a digital camera, a video camera, an infrared camera, a night vision camera, a camera with crossed polarizing lenses, and a camera on a vehicle including at least one of a car, a truck, an airplane, and an unmanned aerial vehicle.

23. The system of claim 19 wherein the computing device digitizes at least one non-digital image.

24. The system of claim 19 wherein processing the images further comprises:

at least partially subtracting the identified glare pattern from at least one image; and

at least partially importing image content corresponding to the identified glare pattern from a different image not having the same identified glare pattern at the same image region.

25. The system of claim 24 wherein the imported image content includes chrominance data.

26. The system of claim 24 wherein the imported image content includes chrominance data from an exposure-bracketed image.

27. The system of claim 19 wherein the processing is performed by at least one of a camera, a personal computer, and a networked server.

28. A fee-based method for automatic image glare removal, comprising:

charging a fee for at least one of:

acquiring a plurality of images from a plurality of locations;

identifying at least one glare pattern in at least one of the images;

processing the images to remove the at least one glare pattern; and

outputting at least one processed image;

wherein identifying the glare pattern comprises:

recording at least one test glare pattern on at least one test image; and

recognizing the glare pattern by comparison against the test glare pattern.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2011
From: ANSFIELD, FREDERICK WILLIAM; CONNORS, KIRSTIN
To: SONY CORPORATION
Reel/Frame 025914/0330 →
Continuity (1)
Related Publication 20120229681A1 · Sep 13, 2012