IP Library › Granted Patent US 11,774,751
Granted Patent B2
US 11,774,751 · App. 17/383,602 · Granted Oct 3, 2023

Digital camera with in-camera software for image correction

Inventor: Neal Solomon (Oakland, CA)
Assignee: Optimum Imaging Technologies LLC
G02B27/0025G06T7/194H04N23/45H04N23/54H04N23/55H04N23/66H04N23/67H04N23/69H04N23/73H04N23/75H04N23/76H04N23/81H04N23/811H04N23/959H04N25/585H04N25/61H04N25/615
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,774,751
App. No.
17/383,602
Granted
Oct 3, 2023
Kind
B2
Abstract

A system is disclosed for the automated correction of optical and digital aberrations in a digital imaging system. The system includes several main parts, including (a) digital filters, (b) hardware modifications, (c) digital system corrections, (d) digital system dynamics and (e) network aspects. The system solves numerous problems in still and video photography that are presented in the digital imaging environment.

Claims (47)

1. A method of processing one or more images in a cellular phone, comprising:

processing with a processor of the cellular phone at least one image captured by an optical system of the cellular phone including a lens and an image sensor of the cellular phone, the processing using upgradable software that performs a plurality of image correction algorithms, the processing including a digital algorithm for a dust correction process that analyzes multiple images for a consistent pattern of pixels obscured by dust and corrects for image discontinuities that are indicative of dust on the image sensor; and,

sending to memory at least one corrected image resulting from the processing,

wherein the cellular phone software is upgradable to provide updated algorithms for correction of images.

2. The method of claim 1 , wherein the dust correction process includes:

processing pixel information from pixels adjacent to the pixels obscured by dust to create corrected pixel information for the pixels obscured by dust.

3. The method of claim 2 , wherein the processing pixel information includes interpolating information from neighboring pixels that are not obscured by dust to produce corrected pixel information.

4. The method of claim 3 , wherein the interpolating is performed to create a continuous tone for the corrected pixel information.

5. The method of claim 1 , wherein the processing further comprises:

determining pixels on the image sensor that are too bright pixels and identifying them as hot pixels; and

interpolating information from pixels adjacent to the hot pixels to create corrected hot pixel information; and

using the corrected hot pixel information for the hot pixels.

6. The method of claim 5 , wherein the processing further comprises:

determining pixels on the image sensor that are too dark pixels and identifying them as dead pixels; and

interpolating information from pixels adjacent to the dead pixels to create corrected dead pixel information; and

using the corrected dead pixel information for the dead pixels.

7. The method of claim 1 , wherein the processing further comprises:

determining pixels on the image sensor that are too dark pixels and identifying them as dead pixels; and

interpolating information from pixels adjacent to the dead pixels to create corrected dead pixel information; and

using the corrected dead pixel information for the dead pixels.

8. The method of claim 1 , further comprising:

creating an initial map of pixels indicative of those pixels that are defective pixels or pixels affected by dust,

creating one or more maps of pixels indicative of defective pixels or pixels affected by dust at different times;

comparing a plurality of the maps to determine pixels that a permanently affected and

identifying those pixels as defective pixels, and to determine pixels that are temporarily affected and identifying those pixels as affected by dust.

9. The method of claim 1 , further comprising:

creating an initial map of pixels indicative of pixels indicative of dead pixels,

creating one or more maps of pixels indicative of dead pixels at different times; and

comparing a plurality of the maps to determine changes in dead pixels over time.

10. The method of claim 1 , wherein multiple frames are captured in a video sequence.

11. The method of claim 1 , wherein the processing further comprises adjusting a depth of field of an image.

12. The method of claim 1 , further comprising adjusting a depth of field of an image after capture of the image using the cellular phone software.

13. The method of claim 1 , further comprising changing a variable based on an auto-focus process, an auto-exposure process, or a depth of field adjustment process performed by the cellular phone and electronically storing that changed variable.

14. The method of claim 1 , wherein the image processing algorithms include a fast Fourier transform.

15. The method of claim 1 , further comprising:

displaying a corrected image of the one or more corrected images on a monitor, and displaying a modified version of the corrected image based on a change to at least one variable.

16. The method of claim 1 , wherein the processing includes using at least one application specific integrated circuit.

17. A method of processing one or more images in a cellular phone, comprising:

processing with a processor of the cellular phone at least one image captured by an optical system of the cellular phone including a lens and an image sensor of the cellular phone, the processing using upgradable software that performs a plurality of image correction algorithms, the processing to correct the at least one captured image and including a digital algorithm for a pixel correction process including analyzing multiple images for a consistent pattern indicative of malfunctioning pixels that compensates for pixel information error; and,

storing in memory at least one corrected image resulting from the processing,

wherein the cellular phone software is upgradable to provide updated algorithms for correction of images.

18. The method of claim 17 , wherein processing further comprises:

processing pixel information from pixels adjacent to malfunctioning pixels to create corrected pixel information for the malfunctioning pixels.

19. The method of claim 18 , wherein the processing pixel information includes interpolating information from pixels adjacent to the malfunctioning pixels.

20. The method of claim 18 , further comprising:

determining a malfunctioning pixel map at a plurality of times; and

comparing a plurality of pixel maps to determine how pixels malfunction over time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2021
From: SOLOMON, NEAL
To: OPTIMUM IMAGING TECHNOLOGIES LLC
Reel/Frame 056956/0633 →
Continuity (6)
Continuation 16692939 · Nov 22, 2019
Continuation 13691805 · Dec 2, 2012
Continuation 12586221 · Sep 18, 2009
Continuation 11825521 · Jul 6, 2007
Provisional Application 60807065 · Jul 11, 2006
Related Publication 20220082821A1 · Mar 17, 2022
Cited By (1)
US 12,645,073