IP Library Granted Patent US 10,880,483
Granted Patent B2
US 10,880,483 · App. 16/544,426 · Granted Dec 29, 2020

Method and apparatus to correct blur in all or part of an image

Inventor: Fatih M. Ozluturk (Sands Point, NY)
Assignee: CLEAR IMAGING RESEARCH, LLC
H04N5/23287G02B27/646G06T5/002G06T5/003G06T7/20H04N5/23216H04N5/23229H04N5/23248H04N5/23251H04N5/23254H04N5/23258H04N5/23267H04N5/23293H04N5/265G06T2207/10004G06T2207/10016G06T2207/20024G06T2207/20201G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,880,483
App. No.
16/544,426
Granted
Dec 29, 2020
Kind
B2
Abstract

The effect of blur in digital images of an imaging device is corrected by displaying a preview image of a scene to be captured in a user interface of a device. A user input designates a first subject in the preview image and a plurality of images that include the first subject and a second subject are captured. The plurality of images are processed to obtain a combined image, taking into account at least one of a focal length of a lens of the imaging device and a zoom level of a lens of the imaging device, and the combined image includes the first subject and the second subject, the first subject in the combined image is substantially blur free, and the second subject in the combined image is blurred compared to the first image. The combined image is stored in a memory of the device.

Claims (52)

1. A method for use in an imaging device for capturing digital images, the method comprising:

displaying a preview of a scene to be captured in a user interface of the device;

capturing a plurality of images using a lens having one or more lens elements and at least one lens element movable relative to the imaging device, wherein the plurality of images include a first subject and a second subject;

moving the at least one moveable lens element of the lens electro-mechanically to counter an effect of motion of the device;

processing the plurality of images by a processor of the device, processor receiving and executing instructions stored in a memory of the device, to obtain a combined image, such that

the combined image includes the first subject and the second subject, the first subject in the combined image is substantially blur free, and the second subject in the combined image is blurred compared to the first subject;

storing the combined image in the memory of the device; and

displaying the combined image in the user interface of the device.

2. The method of claim 1 , wherein the method further comprises;

displaying the combined image in the user interface;

receiving a user input in the user interface, wherein the user input selects the second subject in the combined image;

processing the plurality of images by the processor to obtain a second combined image, such that the second combined image includes the first subject and the second subject, the second subject in the second combined image is substantially blur free, and the first subject in the second combined image is blurred compared to the second subject;

storing the second combined image in the memory; and

displaying the second combined image in the user interface.

3. The method of claim 1 , wherein the imaging device receives a user input in the user interface of the imaging device and the user input designates the first subject to be blur free in the combined image.

4. The method of claim 1 , wherein the processor designates the first subject to be blur free in the combined image.

5. The method of claim 1 , wherein the processing of the images includes calculating by the processor a pixel value for each pixel representing an image point of the first subject in the combined image based on values of the pixels representing the image point of the first subject in one or more of the plurality of images.

6. The method of claim 1 , wherein the areas of the combined image other than the first subject are blurred compared to the areas other than the first subject in the plurality of images being processed.

7. The method of claim 1 , wherein processing the plurality of images comprises modifying one or more of the plurality of images such that the first subject in the plurality of images is aligned in a same location in the combined image.

8. An imaging device for capturing digital images, comprising:

a user interface configured to display a preview of a scene to be captured;

at least one image sensor for capturing a plurality of images, wherein the plurality of images include a first subject and a second subject;

at least one lens optically connected to the at least one image sensor, wherein the lens includes one or more lens elements, at least one of the lens elements electro-mechanically movable relative to the imaging device;

a memory configured to store instructions for execution by a processor;

a processor, wherein the processor is connected to the memory for receiving instructions stored therein, and executing the instructions by the processor causes the processor to combine the plurality of images to obtain a combined image, such that the combined image includes the first subject and the second subject, the first subject in the combined image is substantially blur free and the second subject in the combined image is blurred compared to the first subject;

the memory further configured to store the combined image; and

the user interface further configured to display the combined image.

9. The imaging device of claim 8 , wherein:

the user interface is further configured to display the combined image and to receive a user input, wherein the user input selects the second subject in the combined image;

the instructions, when executed by the processor further cause the processor to process the plurality of images to obtain a second combined image, such that the second combined image includes the first subject and the second subject, the second subject in the second combined image is substantially blur free, and the first subject in the second combined image is blurred compared to the second subject;

the memory is further configured to store the second combined image; and

the user interface is further configured to display the second combined image.

10. The imaging device of claim 8 , wherein executing the instructions by the processor further causes the processor to calculate a pixel value for each pixel representing an image point of the first subject in the combined image based on values of the pixels representing the image point of the first subject in the one or more of the plurality of images.

11. The imaging device of claim 8 , wherein the user interface is further configured to receive a user input and the user input designates the first subject to be blur free in the combined image.

12. The imaging device of claim 8 , wherein executing the instructions by the processor further causes the processor to designate the first subject to be blur free in the combined image.

13. The imaging device of claim 8 , wherein executing the instructions by the processor further causes the processor to process the plurality of images to obtain the combined image such that the areas of the combined image other than the first subject are blurred compared to the areas other than the first subject in the plurality of images being processed.

14. The imaging device of claim 8 , wherein executing the instructions by the processor further causes the processor to modify the plurality of images such that the first subject in the plurality of images is aligned in a same location in the combined image.

15. A processor for use in an imaging device, wherein the processor is connected to a memory of the imaging device, the memory holding instructions for execution by the processor, wherein receiving and executing the instructions by the processor causes the processor to:

move at least one movable lens element within a lens of the imaging device electro-mechanically to counter an effect of a motion of the imaging device, wherein the lens includes one or more lens elements and at least one of the lens elements is movable relative to the imaging device;

receive a plurality of images captured by at least one image sensor and the lens of the imaging device, wherein the plurality of images include a first subject and a second subject;

process the plurality of images to obtain a combined image, such that the combined image includes the first subject and the second subject, the first subject in the combined image is substantially blur free and the second subject in the combined image is blurred compared to the first subject;

store the combined image in the memory of the imaging device; and

display the combined image in the user interface of the imaging device.

16. The processor of claim 15 , wherein executing the instructions by the processor further causes the processor to:

display the combined image in a user interface of the imaging device and receive a user input via the user interface, wherein the user input selects the second subject in the combined image;

combine the plurality of images to obtain a second combined image, such that the second combined image includes the first subject and the second subject, the second subject in the second combined image is substantially blur free, and the first subject in the second combined image is blurred compared to the second subject;

store the second combined image in the memory of the device; and

display the second combined image in the user interface of the imaging device.

17. The processor of claim 15 , wherein executing the instructions by the processor further causes the processor to calculate a pixel value for each pixel representing an image point of the first subject in the combined image based on values of the pixels representing the image point of the first subject in the one or more of the plurality of images.

18. The processor of claim 15 , wherein executing the instructions by the processor further causes the processor to receive a user input via the user interface of the imaging device and the user input designates the first subject to be blur free in the combined image.

19. The processor of claim 15 , wherein executing the instructions by the processor further causes the processor to process the plurality of images to obtain the combined image such that the areas of the combined image other than the first subject are blurred compared to the areas other than the first subject in the plurality of images being processed.

20. The processor of claim 15 , wherein executing the instructions by the processor further causes the processor to modify the plurality of images such that the first subject in the plurality of images is aligned in a same location in the combined image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2021
From: OZLUTURK, FATIH; OZLUTURK & CO, LLC; CLEAR IMAGING, LLC
To: CLEAR IMAGING RESEARCH, LLC
Reel/Frame 055959/0643 →
Continuity (10)
Continuation 15858339 · Dec 29, 2017
Continuation 15431332 · Feb 13, 2017
Continuation 15149481 · May 9, 2016
Continuation 14690818 · Apr 20, 2015
Continuation 14532654 · Nov 4, 2014
Continuation 13442370 · Apr 9, 2012
Continuation 12274032 · Nov 19, 2008
Continuation 11089081 · Mar 24, 2005
Provisional Application 60556230 · Mar 25, 2004
Related Publication 20190373176A1 · Dec 5, 2019