IP Library Granted Patent US 9,661,218
Granted Patent B2
US 9,661,218 · App. 15/204,225 · Granted May 23, 2017

Using captured high and low resolution images

Inventor: Aaron T. Deever (Pittsford, NY)
Assignee: MONUMENT PEAK VENTURES, LLC
H04N5/23232G06T3/4076H04N5/217H04N5/2173H04N9/045H04N5/347
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,661,218
App. No.
15/204,225
Granted
May 23, 2017
Kind
B2
Abstract

A method produces an improved high resolution image. This method includes capturing low resolution images and a high resolution image and combining the low resolution images to provide an aggregate low resolution image. The method further includes reducing the resolution of the high resolution image to provide an image representative of a low resolution image at a low resolution setting of the image capture device; interpolating the representative low resolution image to provide an interpolated high resolution image; and calculating a residual image from the high resolution image and the interpolated high resolution image. The method also includes combining the representative low resolution image and the aggregate low resolution image to provide a final low resolution image and using the final low resolution image and the residual image to provide the improved high resolution image.

Claims (36)

1. A method for producing an improved high resolution image, the method comprising:

capturing low resolution images and a high resolution image;

combining the low resolution images to provide an aggregate low resolution image;

reducing the resolution of the high resolution image to provide an image representative of a low resolution image at a low resolution setting of the image capture device;

interpolating the representative low resolution image to provide an interpolated high resolution image;

calculating a residual image from the high resolution image and the interpolated high resolution image; and

mapping matching pixels from the aggregate low resolution image and the representative low resolution image.

2. The method of claim 1 , further comprising forming a final low resolution image for matching pixels.

3. The method of claim 2 , wherein the final low resolution image for matching pixel includes a weighted average of the aggregate low resolution image and the representative low resolution image pixel data.

4. The method of claim 3 , wherein the weighted average is calculated as a function of a noise standard deviation of the aggregate low resolution image and the representative low resolution image.

5. The method of claim 2 , further comprising forming a final low resolution image for non-matching pixels.

6. The method of claim 5 , wherein the final low resolution image for non-matching pixels includes a value of the representative low resolution image.

7. The method of claim 1 , further comprising estimating motion between the aggregate low resolution image and the representative low resolution image.

8. A system comprising:

an image capture device configured to capture a low resolution image of a scene and a high resolution image of the scene;

a response filter coupled to the image capture device, wherein the response filter is configured to combine the low resolution image with other low resolution images to provide an aggregate low resolution image; and

a processor configured to reduce the resolution of the high resolution image to provide an image representative of a low resolution image at a low resolution setting of the image capture device; interpolate the representative low resolution image to provide an interpolated high resolution image; calculate a residual image from the high resolution image and the interpolated high resolution image; and map matching pixels from the aggregate low resolution image and the representative low resolution image.

9. The system of claim 8 , wherein the processor is further configured to form a final low resolution image for matching pixels.

10. The system of claim 9 , wherein the final low resolution image for matching pixel includes a weighted average of the aggregate low resolution image and the representative low resolution image pixel data.

11. The system of claim 10 , wherein the weighted average is calculated as a function of a noise standard deviation of the aggregate low resolution image and the representative low resolution image.

12. The system of claim 9 , wherein the processor is further configured to form a final low resolution image for non-matching pixels.

13. The system of claim 12 , wherein the final low resolution image for non-matching pixels includes a value of the representative low resolution image.

14. The system of claim 8 , wherein the processor is further configured to estimate motion between the aggregate low resolution image and the representative low resolution image.

15. A non-transitory computer-readable medium having instructions stored thereon for providing an improved high resolution image using low resolution images and at least one high resolution image of a scene captured by an image capture device, the instructions comprising:

instructions for capturing low resolution images of a scene and a high resolution image of the scene;

instructions for combining the low resolution images to provide an aggregate low resolution image;

instructions for reducing the resolution of the high resolution image to provide an image representative of a low resolution image at a low resolution setting of the image capture device;

instructions for interpolating the representative low resolution image to provide an interpolated high resolution image;

instructions for calculating a residual image from the high resolution image and the interpolated high resolution image;

instructions for estimating motion between the aggregate low resolution image and the representative low resolution image; and

instructions for mapping matching pixels from the aggregate low resolution image and the representative low resolution image.

16. The non-transitory computer-readable medium of claim 15 , further comprising instructions for forming a final low resolution image for matching pixels.

17. The non-transitory computer-readable medium of claim 16 , wherein the final low resolution image for matching pixels include a weighted average of the aggregate low resolution image and the representative low resolution image pixel data.

18. The non-transitory computer-readable medium of claim 17 , wherein the weighted average is calculated as a function of a noise standard deviation of the aggregate low resolution image and the representative low resolution image.

19. The non-transitory computer-readable medium of claim 16 , further comprising instructions for forming a final low resolution image for non-matching pixels.

20. The non-transitory computer-readable medium of claim 18 , wherein the final low resolution image for non-matching pixels includes a value of the representative low resolution image.

Assignments (2)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041940/0462 →
Continuity (3)
Continuation 14247438 · Apr 8, 2014
Continuation 12550559 · Aug 31, 2009
Related Publication 20160316141A1 · Oct 27, 2016