IP Library Granted Patent US 8,823,810
Granted Patent B2
US 8,823,810 · App. 13/938,521 · Granted Sep 2, 2014

Vision system and method for motion adaptive integration of image frames

Inventors: Charles Mistretta (Madison, WI); Justin Mertes-Mistretta (Middleton, WI); Erick Oberstar (Madison, WI); Ethan Brodsky (Madison, WI)
Assignee: Wisconsin Alumni Research Foundation
G06T5/002G06T2207/20182G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,823,810
App. No.
13/938,521
Granted
Sep 2, 2014
Kind
B2
Abstract

A night vision device and method for filtering a series of image frames that depict a moving subject, which thereby improves the signal-to-noise ratio of each image frame, is provided. A composite image is formed for each image frame by combining pixel values in a current image frame with pixel values in composite images corresponding to image frames acquired before the current image frame. Additionally, pixels values in image frames acquired subsequent to the acquisition of the current image frame are included when forming the composite image. A bi-directional recursive filter is used to weight the contributions from the previous composite images and subsequent image frames with a decay constant. Motion of the imaging system is optionally compensated for by establishing a moving reference frame and shifting the image frames to account for this motion; thus, registering the image frames before filtering the current image frame.

Claims (23)

1. A night vision device for providing images of a scene to a user, the night vision device comprising:

an optical apparatus configured to receive light from the scene;

an image array coupled to the optical apparatus and configured to:

detect the light from the scene;

produce a series of image frames of the scene using the detected light from the scene;

an image processor in communication with the image array and configured to:

receive, from the image array, the series of image frames of the scene;

produce a series of filtered image frames by combining a currently produced image frame with at least one prior image frame produced prior to the currently produced image frame and at least one subsequent image frame produced subsequent to the currently produced image frame;

a display device in communication with the image array and configured to:

receive the series of filtered image frames from the image processor; and

display the filtered image frames to the user.

2. The night vision device as recited in claim 1 in which the image processor is further configured to:

determine, from the series of image frames, a moving reference frame indicative of motion of the night vision device; and

correct each currently produced image frame in the series of image frames for motion of the imaging system using the determined moving reference frame.

3. The night vision device as recited in claim 2 further including an orientation detector coupled to the image processor and configured to:

determine an orientation of the night vision device; and

provide, to the image processor, a signal indicative of the determined orientation that is employed by the image processor to determine the moving reference frame of the night vision device.

4. The night vision device as recited in claim 2 further including a motion detector coupled to the image processor and configured to:

determine motion of the night vision device; and

provide, to the image processor, a signal indicative of the determined motion that is employed by the image processor to determine the moving reference frame of the night vision device.

5. The night vision device as recited in claim 1 in which the optical apparatus includes at least one of a monocular lens and a binocular lens.

6. The night vision device as recited in claim 1 in which the display device includes at least one of a light emitting diode display, an organic light emitting diode display, and a liquid crystal display.

7. The night vision device as recited in claim 1 in which the image array includes at least one of a charge coupled device, a complimentary metal-oxide semiconductor, and a focal plane array.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2013
From: OBERSTAR, ERIC; MISTRETTA, CHARLES; MERTES-MISTRETTA, JUSTIN; BRODSKY, ETHAN
To: WISCONSIN ALUMNI RESEARCH FOUNDATION
Reel/Frame 031110/0851 →
CONFIRMATORY LICENSE Recorded Jul 15, 2013
From: WISCONSIN ALUMNI RESEARCH FOUNDATION
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 030801/0124 →
Continuity (2)
Continuation 12538433 · Aug 10, 2009
Related Publication 20130300883A1 · Nov 14, 2013