IP Library Granted Patent US 9,135,683
Granted Patent B2
US 9,135,683 · App. 14/018,952 · Granted Sep 15, 2015

System and method for temporal video image enhancement

Inventor: Sri Rama Prasanna Pavani (Los Angeles, CA)
Assignee: ARECONT VISION, LLC.
G06T5/002G06K9/00758G06K9/46G06K9/6202G06T5/20H04N5/57G06T2207/10016G06T2207/20024G06T2207/20182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,135,683
App. No.
14/018,952
Granted
Sep 15, 2015
Kind
B2
Abstract

A method for improving quality of low light video images including: receiving a current video frame; temporally enhancing it by applying a first weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions to the received frame and a reference frame to generate an enhanced temporal video frame; spatially enhancing the enhanced temporal video frame by applying a second weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions to generate an enhanced spatial video frame; and motion enhancing the enhanced temporal video frame by extracting matched rigid moving objects in a previous or future frame and processing each of the extracted matched rigid moving objects with a corresponding rigid object in the enhanced temporal or spatial or raw current video frame.

Claims (19)

1. A method for improving quality of low light video images, the method comprising:

receiving a current video frame;

generating a reference video frame from the received current video frame and one or more previous or future video frames;

computing a likelihood metric to determine the likelihood of a pixel to correspond to stationary regions and moving regions in the received current video frame from the generated reference frame;

computing a weight matrix from the received current video frame and the generated reference frame, wherein the weight matrix includes higher weight factors for the stationary regions and lower weight factors for the moving regions, in the received current video frame, and wherein computing the weight matrix comprises finding an inverse of the likelihood metric; and

calculating a temporal video frame by applying the weight matrix with higher and lower weight factors to the received current video frame and the generated reference frame.

2. The method of claim 1 , wherein generating a reference video frame further comprises weighted averaging of the current video frame with the previous or future video frame.

3. The method of claim 1 , wherein computing a likelihood metric further comprises finding the difference between the current video frame and the reference frame.

4. The method of claim 1 , wherein calculating a temporal video frame further comprises weighted averaging the current video frame and the reference frame by using the weight matrix.

5. A method for improving quality of low light video images, the method comprising:

receiving a current video frame;

temporally enhancing the received current video frame by applying a first weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions in the received current video frame to the received current video frame, and to a reference frame, to generate an enhanced temporal video frame;

spatially enhancing the enhanced temporal video frame by applying a second weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions, in the enhanced temporal video frame, to generate an enhanced spatial video frame; and

motion enhancing the enhanced temporal video frame by extracting matched rigid moving objects in a previous or future frame and processing each of the extracted matched rigid moving objects with a corresponding rigid object in the enhanced temporal video frame to generate an improved quality video image frame.

6. The method of claim 5 , further comprising generating a reference video frame by weighted averaging of the current video frame with a previous or future video frame.

7. The method of claim 5 , further comprising computing a likelihood metric to determine the likelihood of a pixel to correspond to stationary regions and moving regions in the received current video frame from the reference frame.

8. The method of claim 7 , wherein computing a likelihood metric further comprises finding the difference between the current video frame and the reference frame.

9. The method of claim 7 , wherein the first weight matrix is computed by finding an inverse of the likelihood metric.

10. The method of claim 5 , wherein said generating an enhanced temporal video frame further comprises weighted averaging the current video frame and the reference frame by using the first weight matrix.

Assignments (5)
SECURITY INTEREST Recorded Oct 8, 2018
From: ARECONT VISION COSTAR, LLC
To: UMB BANK, N.A.
Reel/Frame 047093/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: ARECONT VISION, LLC
To: ARECONT VISION COSTAR, LLC
Reel/Frame 047121/0080 →
SECURITY INTEREST Recorded Apr 1, 2014
From: ARECONT VISION, LLC
To: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 032573/0546 →
SECURITY INTEREST Recorded Apr 1, 2014
From: ARECONT VISION, LLC
To: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 032573/0887 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2013
From: PAVANI, SRI RAMA PRASANNA
To: ARECONT VISION, LLC.
Reel/Frame 031144/0949 →
Continuity (1)
Related Publication 20150063717A1 · Mar 5, 2015