IP Library Granted Patent US 9,916,857
Granted Patent B2
US 9,916,857 · App. 14/721,776 · Granted Mar 13, 2018

Techniques to extract ENF signals from video image sequences exploiting the rolling shutter mechanism; and a new video synchronization approach by matching the ENF signals extracted from soundtracks and image sequences

Inventors: Min Wu (Clarksville, MD); Adi Hajj-Ahmad (College Park, MD); Hui Su (College Park, MD)
Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
G11B20/10259G11B20/10527H04N5/04H04N5/913H04N9/8205H04N2005/91342
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,916,857
App. No.
14/721,776
Granted
Mar 13, 2018
Kind
B2
Abstract

Various systems and methods may benefit from determination of environmental signatures in recordings. For example, such signatures may aid forensic analysis and alignment of media recordings, such as alignment of audio or video recordings. A method can include extracting electric network frequency signals from an image sequence of a video recording or an audio recording. The method can also include synchronizing the video recording or the audio recording with at least one other datum based on the electric network frequency signals.

Claims (20)

1. A method, comprising:

extracting electric network frequency signals from a video recording or an audio recording; and

synchronizing the video recording or the audio recording with at least one other datum based on the electric network frequency signals, wherein the extracting comprises taking a sample as a mean value for each row or column of an image frame of the video recording.

2. A method, comprising:

extracting electric network frequency signals from a video recording or an audio recording; and

synchronizing the video recording or the audio recording with at least one other datum based on the electric network frequency signals, wherein the extracting electric network frequency signals comprises extracting electric network frequency signals from frames containing scenes of at least one moving object.

3. The method of claim 2 , wherein the extracting is limited to extraction from at least one static region of the video recording.

4. An apparatus, comprising:

at least one processor; and

at least one memory including computer program code,

wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to

extract electric network frequency signals from a video recording or an audio recording; and

synchronize the video recording or the audio recording with at least one other datum based on the electric network frequency signals, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to take a sample as a mean value for each row or column of an image frame of the video recording.

5. An apparatus, comprising:

at least one processor; and

at least one memory including computer program code,

wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to

extract electric network frequency signals from a video recording or an audio recording; and

synchronize the video recording or the audio recording with at least one other datum based on the electric network frequency signals, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to extract electric network frequency signals from frames containing scenes of at least one moving object.

6. The apparatus of claim 5 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to limit extraction to at least one static region of the video recording.

Assignments (3)
CONFIRMATORY LICENSE Recorded Dec 6, 2022
From: UNIVERSITY OF MARYLAND COLEGE PK CAMPUS
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 062067/0083 →
CONFIRMATORY LICENSE Recorded Sep 25, 2020
From: UNIVERSITY OF MARYLAND, COLLEGE PARK
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 053892/0649 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2016
From: WU, MIN; SU, HUI; AL HAJJ-AHMAD, ADI
To: UNIVERSITY OF MARYLAND, COLLEGE PARK
Reel/Frame 038912/0230 →
Continuity (4)
Continuation In Part 14093399 · Nov 29, 2013
Provisional Application 62002591 · May 23, 2014
Provisional Application 61731353 · Nov 29, 2012
Related Publication 20150356992A1 · Dec 10, 2015