IP Library Granted Patent US 8,520,065
Granted Patent B2
US 8,520,065 · App. 13/526,814 · Granted Aug 27, 2013

Method and system for video processing to determine digital pulse recognition tones

Inventors: Peter Staats (Wenham, MA); Rob Sumner (Cambridge, MA); Daniel Ryan (North Andover, MA)
Assignee: ByteLight, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,520,065
App. No.
13/526,814
Granted
Aug 27, 2013
Kind
B2
Abstract

In one aspect, the present disclosure relates to a method for isolating a broadcast digital pulse recognition tone of a beacon light source in a digital video sequence. In some embodiments, the method includes receiving a digital video sequence of a scene, the digital video sequence including a sequence of frames and the scene including both modulated illumination broadcast by a beacon light source and un-modulated illumination, calculating a background value of the digital video sequence, the background value including a portion of the digital video sequence corresponding to the un-modulated illumination of the scene, subtracting the background value of the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene, calculating a frequency content of a frame of the isolated digital video sequence, and determining a particular tone broadcast by the beacon light source based on the frequency content.

Claims (19)

1. A method for isolating a broadcast digital pulse recognition tone of a beacon light source in a digital video sequence, the method comprising:

electronically receiving, by an image sensor of a mobile device, a digital video sequence of a scene, wherein the digital video sequence comprises a sequence of frames and the scene comprises both modulated illumination broadcast by a beacon light source and un-modulated illumination;

calculating a background value of the digital video sequence, wherein the background value comprises a portion of the digital video sequence corresponding to the un-modulated illumination of the scene;

subtracting the background value of the digital video sequence from the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene;

calculating a frequency content of a frame of the isolated digital video sequence; and

determining a particular symbol broadcast by the beacon light source based on the frequency content; wherein each frame of the sequence of frames comprises a plurality of pixel values, each of the plurality of pixel values having a given point in the frame, and calculating the background value comprises analyzing the plurality of pixel values of each given point of a subset of the sequence of frames.

2. The method of claim 1 , comprising accumulating the subset of the frames in a frame buffer.

3. The method of claim 1 , wherein the averaging is performed using a technique comprising one of calculating a simple numerical average, calculating a normalized average, calculating a Gaussian average, or calculating the frame difference between subsequent frames.

4. The method of claim 1 , comprising applying a motion compensation technique to transform each frame prior to calculating the background value.

5. The method of claim 4 , wherein the motion compensation technique comprises one of shifting or transforming each frame of the sequence of frames to substantially overlie the previous frame.

6. The method of claim 4 , wherein the motion compensation technique comprises one of kernel density estimation, Eigenbackground, or mean-shift based estimation.

7. An image detection apparatus for isolating a broadcast digital pulse recognition tone of a beacon light source in a digital video sequence comprising:

an imaging sensor; and

a processor in communication with the imaging sensor configured to receive a digital video sequence comprising a sequence of frames of a scene comprising both modulated illumination broadcast by the beacon light source and un-modulated illumination, calculate a background value comprising a portion of the digital video sequence corresponding to the un-modulated illumination of the scene of the digital video sequence, subtract the background value of the digital video sequence from the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene, calculate a frequency content of a frame of the isolated digital video sequence, and determine a particular symbol broadcast by the beacon light source based on the frequency content; wherein each frame of the sequence of frames comprises a plurality of pixel values, each of the plurality of pixel values having a given point in the frame and the processor is configured to calculate the background value by analyzing the plurality of pixel values of each given point of a subset of the sequence of frames.

8. The image detection apparatus of claim 7 , further comprising a frame buffer accessible by the processor, wherein the processor is configured to accumulate the subset of the frames in a frame buffer.

9. The image detection apparatus of claim 7 , wherein the processor is configured to perform the averaging using a technique comprising one of calculating a simple numerical average, calculating a normalized average, calculating a Gaussian average, or calculating the frame difference between subsequent frames.

10. The image detection apparatus of claim 7 , wherein the processor is configured to apply a motion compensation technique to transform each frame prior to calculating the background value.

11. The image detection apparatus of claim 10 , wherein the motion compensation technique comprises one of shifting or transforming each frame of the sequence of frames to substantially overlie the previous frame.

12. The image detection apparatus of claim 10 , wherein the motion compensation technique comprises one of using kernel density estimation, Eigenbackground, or mean-shift based estimation.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2015
From: BYTELIGHT, INC.
To: ABL IP HOLDING LLC
Reel/Frame 035511/0637 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2013
From: STAATS, PETER; SUMNER, ROB; RYAN, DANIEL
To: BYTELIGHT, INC.
Reel/Frame 031351/0678 →
Continuity (20)
Continuation In Part 13446520 · Apr 13, 2012
Continuation 13369147 · Feb 8, 2012
Continuation 13369144 · Feb 8, 2012
Continuation 13422580 · Mar 16, 2012
Continuation 13422591 · Mar 16, 2012
Continuation 13435448 · Mar 30, 2012
Continuation 13445019 · Apr 12, 2012
Continuation 13526814
Continuation In Part 13446506 · Apr 13, 2012
Continuation 13369144 · Feb 8, 2012
Continuation 13422580 · Mar 16, 2012
Continuation 13422591 · Mar 16, 2012
Continuation 13435448 · Mar 30, 2012
Continuation 13445019 · Apr 12, 2012
Continuation 13369147 · Feb 8, 2012
Provisional Application 61639428 · Apr 27, 2012
Provisional Application 61635413 · Apr 19, 2012
Provisional Application 61567484 · Dec 6, 2011
Provisional Application 61511589 · Jul 26, 2011
Related Publication 20130027528A1 · Jan 31, 2013