IP Library Granted Patent US 8,700,641
Granted Patent B2
US 8,700,641 · App. 13/195,330 · Granted Apr 15, 2014

Detecting repeating content in broadcast media

Inventors: Michele Covell (Palo Alto, CA); Shumeet Baluja (Leesburg, VA); Michael Fink (Jerusalem, IL)
Assignee: Google Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,700,641
App. No.
13/195,330
Granted
Apr 15, 2014
Kind
B2
Abstract

Systems, methods, devices, and computer program products provide social and interactive applications for detecting repeating content in broadcast media. In some implementations, a method includes: generating a database of audio statistics from content; generating a query from the database of audio statistics; running the query against the database of audio statistics to determine a non-identity match; if a non-identity match exists, identifying the content corresponding to the matched query as repeating content.

Claims (38)

1. A method, comprising:

determining, by a system including a processor, a first match M h between a first audio descriptor representing a first recording at a first time step in an environment and a first reference descriptor, the first match M h having-a first confidence score C h indicative of a confidence of the first match, the first time step having a time step length l;

determining, by the system, a second match M 0 between a second audio descriptor representing a second recording at a second time step in the environment and a second reference descriptor, the second match M 0 having a second confidence score C 0 indicative of a confidence of the second match, the second time step having the time step length l, wherein the first time step is prior to the second time step, and the first match M h and the second match M 0 are non-identity matches determined using a direct or locality sensitive hashing function and a validation process to select a most accurate match out of a plurality of candidate matches, wherein the first confidence score C h and the second confidence score C 0 are based upon a log-likelihood function given by an audio fingerprinting process;

discounting, by the system, the first confidence score C h by a discount value l/L to generate a discounted first confidence score C h −l/L, where L is an expected dwell time between a channel change;

in response to the discounted first confidence score C h −l/L being greater than the second confidence score C 0 , employing, by the system, the first reference descriptor associated with the first match M h for selecting related content; and

in response to the discounted first confidence score C h −l/L not being greater than the second confidence score C 0 , employing, by the system, the second reference descriptor associated with the second match M 0 for selecting the related content.

2. The method of claim 1 , further comprising:

in response to the discounted first confidence score C h −l/L being greater than the second confidence score C 0 , designating, by the system, the first reference descriptor as a best match to the second audio descriptor of the second time step.

3. The method of claim 1 , further comprising:

in response to the discounted first confidence score C h −l/L not being greater than the second confidence score C 0 , designating, by the system, the second reference descriptor as a best match to the second audio descriptor of the second time step.

4. The method of claim 1 , wherein the second reference descriptor has a highest confidence score of a plurality of reference descriptors that match the second audio descriptor.

5. The method of claim 1 , wherein the first reference descriptor has a highest confidence score of a plurality of reference descriptors that match the first audio descriptor.

6. A non-transitory computer-readable medium having instructions stored thereon that, in response to execution, cause a system including a processor to perform operations comprising:

determining a first match M h between a first audio descriptor representing a first recording at a first time step in an environment and a first reference descriptor, the first match M h having-a first confidence score C h indicative of a confidence of the first match, the first time step having a time step length l;

determining a second match M 0 between a second audio descriptor representing a second recording at a second time step in the environment and a second reference descriptor, the second match M 0 having a second confidence score C 0 indicative of a confidence of the second match, the second time step having the time step length l, wherein the first time step is temporally prior to the second time step, and the first match M h and the second match M 0 are non-identity matches determined using a direct or locality sensitive hashing function and a validation process to select a most accurate match out of a plurality of candidate matches, wherein the first confidence score C h and the second confidence score C 0 are based upon a log-likelihood function given by an audio fingerprinting process;

discounting the first confidence score C h by a discount value l/L to generate a discounted first confidence score C h −l/L, where L is an expected dwell time between a channel change;

in response to the discounted first confidence score C h −l/L being greater than the second confidence score C 0 , employing the first reference descriptor associated with the first match M h for selecting related content; and

in response to the discounted first confidence score C h −l/L not being greater than the second confidence score C 0 , employing the second reference descriptor associated with the second match M 0 for selecting the related content.

7. The non-transitory computer-readable medium of claim 6 , the operations further comprising:

in response to the discounted first confidence score C h −l/L being greater than the second confidence score C 0 , designating the first reference descriptor as a best match to the second audio descriptor of the second time step.

8. The non-transitory computer-readable medium of claim 6 , the operations further comprising:

in response to the discounted first confidence score C h −l/L not being greater than the second confidence score C 0 , designating the second reference descriptor as a best match of the second time step.

9. The non-transitory computer-readable medium of claim 6 , wherein the second reference descriptor has a highest confidence score of a plurality of reference descriptors that match the second audio descriptor.

10. The non-transitory computer-readable medium of claim 6 , wherein the first reference descriptor has a highest confidence score of a plurality of reference descriptors that match the first audio descriptor.

11. A system, comprising:

a processor, communicatively coupled to a memory that stores computer-executable instructions, that executes or facilitates execution of the computer-executable instructions to perform operations comprising:

a social application server:

determine a first match M h between a first audio descriptor representing a first recording at a first time step in an environment and a first reference descriptor, the first match M h having-a first confidence score C h indicative of a confidence of the first match, the first time step having a time step length l;

determine a second match M 0 between a second audio descriptor representing a second recording at a second time step in the environment and a second reference descriptor, the second match M 0 having a second confidence score C 0 indicative of a confidence of the second match, the second time step having the time step length l, wherein the first time step is temporally prior to the second time step, and the first match M h and the second match M 0 are non-identity matches determined using a direct or locality sensitive hashing function and a validation process to select a most accurate match out of a plurality of candidate matches, wherein the first confidence score C h and the second confidence score C 0 are based upon a log-likelihood function given by an audio fingerprinting process;

discount the first confidence score C h by a discount value l/L to generate a discounted first confidence score C h −l/L, where L is an expected dwell time between a channel change;

in response to the discounted first confidence score C h −l/L being greater than the second confidence score C 0 , employ the first reference descriptor associated with the first match M h for selecting related content; and

in response to the discounted first confidence score C h −l/L not being greater than the second confidence score C 0 , employ the second reference descriptor associated with the second match M 0 for selecting the related content.

12. The system of claim 11 , wherein the social application server further determine:

in response to the discounted first confidence score C h −l/L being greater than the second confidence score C 0 , designate the first reference descriptor as a best match to the second audio descriptor of the second time step.

13. The system of claim 11 , wherein the social application server further determine:

in response to the discounted first confidence score C h −l/L not being greater than the second confidence score C 0 , designate the second reference descriptor as a best match to the second audio descriptor of the second time step.

14. The system of claim 11 , wherein the second reference descriptor has a highest confidence score of a plurality of reference descriptors that match the second audio descriptor.

15. The system of claim 11 , wherein the first reference descriptor has a highest confidence score of a plurality of reference descriptors that match the first audio descriptor.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044277/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2012
From: COVELL, MICHELE; BALUJA, SHUMEET; FINK, MICHAEL
To: GOOGLE INC.
Reel/Frame 028462/0222 →
Continuity (4)
Continuation 11563665 · Nov 27, 2006
Provisional Application 60740760 · Nov 29, 2005
Provisional Application 60823881 · Aug 29, 2006
Related Publication 20120059845A1 · Mar 8, 2012