IP Library Granted Patent US 9,094,715
Granted Patent B2
US 9,094,715 · App. 14/217,435 · Granted Jul 28, 2015

Systems and methods for multi-broadcast differentiation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,094,715
App. No.
14/217,435
Granted
Jul 28, 2015
Kind
B2
Abstract

A system and method is disclosed for resolving false positives in a centralized, real-time automatic content recognition system that is ingesting, fingerprinting, and attempting to match for recognition purposes, multiple streams of broadcast content that are simultaneously arriving from a plurality of sources. In particular, the problem of identifying which specific broadcast of certain programming has been matched, including the episode of a series, as well as the channel, time zone and time of broadcast and whether the programming is being watched “live” as broadcast or from a DVR time-shifted source, is addressed. This system and method enables the processing means of any connected TV viewing means to synchronize with a regional automated content recognition (ACR) center with regard to displaying at the correct time certain supplemental information or other media that may be associated with certain programming. It also reduces the probability of a false positive “recognition” of pre-recorded media or broadcasts from other time zones being displayed on the connected TV viewing means, and confusing such programming with the actual media with which the TV viewing device's processing means is intended to count, synchronize, interact with, or supplement.

Claims (65)

1. A method, comprising:

maintaining at least one database utilized for identifying at least one particular broadcast of a specific program, including at least:

creating one or more fingerprints associated with one or more ingested audiovisual data streams;

identifying at least one known program based at least partially on testing at least one fingerprint associated with at least one ingested audiovisual data stream against a database of known programs;

associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on one or more elements of metadata associated with the at least one ingested audiovisual data stream; and

storing at least (i) at least one identifier of the at least one known program, (ii) at least one identifier of the particular broadcast of the at least one known program, (iii) at least some fingerprints related to the at least one ingested audiovisual data stream, and (iv) at least some data related to the one or more elements of metadata associated with the at least one ingested audiovisual data stream;

receiving one or more fingerprint packages and at least some data associated with signatures from at least one client;

preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some of the received data associated with signatures; and

determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client.

2. The method of claim 1 , wherein associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on one or more elements of metadata associated with the at least one ingested audiovisual data stream comprises:

associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on at least one of a network identifier, a satellite feed identifier, a time zone identifier, a local time identifier, a time offset identifier, an on-screen graphic identifier, or at least some closed-captioning data associated with the at least one ingested audiovisual data stream.

3. The method of claim 1 , wherein receiving one or more fingerprint packages and at least some data associated with signatures from at least one client comprises:

receiving one or more fingerprint packages and at least one of a geographical location, an IP address, a timestamp, an on-screen graphic identifier, a channel identifier, a cable system identifier, a satellite provider identifier, a time zone identifier, an indication of live programming, an indication of DVR use, at least some metadata, or at least some closed-captioning data from the at least one client, the received one or more fingerprint packages at least partially transported from the at least one client via the Internet.

4. The method of claim 1 , wherein determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client comprises:

employing at least one of a scoring algorithm or a probability algorithm in conjunction with the at least one prepared database query to determine the one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client.

5. The method of claim 1 , wherein determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client comprises:

retrieving one or more candidates of the particular broadcast of a specific program and at least one element of metadata associated with the one or more candidates of the particular broadcast of a specific program based at least partially on the at least one prepared database query;

comparing at least some received data associated with signatures with the at least one element of metadata; and

determining, based at least partially on the comparison, one or more of a particular broadcast of a specific program or a particular audiovisual data stream most likely associated with the video buffer of the at least one client.

6. The method of claim 5 , wherein determining, based at least partially on the comparison, one or more of a particular broadcast of a specific program or a particular audiovisual data stream most likely associated with the video buffer of the at least one client comprises:

assigning a score to each candidate based at least partially on the number of elements of metadata associated with each candidate matching a corresponding received datum associated with a signature; and

determining, based at least partially on a highest scoring candidate, one or more of a particular broadcast of a specific program or a particular audiovisual data stream most likely associated with the video buffer of the at least one client.

7. The method of claim 1 , wherein creating one or more fingerprints associated with one or more ingested audiovisual data streams comprises:

creating one or more fingerprints associated with one or more ingested audiovisual data streams, the one or more fingerprints determined using at least some pixel data associated with the one or more ingested audiovisual data streams.

8. The method of claim 1 , wherein receiving one or more fingerprint packages and at least some data associated with signatures from at least one client comprises:

receiving one or more fingerprint packages and at least some data associated with signatures from at least one client, the received one or more fingerprint packages including at least some data derived from video buffer pixel data of the at least one client.

9. The method of claim 1 , wherein creating one or more fingerprints associated with one or more ingested audiovisual data streams and receiving one or more fingerprint packages and at least some data associated with signatures from at least one client comprise:

creating one or more fingerprints associated with one or more ingested audiovisual data streams, the one or more fingerprints determined using at least some pixel data associated with the one or more ingested audiovisual data streams; and

receiving one or more fingerprint packages and at least some data associated with signatures from at least one client, the received one or more fingerprint packages including at least some data derived from video buffer pixel data of the at least one client.

10. The method of claim 1 , wherein receiving one or more fingerprint packages and at least some data associated with signatures from at least one client comprises:

receiving one or more fingerprint packages and at least some data associated with signatures from at least one client, the received one or more fingerprint packages transported from the at least one client at least partially via the Internet.

11. The method of claim 1 , wherein receiving one or more fingerprint packages and at least some data associated with signatures from at least one client comprises:

receiving one or more fingerprint packages and at least some data associated with signatures from at least one client, the received one or more fingerprint packages including at least some data derived from video buffer pixel data of the at least one client and transported from the at least one client at least partially via the Internet.

12. The method of claim 1 , further comprising:

preparing one or more triggers for transport at least partially via the internet to at least one client at least partially based on the determined one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client, the prepared one or more triggers capable of initiating at least one context-sensitive action on the at least one client.

13. The method of claim 1 , wherein associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on one or more elements of metadata associated with the at least one ingested audiovisual data stream comprises:

associating the identified at least one known program with at least one particular broadcast of the at least one known program by at least one particular network based at least partially on at least one search of at least one channel graphics database using at least one logo overlaid on the at least one ingested audiovisual data stream.

14. The method of claim 1 , wherein associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on one or more elements of metadata associated with the at least one ingested audiovisual data stream comprises:

associating the identified at least one known program with at least one particular broadcast of the at least one known program by at least one particular network based at least partially on at least one search of at least one channel graphics database using at least one logo overlaid on the at least one ingested audiovisual data stream and retrieving at least one identifier of at least one network at least partially based on matching the at least one logo in the at least one channel graphics database.

15. The method of claim 1 , wherein preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some of the received data associated with signatures comprises:

preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some data related to at least one logo overlaid on at least one frame of the video buffer of the at least one client.

16. The method of claim 1 , wherein determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client comprises:

determining, based at least partially on at least one search of at least one channel graphics database using at least some data related to at least one logo overlaid on at least one frame of the video buffer of the at least one client, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client.

17. The method of claim 1 , wherein preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some of the received data associated with signatures comprises:

preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some received data related to at least one ad pod displayed by the at least one client.

18. The method of claim 1 , wherein determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client comprises:

determining, based at least partially on at least one search of at least one television advertising database using at least some received data related to at least one ad pod displayed by the at least one client, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client.

19. A machine, comprising:

means for maintaining at least one database utilized for identifying at least one particular broadcast of a specific program, including at least:

means for creating one or more fingerprints associated with one or more ingested audiovisual data streams;

means for identifying at least one known program based at least partially on testing at least one fingerprint associated with at least one ingested audiovisual data stream against a database of known programs;

means for associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on one or more elements of metadata associated with the at least one ingested audiovisual data stream; and

means for storing at least (i) at least one identifier of the at least one known program, (ii) at least one identifier of the particular broadcast of the at least one known program, (iii) at least some fingerprints related to the at least one ingested audiovisual data stream, and (iv) at least some data related to the one or more elements of metadata associated with the at least one ingested audiovisual data stream;

means for receiving one or more fingerprint packages and at least some data associated with signatures from at least one client;

means for preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some of the received data associated with signatures; and

means for determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client.

20. A system, comprising:

circuitry configured for maintaining at least one database utilized for identifying at least one particular broadcast of a specific program, including at least:

circuitry configured for creating one or more fingerprints associated with receiving one or more ingested audiovisual data streams;

circuitry configured for identifying at least one known program based at least partially on testing at least one fingerprint associated with at least one ingested audiovisual data stream against a database of known programs;

circuitry configured for associating the identified at least one known program with at least one particular broadcast of the at least one known program based at least partially on one or more elements of metadata associated with the at least one ingested audiovisual data stream;

circuitry configured for storing at least (i) at least one identifier of the at least one known program, (ii) at least one identifier of the particular broadcast of the at least one known program, (iii) at least some fingerprints related to the at least one ingested audiovisual data stream, and (iv) at least some data related to the one or more elements of metadata associated with the at least one ingested audiovisual data stream;

circuitry configured for receiving one or more fingerprint packages and at least some data associated with signatures from at least one client;

circuitry configured for preparing at least one query of the at least one database based at least partially on at least a portion of at least one received fingerprint package and at least some of the received data associated with signatures; and

circuitry configured for determining, based at least partially on the at least one prepared database query, one or more of a particular broadcast of a specific program associated with a video buffer of the at least one client or a particular audiovisual data stream associated with the video buffer of the at least one client.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Apr 15, 2024
From: BANK OF AMERICA, N.A.
To: VIZIO, INC.; INSCAPE DATA, INC. (F/K/A VIZIO INSCAPE TECHNOLOGIES, LLC); VIZIO SERVICES, LLC (F/K/A VIZIO INSCAPE SERVICES, LLC)
Reel/Frame 067123/0675 →
ENTITY CONVERSION Recorded Jan 17, 2017
From: VIZIO INSCAPE TECHNOLOGIES, LLC
To: INSCAPE DATA, INC.
Reel/Frame 041447/0094 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2016
From: COGNITIVE MEDIA NETWORKS, INC.
To: VIZIO INSCAPE TECHNOLOGIES, LLC.
Reel/Frame 038442/0922 →
SECURITY INTEREST Recorded Apr 29, 2016
From: VIZIO, INC.; VIZIO INSCAPE TECHNOLOGIES, LLC; VIZIO INSCAPE SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 038663/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2015
From: NEUMEIER, ZEEV; COLLETTE, MICHAEL
To: COGNITIVE MEDIA NETWORKS, INC.
Reel/Frame 036262/0811 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2014
From: NEUMEIER, ZEEV; COLLETTE, MICHAEL
To: COGNITIVE NETWORKS, INC.
Reel/Frame 034503/0526 →