IP Library Granted Patent US 9,456,228
Granted Patent B2
US 9,456,228 · App. 14/880,124 · Granted Sep 27, 2016

Methods and systems for distributing interactive content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,456,228
App. No.
14/880,124
Granted
Sep 27, 2016
Kind
B2
Abstract

Aspects of the present invention relate to methods and systems for controlling the distribution of supplementary content by generating a first control signal when known content is initially detected in a broadcast stream, and after generating the first control signal, generating a second control signal when the detected content is no longer detected in the broadcast stream. The first and second control signals may be used to control the distribution of supplementary content.

Claims (99)

1. In a computer system, a method for controlling a distribution of supplementary content, the method comprising:

receiving a media content comprising at least one of an audio content and a video content;

receiving, at a web server, a supplementary content associated with the media content;

monitoring a broadcast stream;

when the monitoring initially detects either one of the at least one of an audio content and a video content:

determining that a count of unambiguous matches for the initially detected either one of the at least one of an audio content and a video content, when compared to a reference database, meets a first criterion in relation to a first predefined limit; and

based on the count of unambiguous matches for the initially detected either one of the at least one of an audio content and a video content, when compared to the reference database, meeting the first criterion in relation to the first predefined limit:

selecting the supplementary content based on the detected media content;

generating a first control signal;

sending the first control signal to the web server; and

using the first control signal, at the web server, to control the distribution of the selected supplementary content;

and

when the monitoring fails to detect the initially detected either one of the at least one of an audio content and a video content subsequent to the initial detection:

generating a second control signal;

sending the second control signal to the web server; and

using the second control signal, at the web server, to control the distribution of the selected supplementary content.

2. The method of claim 1 , further comprising:

upon receiving the media content and the supplementary content associated with the media content, assigning a unique identifier to an enhanced media content comprising the media content and the supplementary content.

3. The method of claim 2 , further comprising creating a first database, wherein the creating the first database comprises:

generating a plurality of reference fingerprints from the at least one of an audio content and a video content;

associating the plurality of reference fingerprints with the unique identifier of the enhanced media content; and

storing the plurality of reference fingerprints, the unique identifier, and the association in the first database.

4. The method of claim 3 , further comprising:

generating a first fingerprint from at least one of a received audio content and a received video content from the monitored broadcast stream;

comparing the first fingerprint with the plurality of reference fingerprints;

wherein the monitoring initially detects either one of the at least one of an audio content and a video content when a match between any reference fingerprint in the plurality of reference fingerprints and the first fingerprint is initially determined.

5. The method of claim 4 , further comprising extracting the unique identifier associated with the plurality of reference fingerprints from the first database when the monitoring initially detects either one of the at least one of an audio content and a video content.

6. The method of claim 3 , further comprising:

generating a first fingerprint from at least one of a received audio content and a received video content from the monitored broadcast stream;

comparing the first fingerprint with the plurality of reference fingerprints;

wherein the monitoring fails to detect the initially detected either one of the at least one of an audio content and a video content when none of the reference fingerprints in the plurality of reference fingerprints matches the first fingerprint.

7. The method of claim 2 , further comprising creating a second database, wherein creating the second database comprises:

creating an association between the unique identifier for the enhanced media content and the supplementary content associated with the media content;

storing the unique identifier, the supplementary content, and the association in the second database; and

using the unique identifier to extract supplementary content from the second database.

8. The method of claim 1 , further comprising:

after generating the first control signal and prior to generating the second control signal, sending a query to the web server requesting the supplementary content from the web server;

receiving the supplementary content from web server; and

inserting the supplementary content into the broadcast stream.

9. The method of claim 8 , further comprising:

upon generating the second control signal, ceasing to insert the supplementary content into the broadcast stream.

10. The method of claim 1 , further comprising, when the monitoring fails to detect the initially detected either one of the at least one of an audio content and a video content subsequent to the initial detection, determining that an error count of match failures for the initially detected either one of the at least one of an audio content and a video content, when compared to the reference database, meets a second criterion in relation to a second predefined limit.

11. The method of claim 1 , wherein the monitoring occurs at a broadcast site.

12. A system for the control of a distribution of supplementary content, the system comprising:

a receiver for receiving a media content comprising at least one of an audio content and a video content;

a web server comprising a web-server receiver for receiving a supplementary content associated with the media content;

a monitor for monitoring a broadcast stream;

a detector for:

detecting, in the broadcast stream, either one of the at least one of the audio content and the video content of the received media content; and

upon initially detecting the either one of the at least one of the audio content and the video content:

determining that a count of unambiguous matches for the at least one of an audio content and a video content, when compared to a reference database, meets a first criterion in relation to a first predefined limit; and

generating a first control signal and send the first control signal to the web server; and

after failing to detect, subsequent to the initial detection, the initially detected either one of the at least one of the audio content and the video content, generating a second control signal and send the second control signal to the web server; and

the web server further comprising a controller for:

selecting, based on the count of unambiguous matches for the at least one of an audio content and a video content, when compared to the reference database, meeting the first criterion in relation to the first predefined limit, a first supplementary content based on the initially detected either one of the at least one of the audio content and the video content; and

using the first control signal and the second control signal to control the distribution of the first supplementary content.

13. The system of claim 12 , further comprising:

an identifier for assigning a unique identifier to an enhanced media content comprising the media content and the supplementary content.

14. The system of claim 13 , further comprising:

a fingerprint calculator for computing a plurality of reference fingerprints from the received media content; and

a first database for:

receiving the plurality of reference fingerprints and the unique identifier;

associating the plurality of reference fingerprints and the unique identifier, and

storing and retrieving the plurality of reference fingerprints, the unique identifier, and the association between the plurality of reference fingerprints and the unique identifier;

wherein the monitor is additionally for:

generating a first fingerprint from the initially detected either one of the at least one of a received audio content and a received video content in the monitored broadcast stream;

comparing the first fingerprint with the plurality of reference fingerprints retrieved from the first database module; and

determining whether the first fingerprint matches any fingerprint in the plurality of reference fingerprints.

15. The system of claim 13 , further comprising:

a second database for:

receiving the supplementary content and the unique identifier;

associating the supplementary content and the unique identifier, and

storing and retrieving the supplementary content, the unique identifier, and the association between the supplementary content and the unique identifier.

16. In a computer system, a method for controlling a distribution of supplementary content, the method comprising:

receiving a media content comprising at least one of an audio content and a video content;

receiving, at a web server, a supplementary content associated with the media content;

monitoring a broadcast stream;

when the monitoring initially detects either one of the at least one of an audio content and a video content:

selecting the supplementary content based on the detected media content;

generating a first control signal;

sending the first control signal to the web server; and

using the first control signal, at the web server, to control the distribution of the selected supplementary content;

and

when the monitoring fails to detect the initially detected either one of the at least one of an audio content and a video content subsequent to the initial detection:

determining that multiple error counts of match failures for the initially detected either one of the at least one of an audio content and a video content, when compared to the reference database, meets a criterion in relation to a predefined limit, and based on meeting the criterion:

generating a second control signal;

sending the second control signal to the web server; and

using the second control signal, at the web server, to cease to insert the selected supplementary content into the broadcast stream.

17. The method of claim 16 , further comprising:

after generating the first control signal and prior to generating the second control signal, sending a query to the web server requesting the supplementary content from the web server;

receiving the supplementary content from web server; and

inserting the supplementary content into the broadcast stream.

18. The method of claim 17 , wherein the monitoring occurs at a broadcast site.

19. The method of claim 16 , further comprising:

upon receiving the media content and the supplementary content associated with the media content, assigning a unique identifier to an enhanced media content comprising the media content and the supplementary content.

20. The method of claim 19 , further comprising creating a first database, wherein the creating the first database comprises:

generating a plurality of reference fingerprints from the at least one of an audio content and a video content;

associating the plurality of reference fingerprints with the unique identifier of the enhanced media content; and

storing the plurality of reference fingerprints, the unique identifier, and the association in the first database.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2018
From: MYRIAN CAPITAL FUND, LLC (SERIES C)
To: ENSEQUENCE, INC.
Reel/Frame 047415/0279 →
MERGER Recorded Sep 25, 2018
From: ENSEQUENCE, INC.
To: ESW HOLDINGS, INC.
Reel/Frame 046958/0460 →
SECURITY INTEREST Recorded Nov 3, 2015
From: ENSEQUENCE, INC.
To: MYRIAN CAPITAL FUND, LLC (SERIES C)
Reel/Frame 036944/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2015
From: KHADER, ASLAM; TAIT, MARK-ANDREW RAY; WESTERMAN, LARRY ALAN
To: ENSEQUENCE, INC
Reel/Frame 036769/0216 →