IP Library Granted Patent US 9,015,745
Granted Patent B2
US 9,015,745 · App. 13/730,734 · Granted Apr 21, 2015

Method and system for detection of user-initiated events utilizing automatic content recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,015,745
App. No.
13/730,734
Granted
Apr 21, 2015
Kind
B2
Abstract

Systems, methods and/or techniques for detection of user-initiated events in relation to a media device are described, for example utilizing a content recognition system. A method may be executed in a media device that is operable to play video content. The method may include receiving user interaction with the media device and the user interaction causes initiation of a feature that affects video content that plays on the media device. The method may include receiving one or more interactive events from a content recognition system in response to the user interaction. The method may comprise executing the one or more interactive events to affect video content that is playing on the media device, and display one or more overlay windows corresponding to the affected video content. One or more video fingerprints that correspond to the affected video content may be communicated to the content recognition system.

Claims (87)

1. A method, comprising:

in a media device that is operable to play video content, wherein:

the media device comprises an automatic content recognition (ACR) module that communicates with an ACR system that is external to the media device, and the ACR system supports different video fingerprint technologies from multiple vendors, wherein:

the ACR system assigns same interactive event identifiers to different sets of video and audio fingerprints that are generated from the same video and audio content by the different video and audio fingerprint technologies from the multiple vendors based on timing of the assignment of the interactive event identifiers; and

the interactive event identifiers are utilized by the media device to trigger one or more interactive events;

the ACR module providing fingerprints to a fingerprint matching system in the ACR system for matching by the fingerprint matching system;

the ACR module receiving information and/or content from the ACR system based on the matching by the fingerprint matching system; and

the media device:

detecting by the ACR module, user interaction with the media device, wherein the user interaction causes the initiation of a feature that affects video content that plays on the media device;

receiving by the ACR module, the one or more interactive events from the fingerprint matching system in the ACR system in response to the user interaction; and

executing the one or more interactive events to:

affect video content that is playing on the media device;

display one or more overlay windows corresponding to the affected video content; and

allow interaction via the displayed one or more overlay windows.

2. The method according to claim 1 , comprising communicating to the fingerprint matching system in the ACR system one or more video fingerprints that correspond to video content that has been affected by the user interaction, wherein the fingerprint matching system in the ACR system communicates the one or more interactive events to the media device in response to detecting a match with the one or more video fingerprints.

3. The method according to claim 1 , wherein:

the ACR system comprises an event trigger module that provides an indication of the one or more interactive events to be communicated to the media device; and

the one or more interactive events are executed at a time that is synchronized to the user interaction with the media device.

4. The method according to claim 1 , wherein the video content as affected by the user interaction determines the one or more interactive events that are communicated from the ACR system.

5. The method according to claim 4 , wherein:

the user interaction causes the initiation of a feature that is operable to fast forward through one or more commercials; and

the one or more interactive events, when executed, display an incentive to watch the one or more commercials and display an option whether to continue fast forwarding.

6. The method according to claim 5 , wherein:

the incentive to watch the one or more commercials is an overlay window that informs viewers of a scavenger hunt game; and

the scavenger hunt game is operable to allow viewers to earn points by indicating items in the one or more commercials.

7. The method according to claim 4 , wherein:

the user interaction causes the initiation of a feature that is operable to pause a program; and

the one or more interactive events, when executed, display entertainment or advertisements while the video content is paused.

8. The method according to claim 4 , wherein:

the user interaction causes the initiation of a feature that is operable to tune to an unauthorized or blocked channel or program; and

the one or more interactive events, when executed, block the media device from displaying an unauthorized program and tune to an alternative channel.

9. The method according to claim 1 , wherein:

executing the one or more interactive events comprises accepting user response data from a user; and

the user response data affects video content that plays on the media device.

10. The method according to claim 1 , wherein user preferences determine the type of the one or more interactive events that are communicated from the ACR system.

11. An system, comprising:

a media device that is operable to play video content, wherein the media device comprises an automatic content recognition (ACR) module that communicates with an ACR system that is external to the media device, and the ACR system supports different video fingerprint technologies from multiple vendors, wherein:

the ACR system assigns same interactive event identifiers to different sets of video and audio fingerprints that are generated from the same video and audio content by the different video and audio fingerprint technologies from the multiple vendors based on timing of the assignment of the interactive event identifiers; and

the interactive event identifiers are utilized by the media device to trigger one or more interactive events;

the ACR module providing fingerprints to a fingerprint matching system in the ACR system for matching by the fingerprint matching system; and

the ACR module receiving information and/or content from the ACR system based on the matching by the fingerprint matching system; and

the media device being operable to:

detect by the ACR module, user interaction with the media device, wherein the user interaction initiates a feature that affects video content that plays on the media device;

receive by the ACR module, the one or more interactive events from the fingerprint matching system in the ACR system in response to the user interaction; and

execute the one or more interactive events to:

affect video content that is playing on the media device;

display one or more overlay windows corresponding to the affected video content; and

allow interaction via the displayed one or more overlay windows.

12. The system according to claim 11 , wherein the media device is operable to communicate to the fingerprint matching system in the ACR system one or more video fingerprints that correspond to video content that has been affected by the user interaction, wherein the fingerprint matching system in the ACR system communicates the one or more interactive events to the media device in response to detecting a match with the one or more video fingerprints.

13. The system according to claim 11 , wherein:

the ACR system comprises an event trigger module that provides an indication of the one or more interactive events to be communicated to the media device; and

the media device is operable to execute the one or more interactive events at a time that is synchronized to the user interaction with the media device.

14. The system according to claim 11 , wherein the video content as affected by the user interaction determines the one or more interactive events that are communicated from the ACR system.

15. The method according to claim 14 , wherein:

the feature that affects video content that plays on the media device is operable to fast forward through one or more commercials; and

the media device is operable to execute the one or more interactive events to display an incentive to watch the one or more commercials and display an option whether to continue fast forwarding.

16. The method according to claim 15 , wherein:

the incentive to watch the one or more commercials is an overlay window that informs viewers of a scavenger hunt game; and

the scavenger hunt game is operable to allow viewers to earn points by indicating items in the one or more commercials.

17. The method according to claim 14 , wherein:

the feature that affects video content that plays on the media device is operable to pause a program; and

the media device is operable to execute the one or more interactive events to display entertainment or advertisements while the video content is paused.

18. The method according to claim 14 , wherein:

the feature that affects video content that plays on the media device is operable to tune to an unauthorized or blocked channel or program, and

the media device is operable to execute the one or more interactive events to block the media device from displaying an unauthorized program and tune to an alternative channel.

19. The method according to claim 11 , wherein:

the media device is operable to execute the one or more interactive events to accept user response data from a user; and

the user response data affects video content that plays on the media device.

20. The method according to claim 11 , wherein user preferences determine the type of the one or more interactive events that are communicated from the ACR system.

21. A system, comprising:

a media device;

an automatic content recognition (ACR) module within the media device;

an ACR system comprising an event trigger module; and

a fingerprint matching system in the ACR system, wherein:

the ACR System supports different video fingerprint technologies from multiple vendors;

the ACR system assigns same interactive event identifiers to different sets of video and audio fingerprints that are generated from the same video and audio content by the different video and audio fingerprint technologies from the multiple vendors based on timing of the assignment of the interactive event identifiers;

the interactive event identifiers are utilized by the media device to trigger one or more interactive events; and

the ACR module being operable to:

communicate fingerprints to the fingerprint matching system in the ACR system, wherein the fingerprint matching system matches the communicated fingerprints; and

receive information and/or content from the ACR system based on the matching that is done by the fingerprint matching system;

the media device being operable to:

detect user interaction with the media device that causes the initiation of a feature that affects video content that plays on the media device;

receive the one or more interactive events from the fingerprint matching system in the ACR system in response to the user interaction, wherein the event trigger module provides an indication of the one or more interactive events that are to be communicated to the media device; and

execute the one or more interactive events to:

 affect video content that is playing on the media device;

 cause display one or more overlay windows corresponding to the affected video content; and

 allow interaction on the media device via the displayed one or more overlay windows.

Assignments (1)
SECURITY INTEREST Recorded Oct 1, 2025
From: WARNER BROS. DISCOVERY, INC.; WARNER MEDIA, LLC; TURNER BROADCASTING SYSTEM, INC.; HOME BOX OFFICE, INC.; DISCOVERY COMMUNICATIONS, LLC; WARNERMEDIA DIRECT LLC; DISCOVERY.COM LLC; WARNER BROS. ENTERTAINMENT INC.; CNN INTERACTIVE GROUP, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 072995/0858 →