IP Library Granted Patent US 9,615,122
Granted Patent B2
US 9,615,122 · App. 14/168,178 · Granted Apr 4, 2017

Methods and apparatus to synchronize second screen content with audio/video programming using closed captioning data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,615,122
App. No.
14/168,178
Granted
Apr 4, 2017
Kind
B2
Abstract

A method for synchronized utilization of an electronic device is provided. The method receives closed captioning data from an audio/video content receiver for a set of audio/video content; retrieves detail for a first event occurring in the set of audio/video content, wherein the first event is indicated by the received closed captioning data; and presents content to a user, using the electronic device, based on the retrieved detail.

Claims (54)

1. A method for synchronized utilization of an electronic device, the method comprising:

receiving closed captioning data from an audio/video content receiver for a set of audio/video content;

retrieving detail for a first event occurring in the set of audio/video content, wherein the first event is indicated by the received closed captioning data, by:

accessing a remote server to retrieve a playlist comprising a list of events occurring in the set of audio/video content and detail associated with each of the list of events;

wherein the detail associated with each of the events comprises a closed captioning reference string, a time offset, and a reference to second screen content for display after occurrence of the closed captioning reference string and passage of the time offset in the set of audio/video content;

performing a lookup to compare the closed captioning data to a plurality of closed captioning reference strings cataloged in the playlist, to locate a match, wherein the plurality of closed captioning reference strings comprises the closed captioning reference string; and

when a match is located,

identifying appropriate second screen content cataloged in the playlist; and

presenting the appropriate second screen content to a user, during occurrence of the first event during playback of the set of audio/video content, by the electronic device, based on the retrieved detail, wherein the appropriate second screen content comprises the second screen content.

2. The method of claim 1 , wherein the closed captioning data comprises a proper noun, and wherein the first event is associated with occurrence of the proper noun in the closed captioning data of the set of audio/video content.

3. The method of claim 2 , further comprising:

identifying the proper noun, based on the occurrence of the proper noun;

determining a genre for the set of audio/video content;

determining a context for the proper noun based on the determined genre of the set of audio/video content; and

presenting the content to the user based on the retrieved detail and the determined context.

4. The method of claim 2 , further comprising:

identifying the proper noun, based on the occurrence of the proper noun;

evaluating a group of words surrounding the proper noun;

determining a context for the proper noun based on the evaluated group of words; and

presenting the content to the user based on the retrieved detail and the determined context.

5. The method of claim 1 , wherein the presenting step further comprises:

executing a command to open a web browser, via the electronic device; and

presenting a website to the user, using the opened web browser, wherein the retrieved detail comprises a uniform resource locator (URL), and wherein the content comprises the website.

6. The method of claim 1 , wherein the presenting step further comprises:

presenting a plurality of selectable options to the user, via the electronic device, wherein the detail comprises the plurality of selectable options; and

receiving user input to select one of the plurality of selectable options;

wherein the content comprises the selected one of the plurality of selectable options.

7. A system for processing audio/video content, the system comprising:

an audio/video content receiver, configured to provide audio/video programming to a display device and to provide closed captioning data;

a second screen electronic device, configured for use in conjunction with viewing the audio/video programming on the display device, wherein the second screen electronic device is configured to:

receive the closed captioning data provided by the audio/video content receiver;

access a remote server to retrieve detail for an event occurring in the audio/video programming, by:

accessing the remote server to retrieve a playlist comprising a list of events occurring in the set of audio/video content and detail associated with each of the list of events;

wherein the detail for the event comprises a closed captioning reference string, a time offset, and a reference to second screen content for display after occurrence of the closed captioning reference string and passage of the time offset in the set of audio/video content; and

wherein the event is indicated by the closed captioning data;

perform a lookup to compare the closed captioning data to a plurality of closed captioning reference strings cataloged in the playlist, to locate a match, wherein the plurality of closed captioning reference strings comprises the closed captioning reference string; and

when a match is located,

identify appropriate second screen content cataloged in the playlist; and

present the appropriate second screen content to a user, during occurrence of the first event during playback of the set of audio/video content, based on the retrieved detail, wherein the appropriate second screen content comprises the second screen content.

8. The system of claim 7 , wherein the audio/video content receiver comprises a set-top box (STB) configured to communicate with the second screen electronic device over a wireless local area network (WLAN).

9. The system of claim 7 , further comprising a single computing device,

wherein the single computing device comprises the audio/video content receiver and the second screen electronic device; and

wherein the audio/video programming and the content are presented using a shared screen of the single computing device.

10. The system of claim 7 , further comprising:

a playlist generator, configured to:

manually designate the event occurring in the audio/video programming; and

associate the event with a closed captioning reference string, wherein the closed captioning reference string comprises a subset of the closed captioning data; and

a playlist creation module, configured to:

further associate the manually designated event with the content for presentation via the second screen electronic device; and

generate the playlist cataloging the event, the closed captioning reference string, and the content;

wherein the detail comprises the playlist.

11. The system of claim 7 , wherein the retrieved detail comprises at least the event, an associated closed captioning reference string, and associated content detail.

12. The system of claim 11 , wherein the content comprises a website, and wherein the associated content detail comprises a uniform resource locator (URL).

13. The system of claim 11 , wherein the content comprises text displayed via the second screen electronic device, and wherein the associated content detail comprises a representation of the text.

Assignments (3)
SECURITY INTEREST Recorded Nov 30, 2021
From: DISH BROADCASTING CORPORATION; DISH NETWORK L.L.C.; DISH TECHNOLOGIES L.L.C.
To: U.S. BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 058295/0293 →
CONVERSION Recorded Aug 7, 2018
From: ECHOSTAR TECHNOLOGIES L.L.C.
To: DISH TECHNOLOGIES L.L.C.
Reel/Frame 046737/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2014
From: CASAGRANDE, STEVEN MICHAEL
To: ECHOSTAR TECHNOLOGIES L.L.C.
Reel/Frame 032154/0692 →