Identification and presentation of content associated with currently playing television programs
Features of various implementations are used to enable identifying and presenting, in real time, Internet-accessible and/or Internet-based functionality, content and/or services associated with a particular television program concurrently playing on a television or display, as a part of an interactive television suite of technologies. In some implementations, the process of identifying Internet-accessible and/or Internet-based functionality, content and/or services associated with a particular television program is enabled to reduce communication between a primary set-top box and a supplemental set-top box and/or television integrated device, thereby reducing the need for one or more provider specific APIs. For example, one aspect of the disclosure is a computer-implemented method of identifying a media program by capturing display data from the media program, and extracting information from the display data in response to determining that the display data includes a program information overlay associated with the media program.
1. A computer-implemented method, implemented at an electronic system including a display device, the method comprising:
obtaining a media program for display on the display device;
displaying a program information overlay concurrently with the media program on the display device, wherein the program information overlay is associated with the media program;
while displaying the program information overlay, receiving a request for content associated with at least part of information displayed on the program information overlay; and
in response to the request for associated content:
capturing screen display data associated with the media program displayed on the display device;
determining whether the program information overlay is being displayed on the display device based on an analysis of the captured screen display data to determine whether the screen display data includes one or more predefined indicators of the program information overlay;
retrieving from a server the content associated with at least part of the information displayed on the program information overlay; and
displaying the retrieved content on one of the display device and a second screen client device.
2. The method of claim 1 , wherein processing the information displayed on the program information overlay further comprises:
generating search terms from the information displayed on the program information overlay; and
performing a search based on a subset of the search terms to identify the content from the server.
3. The method of claim 2 , wherein the search includes a search selected from a group consisting of a general Internet search, a targeted search for associated news items, a targeted search for associated images, a targeted search for associated Internet-accessible media content, and a targeted search for associated social media content.
4. The method of claim 1 , wherein receiving the request for associated content further comprising receiving a user press on one of:
a button of a remote control coupled to the display device; and
an affordance on an application interface configured to control play of the media program on the display device.
5. The method of claim 1 , wherein the retrieved content includes one or more of: a program title, actor names, character names, and plot summaries.
6. The method of claim 1 , wherein the retrieved content includes one or more of: a content file, a link to the content file, and metadata associated with the content file.
7. The method of claim 1 , wherein the retrieved content includes one or more of videos, images, music, web pages, email messages, SMS messages, content feeds, playlists, XML documents, and ratings associated with media content.
8. The method of claim 1 , wherein the retrieved content includes one or more of links to videos, images, music, web pages, email messages, SMS messages, content feeds, playlists, XML documents, and ratings associated with media content.
9. The method of claim 1 , wherein the retrieved content is displayed on the one of the display device and second screen client device, concurrently and synchronously with displaying the media program and program information overlay.
10. The method of claim 1 , wherein the one or more predefined indicators include at least one of: a color of the program information overlay, a percentage of display area the program information overlay typically covers when visible, an arrangement of text with the program information overlay, contrast between a portion of a display likely to be displaying the media program and another portion of the display likely to be displaying the program information overlay.
11. The method of claim 1 , wherein the server includes one or more third party content servers, and the content is stored in a database of the server, and wherein the database is established at least partially based on heuristic data of prior searches of a plurality of users and content providers.
12. An electronic system, comprising:
a display device;
one or more processors; and
memory storing one or more programs, the one or more programs including instructions that, when executed by the one or more processors, cause the device to implement operations for:
obtaining a media program for display on the display device;
displaying a program information overlay concurrently with the media program on the display device, wherein the program information overlay is associated with the media program;
while displaying the program information overlay, receiving a request for content associated with at least part of information displayed on the program information overlay; and
in response to the request for associated content:
capturing screen display data associated with the media program displayed on the display device;
determining whether the program information overlay is being displayed on the display device based on an analysis of the captured screen display data to determine whether the screen display data includes one or more predefined indicators of the program information overlay;
retrieving from a server the content associated with at least part of the information displayed on the program information overlay; and
displaying the retrieved content on one of the display device and a second screen client device.
13. The electronic system of claim 12 , wherein processing the information displayed on the program information overlay further comprises:
identifying noun phrases in the information displayed on the program information overlay; and
selecting a threshold number of noun phrases to be search terms to retrieve the content from the server.
14. The electronic system of claim 13 , wherein retrieving the content from the server further comprises:
performing a respective search for each of the threshold number of noun phrases, and wherein each respective search produces a subset of the retrieved content.
15. The electronic system of claim 12 , wherein processing the information displayed on the program information overlay further comprises:
cross-referencing noun phrases in the information displayed on the program information overlay against prior search data.
16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic system cause the processors to implement operations for:
obtaining a media program for display on a display device of the electronic system;
displaying a program information overlay concurrently with the media program on the display device, wherein the program information overlay is associated with the media program;
while displaying the program information overlay, receiving a request for content associated with at least part of information displayed on the program information overlay;
in response to the request for associated content:
capturing screen display data associated with the media program displayed on the display device;
determining whether the program information overlay is being displayed on the display device based on an analysis of the captured screen display data to determine whether the screen display data includes one or more predefined indicators of the program information overlay;
retrieving from a server the content associated with at least part of the information displayed on the program information overlay; and
displaying the retrieved content on one of the display device and a second screen client device.
17. The non-transitory computer readable storage medium of claim 16 , wherein retrieving the content from the server further comprises:
performing a search at the server to identify a plurality of search results;
scoring the search results; and
enabling display of at least some of the search results as the retrieved content based on the scoring.
18. The non-transitory computer readable storage medium of claim 17 , wherein scoring the search results comprises:
categorizing the search results; and
for each search result, assigning a query score based on at least one of location data, search history and user preferences, wherein each result of the search is displayed based at least on the query score.
19. The non-transitory computer readable storage medium of claim 16 , wherein processing the information displayed on the program information overlay further comprises:
cross-referencing noun phrases in the information displayed on the program information overlay against known names of television shows, movies, sporting events and known proper names.