Media processing methods and arrangements
The present technology concerns cell phones and other portable devices, and more particularly concerns use of such devices in connection with media content (electronic and physical) and with other systems (e.g., televisions, digital video recorders, and electronic program directories). Some aspects of the technology allow users to easily transfer displayed content from cell phone screens onto a television screens for easier viewing, or vice versa for content portability. Others enable users to participate interactively in entertainment content, such as by submitting plot directions, audio input, character names, etc., yielding more engaging, immersive, user experiences. Still other aspects of the technology involve a program directory database, compiled automatically from information reported by network nodes that watch and identify content traffic passing into (and/or out of) networked computers. By identifying content resident at a number of different repositories (e.g., web sites, TV networks, P2P systems, etc.), such a directory allows cell phone users to identify the diversity of sources from which desired content can be obtained—some available on a scheduled basis, others available on demand. Depending on the application, the directory information may be transparent to the user—serving to identify sources for desired content, from which application software can pick for content downloading, based, e.g., on context and stored profile data. A great number of other features and arrangements are also detailed.
1. A data processing method involving a television and a microphone-equipped device, the method comprising the acts:
applying a content recognition process to audio captured from a user's ambient environment by the microphone of said device, the audio captured from the user's ambient environment including audio emitted from the television as it renders entertainment content, the recognition process being performed by a hardware processor and yielding content identification data, but said content identification data being insufficient to identify the rendered entertainment content because the audio of said entertainment content is not adequately sampled;
based on said content identification data and also based on user data, refining a content identification hypothesis identifying the rendered entertainment content, the user data including data selected from a list consisting of: (i) data about sports teams of interest to the user, (ii) data indicating the user's age or gender, (iii) data about a social group to which the user belongs, (iv) search history records of the user, (v) records of web pages visited by the user, (vi) records of user emails, (vii) records of travel reservations by the user, (viii) cell phone billing records of the user, (ix) credit card records of the user, (x) records of user purchases made from the Amazon or EBay service, and times of day that are memorialized in said records (iv)-(x);
after the identification hypothesis has been refined, providing further content for presentation to the user, the provided further content being determined based on data including (1) the refined entertainment content identification hypothesis, and (2) the user data;
wherein further content for presentation to the user is determined based on user data from said list, and user data from said list is also employed in refining the content identification hypothesis—on which hypothesis determination of the further content is also based.
2. The method of claim 1 that includes performing a domain transformation operation on the captured audio, from a temporal signal domain to a frequency signal domain, as part of said content recognition process.
3. The method of claim 1 that includes refining the content identification hypothesis based on search history records of the user.
4. The method of claim 1 that includes refining the content identification hypothesis based on records of web pages visited by the user.
5. The method of claim 1 that includes refining the content identification hypothesis based on records of travel reservations by the user.
6. The method of claim 1 that includes refining the content identification hypothesis based on cell phone billing records of the user.
7. The method of claim 1 that includes refining the content identification hypothesis based on credit card records of the user.
8. The method of claim 1 that includes refining the content identification hypothesis based on records of user shopping from the Amazon or EBay service.
9. The method of claim 1 that includes providing further content for presentation to the user, determined based on data including (1) the refined entertainment content identification hypothesis, (2) the user data, and (3) GPS data for the user.
10. The method of claim 1 that further includes transmitting the content identification data to a remote server with an HTTP request, wherein the further content is provided in response to said HTTP request.
11. A data processing method involving a television and a microphone-equipped device, the method comprising the acts:
applying a content recognition process to audio captured from a user's ambient environment by the microphone of said device, the audio captured from the user's ambient environment including audio emitted from the television as it renders entertainment content, said content recognition process being performed by a hardware processor and including performing a domain transformation operation on the captured audio from a temporal signal domain to a frequency signal domain, said content recognition process yielding content identification data;
obtaining user data compiled in a data store, the user data including data selected from a list consisting of: search history records of the user, records of web pages visited by the user, records of user emails, records of travel reservations by the user, records of user shopping from the Amazon or EBay service, and times of day that are memorialized in said records;
providing auxiliary entertainment content, complementary to that presented on the television, for presentation to the user, the auxiliary content being determined based on data including: (1) GPS data for the user, (2) the obtained user data, and (3) the content identification data.
12. The data processing method of claim 11 in which:
said content identification data is insufficient to identify the rendered entertainment content, because the audio of said entertainment content is not adequately sampled;
the method further including, based on said content identification data and also based on user data selected from said list, refining a content identification hypothesis identifying the rendered entertainment content;
wherein further content for presentation to the user is determined based on user data from said list, and user data from said list is also employed in refining the content identification hypothesis—on which hypothesis the determination of the further content is also based.
13. The data processing method of claim 11 in which the obtained user data includes records of user shopping from the Amazon or EBay service.
14. A data processing method involving a television and a microphone-equipped device, the method comprising the acts:
applying a content recognition process to audio captured from a user's ambient environment by the microphone of said device, the audio captured from the user's ambient environment including audio emitted from the television as it renders entertainment content, the recognition process being performed by a hardware processor and yielding content identification data about the entertainment content, but said content identification data being insufficient to identify the rendered entertainment content because the audio of said entertainment content is not adequately sampled;
based on said content identification data and also based on user data, refining a content identification hypothesis identifying the rendered entertainment content, the user data including data selected from a list consisting of: (i) data about sports teams of interest to the user, (ii) data indicating the user's age or gender, (iii) data about a social group to which the user belongs, (iv) search history records of the user, (v) records of web pages visited by the user, (vi) records of user emails, (vii) records of travel reservations by the user, (viii) cell phone billing records of the user, (ix) credit card records of the user, (x) records of user purchases made from the Amazon or EBay service, and times of day that are memorialized in said records (iv)-(x);
transmitting said refined content identification data with an HTTP request sent by the device to a remote server, to obtain further content, said content identification data being included in an HTTP packet as header data; and
receiving, in response to said HTTP request, content that the remote server has adapted for the user, based on the content identification data;
wherein transmission of said content identification data, about entertainment content being rendered in the user's environment, with the HTTP request, serves as a clue to user interests, and enables a provider of the requested content to customize the content delivered to the user device in accordance with such interests.
15. The method of claim 14 in which the further content comprises a web page from an address specified by the user and included with said HTTP request.
16. The method of claim 14 in which the content is news from a news website, and the entertainment content that is being audibly rendered in the environment of the device is sports programming, wherein a provider of the news website can customize a web page sent to the device to give prominence to sporting news, by reason of said content identification data.
17. The method of claim 14 in which the content recognition process includes subtracting a short-term average of the captured audio from its instantaneous amplitude.
18. The method of claim 14 in which said content identification data correctly identifies the content 20 percent of the time, or less.