Using features extracted from an audio and/or video work to obtain information about the work
View Patent ↗Information about an audio or video file played on a device is provided by (a) extracting features from the audio or video file, (b) communicating the features to a database, and (c) receiving the information about the audio or video file from the database. The information might include a song title, an album title, and/or a performer name. The information might include a title of a video work, a director of the video work, and/or names of performers in the video work. The information might be rendered on an output of the device. The information might be stored (e.g., persistently) locally on the device.
1. A method for associating an electronic work with an action, the electronic work comprising at least one of audio and video, the method comprising:
a) electronically extracting within a portable client device features from the electronic work;
b) transmitting the extracted features from the portable client device to one or more servers;
c) receiving at the portable client device from the one or more servers an identification of the electronic work based on the extracted features, wherein the identification is based on a non-exhaustive search identifying a neighbor;
d) electronically determining an action based on the identification of the electronic work; and
e) electronically performing the action on the portable client device.
2. A method of claim 1 , wherein the identification is based on a non-exhaustive search identifying a neighbor within a fixed radius.
3. The method of claim 1 , wherein the non-exhaustive search is sublinear.
4. The method of claim 1 , wherein the non-exhaustive search is based on kd-trees.
5. The method of claim 1 , wherein the non-exhaustive search is based on vantage point trees.
6. The method of claim 1 , wherein the non-exhaustive search is based on excluded middle vantage point forest.
7. The method of claim 1 , wherein the electronic work is an audio work.
8. The method of claim 7 , wherein the audio work is obtained from at least one of a broadcast and an audio file format.
9. The method of claim 7 , wherein the identification includes at least one of a song title, an album title, and a performer name.
10. The method of claim 1 , wherein the electronic work is a video work.
11. The method of claim 10 , wherein the video work is obtained from at least one of a broadcast and a video file format.
12. The method of claim 10 , wherein the identification includes at least one of a title of the video work, a director of the video work, and names of performers in the video work.
13. The method of claim 1 , wherein the step of electronically determining the action includes receiving at the portable client device an action based on the identification of the electronic work from the one or more servers.
14. The method of claim 1 , wherein the step of electronically extracting the features is performed by at least one of a microprocessor of the portable client device and a digital signal processor of the portable client device.
15. A method for associating an electronic work with an action, the electronic work comprising at least one of audio and video, the method comprising:
a) electronically extracting features from the electronic work;
b) electronically determining an identification of the electronic work based on the extracted features, wherein the identification is based on a non-exhaustive search identifying a neighbor;
c) electronically determining an action based on the identification of the electronic work; and
d) electronically performing the action.
16. A method of claim 15 , wherein the identification is based on a non-exhaustive search identifying a neighbor within a fixed radius.
17. The method of claim 15 , wherein the non-exhaustive search is sublinear.
18. The method of claim 15 , wherein the non-exhaustive search is based on kd-trees.
19. The method of claim 15 , wherein the non-exhaustive search is based on vantage point trees.
20. The method of claim 15 , wherein the non-exhaustive search is based on excluded middle vantage point forest.
21. The method of claim 15 , wherein the electronic work is an audio work.
22. The method of claim 21 , wherein the audio work is obtained from at least one of a broadcast and an audio file format.
23. The method of claim 21 , wherein the identification includes at least one of a song title, an album title, and a performer name.
24. The method of claim 15 , wherein the electronic work is a video work.
25. The method of claim 24 , wherein the video work is obtained from at least one of a broadcast and a video file format.
26. The method of claim 24 , wherein the identification includes at least one of a title of the video work, a director of the video work, and names of performers in the video work.
27. The method of claim 15 , wherein the action promotes e-commerce.
28. The method of claim 15 , wherein the action promotes interaction.
29. The method of claim 1 , wherein the action promotes e-commerce.
30. The method of claim 1 , wherein the action promotes interaction.
31. The method of claim 15 , wherein the action comprises providing and/or displaying additional information in association with the electronic work.
32. The method of claim 31 , wherein the additional information is an advertisement.
33. The method of claim 32 , wherein the action comprises providing a link to a site on the World Wide Web associated with the advertisement.
34. The method of claim 32 , wherein the action comprises electronically registering a user with at least one of a service and a product related to the advertisement.
35. The method of claim 32 , wherein the action comprises electronically providing at least one of a coupon and a certificate related to the advertisement.
36. The method of claim 32 , wherein the action comprises automatically dialing a telephone number associated with the advertisement.
37. The method of claim 32 , wherein the action comprises collecting competitive market research data related to the advertisement.
38. The method of claim 32 , wherein the action comprises purchasing a product or service related to the advertisement.
39. The method of claim 32 , wherein the action comprises allowing a user to interact with a live broadcast related to the advertisement.
40. The method of claim 1 , wherein the action comprises providing and/or displaying additional information in association with the electronic work.
41. The method of claim 40 , wherein the additional information is an advertisement.
42. The method of claim 41 , wherein the action comprises providing a link to a site on the World Wide Web associated with the advertisement.
43. The method of claim 41 , wherein the action comprises electronically registering a user with at least one of a service and a product related to the advertisement.
44. The method of claim 41 , wherein the action comprises electronically providing at least one of a coupon and a certificate related to the advertisement.
45. The method of claim 41 , wherein the action comprises automatically dialing a telephone number associated with the advertisement.
46. The method of claim 41 , wherein the action comprises collecting competitive market research data related to the advertisement.
47. The method of claim 41 , wherein the action comprises purchasing a product or service related to the advertisement.
48. The method of claim 41 , wherein the action comprises allowing a user to interact with a live broadcast related to the advertisement.
49. The method of claim 40 , wherein the electronic work is an audio work and the additional information comprises at least one of a song title, an album title, and a performer name.
50. The method of claim 40 , wherein the electronic work is a video work and the additional information comprises at least one of a title of the video work, a director of the video work, and names of performers in the video work.
51. The method of claim 31 , wherein the electronic work is an audio work and the additional information comprises at least one of a song title, an album title, and a performer name.
52. The method of claim 31 , wherein the electronic work is a video work and the additional information comprises at least one of a title of the video work, a director of the video work, and names of performers in the video work.