Tagging an image with audio-related metadata
In one aspect, an example method to be performed by a computing device includes (a) receiving a request to use a camera of the computing device; (b) in response to receiving the request, (i) using a microphone of the computing device to capture audio content and (ii) using the camera of the computing device to capture an image; (c) identifying reference audio content that has at least a threshold extent of similarity with the captured audio content; and (d) outputting an indication of the identified reference audio content while displaying the captured image.
1. A computing device, comprising:
a camera;
a microphone;
one or more processors; and
a non-transitory, computer-readable medium storing instructions that, when executed by the one or more processors, cause the computing device to perform a set of acts comprising:
detecting one or more predetermined phrases indicating a request to capture an image;
in response to detecting the one or more predetermined phrases indicating a request to capture an image, using the microphone of the computing device to capture audio content
receiving a request to use the camera of the computing device;
in response to receiving the request, using the camera of the computing device to capture an image;
generating audio fingerprint data of the captured audio content;
storing the audio fingerprint data with the captured image on the computing device;
receiving a user input representing a selection of the captured image on the computing device;
in response to receiving the user input, using the stored audio fingerprint data to identify reference audio content that has at least a threshold extent of similarity with the captured audio content; and
outputting an indication of the identified reference audio content while displaying the captured image.
2. The computing device of claim 1 , wherein receiving the request to use the camera of the computing device comprises one or more of (i) receiving a request to launch a camera application of the computing device or (ii) receiving a request to capture an image.
3. The computing device of claim 1 , wherein the computing device is a first computing device further comprising a communication interface for communicating with a second computing device, wherein the second computing device comprises data storage having stored thereon a plurality of reference audio fingerprint items, and wherein using the stored audio fingerprint data to identify the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:
sending, to the second computing device, (i) the stored audio fingerprint data of the captured audio content and (ii) an instruction that causes the second computing device to compare the stored audio fingerprint data to the plurality of reference audio fingerprint items; and
receiving, from the second computing device, an indication of a particular reference audio fingerprint item of the plurality of reference audio fingerprint items that has at least the threshold extent of similarity with the stored audio fingerprint data.
4. The computing device of claim 1 , wherein using the stored audio fingerprint data to identify the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:
comparing the stored audio fingerprint data to a plurality of reference audio fingerprint items, wherein each respective reference audio fingerprint item is associated with respective reference audio content;
determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the stored audio fingerprint data; and
identifying the reference audio content that has at least the threshold extent of similarity with the captured audio content as the respective reference audio content associated with the particular reference audio fingerprint item.
5. The computing device of claim 1 , the set of acts further comprising:
identifying metadata associated with the identified reference audio content, wherein outputting the indication of the identified reference audio content comprises displaying an indication of the metadata associated with the identified reference audio content.
6. The computing device of claim 5 , wherein the metadata comprises one or more of (i) a song title, (ii) an artist, (iii) a genre, (iv) an album title, or (v) a release year.
7. The computing device of claim 1 , wherein outputting the indication of the identified reference audio content comprises outputting the reference audio content.
8. The computing device of claim 1 , wherein the user input representing the selection of the captured image on the computing device comprises a request to view the captured image.
9. A method to be performed by a computing device, the method comprising:
detecting one or more predetermined phrases indicating a request to capture an image;
in response to detecting the one or more predetermined phrases indicating a request to capture an image, using a microphone of the computing device to capture audio content;
receiving a request to use a camera of the computing device;
in response to receiving the request, using the camera of the computing device to capture an image;
generating audio fingerprint data of the captured audio content;
storing the audio fingerprint data with the captured image on the computing device;
receiving a user input representing a selection of the captured image on the computing device;
in response to receiving the user input, using the stored audio fingerprint data to identify reference audio content that has at least a threshold extent of similarity with the captured audio content; and
outputting an indication of the identified reference audio content while displaying the captured image.
10. The method of claim 9 , wherein the computing device is a first computing device further comprising a communication interface for communicating with a second computing device, wherein the second computing device comprises data storage having stored thereon a plurality of reference audio fingerprint items, and wherein using the stored audio fingerprint data to identify the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:
sending, to the second computing device, (i) the stored audio fingerprint data of the captured audio content and (ii) an instruction that causes the second computing device to compare the stored audio fingerprint data to the plurality of reference audio fingerprint items; and
receiving, from the second computing device, an indication of a particular reference audio fingerprint item of the plurality of reference audio fingerprint items that has at least the threshold extent of similarity with the stored audio fingerprint data.
11. The method of claim 9 , wherein using the stored audio fingerprint data to identify the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:
comparing the stored audio fingerprint data to a plurality of reference audio fingerprint items, wherein each respective reference audio fingerprint item is associated with respective reference audio content;
determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the stored audio fingerprint data; and
identifying the reference audio content that has at least the threshold extent of similarity with the captured audio content as the respective reference audio content associated with the particular reference audio fingerprint item.
12. The method of claim 9 , the method further comprising:
identifying metadata associated with the identified reference audio content, wherein outputting the indication of the identified reference audio content comprises displaying an indication of the metadata associated with the identified reference audio content.
13. The method of claim 12 , wherein the metadata comprises one or more of (i) a song title, (ii) an artist, (iii) a genre, (iv) an album title, or (v) a release year.
14. The method of claim 9 , wherein the user input representing the selection of the captured image on the computing device comprises a request to view the captured image.
15. A non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a computing system, cause the computing system to perform a set of operations comprising:
detecting one or more predetermined phrases indicating a request to capture an image;
in response to detecting the one or more predetermined phrases indicating a request to capture an image, using a microphone of a computing device to capture audio content;
receiving a request to use a camera of the computing device;
in response to receiving the request, using the camera of the computing device to capture an image;
generating audio fingerprint data of the captured audio content;
storing the audio fingerprint data with the captured image on the computing device;
receiving a user input representing a selection of the captured image on the computing device;
in response to receiving the user input, using the stored audio fingerprint data to identify reference audio content that has at least a threshold extent of similarity with the captured audio content; and
outputting an indication of the identified reference audio content while displaying the captured image.
16. The non-transitory computer-readable medium of claim 15 , wherein the computing device is a first computing device further comprising a communication interface for communicating with a second computing device, wherein the second computing device comprises data storage having stored thereon a plurality of reference audio fingerprint items, and wherein using the stored audio fingerprint data to identify the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:
sending, to the second computing device, (i) the stored audio fingerprint data of the captured audio content and (ii) an instruction that causes the second computing device to compare the stored audio fingerprint data to the plurality of reference audio fingerprint items; and
receiving, from the second computing device, an indication of a particular reference audio fingerprint item of the plurality of reference audio fingerprint items that has at least the threshold extent of similarity with the stored audio fingerprint data.
17. The non-transitory computer-readable medium of claim 15 , wherein identifying the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:
comparing the stored audio fingerprint data to a plurality of reference audio fingerprint items, wherein each respective reference audio fingerprint item is associated with respective reference audio content;
determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the audio fingerprint data; and
identifying the reference audio content that has at least the threshold extent of similarity with the captured audio content as the respective reference audio content associated with the particular reference audio fingerprint item.
18. The non-transitory computer-readable medium of claim 15 , the set of operations further comprising:
identifying metadata associated with the identified reference audio content, wherein outputting the indication of the identified reference audio content comprises displaying an indication of the metadata associated with the identified reference audio content.
19. The non-transitory computer-readable medium of claim 18 , wherein the metadata comprises one or more of (i) a song title, (ii) an artist, (iii) a genre, (iv) an album title, or (v) a release year.
20. The non-transitory computer-readable medium of claim 15 , wherein the user input representing the selection of the captured image on the computing device comprises a request to view the captured image.