Predicting topics of potential relevance based on retrieved/created digital media files
Implementations are described herein for leveraging digital media files retrieved and/or created by users to predict/determine topics of potential relevance to the users. In various implementations, digital media file(s) created and/or retrieved by a user with a client device may be applied as input across trained machine learning model(s), which in some cases are local to the client device, to generate output that indicates object(s) detected in the digital media file(s). Data indicative of the indicated object(s) may be provided to a remote computing system without providing the digital media file(s) themselves. In some implementations, information associated with the indicated object(s) may be retrieved and proactively output to the user. In some implementations, a frequency at which objects occur across a corpus of digital media files may be considered when determining a likelihood that a detected object is potentially relevant to a user.
1. A method implemented using one or more processors, comprising:
obtaining one or more digital image files created by a user with one or more client devices;
applying the one or more digital image files as input across one or more trained object recognition machine learning models, wherein the one or more trained object recognition machine learning models generate output indicative of a plurality of objects detected in the one or more digital image files;
analyzing the plurality of detected objects to identify a theme or genus that corresponds to a subset of multiple detected objects within the plurality;
identifying one or more topics of potential relevance to the user based on one or more of the plurality of detected objects that are excluded from the subset;
formulating a search query based on the identified one or more topics; and
proactively causing information responsive to the formulated search query to be output at one or more of the client devices operated by the user.
2. The method of claim 1 , wherein the theme comprises a type of location to which the detected objects of the subset are related.
3. The method of claim 2 , wherein the one or more detected objects that are excluded from the subset comprise objects that are unrelated to the type of location.
4. The method of claim 2 , wherein the detected objects of the subset are related to the type of location by virtue of the detected objects of the subset being commonly found in the type of location.
5. The method of claim 1 , wherein one or more of the trained object recognition machine learning models comprises a convolutional neural network.
6. A client device comprising one or more processors and memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:
obtain one or more digital image files created by a user with the client device;
apply the one or more digital image files as input across one or more trained object recognition machine learning models, wherein the one or more trained object recognition machine learning models generate output indicative of a plurality of objects detected in the one or more digital media files;
analyze the plurality of detected objects to identify a theme or genus that corresponds to a subset of multiple detected objects within the plurality;
identify one or more topics of potential relevance to the user based on one or more of the detected objects that are excluded from the subset;
formulate a search query based on the identified one or more topics; and
proactively cause information responsive to the formulated search query to be output at one or more of the client devices operated by the user.
7. The client device of claim 6 , wherein the theme comprises a type of location to which the detected objects of the subset are related.
8. The client device of claim 7 , wherein the one or more detected objects that are excluded from the subset comprise objects that are unrelated to the type of location.
9. The client device of claim 7 , wherein the detected objects of the subset are related to the type of location by virtue of the detected objects of the subset being commonly found in the type of location.
10. The client device of claim 6 , wherein one or more of the trained object recognition machine learning models comprises a convolutional neural network.
11. At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by one or more processors of a client device, cause the one or more processors to perform the following operations:
obtaining one or more digital image files created by a user with one or more client devices;
applying the one or more digital image files as input across one or more trained object recognition machine learning models, wherein the one or more trained object recognition machine learning models generate output indicative of a plurality of objects detected in the one or more digital image files;
analyzing the plurality of detected objects to identify a theme or genus that corresponds to a subset of multiple detected objects within the plurality;
identifying one or more topics of potential relevance to the user based on one or more of the plurality of detected objects that are excluded from the subset;
formulating a search query based on the identified one or more topics; and
proactively causing information responsive to the formulated search query to be output at one or more of the client devices operated by the user.
12. The at least one non-transitory computer-readable medium of claim 11 , wherein the theme comprises a type of location to which the detected objects of the subset are related.
13. The at least one non-transitory computer-readable medium of claim 12 , wherein the one or more detected objects that are excluded from the subset comprise objects that are unrelated to the type of location.
14. The at least one non-transitory computer-readable medium of claim 12 , wherein the detected objects of the subset are related to the type of location by virtue of the detected objects of the subset being commonly found in the type of location.