Systems and methods for screenshot linking
A system for analyzing screenshots can include a computing device including a processor coupled to a memory and a display screen configured to display content. The system can include an application stored on the memory and executable by the processor. The application can include a screenshot receiver configured to access, from storage to which a screenshot of the content displayed on the display screen captured using a screenshot function of the computing device is stored, the screenshot including an image and a predetermined marker. The application can include a marker detector configured to detect the predetermined marker included in the screenshot. The application can include a link identifier configured to identify, using the predetermined marker, a link to a resource mapped to the image included in the screenshot, the resource accessible by the computing device via the link.
1. A computer-implemented method for processing image data using at least one processor coupled to a memory, the method comprising:
receiving, by the at least one processor, a set of image data generated from a display device at a client computing device associated with a user;
determining, by the at least one processor, that the received set of image data represents a first screenshot based on metadata associated with the received set of image data;
identifying, by the at least one processor, a first plurality of visual elements of the first screenshot;
determining, by the at least one processor, first relevant content in the first screenshot based on the identified first plurality of visual elements;
matching, by the at least one processor, the first relevant content in the first screenshot with first reference content;
identifying, by the at least one processor, a first product category or a first product brand to which the first relevant content corresponds;
determining, by the at least one processor, a first link associated with the first reference content;
transmitting, by the at least one processor, the first link to the client computing device to enable the user to access the first link;
generating, by the at least one processor, a user profile for the user to include data associated with the first relevant content in the first screenshot; and
associating, by the at least one processor, the user profile with the identified first product category.
2. The method of claim 1 , wherein the first relevant content is determined in the first screenshot using image processing techniques.
3. The method of claim 1 , wherein the first link provided to the client computing device is a URL to a product webpage for purchasing a product identified in the screenshot.
4. The method of claim 1 , wherein the first relevant content includes a marker configured to uniquely identify the first relevant content.
5. The method of claim 1 , further comprising identifying at least one application associated with the first screenshot based on the identified first plurality of visual elements.
6. The method of claim 1 , further comprising:
monitoring, by the at least one processor, a database associated with the client computing device to determine when new sets of image data that correspond to screenshots are added to the database.
7. The method of claim 1 , further comprising generating and transmitting a notification to the client computing device that the first link associated with the first screenshot has been determined.
8. The method of claim 1 , wherein the first relevant content is an image in the first screenshot, and wherein matching the first relevant content in the first screenshot with the first reference content comprises:
comparing the image to a plurality of reference images stored within the memory; and
determining a match between the image and one of the plurality of reference images.
9. The method of claim 1 , wherein the first link comprises a deep link corresponding to at least one of a particular webpage or a portion of a particular mobile application associated with the first screenshot.
10. The method of claim 1 , further comprising:
identifying, by the at least one processor, a second plurality of visual elements in a second screenshot;
determining, by the at least one processor, second relevant content in the second screenshot based on the second plurality of visual elements;
matching, by the at least one processor, the second relevant content in the second screenshot with a second reference content;
identifying, by the at least one processor, a second product category to which the second relevant content in the second screenshot corresponds, wherein the second product category is the same as the first product category;
determining, by the at least one processor, a second link associated with the second reference content;
transmitting, by the at least one processor, the second link to the client computing device to enable the user to access the second link; and
updating the user profile associated with the first product category to include data associated with the second relevant content in the second screenshot.
11. A system for analyzing image data comprising:
at least one processor; and
at least one storage device storing instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving a set of image data generated from a display device at a client computing device associated with a user;
determining that the received set of image data represents a first screenshot based on metadata associated with the received set of image data;
identifying a first plurality of visual elements of the first screenshot;
determining first relevant content in the first screenshot based on the identified first plurality of visual elements;
matching the first relevant content in the first screenshot with first reference content;
identifying a first product category or a first product brand to which the first relevant content corresponds;
determining a first link associated with the first reference content;
transmitting the first link to the client computing device to enable the user to access the first link;
generating, by the at least one processor, a user profile for the user to include data associated with the first relevant content in the first screenshot; and
associating, by the at least one processor, the user profile with the identified first product category.
12. The system of claim 11 , wherein the first relevant content is determined in the first screenshot using image processing techniques.
13. The system of claim 11 , wherein the first relevant content includes a marker configured to uniquely identify the first relevant content.
14. The system of claim 11 , wherein the operations further comprise monitoring a database associated with the client computing device to determine when new sets of image data are added to the database.
15. The system of claim 11 , wherein the operations further comprise generating and transmitting a notification to the client computing device that the first link associated with the first screenshot has been determined.
16. The system of claim 11 , wherein the first link comprises a deep link corresponding to at least one of a particular webpage or a portion of a particular mobile application associated with the first screenshot.
17. A non-transitory computer-readable medium storing computer-executable instructions which, when executed by at least one processor, cause the at least one processor to perform operations comprising:
receiving a set of image data generated from a display device at a client computing device associated with a user;
determining that the received set of image data represents a first screenshot based on metadata associated with the received set of image data;
identifying a first plurality of visual elements of the first screenshot;
determining first relevant content in the first screenshot based on the identified first plurality of visual elements;
matching the first relevant content in the first screenshot with first reference content;
identifying a first product category or a first product brand to which the first relevant content corresponds;
determining a first link associated with the first reference content;
transmitting the first link to the client computing device to enable the user to access the first link;
generating, by the at least one processor, a user profile for the user to include data associated with the first relevant content in the first screenshot; and
associating, by the at least one processor, the user profile with the identified first product category.
18. The computer-readable medium of claim 17 , wherein the first link provided to the client computing device is a URL to a product webpage for purchasing a product identified in the first screenshot.
19. The computer-readable medium of claim 17 , wherein the first relevant content includes a marker configured to uniquely identify the first relevant content.
20. The computer-readable medium of claim 17 , wherein the first link comprises a deep link corresponding to at least one of a particular webpage or a portion of a particular mobile application associated with the first screenshot.