Systems and methods for screenshot linking
A system for analyzing screenshots can include a computing device including a processor coupled to a memory and a display screen configured to display content. The system can include an application stored on the memory and executable by the processor. The application can include a screenshot receiver configured to access, from storage to which a screenshot of the content displayed on the display screen captured using a screenshot function of the computing device is stored, the screenshot including an image and a predetermined marker. The application can include a marker detector configured to detect the predetermined marker included in the screenshot. The application can include a link identifier configured to identify, using the predetermined marker, a link to a resource mapped to the image included in the screenshot, the resource accessible by the computing device via the link.
1. A computer-implemented method for processing image data using a client computing device associated with a user, the client computing device including at least one processor communicatively coupled to a memory, the method comprising:
accessing, by the at least one processor of the client computing device, a set of image data from the memory;
determining, by the at least one processor of the client computing device, that the accessed set of image data represents a screenshot based on metadata associated with the accessed set of image data;
determining, by the at least one processor of the client computing device, relevant content in the screenshot based on a plurality of visual elements identified within the screenshot, the relevant content including an image representative of at least one product;
extracting, by the at least one processor of the client computing device, the determined relevant content from the screenshot;
matching, by the at least one processor of the client computing device, the relevant content to reference content;
transmitting, by the at least one processor of the client computing device, to a server, a request for a link to a social media post associated with the at least one product, the social media post published by an online content publisher on a social media platform, the request including data associated with the extracted relevant content and the reference content; and
receiving, by the at least one processor of the client computing device, the link from the server in response to the request, wherein the link is configured to be displayed in a first application, and wherein the social media post is provided on a second application or website that is different from the first application.
2. The method of claim 1 , wherein:
the relevant content is determined in the screenshot using image processing techniques;
determining that the accessed set of image data represents a screenshot includes determining that the accessed set of image data represents a plurality of screenshots stored in a photo roll of the client computing device; and
the relevant content includes a plurality of products.
3. The method of claim 1 , further comprising:
receiving, by the at least one processor of the client computing device, a link to a product webpage for purchasing the at least one product identified in the screenshot.
4. The method of claim 1 , further comprising:
identifying, by the at least one processor, at least one social media application, among a plurality of possible social media applications, associated with the screenshot and the social media post based on the plurality of visual elements identified within the screenshot, wherein the link is configured to provide the social media post using the identified social media application.
5. The method of claim 4 , wherein identifying the at least one application further comprises comparing the plurality of visual elements to reference data stored in the memory for a plurality of applications.
6. The method of claim 1 , further comprising:
monitoring, by the at least one processor, the memory to determine when new sets of image data that correspond to screenshots are added to the memory.
7. The method of claim 1 , further comprising:
displaying, by the at least one processor, a generic shopping interface on the client computing device to allow purchase of the at least one product, wherein the generic shopping interface is unassociated with the online content publisher, wherein the relevant content includes at least one image in the screenshot that is representative of at least one product.
8. The method of claim 1 , wherein the link comprises a deep link corresponding to at least one of a particular webpage or a portion of a particular mobile application associated with the screenshot, wherein the link is provided in a push notification or a popup notification.
9. The method of claim 1 , wherein the screenshot is taken using an image capturing device associated with the client computing device, and wherein the link is provided in a notification displayed over a view port of the first application.
10. The method of claim 1 , wherein the screenshot includes an image of the social media post captured from the second application, the second application including a social media application executed on the client computing device.
11. The method of claim 1 , wherein the server is configured to determine the link based on the extracted relevant content and the reference content.
12. The method of claim 1 , wherein the relevant content includes one or more of:
at least one image representative of at least one product;
a watermark; or
a fingerprint.
13. A client computing device associated with a user for processing image data comprising:
at least one processor; and
at least one storage device storing instructions which, when executed by the at least one processor, cause the at least one processor of the client computing device to perform operations comprising:
accessing a set of image data from the at least one storage device;
determining that the accessed set of image data represents a screenshot based on metadata associated with the accessed set of image data;
determining relevant content in the screenshot based on a plurality of visual elements identified within the screenshot, the relevant content including an image representative of at least one product;
extracting the determined relevant content from the screenshot;
matching the relevant content to reference content;
transmitting, to a server, a request for a link to a social media post associated with the at least one product, the social media post published by an online content publisher on a social media platform, the request including data associated with the extracted relevant content and the reference content; and
receiving the link from the server in response to the request, wherein the link is configured to be displayed in a first application, and wherein the social media post is provided on a second application or website that is different from the first application.
14. The client computing device of claim 13 , wherein the relevant content is determined in the screenshot using image processing techniques.
15. The client computing device of claim 13 , wherein the at least one processor of the client computing device is configured to perform further operations comprising:
receiving a URL to a product webpage for purchasing a product identified in the screenshot.
16. The client computing device of claim 13 , wherein the relevant content includes at least one image in the screenshot that is representative of at least one product.
17. The client computing device of claim 13 , wherein the link comprises a deep link corresponding to at least one of a particular webpage or a portion of a particular mobile application associated with the screenshot.
18. The client computing device of claim 13 , wherein the screenshot is taken using an image capturing device associated with the client computing device.
19. A non-transitory computer-readable medium storing computer-executable instructions which, when executed by at least one processor of a client computing device associated with a user, cause the at least one processor of the client computing device to perform operations for processing image data, the operations comprising:
accessing a set of image data from a data storage of the client computing device;
determining that the accessed set of image data represents a screenshot based on metadata associated with the accessed set of image data;
determining relevant content in the screenshot based on a plurality of visual elements identified within the screenshot, the relevant content including an image representative of at least one product;
extracting the determined relevant content from the screenshot;
matching the relevant content to reference content;
transmitting, to a server, a request for a link to a social media post associated with the at least one product, the social media post published by an online content publisher on a social media platform, the request including data associated with the extracted relevant content and the reference content; and
receiving the link from the server in response to the request, wherein the link is configured to be displayed in a first application, and wherein the social media post is provided on a second application or website that is different from the first application.
20. The computer-implemented method of claim 1 , further comprising:
receiving, at the client computing device, a number of times the relevant content has been captured in a screenshot by the client computing device associated with the user and/or by secondary client computing devices associated with secondary users.