IP Library Granted Patent US 11,468,113
Granted Patent B2
US 11,468,113 · App. 16/989,573 · Granted Oct 11, 2022

Systems and methods for screenshot linking

Inventors: Jason Ellis Pearlman (Lloyd Harbor, NY); Elias Jason Mablekos (New York, NY); Andrew Cummins (Brooklyn, NY)
Assignee: rewardStyle, Inc.
G06F16/5866G06F16/51G06F16/583G06F16/9566G06T1/0007G06V10/40G06V10/462H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,113
App. No.
16/989,573
Granted
Oct 11, 2022
Kind
B2
Abstract

A system for analyzing screenshots can include a computing device including a processor coupled to a memory and a display screen configured to display content. The system can include an application stored on the memory and executable by the processor. The application can include a screenshot receiver configured to access, from storage to which a screenshot of the content displayed on the display screen captured using a screenshot function of the computing device is stored, the screenshot including an image and a predetermined marker. The application can include a marker detector configured to detect the predetermined marker included in the screenshot. The application can include a link identifier configured to identify, using the predetermined marker, a link to a resource mapped to the image included in the screenshot, the resource accessible by the computing device via the link.

Claims (37)

1. A method for processing image data comprising:

receiving, by a processor, a first set of image data generated from a screenshot of a display device;

processing, by the processor, the first set of image data in response to instructions fetched from a memory device to identify a predetermined marker, a plurality of visual elements in the first set of image data that have a pre-existing association with an application software program, and metadata uniquely identifying the first set of image data;

identifying, by the processor and based at least on the predetermined marker, the plurality of visual elements, and the metadata, a link to a social media post viewable at the application software program, the social media post including a second set of image data matching the first set of image data; and

causing, by the processor, the link to be displayed on a client device.

2. The method of claim 1 , wherein the predetermined marker includes a visual marker added to the first set of image data included in the screenshot.

3. The method of claim 1 , wherein the predetermined marker includes a code comprising a string of characters.

4. The method of claim 1 , further comprising:

comparing the first set of image data to a plurality of reference markers;

determining a match between the first set of image data and one of the plurality of reference markers; and

identifying the link based at least on the one of the plurality of reference markers.

5. The method of claim 1 , wherein causing the link to be displayed on the client device comprises causing a notification including the link to be displayed on the client device.

6. The method of claim 1 , wherein the link comprises a deep link corresponding to the social media post within the application software program.

7. A system for analyzing screenshots to identify links to resources comprising:

a processor coupled to a memory device and

configured to perform operations including:

receiving, from a client device, a first set of image data generated from a screenshot;

processing the first set of image data to identify a predetermined marker, a plurality of visual elements in the first set of image data that have a pre-existing association with an application software program, and metadata uniquely identifying the first set of image data;

identifying, based at least on the predetermined marker, the plurality of visual elements, and the metadata, a link to a social media post viewable at the application software program, the social media post including a second set of image data matching the first set of image data; and

causing the link to be displayed at the client device.

8. The system of claim 7 , wherein the predetermined marker includes a visual marker added to the set of image data included in the screenshot.

9. The system of claim 7 , wherein the predetermined marker includes metadata uniquely identifying the first set of image data.

10. The system of claim 7 , wherein the predetermined marker includes a code comprising a string of characters.

11. The system of claim 7 , the operations further including:

comparing the predetermined marker to a plurality of reference markers;

determining a match between the predetermined marker and one of the plurality of reference markers; and

identifying the link based on the one of the plurality of reference markers.

12. The system of claim 7 , wherein the link comprises a deep link corresponding to the social media post within the application software program.

13. A non-transitory computer-readable medium storing computer-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:

accessing a screenshot including a first set of image data;

extracting data corresponding to the first set of image data included in the screenshot;

identifying, based on the extracted data, a predetermined marker, a plurality of visual elements in the first set of image data that have a pre-existing association with an application software program, and metadata uniquely identifying the first set of image data;

identifying, based at least on the predetermined marker, the plurality of visual elements, and the metadata, a link to a social media post viewable at the application software program, the social media post including a second set of image data matching the first set of image data; and

causing the link to be displayed at a client device.

14. The computer-readable medium of claim 13 , further comprising identifying the first set of image data from the screenshot by performing image entropy analysis on the screenshot to determine a portion of the screenshot that corresponds to the first set of image data.

15. The computer-readable medium of claim 13 , wherein the link comprises a deep link corresponding to the social media post within the application software program.

16. The computer-readable medium of claim 13 , wherein the predetermined marker includes a fingerprint, and wherein identifying the link further comprises identifying the link responsive to determining a match between the fingerprint and a plurality of reference fingerprints based on a comparison of the fingerprint of the image to a plurality of reference fingerprints.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Oct 2, 2023
From: SILICON VALLEY BANK, A DIVISION OF FIRST CITIZENS BANK & TRUST COMPANY (SUCCESSOR BY PURCHASE TO THE FEDERAL DEPOSIT INSURANCE CORPORATION AS RECEIVER FOR SILICON VALLEY BRIDGE BANK, N.A. (AS SUCCESSOR TO SILICON VALLEY BANK))
To: REWARDSTYLE, INC.
Reel/Frame 065098/0831 →
SECURITY INTEREST Recorded Feb 2, 2022
From: REWARDSTYLE, INC.
To: SILICON VALLEY BANK
Reel/Frame 058950/0367 →
SECOND AMENDMENT TO INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jan 15, 2021
From: REWARDSTYLE, INC.
To: SILICON VALLEY BANK
Reel/Frame 055009/0281 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2020
From: PEARLMAN, JASON ELLIS; MABLEKOS, ELIAS JASON; CUMMINS, ANDREW
To: CHAPPY, INC.
Reel/Frame 053448/0063 →
MERGER AND CHANGE OF NAME Recorded Aug 10, 2020
From: CHAPPY, INC.; RACCOON ACQUISITION SUB, INC.
To: RACCOON ACQUISITION SUB, INC.
Reel/Frame 053448/0125 →
MERGER AND CHANGE OF NAME Recorded Aug 10, 2020
From: RACCOON ACQUISITION SUB, INC.; REWARDSTYLE, INC.
To: REWARDSTYLE, INC.
Reel/Frame 053448/0233 →
Continuity (4)
Continuation 15344342 · Nov 4, 2016
Continuation 15211321 · Jul 15, 2016
Provisional Application 62192873 · Jul 15, 2015
Related Publication 20200372069A1 · Nov 26, 2020
Cited By (1)
US 12,412,204