IP Library › Granted Patent US 10,607,053
Granted Patent B1
US 10,607,053 · App. 16/448,796 · Granted Mar 31, 2020

Presenting an augmented reality within a custom graphic

Inventors: Nathan Kenneth Boyd (Los Angeles, CA); Christopher Jonathan Luc (Venice, CA); Kirk Ouimet (Orem, UT); Rahul Bhupendra Sheth (Los Angeles, CA)
Assignee: Snap Inc.
G06K7/1456G06F3/04842G06F16/5866G06K7/1417G06K7/1443G06K7/1447G06K19/06037G06K19/06103G06K19/06112G06T11/60H04L51/04H04L67/306H04L67/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,053
App. No.
16/448,796
Granted
Mar 31, 2020
Kind
B1
Abstract

Systems and methods for presenting an augmented reality within a custom graphic are provided. In example embodiments, one or more hardware processors may receive an image, identify candidate shape features in the image, identify a custom graphic by comparing the candidate shape features with a reference shape feature of the custom graphic, identify an optical barcode based on the identified custom graphic, identify an augmented reality based on the optical barcode, and transmit the augmented reality to the client device.

Claims (74)

1. A method comprising:

identifying, by one or more hardware processors, shape features from an image received from a client device;

analyzing, by the one or more hardware processors, a first shape feature of the shape features;

determining, by the one or more hardware processors, based on analyzing the first shape feature, whether the first shape feature satisfies a first rule;

in response to determining that the first shape feature fails to satisfy the first rule, analyzing, by the one or more hardware processors, a second shape feature of the shape features;

determining, by the one or more hardware processors, based on analyzing the second shape feature, whether the second shape feature satisfies a second rule;

identifying, by the one or more hardware processors, a custom graphic in response to determining that the second shape feature satisfies the second rule;

identifying, by the one or more hardware processors, an optical barcode based on the identified custom graphic; and

transmitting, by the one or more hardware processors, a media item to the client device that corresponds to the identified optical barcode.

2. The method of claim 1 , wherein the first rule comprises an area rule, and further comprising:

comparing an area value represented by the first shape feature with a reference area of the area rule;

computing an area score based on comparing the area value with the reference area; and

determining that the first shape feature fails to satisfy the first rule when the area score fails to exceed an area threshold.

3. The method of claim 1 , wherein the second rule comprises a path rule, and further comprising:

generating a path having a starting point and an ending point based on the second shape feature;

determining that the starting point and the ending point are the same; and

determining that the second shape feature satisfies the second rule in response to determining that the starting point and the ending point are the same.

4. The method of claim 1 , further comprising:

identifying a user account based on the optical barcode; and

receiving an indication that the image including the optical barcode was selected at the client device.

5. The method of claim 1 , further comprising determining an orientation of the custom graphic based on the image, wherein the identification of the optical barcode is based on the orientation.

6. The method of claim 1 , further comprising causing the media item to be displayed within the custom graphic.

7. The method of claim 1 , wherein the media item comprises augmented reality, and further comprising:

storing the augmented reality in conjunction with a user account on a server;

determining that the user account, identified based on the optical barcode, is associated with the augmented reality;

retrieving the augmented reality in response to determining that the user account, identified based on the optical barcode, is associated with the augmented reality; and

transmitting, to the client device, the retrieved augmented reality in response to determining that the user account, identified based on the optical barcode, is associated with the augmented reality.

8. The method of claim 1 , further comprising:

generating a low resolution version of the image;

modifying the low resolution version of the image;

extracting the shape features from the modified low resolution version of the image; and

generating a high resolution version of a particular portion of the image corresponding to the extracted shape features.

9. The method of claim 1 , wherein the custom graphic is included in a portion of the image and comprises a first region bounded by a second region, wherein the optical barcode is in a portion of the custom graphic between the first and second regions and is excluded from the first region, and wherein the first region includes visual content visible in part of the image received from the client device.

10. The method of claim 1 , further comprising aligning the custom graphic based on a distinctive feature of the custom graphic.

11. The method of claim 1 , further comprising displaying at least a portion of the image external to the custom graphic while displaying the media item within the custom graphic of the image.

12. A non-transitory machine-readable medium comprising instructions which, when executed by one or more hardware processors of a device, cause the device to implement operations comprising:

identifying shape features from an image received from a client device;

analyzing a first shape feature of the shape features;

determining based on analyzing the first shape feature, whether the first shape feature satisfies a first rule;

in response to determining that the first shape feature fails to satisfy the first rule, analyzing a second shape feature of the shape features;

determining, based on analyzing the second shape feature, whether the second shape feature satisfies a second rule;

identifying a custom graphic in response to determining that the second shape feature satisfies the second rule;

identifying an optical barcode based on the identified custom graphic; and

transmitting a media item to the client device that corresponds to the identified optical barcode.

13. The non-transitory machine-readable medium of claim 12 , wherein the first rule comprises an area rule, and the operations further comprising:

comparing an area value represented by the first shape feature with a reference area of the area rule;

computing an area score based on comparing the area value with the reference area; and

determining that the first shape feature fails to satisfy the first rule when the area score fails to exceed an area threshold.

14. The non-transitory machine-readable medium of claim 12 , wherein the second rule comprises a path rule, and the operations further comprising:

generating a path having a starting point and an ending point based on the second shape feature;

determining that the starting point and the ending point are the same; and

determining that the second shape feature satisfies the second rule in response to determining that the starting point and the ending point are the same.

15. The non-transitory machine-readable medium of claim 12 , the operations further comprising:

identifying a user account based on the optical barcode; and

receiving an indication that the image including the optical barcode was selected at the client device.

16. The non-transitory machine-readable medium of claim 12 , the operations determining an orientation of the custom graphic based on the image, and wherein the identification of the optical barcode is based on the orientation.

17. The non-transitory machine-readable medium of claim 12 , the operations further comprising:

generating a low resolution version of the image;

modifying the low resolution version of the image;

extracting the shape features from the modified low resolution version of the image; and

generating a high resolution version of a particular portion of the image corresponding to the extracted shape features.

18. The non-transitory machine-readable medium of claim 12 , wherein the custom graphic is included in a portion of the image and comprises a first region bounded by a second region, wherein the optical barcode is in a portion of the custom graphic between the first and second regions and is excluded from the first region, and wherein the first region includes visual content visible in part of the image received from the client device.

19. The non-transitory machine-readable medium of claim 12 , the operations further comprising aligning the custom graphic based on a distinctive feature of the custom graphic.

20. A system comprising:

one or more hardware processors; and

a memory storing instructions which, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:

identifying shape features from an image received from a client device;

analyzing a first shape feature of the shape features;

determining based on analyzing the first shape feature, whether the first shape feature satisfies a first rule;

in response to determining that the first shape feature fails to satisfy the first rule, analyzing a second shape feature of the shape features;

determining, based on analyzing the second shape feature, whether the second shape feature satisfies a second rule;

identifying a custom graphic in response to determining that the second shape feature satisfies the second rule;

identifying an optical barcode based on the identified custom graphic; and

transmitting a media item to the client device that corresponds to the identified optical barcode.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2020
From: BOYD, NATHAN KENNETH; LUC, CHRISTOPHER JONATHAN; OUIMET, KIRK; SHETH, RAHUL BHUPENDRA
To: SNAPCHAT, INC.
Reel/Frame 051748/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2020
From: SNAPCHAT, INC.
To: SNAP INC.
Reel/Frame 051748/0336 →
Continuity (2)
Continuation 15893165 · Feb 9, 2018
Continuation 15262942 · Sep 12, 2016
Cited By (4)
US 12,293,433 US 12,393,036 US 12,482,131 US 12,580,784