IP Library › Granted Patent US 12,211,148
Granted Patent B2
US 12,211,148 · App. 18/133,478 · Granted Jan 28, 2025

Interactive augmented reality system

Inventors: David Li (London, GB); Piers Cowburn (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB)
Assignee: Snap Inc.
G06T19/00G06F3/011G06T11/00G06T11/60G06T15/04G06T19/006G06T19/20H04N5/2628H04N5/272G06F3/04845G06T2200/24G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,148
App. No.
18/133,478
Granted
Jan 28, 2025
Kind
B2
Abstract

Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.

Claims (59)

1. A method comprising:

causing display of image data at a client device, the image data including a display of an object that comprises one or more semantic features that define material parameters of the object;

detecting the display of the object within the image data based on the one or more semantic features;

determining a number of client devices within a proximity of the client device;

accessing a texture map from among a plurality of texture maps based on the one or more semantic features that define the material parameters of the object and the number of client devices within the proximity of the client device; and

causing display of Augmented-Reality (AR) content within the image data at the client device based on the accessed texture map.

2. The method of claim 1 , wherein the accessing the texture map from among the plurality of texture maps further comprises:

determining a location of the client device; and

accessing the texture map based on the one or more semantic features and the location of the client device.

3. The method of claim 1 , wherein the detecting the display of the object includes:

accessing location data at the client device; and

detecting the display of the object based on the location data and the one or more semantic features.

4. The method of claim 1 , wherein the accessing the texture map from among the plurality of texture maps further comprises:

accessing contextual data at the client device; and

accessing the texture map based on the one or more semantic features and the contextual data.

5. The method of claim 4 , wherein the contextual data includes temporal data.

6. The method of claim 4 , wherein the contextual data includes user profile data.

7. The method of claim 1 , further comprising:

receiving an input that comprises an input attribute; and

displaying the AR content based on the input attribute of the input.

8. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

causing display of image data at a client device, the image data including a display of an object that comprises one or more semantic features that define material parameters of the object;

detecting the display of the object within the image data based on the one or more semantic features;

determining a number of client devices within a proximity of the client device;

accessing a texture map from among a plurality of texture maps based on the one or more semantic features that define the material parameters of the object and the number of client devices within the proximity of the client device; and

causing display of Augmented-Reality (AR) content within the image data at the client device based on the accessed texture map.

9. The non-transitory machine-readable storage medium of claim 8 , wherein the accessing the texture map from among the plurality of texture maps further comprises:

determining a location of the client device; and

accessing the texture map based on the one or more semantic features and the location of the client device.

10. The non-transitory machine-readable storage medium of claim 8 , wherein the detecting the display of the object includes:

accessing location data at the client device; and

detecting the display of the object based on the location data and the one or more semantic features.

11. The non-transitory machine-readable storage medium of claim 8 , wherein the accessing the texture map from among the plurality of texture maps further comprises:

accessing contextual data at the client device; and

accessing the texture map based on the one or more semantic features and the contextual data.

12. The non-transitory machine-readable storage medium of claim 11 , wherein the contextual data includes temporal data.

13. The non-transitory machine-readable storage medium of claim 11 , wherein the contextual data includes user profile data.

14. The non-transitory machine-readable storage medium of claim 8 , further comprising:

receiving an input that comprises an input attribute; and

displaying the AR content based on the input attribute of the input.

15. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

causing display of image data at a client device, the image data including a display of an object that comprises one or more semantic features that define material parameters of the object;

detecting the display of the object within the image data based on the one or more semantic features;

determining a number of client devices within a proximity of the client device;

accessing a texture map from among a plurality of texture maps based on the one or more semantic features that define the material parameters of the object and the number of client devices within the proximity of the client device; and

causing display of Augmented-Reality (AR) content within the image data at the client device based on the accessed texture map.

16. The system of claim 15 , wherein the accessing the texture map from among the plurality of texture maps further comprises:

determining a location of the client device; and

accessing the texture map based on the one or more semantic features and the location of the client device.

17. The system of claim 15 , wherein the detecting the display of the object includes:

accessing location data at the client device; and

detecting the display of the object based on the location data and the one or more semantic features.

18. The system of claim 15 , wherein the accessing the texture map from among the plurality of texture maps further comprises:

accessing contextual data at the client device; and

accessing the texture map based on the one or more semantic features and the contextual data.

19. The system of claim 18 , wherein the contextual data includes temporal data.

20. The system of claim 18 , wherein the contextual data includes user profile data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2023
From: LI, DAVID; GEORGE COWBURN, PIERS; ANDREAS MÜLLER SANDVIK, ISAC; PAN, QI
To: SNAP INC.
Reel/Frame 063357/0068 →
Continuity (5)
Continuation 17876941 · Jul 29, 2022
Continuation 17373035 · Jul 12, 2021
Continuation 16566379 · Sep 10, 2019
Provisional Application 62799667 · Jan 31, 2019
Related Publication 20230245394A1 · Aug 3, 2023
References Cited (40)
US 4970666A · Welsh · 1990 [cited by examiner]
US 7181081B2 · Sandrew · 2007 [cited by examiner]
US 8560957B2 · Maillot · 2013 [cited by examiner]
US 11107255B2 · Li et al. · 2021 [cited by applicant]
US 11481932B2 · Li et al. · 2022 [cited by applicant]
US 11721072B2 · Li et al. · 2023 [cited by applicant]
US 20050001852A1 · Dengler et al. · 2005 [cited by applicant]
US 20130044128A1 · Liu · 2013 [cited by examiner]
US 20140028799A1 · Kuffner · 2014 [cited by examiner]
US 20140267406A1 · Mullins · 2014 [cited by applicant]
US 20180190032A1 · Barnett · 2018 [cited by examiner]
US 20180210628A1 · Mcphee et al. · 2018 [cited by applicant]
US 20200221070A1 · Godar · 2020 [cited by examiner]
US 20200250858A1 · Li et al. · 2020 [cited by applicant]
US 20200368616A1 · Delamont · 2020 [cited by examiner]
US 20200394835A1 · Barker · 2020 [cited by examiner]
US 20210142551A1 · Kobayashi · 2021 [cited by examiner]
US 20210343050A1 · Li et al. · 2021 [cited by applicant]
US 20220366616A1 · Li et al. · 2022 [cited by applicant]
CN 113366413 · 2021 [cited by applicant]
KR 20190005208 · 2019 [cited by applicant]
WO 2020160245 · 2020 [cited by applicant]
“International Application Serial No. PCT/US2020/015846, International Search Report mailed May 8, 2020”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/015846, Written Opinion mailed May 8, 2020”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 16/566,379, Non Final Office Action mailed Jan. 6, 2021”, 20 pgs. [cited by applicant]
“U.S. Appl. No. 16/566,379, Response filed Mar. 30, 2021 to Non Final Office Action mailed Jan. 6, 2021”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/566,379, Notice of Allowance mailed Apr. 30, 2021”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/015846, International Preliminary Report on Patentability mailed Aug. 12, 2021”, 9 pgs. [cited by applicant]
“European Application Serial No. 20711356.4, Response Filed Mar. 16, 2022 to Communication pursuant to Rule 161 (1 ) and Rule 162 EPC mailed Sep. 7, 2021”, 22 pgs. [cited by applicant]
“U.S. Appl. No. 17/373,035, Non Final Office Action mailed Apr. 28, 2022”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/373,035, Response filed May 26, 2022 to Non Final Office Action mailed Apr. 28, 2022”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/373,035, Notice of Allowance mailed Jun. 9, 2022”, 7 pgs. [cited by applicant]
“European Application Serial No. 20711356.4, Communication Pursuant to Article 94(3) EPC mailed Jul. 1, 2022”, 8 pgs. [cited by applicant]
“European Application Serial No. 20711356.4, Response filed Oct. 20, 2022 to Communication Pursuant to Article 94(3) EPC mailed Jul. 1, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/876,941, Non Final Office Action mailed Dec. 8, 2022”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 17/876,941, Response filed Jan. 18, 2023 to Non Final Office Action mailed Dec. 8, 2022”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/876,941, Notice of Allowance mailed Mar. 21, 2023”, 5 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7027333, Notice of Preliminary Rejection mailed Oct. 28, 2023”, w/ English Translation, 7 pgs. [cited by applicant]
“European Application Serial No. 20711356.4, Communication Pursuant to Article 94(3) EPC mailed Nov. 22, 2023”, 6 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7027333, Response Filed Dec. 28, 2023 to Notice of Preliminary Rejection mailed Oct. 28, 2023”, w/ English Claims, 24 pgs. [cited by applicant]