IP Library › Granted Patent US 11,107,255
Granted Patent B2
US 11,107,255 · App. 16/566,379 · Granted Aug 31, 2021

Interactive augmented reality system

Inventors: David Li (London, GB); Piers Cowburn (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB)
Assignee: Snap Inc.
G06T11/00G06T15/04G06F3/04845G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,107,255
App. No.
16/566,379
Granted
Aug 31, 2021
Kind
B2
Abstract

Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.

Claims (74)

1. A method comprising:

causing display of a presentation of an environment within a graphical user interface at a client device, the presentation of the environment including a display of an object at a position within the environment;

identifying the object responsive to the causing display of the presentation of the environment that includes the display of the object;

accessing a texture map and a mesh-model associated with the object responsive to the identifying the object, the mesh-model comprising a base mesh at a first end of the mesh-model, a cap mesh at a second end of the mesh-model, and a repeatable segment located between the first end and the second end;

generating interactive content based on the texture map and the mesh-model associated with the object;

causing display of the interactive content within the presentation of the environment based on the position of the object within the environment;

receiving an interaction input from the client device; and

presenting a visualization of the interaction input within the presentation of the environment, the presenting the visualization of the interaction input including:

causing display of the base mesh based on the position of the object within the environment;

causing display of the cap mesh within the environment based on the interaction input; and

applying the texture map to the repeatable segment located between the base mesh and the cap mesh;

presenting a visualization of the interaction input within the presentation of the environment, the visualization of the interaction input based on at least the interactive content.

2. The method of claim 1 , wherein the identifying the object responsive to the causing display of the presentation of the environment that includes the display of the object further comprises:

accessing location data that identifies a location of the client device; and

identifying the object based on at least the location of the client device.

3. The method of claim 1 , wherein the accessing the texture map associated with the object responsive to the identifying the object further comprises:

accessing contextual data associated with the client device; and

selecting the texture map based on the contextual data.

4. The method of claim 3 , wherein the contextual data includes user profile data associated with a user of the client device.

5. The method of claim 3 , wherein the contextual data includes temporal data.

6. The method of claim 1 , wherein the interaction input includes a starting-point and a trajectory, and the presenting the visualization of the interaction input within the presentation of the environment includes:

causing display of a projectile at a location within the presentation of the environment at the client device, the location of the projectile based on the starting-point;

calculating a termination-point of the projectile based on the trajectory;

determining the termination-point of the projectile corresponds with a portion of the interactive content; and

presenting a notification responsive to the determining the termination-point of the projectile corresponds with the portion of the interactive content.

7. The method of claim 6 , wherein the method further comprises:

generating the projectile based on contextual data.

8. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

causing display of a presentation of an environment within a graphical user interface at a client device, the presentation of the environment including a display of an object at a position within the environment;

identifying the object responsive to the causing display of the presentation of the environment that includes the display of the object;

accessing a texture map and a mesh-model associated with the object responsive to the identifying the object, the mesh-model comprising a base mesh at a first end of the mesh-model, a cap mesh at a second end of the mesh-model, and a repeatable segment located between the first end and the second end;

generating interactive content based on the texture map and the mesh-model associated with the object;

causing display of the interactive content within the presentation of the environment based on the position of the object within the environment;

receiving an interaction input from the client device; and

presenting a visualization of the interaction input within the presentation of the environment, the presenting the visualization of the interaction input including:

causing display of the base mesh based on the position of the object within the environment;

causing display of the cap mesh within the environment based on the interaction input; and

applying the texture map to the repeatable segment located between the base mesh and the cap mesh;

presenting a visualization of the interaction input within the presentation of the environment, the visualization of the interaction input based on at least the interactive content.

9. The non-transitory machine-readable storage medium of claim 8 , wherein the identifying the object responsive to the causing display of the presentation of the environment that includes the display of the object further comprises:

accessing location data that identifies a location of the client device; and

identifying the object based on at least the location of the client device.

10. The non-transitory machine-readable storage medium of claim 8 , wherein the accessing the texture map associated with the object responsive to the identifying the object further comprises:

accessing contextual data associated with the client device; and

selecting the texture map based on the contextual data.

11. The non-transitory machine-readable storage medium of claim 10 , wherein the contextual data includes user profile data associated with a user of the client device.

12. The non-transitory machine-readable storage medium of claim 10 , wherein the contextual data includes temporal data.

13. The non-transitory machine-readable storage medium of claim 8 , wherein the interaction input includes a starting-point and a trajectory, and the presenting the visualization of the interaction input within the presentation of the environment includes:

causing display of a projectile at a location within the presentation of the environment at the client device, the location of the projectile based on the starting-point;

calculating a termination-point of the projectile based on the trajectory;

determining the termination-point of the projectile corresponds with a portion of the interactive content; and

presenting a notification responsive to the determining the termination-point of the projectile corresponds with the portion of the interactive content.

14. The non-transitory machine-readable storage medium of claim 13 , wherein the instructions further comprise:

generating the projectile based on contextual data.

15. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

causing display of a presentation of an environment within a graphical user interface at a client device, the presentation of the environment including a display of an object at a position within the environment;

identifying the object responsive to the causing display of the presentation of the environment that includes the display of the object;

accessing a texture map and a mesh-model associated with the object responsive to the identifying the object, the mesh-model comprising a base mesh at a first end of the mesh-model, a cap mesh at a second end of the mesh-model, and a repeatable segment located between the first end and the second end;

generating interactive content based on the texture map and the mesh-model associated with the object;

causing display of the interactive content within the presentation of the environment based on the position of the object within the environment;

receiving an interaction input from the client device; and

presenting a visualization of the interaction input within the presentation of the environment, the presenting the visualization of the interaction input including:

causing display of the base mesh based on the position of the object within the environment;

causing display of the cap mesh within the environment based on the interaction input; and applying the texture map to the repeatable segment located between the base mesh and the cap mesh;

presenting a visualization of the interaction input within the presentation of the environment, the visualization of the interaction input based on at least the interactive content.

16. The system of claim 15 , wherein the identifying the object responsive to the causing display of the presentation of the environment that includes the display of the object further comprises:

accessing location data that identifies a location of the client device; and

identifying the object based on at least the location of the client device.

17. The system of claim 15 , wherein the accessing the texture map associated with the object responsive to the identifying the object further comprises:

accessing contextual data associated with the client device; and

selecting the texture map based on the contextual data.

18. The system of claim 17 , wherein the contextual data includes user profile data associated with a user of the client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2021
From: LI, DAVID; COWBURN, PIERS GEORGE; MÜLLER, ISAC ANDREAS; PAN, QI
To: SNAP INC.
Reel/Frame 057029/0410 →
Continuity (2)
Provisional Application 62799667 · Jan 31, 2019
Related Publication 20200250858A1 · Aug 6, 2020
Cited By (3)
US 12,211,148 US 12,462,506 US 12,614,348