IP Library › Granted Patent US 11,335,060
Granted Patent B2
US 11,335,060 · App. 16/818,540 · Granted May 17, 2022

Location based augmented-reality system

Inventors: Piers George Cowburn (London, GB); David Li (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB)
Assignee: Snap Inc.
G06T17/05H04L51/046H04L67/306H04W4/023
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,335,060
App. No.
16/818,540
Granted
May 17, 2022
Kind
B2
Abstract

A location-based augmented-reality system to generate and cause display of augmented-reality content that includes three-dimensional typography, based on a perspective, and location of a client device.

Claims (71)

1. A system comprising:

a memory; and

at least one hardware processor couple to the memory and comprising instructions that cause the system to perform operations comprising:

detecting a client device at a location;

accessing a surface model of an environment associated with the location in response to the detecting the client device at the location, the surface model comprising a wire-mesh form that comprises a representation of a plurality of three-dimensional (3D) features of the environment;

determining relative positions of the plurality of 3D features based on the location of the client device;

determining a perspective of a client device based on the location of the client device, and the relative positions of the plurality of 3D features;

accessing a user profile associated with the client device, the user profile comprising user profile data that includes a language preference;

generating media content based on at least the language preference associated with the user profile data of the client device; and

applying the media content to a position within an image presented at the client device, the position based on the perspective of the client device.

2. The system of claim 1 , wherein the media content includes 3D typography that comprises a text string.

3. The system of claim 2 , wherein the instructions further comprise:

accessing a user profile associated with the client device, the user profile comprising user profile data; and

generating the text string based on the user profile data from the user profile associated with the client device.

4. The system of claim 2 , wherein the text string is a first text string, and the instructions further comprise:

receiving a request to edit the media content from the client device, the request including a second text string; and

editing the media content based on the second text string from the request.

5. The system of claim 1 , wherein the accessing the surface model includes:

generating the surface model;

assigning the surface model to a set of geo-location coordinates within a surface model database;

receiving a request from the client device, the request including the geo-location coordinates assigned to the surface model within the surface model database; and

accessing the surface model associated with the geo-location coordinates in response to the request from the client device.

6. The system of claim 1 , wherein the media content comprises a media property, and wherein the instructions further comprise:

accessing a user profile associated with the client device, the user profile comprising user profile data; and

determining the media property of the media content based on the user profile data.

7. A method comprising:

detecting a client device at a location;

accessing a surface model of an environment associated with the location in response to the detecting the client device at the location, the surface model comprising a wire-mesh form that comprises a representation of a plurality of three-dimensional (3D) features of the environment;

determining relative positions of the plurality of 3D features based on the location of the client device;

determining a perspective of a client device based on the location of the client device, and the relative positions of the plurality of 3D features;

accessing a user profile associated with the client device, the user profile comprising user profile data that includes a language preference;

generating media content based on at least the language preference associated with the user profile data of the client device; and

applying the media content to a position within an image presented at the client device, the position based on the perspective of the client device.

8. The method of claim 7 , wherein the media content includes 3D typography that comprises a text string.

9. The method of claim 8 , wherein the method further comprises:

accessing a user profile associated with the client device, the user profile comprising user profile data; and

generating the text string based on the user profile data from the user profile associated with the client device.

10. The method of claim 8 , wherein the text string is a first text string, and the method further comprises:

receiving a request to edit the media content from the client device, the request including a second text string; and

editing the media content based on the second text string from the request.

11. The method of claim 7 , wherein the accessing the surface model includes:

generating the surface model;

assigning the surface model to a set of geo-location coordinates within a surface model database;

receiving a request from the client device, the request including the geo-location coordinates assigned to the surface model within the surface model database; and

accessing the surface model associated with the geo-location coordinates in response to the request from the client device.

12. The method of claim 7 , wherein the media content comprises a media property, and wherein the method further comprises:

accessing a user profile associated with the client device, the user profile comprising user profile data; and

determining the media property of the media content based on the user profile data.

13. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

detecting a client device at a location;

accessing a surface model of an environment associated with the location in response to the detecting the client device at the location, the surface model comprising a wire-mesh form that comprises a representation of a plurality of three-dimensional (3D) features of the environment;

determining relative positions of the plurality of 3D features based on a location of a client device;

determining a perspective of a client device based on the location of the client device, and the relative positions of the plurality of 3D features;

accessing a user profile associated with the client device, the user profile comprising user profile data that includes a language preference;

generating media content based on at least the language preference associated with the user profile data of the client device; and

applying the media content to a position within an image presented at the client device, the position based on the perspective of the client device.

14. The non-transitory machine-readable storage medium of claim 13 , wherein the media content includes 3D typography that comprises a text string.

15. The non-transitory machine-readable storage medium of claim 14 , wherein the operations further comprise:

accessing a user profile associated with the client device, the user profile comprising user profile data; and

generating the text string based on the user profile data from the user profile associated with the client device.

16. The non-transitory machine-readable storage medium of claim 14 , wherein the text string is a first text string, and the operations further comprise:

receiving a request to edit the media content from the client device, the request including a second text string; and

editing the media content based on the second text string from the request.

17. The non-transitory machine-readable storage medium of claim 13 , wherein the accessing the surface model includes:

generating the surface model;

assigning the surface model to a set of geo-location coordinates within a surface model database;

receiving a request from the client device, the request including the geo-location coordinates assigned to the surface model within the surface model database; and

accessing the surface model associated with the geo-location coordinates in response to the request from the client device.

18. The non-transitory machine-readable storage medium of claim 13 , wherein the media content comprises a media property, and wherein the operations further comprise:

accessing a user profile associated with the client device, the user profile comprising user profile data; and

determining the media property of the media content based on the user profile data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2022
From: COWBURN, PIERS GEORGE; LI, DAVID; MÜLLER SANDVIK, ISAC ANDREAS; PAN, QI
To: SNAP INC.
Reel/Frame 059594/0157 →
Continuity (2)
Provisional Application 62829571 · Apr 4, 2019
Related Publication 20200320782A1 · Oct 8, 2020