IP Library › Granted Patent US 10,956,743
Granted Patent B1
US 10,956,743 · App. 16/833,087 · Granted Mar 23, 2021

Shared augmented reality system

Inventors: David Li (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB); Rastan Boroujerdi (Hermosa Beach, CA); Kevin Yimeng Hong (Los Angeles, CA); Peng Deng (Playa Vista, CA); Piers George Cowburn (London, GB); Jonathan Tang (Los Angeles, CA); Junjie Wei (Santa Monica, CA)
Assignee: Snap Inc.
G06K9/00671G06F3/011G06T7/74G06T19/006G09G3/003G09G2340/14G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,956,743
App. No.
16/833,087
Granted
Mar 23, 2021
Kind
B1
Abstract

An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

Claims (66)

1. A method comprising:

accessing image data at a client device, the image data comprising a set of image features, the set of image features defining a surface of an object;

determining a position of a user of the client device based on the set of image features;

causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device, the projection comprising a graphical property and having a trajectory based on the position of the user of the client device;

detecting an intersection of the projection and the surface of the object based on the trajectory, the intersection corresponding with a portion of the surface of the object:

generating a request that includes an identification of the portion of the surface of the object at the client device; and

presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

2. The method of claim 1 , wherein the client device is a first client device, and the method further comprises:

identifying a second client device based on the position of the user of the client device; and

initiating a communication session between at least the first client device and the second client device.

3. The method of claim 2 , wherein the graphical property of the projection is a first graphical property, and the method further comprises:

receiving, at the first client device, location data that identifies a location of the second client device, the location data indicating a heading of the second client device; and

causing display of media content at the first client device, the media content comprising a second graphical property associated with the second client device.

4. The method of claim 1 , wherein the method further comprises:

receiving an input at the client device; and

causing display of the projection that extends from the position of the user upon the presentation of the image data at the client device in response to the input.

5. The method of claim 1 , wherein the position indicates a heading of the user, and wherein the trajectory of the projection is based on at least the heading of the user.

6. The method of claim 1 , wherein the surface of the object comprises a total area, and the attribute of the portion of the surface of the object includes an area of the portion, and the method further comprises:

determining a value based on a ratio of the area of the portion and the total area; and

causing display of the value at the client device.

7. The method of claim 1 , wherein the graphical property includes a color associated with a user profile.

8. The method of claim 1 , wherein the method further comprises:

assigning a graphical property from among a plurality of graphical properties to a user profile associated with the client device in response to the determining the position of the user of the client device based on the set of image features; and

wherein the causing display of the projection is based on the graphical property.

9. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

accessing image data at a client device, the image data comprising a set of image features, the set of image features defining a surface of an object;

determining a position of a user of the client device based on the set of image features;

causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device, the projection comprising a graphical property and having a trajectory based on the position of the user of the client device;

detecting an intersection of the projection and the surface of the object based on the trajectory, the intersection corresponding with a portion of the surface of the object;

generating a request that includes an identification of the portion of the surface of the object at the client device; and

presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

10. The system of claim 9 , wherein the client device is a first client device, and the operations further comprise:

identifying a second client device based on the position of the user of the client device; and

initiating a communication session between at least the first client device and the second client device.

11. The system of claim 10 , wherein the graphical property of the projection is a first graphical property, and the method further comprises:

receiving, at the first client device, location data that identifies a location of the second client device, the location data indicating a heading of the second client device, and

causing display of media content at the first client device, the media content comprising a second graphical property associated with the second client device.

12. The system of claim 9 , wherein the operations further comprise:

receiving an input at the client device; and

causing display of the projection that extends from the position of the user upon the presentation of the image data at the client device in response to the input.

13. The system of claim 9 , wherein the position indicates a heading of the user, and wherein the trajectory of the projection is based on at least the heading of the user.

14. The system of claim 9 , wherein the surface of the object comprises a total area, and the attribute of the portion of the surface of the object includes an area of the portion, and the operations further comprise:

determining a value based on a ratio of the area of the portion and the total area; and

causing display of the value at the client device.

15. The system of claim 14 , wherein the graphical property includes a color associated with a user profile.

16. The system of claim 9 , wherein the operations further comprise:

assigning a graphical property from among a plurality of graphical properties to a user profile associated with the client device in response to the determining the position of the user of the client device based on the set of image features; and

wherein the causing display of the projection is based on the graphical property.

17. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing image data at a client device, the image data comprising a set of image features, the set of image features defining a surface of an object;

determining a position of a user of the client device based on the set of image features;

causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device, the projection comprising a graphical property and having a trajectory based on the position of the user of the client device;

detecting an intersection of the projection and the surface of the object based on the trajectory, the intersection corresponding with a portion of the surface of the object;

generating a request that includes an identification of the portion of the surface of the object at the client device; and

presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

18. The non-transitory machine-readable storage medium of claim 17 , wherein the client device is a first client device, and the operations further comprise:

identifying a second client device based on the position of the user of the client device; and

initiating a communication session between at least the first client device and the second client device.

19. The non-transitory machine-readable storage medium of claim 17 , wherein the graphical property of the projection is a first graphical property, and the operations further comprise:

receiving, at the first client device, location data that identifies a location of the second client device, the location data indicating a heading of the second client device; and

causing display of media content at the first client device, the media content comprising a second graphical property associated with the second client device.

20. The non-transitory machine-readable storage medium of claim 17 , wherein the operations further comprise:

receiving an input at the client device; and

causing display of the projection that extends from the position of the user upon the presentation of the image data at the client device in response to the input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2021
From: LI, DAVID; SANDVIK, ANDREAS MÜLLER; PAN, QI; BOROUJERDI, RASTAN; HONG, KEVIN YIMENG; DENG, PENG; COWBURN, PIERS GEORGE; TANG, JONATHAN; WEI, JUNJIE
To: SNAP INC.
Reel/Frame 055366/0297 →
Cited By (8)
US 12,223,608 US 12,265,586 US 12,293,433 US 12,322,046 US 12,482,080 US 12,482,131 US 12,561,651 US 12,567,251