IP Library › Granted Patent US 11,488,368
Granted Patent B2
US 11,488,368 · App. 17/329,435 · Granted Nov 1, 2022

Crowd sourced mapping system

Inventors: Piers Cowburn (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB); David Li (London, GB)
Assignee: Snap Inc.
G06T19/006G06F16/51G06F16/54G06T7/97G06T19/20H04L51/224H04L67/51G06T2219/024H04L67/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,488,368
App. No.
17/329,435
Granted
Nov 1, 2022
Kind
B2
Abstract

A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

Claims (54)

1. A method comprising:

detecting a change to an environment based on a comparison of image data with a three-dimensional (3D) model associated with the environment, the environment corresponding with a location;

identifying a client device within a threshold distance of the location associated with the environment responsive to the change to the environment;

presenting a guide at the client device, the guide comprising at least a display of an augmented-reality guidance element within a presentation of an image at the client device, the augmented-reality guidance element directing a user of the client device to the location;

detecting the client device at the location;

accessing image data at the client device based on the detecting the client device at the location, the image data comprising image attributes; and

generating a portion of a 3D model based on the image attributes of the image data.

2. The method of claim 1 , wherein the accessing the image data at the client device includes:

accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the image data.

3. The method of claim 1 , wherein the accessing image data at the client device based on the detecting the client device at the location includes:

causing display of a request for the image data at the client device in response to the detecting the client device at the location; and

receiving the image data at the client device.

4. The method of claim 1 , wherein the detecting the client device within the threshold distance of the location includes:

detecting a change in an environment that corresponds with the location; and

identifying the client device within the threshold distance of the location in response to the detecting the change in the environment.

5. The method of claim 1 , wherein the 3D model includes a 3D mesh model that depicts a surface feature of the location.

6. The method of claim 1 , wherein the accessing the image data at the client device based on the detecting the client device at the location includes:

selecting the image data based on the image attributes of the image data, the image attributes including image metadata.

7. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

detecting a change to an environment based on a comparison of image data with a three-dimensional (3D) model associated with the environment, the environment corresponding with a location;

identifying a client device within a threshold distance of the location associated with the environment responsive to the change to the environment;

presenting a guide at the client device, the guide comprising at least a display of an augmented-reality guidance element within a presentation of an image at the client device, the augmented-reality guidance element directing a user of the client device to the location;

detecting the client device at the location;

accessing image data at the client device based on the detecting the client device at the location, the image data comprising image attributes; and

generating a portion of a 3D model based on the image attributes of the image data.

8. The system of claim 7 , wherein the accessing the image data at the client device includes:

accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the image data.

9. The system of claim 7 , wherein the accessing image data at the client device based on the detecting the client device at the location includes:

causing display of a request for the image data at the client device in response to the detecting the client device at the location; and

receiving the image data at the client device.

10. The system of claim 7 , wherein the detecting the client device within the threshold distance of the location includes:

detecting a change in an environment that corresponds with the location; and

identifying the client device within the threshold distance of the location in response to the detecting the change in the environment.

11. The system of claim 7 , wherein the 3D model includes a 3D mesh model that depicts a surface feature of the location.

12. The system of claim 7 , wherein the accessing the image data at the client device based on the detecting the client device at the location includes:

selecting the image data based on the image attributes of the image data, the image attributes including image metadata.

13. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

detecting a change to an environment based on a comparison of image data with a three-dimensional (3D) model associated with the environment, the environment corresponding with a location;

identifying a client device within a threshold distance of the location associated with the environment responsive to the change to the environment;

presenting a guide at the client device, the guide comprising at least a display of an augmented-reality guidance element within a presentation of an image at the client device, the augmented-reality guidance element directing a user of the client device to the location;

detecting the client device at the location;

accessing image data at the client device based on the detecting the client device at the location, the image data comprising image attributes; and

generating a portion of a 3D model based on the image attributes of the image data.

14. The non-transitory machine-readable storage medium of claim 13 , wherein the accessing the image data at the client device includes:

accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the image data.

15. The non-transitory machine-readable storage medium of claim 13 , wherein the accessing image data at the client device based on the detecting the client device at the location includes:

causing display of a request for the image data at the client device in response to the detecting the client device at the location; and

receiving the image data at the client device.

16. The non-transitory machine-readable storage medium of claim 13 , wherein the detecting the client device within the threshold distance of the location includes:

detecting a change in an environment that corresponds with the location; and

identifying the client device within the threshold distance of the location in response to the detecting the change in the environment.

17. The non-transitory machine-readable storage medium of claim 13 , wherein the 3D model includes a 3D mesh model that depicts a surface feature of the location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2022
From: COWBURN, PIERS; MÜLLER SANDVIK, ISAC ANDREAS; PAN, QI; LI, DAVID
To: SNAP INC.
Reel/Frame 061258/0558 →
Continuity (2)
Continuation 16447591 · Jun 20, 2019
Related Publication 20210279969A1 · Sep 9, 2021
Cited By (1)
US 12,211,157