IP Library › Granted Patent US 11,087,543
Granted Patent B1
US 11,087,543 · App. 16/447,591 · Granted Aug 10, 2021

Crowd sourced mapping system

Inventors: Piers Cowburn (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB); David Li (London, GB)
Assignee: Snap Inc.
G06T19/006G06F16/51G06F16/54G06T7/97G06T19/20H04L51/24H04L67/16G06T2219/024H04L67/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,543
App. No.
16/447,591
Granted
Aug 10, 2021
Kind
B1
Abstract

A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

Claims (52)

1. A method comprising:

receiving image data that comprises image attributes, the image attributes including a set of image features that depict an environment;

identifying an object depicted by the image data based on the image features of the image data;

accessing a 3-dimensional (3D) model based on the object identified based on the image feature of the image data, the 3D model comprising a plurality of parts that collectively depict the environment;

identifying a change in the environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts;

identifying a client device within a threshold distance of a location that corresponds with the environment;

presenting a notification at the client device, the notification including an identification of the location;

detecting the client device at the location that corresponds with the environment;

accessing second image data at the client device based on the detecting the client device at the location; and

generating an update to the part of the 3D model based on the image attributes of the image data and the second image data.

2. The method of claim 1 , wherein the environment corresponds to a location and the accessing the second image data includes:

accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the second image data and generating the update to the part of the 3D model based on the collection of image data.

3. The method of claim 1 , wherein the method further comprises:

guiding a user of the client device to the location of the environment;

detecting the client device at the location of the environment; and

causing display of a request for the second image data at the client device based on the detecting the client device at the location.

4. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

receiving image data that comprises image attributes, the image attributes including a set of image features that depict an environment;

identifying an object depicted by the image data based on the image features of the image data;

accessing a 3-dimensional (3D) model based on the object identified based on the image feature of the image data, the 3D model comprising a plurality of parts that collectively depict the environment;

identifying a change in the environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts;

identifying a client device within a threshold distance of a location that corresponds with the environment;

presenting a notification at the client device, the notification including an identification of the location;

detecting the client device at the location that corresponds with the environment;

accessing second image data at the client device based on the detecting the client device at the location; and

generating an update to the part of the 3D model based on the image attributes of the image data and the second image data.

5. The system of claim 4 , wherein the environment corresponds to a location and the accessing the second image data includes:

accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the second image data; and

generating the update to the part of the 3D model based on the collection of image data.

6. The system of claim 4 , wherein the instructions cause the system to perform operations further comprising:

guiding a user of the client device to the location of the environment;

detecting the client device at the location of the environment; and

causing display of a request for the second image data at the client device based on the detecting the client device at the location.

7. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving image data that comprises image attributes, the image attributes including a set of image features that depict an environment;

identifying an object depicted by the image data based on the image features of the image data;

accessing a 3-dimensional (3D) model based on the object identified based on the image feature of the image data, the 3D model comprising a plurality of parts that collectively depict the environment;

identifying a change in the environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts;

identifying a client device within a threshold distance of a location that corresponds with the environment;

presenting a notification at the client device, the notification including an identification of the location;

detecting the client device at the location that corresponds with the environment;

accessing second image data at the client device based on the detecting the client device at the location; and

generating an update to the part of the 3D model based on the image attributes of the image data and the second image data.

8. The non-transitory machine-readable storage medium of claim 7 , wherein the environment corresponds to a location and the accessing the second image data includes:

accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the second image data; and

generating the update to the part of the 3D model based on the collection of image data.

9. The non-transitory machine-readable storage medium of claim 7 , wherein the instructions cause the machine to perform operations further comprising:

guiding a user of the client device to the location of the environment;

detecting the client device at the location of the environment; and

causing display of a request for the second image data at the client device based on the detecting the client device at the location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2021
From: COWBURN, PIERS; MÜLLER SANDVIK, ISAC ANDREAS; PAN, QI; LI, DAVID
To: SNAP INC.
Reel/Frame 056706/0761 →
Cited By (5)
US 12,211,157 US 12,217,376 US 12,293,433 US 12,482,131 US 12,579,738