IP Library Granted Patent US 11,651,029
Granted Patent B2
US 11,651,029 · App. 17/131,374 · Granted May 16, 2023

Contextual augmentation of map information using overlays

Inventors: Andrew Elder (Greenwood Village, CO); John Carrino (Redwood City, CA); Lucas Nunno (Albuquerque, NM); Westin Miller (Palo Alto, CA)
Assignee: Palantir Technologies Inc.
G06T11/00G01C21/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,029
App. No.
17/131,374
Granted
May 16, 2023
Kind
B2
Abstract

Systems, methods, and non-transitory computer readable media are provided for displaying and annotating map-based geolocation data at an augmented reality (AR) headset. Users with access to the map-based geolocation data can create or confirm annotations for geospatial data that may be sent to the server computer and transmitted back to the headset of the user as well as different AR headsets associated with other users.

Claims (44)

1. A method comprising:

determining, by a computing system, a geolocation of an augmented reality (AR) system;

determining, based on a size and a type of an entity, whether any portions of a previously unlabeled path are traversable or non-traversable by the entity;

receiving an indication of a change in the size or the type of the entity;

updating the determination of whether the any portions of the previously unlabeled path are traversable or non-traversable by the entity;

determining, by the computing system, a plurality of annotations associated with the geolocation of the AR system, wherein an annotation of the annotations indicates any traversable or non-traversable portion of the previously unlabeled path, according to the updated determination;

providing, by the computing system, the plurality of annotations associated with the geolocation to the AR system, wherein the AR system is enabled to project the plurality of annotations to correspond with a region corresponding to the geolocation of the AR system;

determining, by the computing system, information associated with at least one annotation of the plurality of annotations as provided by the AR system, wherein the information is based on an observation of the at least one annotation; and

outputting, as an overlay with respect to the geolocation, an indication of the any traversable or non-traversable portion of the previously unlabeled path.

2. The method of claim 1 , wherein the annotation of the plurality of annotations is created by a user of a different AR system while at the geolocation of the AR system.

3. The method of claim 1 , wherein the annotation of the plurality of annotations is updated by a user of a different AR system while at the geolocation of the AR system.

4. The method of claim 1 , wherein the annotations identify one or more hazards present within a region corresponding with the geolocation of the AR system.

5. The method of claim 1 , wherein the observation is determined based on information provided by a user of the AR system.

6. The method of claim 1 , wherein the observation is determined based at least in part on sensor data collected by one or more sensors associated with the AR system.

7. The method of claim 1 , further comprising:

updating, by the computing system, information associated with the annotation based on the information provided by the AR system.

8. The method of claim 1 , wherein the annotations are selected from a list comprising at least a route path, a person, a building, and a hazard.

9. The method of claim 1 , wherein the annotations comprise a visualization of temporal and non-temporal costs for an entity to traverse one or more paths.

10. The method of claim 1 , wherein the outputting of the indication is in response to a confirmation; and the determining of the traversable route path is based on a degree of slip of terrain corresponding to the previously unlabeled path.

11. A computing system comprising:

one or more processors;

a memory storing instructions that, when executed by the one or more processors, cause the computing system to perform:

determine a geolocation of an augmented reality (AR) system;

determine, based on a size and a type of an entity, whether any portions of a previously unlabeled path are traversable or non-traversable by the entity;

receive an indication of a change in the size or the type of the entity;

update the determination of whether the any portions of the previously unlabeled path are traversable or non-traversable by the entity according to the change in the size or the type of the entity;

determine a plurality of annotations associated with the geolocation of the AR system, wherein an annotation of the annotations indicates any traversable or non-traversable portion of the previously unlabeled path, according to the updated determination;

providing the plurality of annotations associated with the geolocation to the AR system, wherein the AR system is enabled to project the plurality of annotations to correspond with a region corresponding to the geolocation of the AR system;

determine information associated with at least one annotation of the plurality of annotations as provided by the AR system, wherein the information is based on an observation of the at least one annotation; and

output, as an overlay with respect to the geolocation, an indication of the any traversable portion of the previously unlabeled path.

12. The computing system of claim 11 , wherein the annotation of the plurality of annotations is created by a user of a different AR system while at the geolocation of the AR system.

13. The computing system of claim 11 , wherein the annotation of the plurality of annotations is updated by a user of a different AR system while at the geolocation of the AR system.

14. The computing system of claim 11 , wherein the annotations identify one or more hazards present within a region corresponding with the geolocation of the AR system.

15. The computing system of claim 11 , wherein the observation is determined based on information provided by a user of the AR system.

16. The computing system of claim 11 , wherein the observation is determined based at least in part on sensor data collected by one or more sensors associated with the AR system.

17. The computing system of claim 11 , wherein the computing system is further configured to:

update information associated with the annotation based on the information provided by the AR system.

18. A method comprising:

determining, by a computing system, a geolocation of an augmented reality (AR) system;

determining whether any portions of a previously unlabeled path are traversable or non-traversable by an entity, wherein a non-traversable portion comprises a restricted region and a buffer around the restricted region;

determining, by the computing system, a plurality of annotations associated with the geolocation of the AR system, wherein an annotation of the annotations indicates any traversable portion of the previously unlabeled path;

providing, by the computing system, the plurality of annotations associated with the geolocation to the AR system, wherein the AR system is enabled to project the plurality of annotations to correspond with a region corresponding to the geolocation of the AR system;

determining, by the computing system, information associated with at least one annotation of the plurality of annotations as provided by the AR system, wherein the information is based on an observation of the at least one annotation; and

outputting, as an overlay with respect to the geolocation, an indication of the any traversable portion of the previously unlabeled path.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2023
From: ELDER, ANDREW; CARRINO, JOHN; NUNNO, LUCAS; MILLER, WESTIN
To: PALANTIR TECHNOLOGIES INC.
Reel/Frame 062327/0259 →
SECURITY INTEREST Recorded Jul 3, 2022
From: PALANTIR TECHNOLOGIES INC.
To: WELLS FARGO BANK, N.A.
Reel/Frame 060572/0506 →
Continuity (2)
Provisional Application 62959131 · Jan 9, 2020
Related Publication 20210217209A1 · Jul 15, 2021