IP Library Granted Patent US 11,900,820
Granted Patent B2
US 11,900,820 · App. 16/689,872 · Granted Feb 13, 2024

Map including data for routing aerial vehicles during GNSS failure

Inventors: Martin Kubie (San Francisco, CA); Dinuka Abeywardena (Mountain View, CA)
Assignee: WING Aviation LLC
G08G5/0069B64C39/024G05D1/0038G05D1/0044G05D1/0094H04W4/029B64U2101/30B64U2201/104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,900,820
App. No.
16/689,872
Granted
Feb 13, 2024
Kind
B2
Abstract

An unmanned aerial vehicle (UAV) includes a propulsion system, a global navigation satellite system (GNSS) sensor, a camera and a controller. The controller includes logic that, in response to execution by the controller, causes the UAV to in response to detecting a loss of tracking by the GNSS sensor determine an estimated location of the UAV on a map based on a location image captured by the camera, determine a route to a destination using tracking parameters embedded in the map, wherein the map is divided into a plurality of sections and the tracking parameters indicate an ease of determining a location of the UAV using images captured by the camera with respect to each section, and control the propulsion system to cause the UAV to follow the route to the destination.

Claims (39)

1. An unmanned aerial vehicle (UAV) comprising:

a propulsion system;

a global navigation satellite system (GNSS) sensor;

a camera; and

a controller including logic that, in response to execution by the controller, causes the UAV to:

in response to detecting a loss of tracking by the GNSS sensor:

determine an estimated location of the UAV on a map based on a location image captured by the camera;

determine a route to a destination using tracking parameters embedded in the map, wherein the map is divided into a plurality of sections and the tracking parameters indicate an ease of determining a location of the UAV using images captured by the camera with respect to each of the sections, wherein determining the route includes planning the route to avoid passing over one of the sections of the map having a corresponding tracking parameter that does not meet a threshold value of ease for determining the location of the UAV using the images; and

control the propulsion system to cause the UAV to follow the route to the destination.

2. The UAV of claim 1 , wherein determining the estimated location of the UAV on the map based on the image captured by the camera includes:

determining the estimated location of the UAV on the map based on the image captured by the camera and a last tracked location of the UAV from the GNSS sensor.

3. The UAV of claim 1 , wherein the logic further causes the UAV to, in response to detecting the loss of tracking by the GNSS sensor, control the propulsion system to cause the UAV to ascend before the location image is captured by the camera.

4. The UAV of claim 1 , wherein the tracking parameters are numerical values.

5. The UAV of claim 4 , wherein the controller further includes logic to determine the route based on an average tracking parameter of sections of the map in the route.

6. The UAV of claim 4 , wherein the controller further includes logic to determine the route such that the UAV travels through fewer than a threshold number of areas related to sections of the map with a tracking parameter that does not meet a threshold value when following the route.

7. The UAV of claim 1 , wherein the map is a three-dimensional map, wherein the three-dimensional map includes a plurality of two-dimensional layers, and wherein different two-dimensional layers of the three-dimensional map correspond to different heights of the UAV.

8. The UAV of claim 7 , wherein determining the route includes determining a route that includes a change in height of the UAV.

9. The UAV of claim 1 , wherein determining the estimated location of the UAV on the map based on the location image captured by the camera includes:

extracting features of interest from the location image;

matching the features of interest to features on the map; and

estimating a location of the UAV based on the matched features of interest.

10. An unmanned aerial vehicle (UAV) comprising:

a propulsion system;

a global navigation satellite system (GNSS) sensor;

a camera; and

a controller including logic that, in response to execution by the controller, causes the UAV to:

in response to detecting a loss of tracking by the GNSS sensor:

determine an estimated location of the UAV on a map based on a location image captured by the camera;

determine a route to a destination using tracking parameters embedded in the map, wherein the map is divided into a plurality of sections and the tracking parameters indicate an ease of determining a location of the UAV using images captured by the camera with respect to each of the sections, wherein the route is determined such that the UAV travels through fewer than a threshold number of the sections of the map having a corresponding tracking parameter that does not meet a threshold value when following the route; and

control the propulsion system to cause the UAV to follow the route to the destination.

11. An unmanned aerial vehicle (UAV) comprising:

a propulsion system;

a global navigation satellite system (GNSS) sensor;

a camera; and

a controller including logic that, in response to execution by the controller, causes the UAV to:

in response to detecting a loss of tracking by the GNSS sensor:

determine an estimated location of the UAV on a map based on a location image captured by the camera;

determine a route to a destination using tracking parameters embedded in the map, wherein the map is divided into a plurality of sections and the tracking parameters indicate an ease of determining a location of the UAV using images captured by the camera with respect to each of the sections, wherein determining the route includes planning the route with a preference for passing the route over first sections of the map deemed easier, as indicated by the tracking parameters, to determine the location of the UAV using the images while avoiding second sections of the map deemed more difficult, as indicated by the tracking parameters, to determine the location of the UAV using the images; and

control the propulsion system to cause the UAV to follow the route to the destination.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2019
From: KUBIE, MARTIN; ABEYWARDENA, DINUKA
To: WING AVIATION LLC
Reel/Frame 051079/0348 →
Continuity (1)
Related Publication 20210150917A1 · May 20, 2021
Cited By (1)
US 12,494,138