IP Library Granted Patent US 10,168,698
Granted Patent B2
US 10,168,698 · App. 15/715,596 · Granted Jan 1, 2019

Aerial image collection

Inventor: Marco Tillmann (Niddatal, DE)
Assignee: HERE Global B.V.
G05D1/0022B64C39/024G01C11/02G01C11/06G01C11/08G05D1/0094B64C2201/024B64C2201/123B64C2201/146G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,168,698
App. No.
15/715,596
Granted
Jan 1, 2019
Kind
B2
Abstract

In one embodiment, an aerial collection system includes an image collection field vehicle that travels at street level and an image collection aerial vehicle that travels in the air above the street. The aerial vehicle collects image data including at least a portion of the field vehicle. The field vehicle includes a marker, which is identified from the collected image data. The marker is analyzed to determine an operating characteristic of the aerial vehicle. In one example, the operating characteristic in the marker includes information for a flight instruction for the aerial vehicle. In another example, the operating characteristic in the marker includes information for the three dimensional relationship between the vehicles. The three dimensional relationship is used to combine images collected from the air and images collected from the street level.

Claims (31)

1. A method comprising:

collecting, at an aerial vehicle, image data depicting a terrestrial vehicle comprising a marker encoded with data for a flight command;

analyzing the image data depicting the terrestrial vehicle comprising the marker for generating the flight command, wherein the flight command comprises instructions for a flight path of the aerial vehicle; and

applying, at the aerial vehicle, the flight path in response to the flight command.

2. The method of claim 1 , wherein applying the flight path further comprises:

maintaining a distance between the aerial vehicle and the terrestrial vehicle in response to the flight command.

3. The method of claim 1 , wherein applying the flight path further comprises:

providing an individual directional command to the aerial vehicle in response to the flight command.

4. The method of claim 1 , wherein applying the flight path further comprises:

guiding the aerial vehicle toward the terrestrial vehicle in response to the flight command.

5. The method of claim 4 , wherein the flight command is generated in response to a tunnel, overpass, or other obstruction.

6. The method of claim 1 , wherein the flight command is encoded in the marker as a predetermined code.

7. The method of claim 6 , wherein the predetermined code is a quick response (AR) code, a universal product code (UPC), an alphanumeric code, a hexadecimal code, a binary code, or a shape.

8. The method of claim 6 , further comprising:

measuring an angle or a relative size of the code for an orientation or a spatial relationship of the terrestrial vehicle and the aerial vehicle.

9. The method of claim 1 , wherein the the marker is displayed on an electronic display that changes in time.

10. The method of claim 1 , wherein the flight command is based on a geographic position of the aerial vehicle.

11. The method of claim 1 , wherein the flight command is included in a plurality of flight commands sequenced in time.

12. The method of claim 1 , wherein the flight command instructs the aerial vehicle to fly at a specific altitude, instructs the aerial vehicle to fly at a specific distance from the terrestrial vehicle, or instructs the aerial vehicle to fly at a specific speed.

13. An apparatus comprising:

a camera of an aerial vehicle configured to collect image data depicting a terrestrial vehicle comprising a marker with data for a flight command; and

a controller configured to analyze the image data depicting the terrestrial vehicle comprising the marker for generating the flight command and select a flight path in response to the flight command.

14. The apparatus of claim 13 , wherein the flight path maintains a distance between the aerial vehicle and the terrestrial vehicle.

15. The apparatus of claim 13 , wherein the flight command includes an individual directional command including flying left or right or an obstacle command to avoid a tunnel, an overpass, or another obstruction.

16. The apparatus of claim 13 , wherein the flight command is encoded in the marker as a predetermined code.

17. The apparatus of claim 16 , wherein the controller is configured to measure an angle or a relative size of the predetermined code for an orientation or a spatial relationship of the terrestrial vehicle and the aerial vehicle.

18. The apparatus of claim 16 , wherein the flight command is included in a plurality of flight commands sequenced in time.

19. A system comprising:

an electronic display of a terrestrial vehicle including images that comprise a marker, wherein the marker changes in time; and

an aerial vehicle controller configured to analyze image data depicting at least the marker of the electronic display of the terrestrial vehicle for generating the flight command and select a flight path for an aerial vehicle in response to the flight command.

20. The system of claim 19 , further comprising: a camera of the aerial vehicle configured to collect image data depicting the electronic display of the terrestrial vehicle.

Assignments (2)
CHANGE OF NAME/CONTINUATION OF <15/195,123> WHICH IS A CONTINUATION OF <13/785,796> Recorded Nov 12, 2018
From: NAVTEQ B.V.
To: HERE GLOBAL B.V.
Reel/Frame 047501/0655 →
CONTINUATION OF <15/195,123> WHICH IS A CONTINUATION OF <13/785,796> Recorded Nov 12, 2018
From: TILLMANN, MARCO
To: NAVTEQ B.V.
Reel/Frame 047501/0700 →
Continuity (3)
Continuation 15195123 · Jun 28, 2016
Continuation 13785796 · Mar 5, 2013
Related Publication 20180024551A1 · Jan 25, 2018