IP Library Granted Patent US 10,606,260
Granted Patent B2
US 10,606,260 · App. 15/716,594 · Granted Mar 31, 2020

Ocular navigation of unmanned aerial vehicle

Inventors: Thomas Seiler (Puchheim, DE); Daniel Pohl (Puchheim, DE); Stefan Menzel (Stockdorf, DE)
Assignee: INTEL IP CORPORATION
G05D1/0038G05D1/0016G06F3/013B64C39/024B64C2201/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,606,260
App. No.
15/716,594
Granted
Mar 31, 2020
Kind
B2
Abstract

Herein is disclosed an unmanned aerial vehicle navigation system including one or more cameras configured to detect user image data; and one or more processors configured to determine from the user image data a user eye orientation; select according to a selection criterion a navigation behavior based on the user eye orientation; and determine a navigation instruction to cause the unmanned aerial vehicle to travel in accordance with the navigation behavior.

Claims (31)

1. An unmanned aerial vehicle navigation system comprising:

a display, configured to display image data received from an unmanned aerial vehicle;

one or more cameras configured to detect ocular image data; and

one or more processors configured to

determine from the ocular image data a user eye orientation;

select a navigation behavior based on the user eye orientation on the unmanned aerial vehicle image data according to a selection criterion; and

determine a navigation instruction to cause the unmanned aerial vehicle to travel in accordance with the navigation behavior.

2. The unmanned aerial vehicle navigation system of claim 1 , wherein the one or more processors map the user eye orientation to a region of the display.

3. The unmanned aerial vehicle navigation system of claim 2 , wherein the mapped display region corresponds to an object; the navigation behavior is navigation toward the object; and the navigation instruction is selected based on a relationship between a location of the unmanned aerial vehicle and the object.

4. The unmanned aerial vehicle navigation system of claim 2 , wherein the mapped display region corresponds to a navigational direction; the navigation behavior is navigation in the navigational direction; and a navigation instruction is selected based on a relationship between a location of the unmanned aerial vehicle and the navigational direction.

5. The unmanned aerial vehicle navigation system of claim 1 , wherein the selection criterion is a sustained user eye orientation toward an object for at least a predetermined duration.

6. The unmanned aerial vehicle navigation system of claim 1 , wherein the selection criterion is a sustained user eye orientation toward a location for at least a predetermined duration.

7. The unmanned aerial vehicle navigation system of claim 1 , wherein the selection criterion is a sustained eye orientation toward a display region for at least a predetermined duration.

8. The unmanned aerial vehicle navigation system of claim 2 , wherein the selection criterion additionally includes a non-ocular election of the mapped display region as an unmanned aerial vehicle destination.

9. The unmanned aerial vehicle navigation system of claim 2 , wherein the mapped display region corresponds to a navigation command, and the navigation behavior is navigation corresponding to the navigation command.

10. The unmanned aerial vehicle navigation system of claim 9 , wherein the navigation command causes the unmanned aerial vehicle to ascend, descend, turn left, turn right, rotate left, rotate right, or return home.

11. A method of navigating an unmanned aerial vehicle comprising:

detecting ocular image data;

displaying image data received from an unmanned aerial vehicle;

determining from the ocular image data a user eye orientation;

selecting a navigation behavior based on the user eye orientation on the unmanned aerial vehicle image data according to a selection criterion; and

determining a navigation instruction to cause the unmanned aerial vehicle to travel in accordance with the navigation behavior.

12. The method of navigating an unmanned aerial vehicle of claim 11 , further comprising mapping the user eye orientation to a region of a user display.

13. The method of navigating an unmanned aerial vehicle of claim 12 , further comprising selecting the navigation instruction based on a relationship between a location of the unmanned aerial vehicle and an object, wherein the object corresponds to the mapped display region, and the navigation behavior is navigation toward the object.

14. The method of navigating an unmanned aerial vehicle of claim 12 , further comprising selecting a navigation instruction based on a relationship between a location of the unmanned aerial vehicle and a navigational direction, wherein the navigational direction corresponds to the mapped display region, and the navigation behavior is navigation in the navigational direction.

15. The method of navigating an unmanned aerial vehicle of claim 11 , wherein the selection criterion is a sustained user eye orientation toward an object for at least a predetermined duration.

16. The method of navigating an unmanned aerial vehicle of claim 11 , wherein the selection criterion is a sustained user eye orientation toward a location for at least a predetermined duration.

17. The method of navigating an unmanned aerial vehicle of claim 11 , wherein the selection criterion is a sustained eye orientation toward a display region for at least a predetermined duration.

18. The method of navigating an unmanned aerial vehicle of claim 12 , wherein the selection criterion additionally includes a non-ocular election of the mapped display region as an unmanned aerial vehicle destination.

19. The method of navigating an unmanned aerial vehicle of claim 12 , wherein the mapped display region corresponds to a navigation command, and the navigation behavior is navigation corresponding to the navigation command.

20. The method of navigating an unmanned aerial vehicle of claim 19 , wherein the navigation command causes the unmanned aerial vehicle to ascend, descend, turn left, turn right, rotate left, rotate right or return home.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2021
From: INTEL IP CORPORATION
To: INTEL CORPORATION
Reel/Frame 056337/0609 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2017
From: SEILER, THOMAS; POHL, DANIEL; MENZEL, STEFAN
To: INTEL IP CORPORATION
Reel/Frame 043941/0068 →
Cited By (1)
US 12,717,332