IP Library Granted Patent US 11,022,969
Granted Patent B2
US 11,022,969 · App. 16/203,712 · Granted Jun 1, 2021

Systems and methods for controlling an unmanned aerial vehicle

Inventors: Pablo Lema (Burlingame, CA); Shu Ching Ip (Cupertino, CA)
Assignee: GoPro, Inc.
G05D1/0016B64C39/024G05D1/0094G06K7/10B64C2201/027B64C2201/127B64C2201/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,022,969
App. No.
16/203,712
Granted
Jun 1, 2021
Kind
B2
Abstract

Systems and methods for controlling an unmanned aerial vehicle are disclosed. The system comprises an image sensor configured to generate output signals conveying visual information, the visual information including one or more images of a user, and one or more physical processors. The one or more physical processors are configured by computer-readable instructions to recognize one or more gestures from the user based on the visual information, interpret the one or more gestures from the user as flight control information, and provide flight control for the unmanned aerial vehicle based on the flight control information.

Claims (54)

1. A system for controlling an unmanned aerial vehicle, the system comprising:

an image sensor configured to generate output signals conveying visual information, the visual information including one or more images of a user; and

one or more physical processors configured by computer-readable instructions to:

recognize one or more gestures from the user based on the visual information;

interpret the one or more gestures from the user as flight control information; and

provide flight control for the unmanned aerial vehicle based on the flight control information.

2. The system of claim 1 , wherein the one or more physical processors are further configured by the computer-readable instructions to:

interpret the one or more gestures from the user as sensor control information; and

control the image sensor based on the sensor control information.

3. The system of claim 2 , wherein to control the image sensor based on the sensor control information comprises to:

control the image sensor through adjustments of any of aperture timing, exposure, focal length, angle of view, depth of field, focus, light metering, white balance, resolution, frame rate, object of focus, capture angle, a zoom parameter, video format, a sound parameter, and a compression parameter.

4. The system of claim 2 , further comprising:

a remote controller configured to provide any of the flight control information and the sensor control information to the one or more physical processors.

5. The system of claim 4 , wherein the remote controller is further configured to be carried or worn by the user.

6. The system of claim 4 , wherein the remote controller is further configured to project a pattern on an object, wherein the one or more physical processors is further configured by the computer-readable instructions to:

recognize the pattern based on the visual information; and

interpret the pattern as any of the flight controller information and the sensor control information.

7. The system of claim 4 , wherein the one or more physical processors are further configured by the computer-readable instructions to:

provide the flight control for the unmanned aerial vehicle such that a target altitude differential between the unmanned aerial vehicle and the remote controller is maintained,

wherein the one or more gestures include a gesture interpreted by the one or more physical processors to adjust the target altitude differential.

8. The system of claim 4 , wherein the one or more physical processors are further configured by the computer-readable instructions to:

provide the flight control for the unmanned aerial vehicle such that a target cardinal direction between the unmanned aerial vehicle and the remote controller is maintained,

wherein the one or more gestures include a gesture interpreted by the one or more physical processors to adjust the target cardinal direction.

9. The system of claim 4 , wherein the one or more physical processors are further configured by the computer-readable instructions to:

provide the flight control for the unmanned aerial vehicle such that a target distance between the unmanned aerial vehicle and the remote controller is maintained,

wherein the one or more gestures include a gesture interpreted by one or more physical processors to adjust the target distance.

10. The system of claim 4 , wherein the one or more physical processors are further configured by the computer-readable instructions to:

provide the flight control for the unmanned aerial vehicle such that a target distance between the unmanned aerial vehicle and the remote controller is maintained,

wherein the one or more gestures include a gesture interpreted by the one or more physical processors to rotate the unmanned aerial vehicle around the remote controller by a predetermined number of degrees.

11. The system of claim 1 , wherein the one or more physical processors are further configured by the computer-readable instructions to:

provide the flight control for the unmanned aerial vehicle such that a target distance between the unmanned aerial vehicle and an object is maintained,

wherein the one or more gestures include a gesture interpreted by the one or more physical processors to adjust the target distance.

12. The system of claim 1 , wherein the flight control includes control of any of altitude, longitude, latitude, geographical location, heading, and speed of the unmanned aerial vehicle.

13. A method for controlling an unmanned aerial vehicle, the method being implemented in a system including a sensor and a processor, the method comprising:

recognizing one or more gestures from a user based on visual information of the user;

interpreting the one or more gestures from the user as flight control information; and

providing flight control for the unmanned aerial vehicle based on the flight control information.

14. The method of claim 13 , further comprising:

interpreting the one or more gestures from the user as sensor control information; and

controlling the sensor based on the sensor control information.

15. The method of claim 14 , wherein controlling the sensor based on the sensor control information comprises:

controlling the sensor through adjustments of any of aperture timing, exposure, focal length, angle of view, depth of field, focus, light metering, white balance, resolution, frame rate, object of focus, capture angle, a zoom parameter, video format, a sound parameter, and a compression parameter.

16. The method of claim 14 , further comprising:

receiving any of the flight control information and the sensor control information from a remote controller.

17. The method of claim 16 , wherein the remote controller is further configured to project a pattern on an object, the method further comprising:

recognizing the pattern based on the visual information; and

interpreting the pattern as any of the flight controller information and the sensor control information.

18. The method of claim 16 , wherein providing the flight control for the unmanned aerial vehicle based on the flight control information comprises:

maintaining a target altitude differential between the unmanned aerial vehicle and the remote controller; and

interpreting the one or more gestures to effectuate an adjustment of the target altitude differential.

19. The method of claim 13 , wherein providing the flight control for the unmanned aerial vehicle based on the flight control information comprises:

maintaining a target distance between the unmanned aerial vehicle and an object; and

interpreting the one or more gestures to effectuate an adjustment of the target distance.

20. The method of claim 13 , wherein the flight control includes control of any of altitude, longitude, latitude, geographical location, heading, and speed of the unmanned aerial vehicle.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GOPRO, INC.
To: SKYDIO, INC.
Reel/Frame 069083/0355 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2019
From: LEMA, PABLO; IP, SHU CHING
To: GOPRO, INC.
Reel/Frame 047942/0527 →