IP Library Granted Patent US 10,175,687
Granted Patent B2
US 10,175,687 · App. 15/606,700 · Granted Jan 8, 2019

Systems and methods for controlling an unmanned aerial vehicle

Inventors: Pablo Lema (San Mateo, CA); Shu Ching Ip (Cupertino, CA)
Assignee: GoPro, Inc.
G05D1/0016B64C39/024G05D1/0094G06K7/10B64C2201/027B64C2201/127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,175,687
App. No.
15/606,700
Granted
Jan 8, 2019
Kind
B2
Abstract

Systems and methods for controlling an unmanned aerial vehicle recognize and interpret gestures by a user. The gestures are interpreted to adjust the operation of the unmanned aerial vehicle, a sensor carried by the unmanned aerial vehicle, or both.

Claims (35)

1. A system for controlling an unmanned aerial vehicle, the system comprising:

an image sensor configured to generate output signals conveying visual information, the visual information including one or more images of a user; and

one or more physical processors configured by computer-readable instructions to:

recognize one or more gestures from the user based on the visual information;

interpret the one or more gestures from the user as any of flight control information and sensor control information;

provide flight control for the unmanned aerial vehicle based on the flight control information; and

control the image sensor based on the sensor control information, the image sensor controlled through adjustments of any of aperture timing, exposure, focal length, angle of view, depth of field, focus, light metering, white balance, resolution, frame rate, object of focus, capture angle, a zoom parameter, video format, a sound parameter, and a compression parameter.

2. The system of claim 1 , further comprising:

a remote controller configured to provide the flight control information and the sensor control information to the one or more physical processors.

3. The system of claim 2 , wherein the remote controller is further configured to be carried or worn by the user.

4. The system of claim 2 , wherein the remote controller is further configured to project a pattern on an object, wherein the one or more physical processors is further configured by the computer-readable instructions to recognize the pattern based on the visual information and interpret the pattern as any of the flight controller information and the sensor control information.

5. The system of claim 1 , wherein the flight control includes control of any of altitude, longitude, latitude, geographical location, heading, and speed of the unmanned aerial vehicle.

6. The system of claim 2 , wherein the one or more physical processors are configured by the computer-readable instructions to provide the flight control for the unmanned aerial vehicle such that a target altitude differential between the unmanned aerial vehicle and the remote controller is maintained, and wherein the one or more gestures include a gesture interpreted by the one or more physical processors to adjust the target altitude differential.

7. The system of claim 2 , wherein the one or more physical processors are configured by the computer-readable instructions to provide the flight control for the unmanned aerial vehicle such that a target cardinal direction between the unmanned aerial vehicle and the remote controller is maintained, and wherein the one or more gestures include a gesture interpreted by the one or more physical processors to adjust the target cardinal direction.

8. The system of claim 2 , wherein the one or more physical processors are configured by the computer-readable instructions to provide the flight control for the unmanned aerial vehicle such that a target distance between the unmanned aerial vehicle and the remote controller is maintained, and wherein the one or more gestures include a gesture interpreted by one or more physical processors to adjust the target distance.

9. The system of claim 2 , wherein the one or more physical processors are configured by the computer-readable instructions to provide the flight control for the unmanned aerial vehicle such that a target distance between the unmanned aerial vehicle and the remote controller is maintained, and wherein the one or more gestures include a gesture interpreted by the one or more physical processors to rotate the unmanned aerial vehicle around the remote controller by a predetermined number of degrees.

10. The system of claim 1 , wherein the one or more physical processors are configured by the computer-readable instructions to provide the flight control for the unmanned aerial vehicle such that a target distance between the unmanned aerial vehicle and an object is maintained, and wherein the one or more gestures include a gesture interpreted by the one or more physical processors to adjust the target distance.

11. A method for controlling an unmanned aerial vehicle, the method being implemented in a system including a sensor and one or more physical processors, the method comprising:

generating, by the sensor, output signals conveying visual information, the visual information including one or more images of a user;

recognize, by the one or more physical processors, one or more gestures from the user based on the visual information;

interpreting, by the one or more physical processors, the one or more gestures from the user as any of flight control information and sensor control information;

providing, by the one or more physical processors, flight control for the unmanned aerial vehicle based on the flight control information; and

controlling, by the one or more physical processors, the image sensor based on the sensor control information, the image sensor controlled through adjustments of any of aperture timing, exposure, focal length, angle of view, depth of field, focus, light metering, white balance, resolution, frame rate, object of focus, capture angle, a zoom parameter, video format, a sound parameter, and a compression parameter.

12. The method of claim 11 , further comprising:

receiving, by the one or more physical processors, the flight control information and the sensor control information from a remote controller.

13. The method of claim 12 , wherein the remote controller is configured to be carried or worn by the user.

14. The method of claim 12 , wherein the remote controller is configured to project a pattern on an object, the method further comprising:

recognizing, by the one or more physical processors, the pattern based on the visual information; and

interpreting, by the one or more physical processors, the pattern as any of the flight controller information and the sensor control information.

15. The method of claim 11 , wherein the flight control includes control of any of altitude, longitude, latitude, geographical location, heading, and speed of the unmanned aerial vehicle.

16. The method of claim 12 , wherein providing the flight control for the unmanned aerial vehicle includes maintaining a target altitude differential between the unmanned aerial vehicle and the remote controller, wherein interpreting the one or more gestures effectuates an adjustment of the target altitude differential.

17. The method of claim 12 , wherein providing the flight control for the unmanned aerial vehicle includes maintaining a target cardinal direction between the unmanned aerial vehicle and the remote controller, wherein interpreting the one or more gestures effectuates an adjustment of the target cardinal direction.

18. The method of claim 12 , wherein providing the flight control for the unmanned aerial vehicle includes maintaining a target distance between the unmanned aerial vehicle and the remote controller, wherein interpreting the one or more gestures effectuates an adjustment of the target distance.

19. The method of claim 12 , wherein providing the flight control for the unmanned aerial vehicle includes maintaining a target distance between the unmanned aerial vehicle and the remote controller, wherein interpreting the one or more gestures effectuates a rotation of the unmanned aerial vehicle around the remote controller by a predetermined number of degrees.

20. The method of claim 11 , wherein providing the flight control for the unmanned aerial vehicle includes maintaining a target distance between the unmanned aerial vehicle and an object, wherein interpreting the one or more gestures effectuates an adjustment of the target distance.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GOPRO, INC.
To: SKYDIO, INC.
Reel/Frame 069083/0355 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
SECURITY INTEREST Recorded Jul 31, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 043380/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2017
From: LEMA, PABLO; IP, SHU CHING
To: GOPRO, INC.
Reel/Frame 042518/0544 →
Continuity (2)
Continuation 14978782 · Dec 22, 2015
Related Publication 20170269588A1 · Sep 21, 2017
Cited By (1)
US 12,359,369