Magic wand interface and other user interaction paradigms for a flying digital assistant
Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.
1. A method for controlling an unmanned aerial vehicle (UAV), the method comprising:
defining, by a processing system, a virtual line extending from a mobile device to the UAV; and
causing the UAV to autonomously maneuver towards a point along the virtual line.
2. The method of claim 1 , further comprising:
receiving an input indicating an intent to control the UAV.
3. The method of claim 2 , further comprising:
responsive to the input, causing the UAV to maintain its current distance relative to a reference point.
4. The method of claim 3 , further comprising:
responsive to the input, causing the UAV to maintain its current position and/or orientation relative to the reference point.
5. The method of claim 4 , wherein the reference point comprises a location of the mobile device in the physical environment.
6. The method of claim 2 , further comprising:
responsive to the input, causing the UAV to autonomously maneuver to a pre-defined position and/or orientation relative to a reference point.
7. The method of claim 6 , further comprising:
tracking, by the processing system, a location of the mobile device in the physical environment;
wherein the reference point comprises the location of the mobile device.
8. The method of claim 6 , wherein the reference point is at or associated with a physical object in physical space.
9. The method of claim 1 , further comprising:
receiving an input indicating an intent to adjust a distance between the UAV and a reference point while maintaining a same angle of elevation.
10. The method of claim 9 , wherein the input is received via a touch screen of the mobile device.
11. The method of claim 10 , wherein the adjustment to the distance between the UAV and the reference point can be manipulated via a slider bar on the touch screen.
12. A system for controlling an unmanned aerial vehicle (UAV), the system comprising:
a display;
one or more processors; and
one or more memory units having instructions stored thereon which, when executed by the one or more processors, cause the system to:
define a virtual line extending from the system to the UAV; and
generate control commands configured to cause the UAV to autonomously maneuver towards a point along the virtual line; and
transmit the control commands to the UAV.
13. The system of claim 12 , further comprising:
an input mechanism configured to receive an input indicating an intent to control the UAV.
14. The system of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the system to:
responsive to the input, generate instructions configured to cause the UAV to maintain its current distance relative to a reference point; and
transmit the instructions to the UAV.
15. The system of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the system to:
responsive to the input, generate instructions configured to cause the UAV to maintain its current position and/or orientation relative to the reference point; and
transmit the instructions to the UAV.
16. The system of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the system to:
responsive to the input, generate instructions configured to cause the UAV to autonomously maneuver to a pre-defined position and/or orientation relative to a reference point; and
transmit the instructions to the UAV.
17. The system of claim 13 , wherein the input mechanism is further configured to receive an input indicating an intent to adjust a distance between the UAV and a reference point while maintaining a same angle of elevation.
18. The system of claim 17 , wherein the input mechanism comprises a touch screen.
19. The system of claim 18 , wherein the adjustment to the distance between the UAV and the reference point is manipulated via a slider bar presented on the touch screen.
20. An unmanned aerial vehicle (UAV) configured for autonomous flight through a physical environment, the UAV comprising:
a first image capture device configured to capture images of the physical environment;
a propulsion system configured to maneuver the UAV through the physical environment;
a processing system; and
an autonomous navigation system configured to:
define a virtual line extending from a mobile device to the UAV; and
cause the propulsion system to autonomously maneuver the UAV towards a point along the virtual line.