IP Library Granted Patent US 10,168,704
Granted Patent B2
US 10,168,704 · App. 15/658,572 · Granted Jan 1, 2019

System and method for providing easy-to-use release and auto-positioning for drone applications

Inventors: Tong Zhang (HangZhou, CN); Mengqiu Wang (HangZhou, CN)
Assignee: Hanzhou Zero Zero Technology Co., Ltd.
G05D1/0088B64C39/024B64D47/08G05D1/0016H04N5/23216H04N5/23296B64C2201/146G06F3/017G06F3/0488G06F3/16H04N5/2252H04N5/2258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,168,704
App. No.
15/658,572
Granted
Jan 1, 2019
Kind
B2
Abstract

System and method for controlling an aerial system to perform a selected operation using an easy-to-use release and auto-positioning process.

Claims (56)

1. An aerial system, comprising:

a body;

a lift mechanism coupled to the body;

an optical system controllably mounted to the body by an actuation system;

a user interface mounted on a surface of the body, the user interface including a display screen; and

a processing system coupled to the user interface, the lift mechanism, the optical system, and the actuation system, the processing system configured to:

display a plurality of operations selectable by a user on the user interface and receive a user selection of an operation to perform via the user interface, each of the plurality of operations associated with a flight trajectory and a predefined action performed by the optical system;

detect a release event in which the aerial system is released from being physically held by the user and responsively operate the lift mechanism to hover the aerial system;

detect a flight event indicating that the aerial system has been supported substantially horizontally for greater than a threshold period of time;

automatically operate the lift mechanism in a flight mode upon detecting the flight event, including:

operating the optical system to detect a target;

establishing a corresponding flight trajectory relative to the target defined by the selected operation; and

controlling the lift mechanism to move the aerial system along the established flight trajectory;

operate the optical system to perform a corresponding predefined action defined by the selected operation;

operate the aerial system in a retrieving mode when the predefined action has completed;

detect a standby event; and

operate the aerial system in a standby mode in response to detecting the standby event.

2. An aerial system, as set forth in claim 1 , wherein the user interface is implemented using one or more of the following: a menu displayed on a display, a touchscreen device, and/or one or more buttons.

3. An aerial system, as set forth in claim 2 , wherein the user interface is mounted on a top surface the body.

4. An aerial system, as set forth in claim 2 , including a second user interface provided at a remote device, the remote device configured to send data related to user input on the second user interface to the processing system.

5. An aerial system, as set forth in claim 1 , wherein the processing system is further configured to detect the standby event including detecting a grab indication that the aerial system has been captured by a retention mechanism.

6. An aerial system, as set forth in claim 1 , wherein the processing system is configured to operate the optical system to perform a predefined action including automatically begin obtaining pictures and/or video of the target.

7. An aerial system, as set of forth in claim 6 , wherein the processing system is configured to track the target during flight mode and automatically adjust a camera angle of the optical system to maintain the target within the pictures and/or video.

8. An aerial system, as set forth in claim 1 , wherein the processing system is configured to detect an initial release speed and to responsively establish a distance travel command as a function of the detected initial release speed.

9. An aerial system, as set forth in claim 1 , wherein the processing system is configured to detect an initial trajectory and to responsively establish a direction to travel.

10. An aerial system, as set forth in claim 1 , wherein the processing system is configured to detect an initial release speed and responsively establish a distance travel command as a function of the detected initial release speed and to detect an initial trajectory and to responsively establish a direction to travel.

11. An aerial system, as set forth in claim 10 , wherein the processing system is configured to establish a desired position of the aerial system relative to the target as a function of the distance travel command and initial trajectory.

12. An aerial system, as set forth in claim 11 , wherein the processing system is further configured to control the aerial system to travel to the desired position and orientate the aerial system towards the target.

13. An aerial system, as set forth in claim 1 , wherein the predefined action includes at least one of: (1) automatically modify the camera angle and flight trajectory with the target in the picture without any interaction between the user and any device; (2) automatically take photos or record videos without any interaction between the user and any device; and (3) automatically select good candidates of photos and/or video clips from raw photo/video material for further user editing or automatic editing procedures.

14. An aerial system, as set forth in claim 13 , wherein the processing system in performing the step of automatically taking photos or recording videos may perform one of more of: (1) taking a snapshot, (2) taking a series of snapshots, (3) taking a video with or without snapshot(s), and (4) taking one or more videos with or without snapshot(s).

15. A method for controlling an aerial system including a body, a lift mechanism coupled to the body, an optical system controllably mounted to the body by an actuation system, a user interface mounted on a surface of the body, the user interface including a display screen, and a processing system, the method comprising the processing system performing the steps of:

displaying a plurality of operations selectable by a user on the user interface, each of the plurality of operations associated with a flight trajectory and a predefined action performed by the optical system;

receiving a user selection of an operation to perform via the user interface;

detecting a release event in which the aerial system is released from being physically held by the user and responsively operating the lift mechanism to hover the aerial system;

detecting a flight event indicating that the aerial system has been supported substantially horizontally for greater than a threshold period of time;

automatically operate the lift mechanism in a flight mode upon detecting the flight event, including:

operating the optical system to detect a target;

establishing a corresponding flight trajectory relative to the target defined by the selected operation; and

controlling the lift mechanism to move the aerial system along the established flight trajectory;

operating the optical system to perform a corresponding predefined action defined by the selected operation;

operating the aerial system in a retrieving mode when the predefined action has completed;

detecting a standby event; and

operating the aerial system in a standby mode in response to detecting the standby event.

16. A method, as set forth in claim 15 , wherein the user interface is implemented using one or more of the following: a menu displayed on a display, a touchscreen device, and/or one or more buttons.

17. A method, as set forth in claim 16 , wherein the user interface is mounted on a top surface the body.

18. A method, as set forth in claim 16 , wherein a second user interface is provided at a remote device, the method including the step of operating the aerial system based on data related to user input on the second user interface received from the remote device.

19. A method, as set forth in claim 15 , wherein the step of detecting the standby event includes detecting a grab indication that the aerial system has been captured by a retention mechanism.

20. A method, as set forth in claim 15 , including the step of operating the optical system to perform a predefined action including automatically begin obtaining pictures and/or video of the target.

21. A method, as set of forth in claim 20 , including the step of tracking the target during flight mode and automatically adjusting a camera angle of the optical system to maintain the target within the pictures and/or video.

22. A method, as set forth in claim 15 , including the steps of detecting an initial release speed and to responsively establishing a distance travel command as a function of the detected initial release speed.

23. A method, as set forth in claim 15 , including the steps of detecting an initial trajectory and to responsively establishing a direction to travel.

24. A method, as set forth in claim 15 , including the steps of detecting an initial release speed and responsively establishing a distance travel command as a function of the detected initial release speed and detecting an initial trajectory and responsively establishing a direction to travel.

25. A method, as set forth in claim 24 , including the step of establishing a desired position of the aerial system relative to the target as a function of the distance travel command and initial trajectory.

26. A method, as set forth in claim 25 , including the steps of controlling the aerial system to travel to the desired position and orientating the aerial system towards the target.

27. A method, as set forth in claim 15 , wherein the predefined action includes at least one of: (1) automatically modify the camera angle and flight trajectory with the target in the picture without any interaction between the user and any device; (2) automatically take photos or record videos without any interaction between the user and any device; and (3) automatically select good candidates of photos and/or video clips from raw photo/video material for further user editing or automatic editing procedures.

28. A method, as set forth in claim 27 , wherein the step of automatically taking photos or recording videos includes one of more of: (1) taking a snapshot, (2) taking a series of snapshots, (3) taking a video with or without snapshot(s), and (4) taking one or more videos with or without snapshot(s).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2017
From: ZHANG, TONG; WANG, MENGQIU
To: HANGZHOU ZERO ZERO TECHNOLOGY CO., LTD.
Reel/Frame 044884/0783 →
Continuity (2)
Provisional Application 62515400 · Jun 5, 2017
Related Publication 20180348764A1 · Dec 6, 2018
Cited By (1)
US 12,623,047