IP Library › Granted Patent US 11,755,042
Granted Patent B2
US 11,755,042 · App. 17/455,744 · Granted Sep 12, 2023

Autonomous orbiting method and device and UAV

Inventor: Ziming Zhong (Guangdong, CN)
Assignee: AUTEL ROBOTICS CO., LTD.
G05D1/12B64C39/024B64D47/08G05D1/0094G05D1/101B64U2101/30B64U2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,755,042
App. No.
17/455,744
Granted
Sep 12, 2023
Kind
B2
Abstract

Embodiments of the disclosure relate to the field of unmanned aerial vehicle (UAV) technologies, and specifically disclose an autonomous orbiting method and device and a UAV. The UAV includes a binocular camera assembly. The method includes: obtaining, through the binocular camera assembly, a target footage and an orbited object selected by a user from the target footage; obtaining a flying height of the UAV when obtaining the target footage; determining a spatial distance between the binocular camera assembly and the orbited object based on the target footage; detecting an optical axis direction of the binocular camera assembly in real time; and performing autonomous orbiting according to the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time.

Claims (68)

1. An autonomous orbiting method, applicable to an unmanned aerial vehicle (UAV), the UAV comprising a binocular camera assembly, the method comprising:

obtaining, through the binocular camera assembly, a target footage and an orbited object selected by a user from the target footage;

obtaining a flying height of the UAV when obtaining the target footage;

determining a spatial distance between the binocular camera assembly and the orbited object based on the target footage; wherein the target footage comprises a left camera view and a right camera view for the same shooting scene, and the step of determining a spatial distance between the binocular camera assembly and the orbited object comprises: obtaining a disparity value of the orbited object by stereo matching the left camera view and the right camera view, so as to obtain the spatial distance between the binocular camera assembly and the orbited object;

detecting an optical axis direction of the binocular camera assembly in real time; and

performing autonomous orbiting according to the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time; using the flying height as a target flying height of the UAV; using the spatial distance as a target spatial distance between the binocular camera assembly and the orbited object; and maintaining the target flying height and the target spatial distance unchanged, and adjusting a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time, to perform the autonomous orbiting centered on the orbited object.

2. The method according to claim 1 , wherein the method further comprises:

obtaining a moving direction of the orbited object in real time; and

the maintaining the target flying height and the target spatial distance unchanged, and adjusting a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time comprises:

maintaining the target flying height and the target spatial distance unchanged, and adjusting a flight direction of the UAV according to the moving direction of the orbited object obtained in real time and the optical axis direction of the binocular camera assembly detected in real time.

3. The method according to claim 1 , wherein the method further comprises:

determining a shooting mode for the orbited object; and

the performing autonomous orbiting according to the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time comprises:

performing autonomous orbiting with reference to the shooting mode, the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time.

4. The method according to claim 3 , wherein the performing autonomous orbiting with reference to the shooting mode, the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time comprises:

using the flying height as an initial flying height;

using the spatial distance as an initial spatial distance between the UAV and the orbited object;

determining a target flying height of the UAV and a target spatial distance between the UAV and the orbited object in each shooting time period according to the shooting mode, the initial flying height and the initial spatial distance; and

flying in the each shooting time period according to the target flying height and the target spatial distance, and adjusting a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time, to perform autonomous orbiting centered on the orbited object.

5. The method according to claim 1 , wherein the obtaining, through the binocular camera assembly, a target footage and an orbited object selected by a user from the target footage comprises:

receiving a control instruction sent by a remote control device, wherein the remote control device is communicably connected to the UAV;

flying to a target shooting position according to the control instruction; and

using a footage acquired by the binocular camera assembly at the target shooting position as the target footage, and obtaining the orbited object selected by the user from the target footage.

6. The method according to claim 5 , wherein the control instruction comprises a joystick instruction or an operating instruction for a footage acquired in real time.

7. An autonomous orbiting device, applicable to an unmanned aerial vehicle (UAV), the UAV comprising a binocular camera assembly, the device comprising:

at least a processor; and a memory communicably connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions, executed by the at least one processor, enabling the at least one processor to perform the following steps:

obtaining, through the binocular camera assembly, a target footage and an orbited object selected by a user from the target footage;

obtaining a flying height of the UAV when obtaining the target footage;

determining a spatial distance between the binocular camera assembly and the orbited object based on the target footage; wherein the target footage comprises a left camera view and a right camera view for the same shooting scene, and the step of determining a spatial distance between the binocular camera assembly and the orbited object comprises: obtaining a disparity value of the orbited object by the stereo matching the left camera view and the right camera view, so as to obtain the spatial distance between the binocular camera assembly and the orbited object;

detecting an optical axis direction of the binocular camera assembly in real time; and

performing autonomous orbiting according to the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time; using the flying height as a target flying height of the UAV; using the spatial distance as a target spatial distance between the binocular camera assembly and the orbited object; and maintaining the target flying height and the target spatial distance unchanged, and adjusting a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time, to perform the autonomous orbiting centered on the orbited object.

8. The device according to claim 7 , wherein the processor is further configured to:

obtain a moving direction of the orbited object in real time; and

that the processor maintains the target flying height and the target spatial distance unchanged, and adjusts a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time further comprises:

maintaining the target flying height and the target spatial distance unchanged, and adjusting a flight direction of the UAV according to the moving direction of the orbited object obtained in real time and the optical axis direction of the binocular camera assembly detected in real time.

9. The device according to claim 7 , wherein the processor is further configured to:

determine a shooting mode for the orbited object; and

perform autonomous orbiting with reference to the shooting mode, the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time.

10. The device according to claim 9 , wherein the processor is further configured to:

use the flying height as an initial flying height;

use the spatial distance as an initial spatial distance between the UAV and the orbited object;

determine a target flying height of the UAV and a target spatial distance between the UAV and the orbited object in each shooting time period according to the shooting mode, the initial flying height and the initial spatial distance; and

fly in the each shooting time period according to the target flying height and the target spatial distance, and adjust a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time, to perform autonomous orbiting centered on the orbited object.

11. An unmanned aerial vehicle (UAV), comprising:

a body;

arms, connected to the body;

power assemblies, disposed on the arms;

a binocular camera assembly, disposed on the body;

at least one processor, disposed in the body and communicably connected to the binocular camera assembly; and

a memory, communicably connected to the at least one processor, wherein

the memory stores instructions executable by the at least one processor, the instructions, executed by the at least one processor, enabling the at least one processor to perform the following steps:

obtaining, through the binocular camera assembly, a target footage and an orbited object selected by a user from the target footage;

obtaining a flying height of the UAV when obtaining the target footage;

determining a spatial distance between the binocular camera assembly and the orbited object based on the target footage; wherein the target footage comprises a left camera view and a right camera view for the same shooting scene, and the step of determining a spatial distance between the binocular camera assembly and the orbited object comprises: obtaining a disparity value of the orbited object by the stereo matching the left camera view and the right camera view, so as to obtain the spatial distance between the binocular camera assembly and the orbited object;

detecting an optical axis direction of the binocular camera assembly in real time; and

performing autonomous orbiting according to the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time; using the flying height as a target flying height of the UAV; using the spatial distance as a target spatial distance between the binocular camera assembly and the orbited object; and maintaining the target flying height and the target spatial distance unchanged, and adjusting a light direction of the UAV according the optical axis direction of the binocular camera assembly detected in real time, to perform the autonomous orbiting centered on the orbited object.

12. The UAV according to claim 11 , wherein the processor is further configured to:

obtain a moving direction of the orbited object in real time; and

that the processor maintains the target flying height and the target spatial distance unchanged, and adjusts a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time further comprises:

maintaining the target flying height and the target spatial distance unchanged, and adjusting a flight direction of the UAV according to the moving direction of the orbited object obtained in real time and the optical axis direction of the binocular camera assembly detected in real time.

13. The UAV according to claim 11 , wherein the processor is further configured to:

determine a shooting mode for the orbited object; and

perform autonomous orbiting with reference to the shooting mode, the flying height, the spatial distance and the optical axis direction of the binocular camera assembly detected in real time.

14. The UAV according to claim 13 , wherein the processor is further configured to:

use the flying height as an initial flying height;

use the spatial distance as an initial spatial distance between the UAV and the orbited object;

determine a target flying height of the UAV and a target spatial distance between the UAV and the orbited object in each shooting time period according to the shooting mode, the initial flying height and the initial spatial distance; and

fly in the each shooting time period according to the target flying height and the target spatial distance, and adjust a flight direction of the UAV according to the optical axis direction of the binocular camera assembly detected in real time, to perform autonomous orbiting centered on the orbited object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2021
From: ZHONG, ZIMING
To: AUTEL ROBOTICS CO., LTD.
Reel/Frame 058166/0431 →
Priority Claims (1)
CN 201910430492.0 · May 22, 2019 · national
Continuity (2)
Continuation PCTCN2020091620 · May 21, 2020
Related Publication 20220075394A1 · Mar 10, 2022