IP Library › Granted Patent US 10,591,292
Granted Patent B2
US 10,591,292 · App. 15/870,174 · Granted Mar 17, 2020

Method and device for movable object distance detection, and aerial vehicle

Inventors: Zhenyu Zhu (Shenzhen, CN); Zihan Chen (Shenzhen, CN); Zhiyuan Zhang (Shenzhen, CN); Weifeng Liu (Shenzhen, CN); Chaobin Chen (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
G01C3/08G01C3/14G05D1/0094G05D1/10G06K9/0063G06K9/209G06K9/4671G06K9/6202G06K9/78G06T7/248G06T7/292G06T7/593G06T7/60G08G5/0021G08G5/0069G08G5/04G08G5/045B64C2201/14G01C9/005G06K2209/21G06T2207/10012G06T2207/10032G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,591,292
App. No.
15/870,174
Granted
Mar 17, 2020
Kind
B2
Abstract

A method for distance detection includes detecting a first distance value between a movable object and a target object in a target direction of the movable object, obtaining an inclination angle of the movable object at the target direction, and calculating a second distance value from the movable object to the target object based upon the inclination angle and the first distance value.

Claims (61)

1. A method for distance detection comprising:

sensing, using a distance sensor configured on an aerial vehicle, a distance value corresponding to a target object in a target direction of the aerial vehicle, the distance sensor including one or more of an ultrasonic sensor, an infrared sensor, a radar sensor, and a laser sensor;

determining, by a processor configured on the aerial vehicle, whether the distance value is less a preset distance threshold;

in response to the distance value being less the preset distance threshold, determining, by the processor, the sensed distance value as the first distance value;

in response to the distance value being no less than the preset distance threshold, obtaining, using two visual sensors and the processor, a visual distance value corresponding to the target object, and determining, by the processor, the visual distance value as the first distance value;

obtaining, using an inclination sensor configured on the aerial vehicle, an inclination angle of the aerial vehicle at the target direction, the inclination sensor including a gyroscope or an accelerometer;

calculating, by the processor, a second distance value from the aerial vehicle to the target object based upon the inclination angle and the first distance value; and

controlling, by a flight controller configured on the aerial vehicle, a movement of the aerial vehicle based upon the second distance value.

2. The method of claim 1 , wherein obtaining the visual distance value corresponding to the target object comprises:

obtaining, using the two visual sensors, at least two images in the target direction;

determining, by the processor, feature points in each of the at least two images;

performing, by the processor, feature point comparison and determining correlated feature points between the at least two images; and

calculating, by the processor, the visual distance value corresponding to the target object based upon the correlated feature points.

3. The method of claim 2 , wherein determining the feature points in each of the at least two images comprises:

determining, by the processor, an effective area in each of the at least two images based upon the inclination angle; and

determining, by the processor, the feature points in the effective area of each of the at least two images.

4. The method of claim 2 , wherein:

the correlated feature points include a group of sparse feature points, and

calculating the visual distance value corresponding to the target object based upon the correlated feature points comprises calculating, by the processor, the visual distance value corresponding to the target object based upon the sparse feature points.

5. The method of claim 2 , wherein:

the correlated feature points include a group of dense feature points, and

calculating the visual distance value corresponding to the target object based upon the correlated feature points comprises calculating, by the processor, the visual distance value corresponding to the target object based upon the dense feature points.

6. The method of claim 2 , wherein controlling the movement of the aerial vehicle based upon the second distance comprises performing, by the flight controller, an obstacle avoidance based upon the second distance, the obstacle avoidance comprising limiting a moving speed of the aerial vehicle or avoiding the target object.

7. The method of claim 2 , wherein controlling the movement of the aerial vehicle based upon the second distance comprises performing a target tracking based upon the second distance, the target tracking comprising controlling the movement of the aerial vehicle such that a distance between the aerial vehicle and the target object is within a predetermined tracking distance threshold.

8. A device for distance detection comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to:

control a distance sensor configured on an aerial vehicle to sense a distance value corresponding to a target object in a target direction of the aerial vehicle, the distance sensor including one or more of an ultrasonic sensor, an infrared sensor, a radar sensor, and a laser sensor;

determine whether the distance value is less a preset distance threshold;

in response to the distance value being less the preset distance threshold, determine the sensed distance value as the first distance value;

in response to the distance value being no less than the preset distance threshold, control two visual sensors to obtain a visual distance value corresponding to the target object, and determine the visual distance value as the first distance value;

control an inclination sensor configured on the aerial vehicle to obtain an inclination angle of the aerial vehicle at the target direction, the inclination sensor including a gyroscope or an accelerometer; and

calculate a second distance value corresponding to the target object based upon the inclination angle and the first distance value; and

control a movement of the aerial vehicle based upon the second distance value.

9. The device of claim 8 , wherein the instructions further cause the processor to:

control the two visual sensors to obtain at least two images in the target direction;

determine feature points in each of the at least two images;

perform feature point comparison and determine correlated feature points between the at least two images; and

calculate the first distance value corresponding to the target object based upon the correlated feature points.

10. The device of claim 9 , wherein the instructions further cause the processor to:

determine an effective area in each of the at least two images based upon the inclination angle; and

determine the feature points in the effective area of each of the at least two images.

11. The device of claim 9 , wherein:

the determined feature points include a group of sparse feature points, and

the instructions further cause the processor to calculate the first distance value corresponding to the target object based upon the sparse feature points.

12. The device of claim 9 , wherein:

the determined feature points include a group of dense feature points, and

the instructions further cause the processor to calculate the first distance value corresponding to the target object based upon the dense feature points.

13. The device of claim 9 , wherein the instructions further cause the processor to perform an obstacle avoidance based upon the second distance, the obstacle avoidance comprising limiting a moving speed of the aerial vehicle or avoiding the target object.

14. The device of claim 9 , wherein the instructions further cause the processor to perform a target tracking based upon the second distance, the target tracking operation comprising controlling a movement of the aerial vehicle such that a distance between the movable object and the target object is within a predetermined tracking distance threshold.

15. An aerial vehicle comprising:

a propulsion device;

a distance sensor configured to sense a distance value corresponding to a target object, the distance sensor including one or more of an ultrasonic sensor, an infrared sensor, a radar sensor, and a laser sensor;

two visual sensors configured to obtain a visual distance value corresponding to the target object;

an inclination sensor configured to obtain an inclination angle of the aerial vehicle at the target direction, the inclination sensor including a gyroscope or an accelerometer; and

a flight controller configured to:

determine whether the sensed distance value is less a preset distance threshold;

in response to the sensed distance value being less the preset distance threshold, determine the sensed distance value as the first distance value;

in response to the distance value being no less than the preset distance threshold, determine the visual distance value as the first distance value;

calculate a second distance value from the aerial vehicle to the target object based upon the inclination angle and the first distance value; and

provide a control instruction to the propulsion device to control the propulsion device to effect a movement of the aerial vehicle based upon the second distance value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2018
From: ZHU, ZHENYU; CHEN, ZIHAN; ZHANG, ZHIYUAN; LIU, WEIFENG; CHEN, CHAOBIN
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 044641/0964 →
Continuity (2)
Continuation PCTCN2015083868 · Jul 13, 2015
Related Publication 20180156610A1 · Jun 7, 2018