IP Library › Granted Patent US 10,976,753
Granted Patent B2
US 10,976,753 · App. 16/188,144 · Granted Apr 13, 2021

System and method for supporting smooth target following

Inventors: Cong Zhao (Shenzhen, CN); Minjian Pang (Shenzhen, CN); Rui Li (Shenzhen, CN); You Zhou (Shenzhen, CN); Zhe Liu (Shenzhen, CN); Guyue Zhou (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
G05D1/106B64C39/024G01S3/7864G05D1/0011G05D1/0094G05D1/12G06K9/0063G06K9/00664G06T7/20G06T7/246G06T7/248G06T7/70H04N5/2328H04N5/23299B64C2201/127B64C2201/141B64C2201/145G06T2207/10028G06T2207/10032G06T2210/12H04N5/232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,976,753
App. No.
16/188,144
Granted
Apr 13, 2021
Kind
B2
Abstract

A method for supporting target tracking includes obtaining a feature model for a target that represents imagery characteristics of the target, extracting one or more features from one or more images captured by an imaging device carried by a movable object, and applying the feature model on the one or more features to determine similarity between the one or more features and the feature model.

Claims (59)

1. A method for supporting target tracking, comprising:

obtaining a feature model for a target, wherein the feature model represents imagery characteristics of the target;

extracting one or more features from one or more images captured by an imaging device carried by a movable object; and

applying the feature model on the one or more features to determine similarity between the one or more features and the feature model,

wherein the movable object moves with respect to the target such that the one or more images have a different perspective projection from the feature model and, before applying the feature model on the one or more features, the method further comprises:

compensating at least one of the feature model and the one or more features for the different perspective projection.

2. The method of claim 1 , further comprising:

acquiring the target based on an initialization image captured by the imaging device.

3. The method of claim 2 , further comprising:

receiving a selection of a point in the initialization image;

providing a plurality of object proposal candidates according to the selected point, each of the object proposal candidates being represented by a bounding box; and

receiving a selection of one of the object proposal candidates as an object proposal for the target.

4. The method of claim 3 , further comprising:

determining the feature model based on the object proposal.

5. The method of claim 1 , wherein:

the feature model is represented in spatial domain and/or frequency domain.

6. The method of claim 1 , wherein:

the one or more features are extracted from a searching window in the one or more images.

7. The method of claim 1 , further comprising:

calculating correlation between the feature model and each of the one or more features; and/or

matching the one or more features with the feature model.

8. The method of claim 1 , further comprising:

obtaining a projective transformation of the target in the one or more images based on state information of the imaging device.

9. The method of claim 8 , wherein:

the state information of the imaging device is determined based on position and attitude information of the movable object and attitude information of the imaging device.

10. The method of claim 9 , wherein:

the position and attitude information of the movable object is received from a control module of the movable object, and the attitude information of the imaging device is received from a payload stabilization control module, wherein the payload stabilization control module controls a stabilization system, which stabilizes the imaging device on the movable object.

11. The method of claim 8 , wherein compensating at least one of the feature model and the one or more features for the different perspective projection further comprises:

applying a perspective transformation on the feature model to compensate for the projective transformation of the target.

12. The method of claim 8 , wherein compensating at least one of the feature model and the one or more features for the different perspective projection further comprises:

applying a reverse perspective transformation on the one or more images to compensate for the projective transformation of the target.

13. The method of claim 1 , further comprising:

updating the feature model based on matching of the one or more features with the feature model, wherein the updated feature model is adapted to be applied to a subsequent image.

14. A method for supporting target tracking, comprising:

obtaining a feature model for a target, wherein the feature model represents imagery characteristics of the target;

extracting one or more features from one or more images captured by an imaging device carried by a movable object;

applying the feature model on the one or more features to determine similarity between the one or more features and the feature model;

obtaining a projective transformation of the target in the one or more images based on state information of the imaging device; and

applying a reverse perspective transformation on the one or more images to compensate for the projective transformation of the target,

wherein:

the reverse perspective transformation is determined based on a pitch angle of the image device.

15. A system for supporting target tracking, comprising:

one or more microprocessors; and

a controller running on the one or more microprocessors, wherein the controller operates to:

obtain a feature model for a target, wherein the feature model represents imagery characteristics of the target;

extract one or more features from one or more images captured by an imaging device carried by a movable object; and

apply the feature model on the one or more features to determine similarity between the one or more features and the feature model,

wherein the movable object moves with respect to the target such that the one or more images have a different perspective projection from the feature model and, before applying the feature model on the one or more features, the controller further operates to:

compensate at least one of the feature model and the one or more features for the different perspective projection.

16. The system of claim 15 , wherein:

the controller further operates to acquire the target based on an initialization image captured by the imaging device.

17. The system of claim 16 , wherein the controller further operates to

receive a selection of a point in the initialization image;

provide a plurality of object proposal candidates according to the selected point, each of the object proposal candidates being represented by a bounding box; and

receive a selection of one of the object proposal candidates as an object proposal for the target.

18. The system of claim 17 , wherein:

the controller further operates to determine the feature model based on the object proposal.

19. The system of claim 15 , wherein:

the one or more features are extracted from a searching window in the one or more images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2018
From: ZHAO, CONG; PANG, MINJIAN; LI, RUI; ZHOU, YOU; LIU, ZHE; ZHOU, GUYUE
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 047478/0900 →
Continuity (3)
Continuation 15396022 · Dec 30, 2016
Continuation PCTCN2015089594 · Sep 15, 2015
Related Publication 20190082088A1 · Mar 14, 2019
Cited By (1)
US 12,205,319