IP Library › Granted Patent US 10,198,634
Granted Patent B2
US 10,198,634 · App. 15/366,857 · Granted Feb 5, 2019

Systems and methods for detecting and tracking movable objects

Inventors: You Zhou (Shenzhen, CN); Cong Zhao (Shenzhen, CN); Ketan Tang (Shenzhen, CN); Jiaqi Yan (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
G06K9/0063B64C39/024B64D47/08G01S5/02G06K9/00771G06K9/4604G06K9/4671G06K9/6228G06T7/215G06T7/248H04N5/232H04N5/33B64C2201/123B64C2201/127B64C2201/145G06T2207/10032G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,198,634
App. No.
15/366,857
Granted
Feb 5, 2019
Kind
B2
Abstract

Systems, methods, and devices are provided herein for detecting and tracking one or more movable objects. A method for supporting visual tracking may be provided. The method may comprise: receiving a plurality of image frames captured at different times using an imaging device, wherein each image frame comprises a plurality of pixels that are associated with a plurality of feature points; analyzing the plurality of image frames to compute movement characteristics of the plurality of feature points; and identifying at least one tracking feature relative to at least one background feature based on the movement characteristics of the plurality of feature points.

Claims (36)

1. A method for supporting visual tracking, the method comprising:

obtaining, via a mobile visual tracking device, movement characteristics of a plurality of feature points;

selecting a group of feature points from the plurality of feature points based on the movement characteristics of the plurality of feature points; and

tracking the group of feature points by adjusting motion characteristics of the mobile visual tracking device, so as to position the group of feature points in a target region of each image frame captured using the mobile visual tracking device,

wherein the mobile visual tracking device is configured to track the group of feature points so long as the group of feature points share a same movement characteristic.

2. The method of claim 1 , wherein the target region is a central region of each image frame.

3. The method of claim 1 , wherein the target region is an edge region of each image frame.

4. The method of claim 1 , wherein the motion characteristics of the mobile visual tracking device are adjusted such that the motion characteristics of the mobile visual tracking device are the same as the movement characteristics of the group of feature points.

5. The method of claim 4 , wherein the movement characteristics of the group of feature points comprise at least a velocity and/or an acceleration of the group of feature points.

6. The method of claim 5 , wherein the velocity of the mobile visual tracking device is substantially the same as the velocity of the group of feature points.

7. The method of claim 5 , wherein the acceleration of the mobile visual tracking device is the same as the acceleration of the group of feature points.

8. The method of claim 1 , wherein, when the mobile visual tracking device is carried by a movable apparatus, a movement characteristic of the movable apparatus is adjusted so as to allow the mobile visual tracking device to track the group of feature points.

9. The method of claim 8 , wherein the mobile visual tracking device comprises an imaging device, and the method further comprising: adjusting the movement of the imaging device relative to the movement of the UAV to track the group of feature points.

10. The method of claim 1 , wherein the mobile visual tracking device is configured to track the group of feature points independent of a size and/or a shape of the group of feature points.

11. The method of claim 1 ,

wherein the group of feature points is a first subset of feature points;

the method further comprising:

selecting a second subset of feature points from the plurality of feature points based on the movement characteristics of the plurality of feature points.

12. The method of claim 11 , wherein the first and second subsets of feature points have the same movement characteristic.

13. The method of claim 12 , wherein the mobile visual tracking device is configured to track the first and second subsets of feature points having the same movement characteristic.

14. The method of claim 11 , wherein the first and second subsets of feature points have different movement characteristics.

15. The method of claim 14 , wherein the mobile visual tracking device is configured to track one of the first or the second subsets of feature points.

16. The method of claim 14 , wherein the mobile visual tracking device is configured to track the first subset of feature points when a size of the first subset of feature points is greater than a size of the second subset of feature points.

17. An apparatus for supporting visual tracking, the apparatus comprising one or more processors that are, individually or collectively, configured to:

obtain, via a mobile visual tracking device, movement characteristics of a plurality of feature points;

select a group of feature points from the plurality of feature points based on the movement characteristics of the plurality of feature points; and

track the group of feature points by adjusting motion characteristics of the mobile visual tracking device, so as to position the group of feature points in a target region of each image frame captured using the mobile visual tracking device,

wherein the mobile visual tracking device is configured to track the group of feature points so long as the group of feature points share a same movement characteristic.

18. An unmanned aerial vehicle (UAV) comprising:

a visual tracking system comprising:

an imaging device; and

one or more processors that are, individually or collectively, configured to:

obtain, via a mobile visual tracking device, movement characteristics of a plurality of feature points;

select a group of feature points from the plurality of feature points based on the movement characteristics of the plurality of feature points; and

track the group of feature points by adjusting motion characteristics of the mobile visual tracking device, so as to position the group of feature points in a target region of each image frame captured using the mobile visual tracking device,

wherein the mobile visual tracking device is configured to track the group of feature points so long as the group of feature points share a same movement characteristic.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2016
From: ZHOU, YOU; ZHAO, CONG; TANG, KETAN; YAN, JIAQI
To: SZ DJI TECHNOLOGY CO., LTD
Reel/Frame 040540/0249 →
Continuity (2)
Continuation PCTCN2015089464 · Sep 11, 2015
Related Publication 20170083748A1 · Mar 23, 2017
Cited By (1)
US 12,236,612