IP Library Granted Patent US 8,649,557
Granted Patent B2
US 8,649,557 · App. 12/857,076 · Granted Feb 11, 2014

Method of mobile platform detecting and tracking dynamic objects and computer-readable medium thereof

Inventors: Seung Yong Hyung (Yongin-si, KR); Sung Hwan Ahn (Anyang-Si, KR); Kyung Shik Roh (Seongnam-si, KR); Suk June Yoon (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,649,557
App. No.
12/857,076
Granted
Feb 11, 2014
Kind
B2
Abstract

Disclosed herein is a computer-readable medium and method of a mobile platform detecting and tracking dynamic objects in an environment having the dynamic objects. The mobile platform acquires a three-dimensional (3D) image using a time-of-flight (TOF) sensor, removes a floor plane from the acquired 3D image using a random sample consensus (RANSAC) algorithm, and individually separates objects from the 3D image. Movement of the respective separated objects is estimated using a joint probability data association filter (JPDAF).

Claims (30)

1. A method of a mobile platform detecting and tracking moving objects, comprising:

acquiring a three-dimensional (3D) image of an environment in which the mobile platform moves;

extracting and removing, using a processor, a floor plane from the 3D image;

individually separating, using the processor, objects from the 3D image with the floor plane removed;

estimating movement of the respective separated objects; and

registering the respective separated objects as formal dynamic objects when a predetermined condition is satisfied,

wherein the predetermined condition entails a covariance value being less than a predetermined critical value.

2. The method according to claim 1 , wherein the extracting and removing the floor plane from the 3D image comprises using a random sample consensus (RANSAC) algorithm.

3. The method according to claim 1 , wherein the 3D image acquired by the mobile platform comprises a depth map acquired by a time-of-flight (TOF) sensor.

4. The method according to claim 3 , wherein the extracting and removing the floor plane from the 3D image comprises performing a RANSAC algorithm using pixel information of the depth map acquired by the TOF sensor as data.

5. The method according to claim 3 , wherein the individually separating the objects from the 3D image with the floor plane removed comprises using a blob algorithm.

6. The method according to claim 3 , wherein the movement of the respective separated objects is estimated using a joint probability data association filter (JPDAF).

7. The method according to claim 6 , further comprising registering the respective separated objects as formal dynamic objects when it is determined that the respective separated objects are dynamic objects as a result of estimating the movement of the respective separated objects using the JPDAF and when the predetermined condition is satisfied.

8. The method according to claim 7 , further comprising estimating location or velocity of the registered formal dynamic objects to track the dynamic objects.

9. The method according to claim 8 , further comprising designing a travel route along which the mobile platform avoids the registered formal dynamic objects using the estimated location or velocity of the registered formal dynamic objects.

10. At least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement a method, comprising:

acquiring a three-dimensional (3D) image of an environment in which the mobile platform moves;

extracting and removing a floor plane from the 3D image;

individually separating objects from the 3D image with the floor plane removed;

estimating movement of the respective separated objects; and

registering the respective separated objects as formal dynamic objects when a predetermined condition is satisfied,

wherein the predetermined condition entails a covariance value being less than a predetermined critical value.

11. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 10 , wherein the extracting and removing the floor plane from the 3D image comprises using a random sample consensus (RANSAC) algorithm.

12. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 10 , wherein the 3D image acquired by the mobile platform comprises a depth map acquired by a time-of-flight (TOF) sensor.

13. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 12 , wherein the extracting and removing the floor plane from the 3D image comprises performing a RANSAC algorithm using pixel information of the depth map acquired by the TOF sensor as data.

14. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 12 , wherein the individually separating the objects from the 3D image with the floor plane removed comprises using a blob algorithm.

15. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 12 , wherein the movement of the respective separated objects is estimated using a joint probability data association filter (JPDAF).

16. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 15 , further comprising registering the respective separated objects as formal dynamic objects when it is determined that the respective separated objects are dynamic objects as a result of estimating the movement of the respective separated objects using the JPDAF and when the predetermined condition is satisfied.

17. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 16 , further comprising estimating location or velocity of the registered formal dynamic objects to track the dynamic objects.

18. The at least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement the method of claim 17 , further comprising designing a travel route along which the mobile platform avoids the registered formal dynamic objects using the estimated location or velocity of the registered formal dynamic objects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2010
From: HYUNG, SEUNG YONG; AHN, SUNG HWAN; ROH, KYUNG SHIK; YOON, SUK JUNE
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 024858/0039 →
Priority Claims (1)
KR 10-2009-0078456 · Aug 25, 2009 · national
Continuity (1)
Related Publication 20110052043A1 · Mar 3, 2011