IP Library Granted Patent US 9,373,034
Granted Patent B2
US 9,373,034 · App. 13/888,532 · Granted Jun 21, 2016

Apparatus and method for tracking object

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,373,034
App. No.
13/888,532
Granted
Jun 21, 2016
Kind
B2
Abstract

A method of tracking an object includes obtaining an image captured by a camera, setting a plurality of patterns having various sizes, according to a distance from a horizon in the image to a plurality of pixels in the image, extracting an object matching one of the plurality of patterns having various sizes, while scanning the image using the plurality of patterns having various sizes, and displaying information about a position of the extracted object in the image.

Claims (91)

1. A method of tracking an object, the method comprising:

setting a plurality of patterns having various sizes, according to a distance from a horizon in an image to a plurality of pixels corresponding to the plurality of patterns in the image captured by a camera;

extracting an object matching one of the plurality of patterns having various sizes, while scanning the image using the plurality of patterns having various sizes; and

displaying information about a position of the extracted object in the image,

wherein the setting the plurality of patterns comprises:

detecting the horizon from the image;

obtaining information about a height of the camera;

obtaining information about an actual size of the object; and

setting the plurality of patterns having various sizes to be used for scanning the image using the distance from the horizon in the image to the plurality of pixels in the image, the obtained information about the height of the camera, and the obtained information about the actual size of the object.

2. The method of claim 1 , further comprising selecting an object to be tracked, from among a plurality of objects stored in a database, before the image is obtained.

3. The method of claim 2 , wherein the plurality of objects are stored in the database in a histogram of gradient (HOG) form, which indicates brightness distribution orientations used as a feature vector.

4. The method of claim 1 , wherein a size of at least one pattern in the plurality of patterns is set according to the equation:

Pattern

Size

=

Distance

from

Horizon

to

Pixel

×

Actual

Size

of

Object

Height

of

Camera

.

5. The method of claim 1 , wherein the extracting the object comprises:

obtaining the object matching one of the plurality of patterns having various sizes, while scanning the image using the plurality of patterns having various sizes; and

extracting an object to be tracked, from a plurality of objects stored in the database, by applying a support vector machine (SVM) to the obtained object.

6. The method of claim 1 , further comprising transferring the information about the position of the extracted object and information about a size of at least one pattern in the plurality of patterns, according to the position of the extracted object in a next image,

wherein the image and the next image are each an image frame, and the next image is captured by the camera immediately after the image is captured by the camera.

7. The method of claim 1 , further comprising:

obtaining a first image captured by a first camera; and

obtaining a second image captured by a second camera.

8. The method of claim 7 , wherein, in the setting the plurality of patterns having various sizes, the various sizes of the plurality of patterns are set according to the distance from the horizon to the plurality of pixels in the first image.

9. The method of claim 8 , wherein, in the extracting the object, the first object is matched with one of the plurality of patterns having various sizes, while scanning the first image using the plurality of patterns having various sizes.

10. The method of claim 9 , wherein the displaying information about the position of the extracted object comprises:

displaying information about the position of an extracted first object on the first image; and

displaying the information about the position of the extracted first object on the second image.

11. The method of claim 10 , further comprising storing the information about the position of the object and information about a size of at least one pattern in the plurality of patterns according to the position of the object, and transferring the information to a next first image when the first camera captures the next first image.

12. An apparatus for tracking an object, the apparatus comprising:

a pattern setting device which sets a plurality of patterns having various sizes, according to a distance from a horizon to a plurality of pixels corresponding to the plurality of patterns in an image captured by a camera;

an object extraction device which extracts an object matching one of the plurality of patterns having various sizes, while the image is scanned using the plurality of patterns having various sizes; and

an object tracking device which displays information about a position of the extracted object in the image,

wherein the pattern setting device sets the plurality of patterns having various sizes to be used for scanning the image by detecting the horizon in the image and obtaining information about a height of the camera and information about a size of the object.

13. The apparatus of claim 12 , further comprising an object selection device which selects an object to be tracked, from among a plurality of objects stored in a database.

14. The apparatus of claim 12 , wherein the object tracking device uses, for a next image, the information about the position of the extracted object and information about a size of at least one pattern in the plurality of patterns, according to the position of the extracted object.

15. An apparatus for tracking an object, the apparatus comprising:

a first camera which captures a first image;

a second camera which captures a second image;

an object selection device which selects an object to be tracked, from among a plurality of objects stored in a database;

a pattern setting device which sets a plurality of patterns having various sizes, according to a distance from a horizon to a plurality of pixels and based on the horizon in the first image;

a first object extraction device which extracts a first object matching one of the plurality of patterns having various sizes, while the first image is scanned using the plurality of patterns having various sizes;

a second object extraction device which extracts a second object using information about a position of the first object extracted from the first image and information about a size of at least one pattern in the plurality of patterns, according to the position of the first object extracted, to the second image;

a matching device which matches the first image and the second image with respect to areas where the first object and the second object are extracted; and

an object tracking device which displays information about the position of an extracted matched object in a matched image.

16. The apparatus of claim 15 , wherein the pattern setting device sets the plurality of patterns having various sizes to be used for scanning the image by detecting the horizon from the first image and obtaining information about a height of the first camera and the second camera and information about a size of the object.

17. The apparatus of claim 15 , wherein the object tracking device stores the information about the position of the first object extracted and the information about the size of the at least one pattern in the plurality of patterns according to the position, and transfers the information to a next first image when the first camera captures the next first image.

18. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of tracking an object, the method comprising:

setting a plurality of patterns having various sizes, according to a distance from a horizon to a plurality of pixels, based on the horizon in an image captured by a camera;

extracting an object matching one of the plurality of patterns having various sizes, while the image is scanned using the plurality of patterns having various sizes; and

displaying information about a position of the extracted object in the image,

wherein the setting the plurality of patterns comprises:

detecting the horizon from the image;

obtaining information about a height of the camera;

obtaining information about an actual size of the object; and

setting the plurality of patterns having various sizes to be used for scanning the image using the distance from the horizon in the image to the plurality of pixels in the image, the obtained information about the height of the camera, and the obtained information about the actual size of the object.

Assignments (9)
PARTIAL ASSIGNMENT Recorded Dec 6, 2023
From: HANWHA CO., LTD.
To: HANWHA ROBOTICS CORPORATION
Reel/Frame 065790/0865 →
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
PARTIAL ASSIGNMENT Recorded Nov 4, 2020
From: HANWHA PRECISION MACHINERY CO., LTD.
To: HANWHA CO., LTD.
Reel/Frame 054308/0056 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049005/0770 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA PRECISION MACHINERY CO., LTD.; HANWHA AEROSPACE CO., LTD.
Reel/Frame 048849/0310 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 24, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036254/0911 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2013
From: BAE, SOON-MIN; SONG, MOO-KYUNG; CHON, JE-YOUL
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 030362/0342 →