IP Library Granted Patent US 9,189,863
Granted Patent B2
US 9,189,863 · App. 13/887,480 · Granted Nov 17, 2015

Method and system for detecting motion capable of removing shadow by heat

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,189,863
App. No.
13/887,480
Granted
Nov 17, 2015
Kind
B2
Abstract

A method and system for detecting a motion of a target object in a thermal image by removing a shadow by heat of the target object from the thermal image. The motion detecting system includes: a learning unit obtaining at least one of size and brightness of a shadow by heat of a reference object based on characteristics of the shadow by heat of the reference object by temperature; and a detecting unit removing a shadow region of the target object from the thermal image including the target object based on at least one of the size and the brightness of the shadow by heat of the object.

Claims (35)

1. A motion detecting system detecting a motion of a target object in a thermal image, the system comprising:

a learning module which is configured to obtain at least one of size and brightness of a shadow by heat of a reference object based on characteristics of the shadow by heat of the reference object by temperature and comprises:

a shadow size obtaining module configured to estimate a size function of the shadow by heat of the reference object to obtain the size of the shadow by heat of the reference object; and

a shadow brightness obtaining module configured to set threshold values based on brightness values of the shadow by heat of the reference object, the threshold values being used to obtain the brightness of the shadow by heat of the reference object; and

a detecting module configured to remove a shadow region of the target object from the thermal image including the target object based on at least one of the size and the brightness of the shadow by heat of the object.

2. The motion detecting system of claim 1 , wherein the shadow size obtaining module collects data regarding a size of a shadow region with respect to a bounding box surrounding the reference object when obtaining the size of the shadow by heat of the reference object.

3. The motion detecting system of claim 2 , wherein the shadow size obtaining module calculates a size parameter of the shadow by heat of the reference object according to temperatures, and calculates a size function of the shadow by heat of the reference object based on the size parameter.

4. The motion detecting system of claim 1 , wherein the learning module estimates a size function of the shadow by heat of the reference object with respect to a bounding box surrounding the reference object based on the characteristics of the shadow by heat of the reference object, thereby to obtain the size of the shadow by heat of the reference object.

5. The motion detecting system of claim 1 , wherein the shadow brightness obtaining module sets the threshold values for dividing an object region, a shadow region, and an engine region in the object region according to temperatures based on brightness value information regarding the regions when obtaining the brightness of the shadow by heat of the reference object.

6. The motion detecting system of claim 1 , wherein the characteristics of the shadow by heat of the reference object by temperature are set according to time in a day.

7. The motion detecting system of claim 1 , wherein the detecting module designates a shadow by heat of the target object in a corresponding temperature by using temperature information about the thermal image, and disregards the designated shadow by heat from the thermal image to detect the motion of the target object.

8. The motion detecting system of claim 1 , wherein the detecting module comprises:

a candidate region designating module extracting a size of a shadow by heat of the target object based on the size of the shadow by heat of the reference object obtained by the learning module, and designating a region corresponding to the size of the shadow by heat of the target object as a candidate region;

a shadow region designating module designating a region of the shadow by heat of the target object in the candidate region based on the brightness of the shadow by heat of the reference object obtained by the learning module; and

a shadow removing module removing the designated shadow region from the thermal image to detect the motion of the target object.

9. The motion detecting system of claim 8 , wherein the candidate region designating module measures a size of a bounding box surrounding the target object in the thermal image, and extracts a size of the shadow by heat of the target object from a size function of the shadow by heat of the reference object obtained by the learning module.

10. The motion detecting system of claim 9 , wherein the candidate region designating module designates the region of the shadow by heat of the target object in reference to a bottom of the bounding box.

11. The motion detecting system of claim 8 , wherein the shadow region designating module designates the region of the shadow by heat of the target object if the region falls within a range of a threshold value of the brightness obtained by the learning module.

12. The motion detecting system of claim 1 , further comprising a database storing data regarding characteristics of the shadow by heat of the reference object according to temperatures of a thermal image including the reference object.

13. A method of detecting a motion of a target object in a thermal image, the method comprising:

obtaining at least one of size and brightness of a shadow by heat of a reference object based on characteristics of the shadow by heat of the reference object by temperature; and

removing a shadow region of the target object from the thermal image including the target object based on the size and brightness of the shadow by heat of the object

wherein the obtaining at least one of the size and the brightness of the shadow by heat of the reference object comprises:

estimating a size function of the shadow by heat of the reference object o obtain the size of the shadow by heat of the reference object; and

setting threshold values based on brightness values of the shadow by heat of the reference object, the threshold values being used to obtain the brightness of the shadow by heat of the reference object.

14. The method of claim 13 , wherein the obtaining at least one of the size and the brightness of the shadow by heat of the reference object comprises:

collecting data regarding a size of a shadow region with respect to a bounding box surrounding the reference object when obtaining the size of the shadow by heat of the reference object; and

calculating a size parameter of the shadow by heat of the reference object according to temperatures.

15. The method of 13 , wherein the obtaining at least one of the size and the brightness of the shadow by heat of the reference object comprises setting the threshold values for dividing an object region, a shadow region, and an engine region in the object region according to temperatures based on brightness value information regarding the regions when obtaining the brightness of the shadow by heat of the reference object.

16. The method of claim 13 , wherein the removing the shadow region of the target object from the thermal image comprises:

extracting a size of a shadow by heat of the target object based on the size of the shadow by heat of the reference object obtained in the obtaining at least one of the size and the brightness of the shadow by heat of the reference object, and designating a region corresponding to the size of the shadow by heat of the target object as a candidate region;

designating a region of the shadow by heat of the target object in the candidate region based on the brightness of the shadow by heat of the reference object obtained in the obtaining at least one of the size and the brightness of the shadow by heat of the reference object; and

removing the designated shadow region from the thermal image to detect the motion of the target object.

17. The method of claim 16 , wherein the designating the shadow region of the target object is performed if the region falls within a range of a threshold value of the brightness obtained in the obtaining at least one of the size and the brightness of the shadow by heat of the reference object.

18. The method of claim 13 , wherein the characteristics of the shadow by heat of the reference object by temperature are set according to time in a day.

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 24, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036254/0911 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2013
From: CHOI, EUN-JI; NOH, SEUNG-IN; KIM, JI-MAN; KIM, DAE-JIN
To: SAMSUNG TECHWIN CO., LTD.; POSTECH ACADEMY-INDUSTRY FOUNDATION
Reel/Frame 030353/0337 →