IP Library Granted Patent US 9,959,460
Granted Patent B2
US 9,959,460 · App. 15/130,218 · Granted May 1, 2018

Re-wandering alarm system and method

Inventors: Hwalsuk Lee (Changwon-si, KR); Shimin Yin (Changwon-si, KR); JuHyeong Park (Changwon-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
G06K9/00348
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,959,460
App. No.
15/130,218
Granted
May 1, 2018
Kind
B2
Abstract

Provided are a re-wandering detecting device and method. The method includes: detecting an object and positional information about the object from an input image; determining whether the object wanders based on the positional information about the object; in response to determining that the object wanders, determining whether the object re-wanders by determining whether a database stores information about an object identical to the object detected from the input image; and providing information about wandering of the object according to whether the object re-wanders.

Claims (73)

1. A method of detecting re-wandering, the method comprising:

detecting, by at least one processor, an object and positional information about the object from an input image;

determining, by the processor, whether the object wanders based on the positional information about the object;

in response to determining that the object wanders, determining whether the object re-wanders by determining whether a database stores information about an object identical to the object detected from the input image; and

providing, by the processor, information about wandering of the object according to whether the object re-wanders,

wherein the information is provided differently in accordance with a number of times of wandering by the object.

2. The method of claim 1 , wherein the input image is a motion picture comprising a plurality of frames,

wherein the detecting the object comprises detecting the object and positional information about the object from each of the plurality of frames, and

wherein, in the determining whether the object wanders, the object is determined as a wandering object if the object satisfies a preset wandering condition.

3. The method of claim 2 , wherein the wandering condition is that a number of consecutive frames from which the object is detected is equal to or greater than a preset critical number.

4. The method of claim 1 , wherein the input image is a motion picture comprising a plurality of frames,

wherein the detecting the object comprises detecting the object and positional information about the object from each of the plurality of frames and detecting reference characteristics of the object from at least one of the plurality of frames, and

wherein the determining whether the object re-wanders comprises:

searching the database to determine whether the database stores information about an object having the same reference characteristics as the detected reference characteristics of the object and determine that the object re-wanders if the database stores the information about the object having the same reference characteristics as the detected reference characteristics;

in response to determining that the object re-wanders, storing images of the object respectively detected from the plurality of frames in the database; and

in response to determining that the object does not re-wander, storing the detected reference characteristics of the object and the images of the object respectively detected from the plurality of frames in the database.

5. The method of claim 4 , wherein the detecting the object comprises detecting box images of the object and positional information about the box images respectively from the plurality of frames and detecting reference characteristics of the box images from at least one of the plurality of frames, and

wherein, in response to determining that the database does not store the information about the object having the same reference characteristics as the detected reference characteristics of the box images, the reference characteristics of the box images and all the box images respectively detected from the plurality of frames are stored in the database.

6. The method of claim 4 , wherein the reference characteristics of the object comprise clothing characteristics, face characteristics, gait characteristics, or a combination thereof.

7. The method of claim 1 , wherein the input image is a motion picture comprising a plurality of frames,

wherein the detecting the object comprises detecting the object and positional information about the object from each of the plurality of frames, and

wherein the providing the information comprises:

in response to determining that the object wanders, providing primary information about the wandering of the object by arranging all images of the object detected in the detecting the object in a single screen with reference to the positional information about the object; and

in response to determining that the object re-wanders in the determining whether the object re-wanders, providing secondary information about the re-wandering of the object by selecting other images of the object stored in the database than the images provided in the providing the primary information and arranging the selected images in the single screen together with the information provided in the providing the primary information with reference to positional information about the object in the selected images.

8. The method of claim 7 , wherein the detecting the object comprises detecting box images of the object and positional information about the box images respectively from the plurality of frames,

wherein the database previously stores box images of a plurality of objects and positional information about the box images of the objects,

wherein the providing the primary information comprises providing information about the wandering of the object by arranging all the box images of the object detected in the detecting the object in the single screen with reference to the positional information about the object in the box images, and

wherein the providing the secondary information comprises providing information about the re-wandering of the object by selecting other box images of the object stored in the database than the box images provided in the providing the primary information and arranging the selected box images in the single screen together with the information provided in the providing the primary information with reference to positional information about the object in the selected box images.

9. The method of claim 1 , wherein in response to determining that the object re-wanders in the determining whether the object re-wanders, the providing the information comprises displaying all images of the object stored in the database in a screen one by one in a time sequence with reference to information about the images of the object and a position of the object stored in the database.

10. A re-wandering detecting device comprising at least one processor to implement:

an object detector configured to detect an object and positional information about the object from an input image;

a first wandering determiner configured to determine whether the object wanders based on the positional information about the object;

a re-wandering determiner, in response to determining by the first wandering determiner that the object wanders, configured to determine whether the object has wandered more than one time by determining whether a database stores information about an object identical to the object detected from the input image; and

an information provider configured to provide information about wandering of the object when the object wanders one time, and differently provide information about wandering of the object when the object wanders more than one time.

11. The re-wandering detecting device of claim 10 , wherein the input image is a motion picture comprising a plurality of frames,

wherein the object detector detects the object and positional information about the object from each of the plurality of frames, and

wherein if the object detected by the object detector satisfies a preset wandering condition, the first wandering determiner determines that the object wanders.

12. The re-wandering detecting device of claim 11 , wherein the wandering condition is that a number of consecutive frames from which the object is detected is equal to or greater than a preset critical number.

13. The re-wandering detecting device of claim 11 , wherein the wandering condition is that at least one closed curve is formed by a path of the object calculated using the positional information about the object.

14. The re-wandering detecting device of claim 10 , wherein the input image is a motion picture comprising a plurality of frames,

wherein the object detector detects the object and positional information about the object from each of the plurality of frames and detects reference characteristics of the object from at least one of the plurality of frames,

wherein the re-wandering determiner comprises:

a first determiner configured to search the database for the detected reference characteristics and determine whether the database stores information about an object having the same reference characteristics as the detected reference characteristics of the object;

a second determiner configured to determine the object as a re-wandering object in response to determining by the first determiner that the database stores the object having the same reference characteristics as the detected reference characteristics of the object; and

a data storage, in response to determining by the second determiner that the object is a re-wandering object, configured to store images of the object respectively detected from the plurality of frames in the database, and, in response to determining by the second determiner that the object is not the re-wandering object, configured to store the reference characteristics of the object and the images of the object respectively detected from the plurality of frames in the database.

15. The re-wandering detecting device of claim 14 , wherein the object detector detects box images of the object and positional information about the box images respectively from the plurality of frames, and detects reference characteristics of the box images from at least one of the plurality of frames, and

wherein, in response to determining by the second determiner that the database does not store the information about the object having the same reference characteristics as the detected reference characteristics of the box images, the data storage stores the reference characteristics of the box images and all the box images respectively detected from the plurality of frames in the database.

16. The re-wandering detecting device claim 14 , wherein the reference characteristics of the object comprise clothing characteristics, face characteristics, gait characteristics, or a combination thereof.

17. The re-wandering detecting device of claim 10 , wherein the input image is a motion picture comprising a plurality of frames,

wherein the object detector detects the object and positional information about the object from each of the plurality of frames, and

wherein the information provider comprises:

a first information provider, in response to determining by the first wandering determiner that the object wanders, configured to provide information about the wandering of the object by arranging all images of the object detected by the object detector in a single screen with reference to the positional information about the object; and

a second information provider, in response to determining by the re-wandering determiner that the object re-wanders, configured to provide information about the re-wandering of the object by selecting other images of the object stored in the database than the images provided by the first information provider and arranging the selected images in the single screen together with the information provided by the first information provider with reference to positional information about the object in the selected images.

18. The re-wandering detecting device of claim 17 , wherein the object detector detects box images of the object and positional information about the box images respectively from the plurality of frames,

wherein the database previously stores box images of a plurality of objects and positional information about the box images of the objects,

wherein the first information provider provides information about the wandering of the object by arranging all the box images of the object detected by the object detector in the single screen with reference to the positional information about the object in the box images, and

wherein the second information provider provides information about the re-wandering of the object by selecting other box images of the object stored in the database than the box images provided by the first information provider and arranging the selected box images in the single screen together with the information provided by the first information provider with reference to positional information about the object in the selected box images.

19. A method of detecting re-wandering, the method comprising:

detecting, by at least one processor, an object and positional information about the object from an input image;

determining, by the processor, whether the object wanders based on the positional information about the object;

in response to determining that the object wanders, determining whether the object re-wanders by determining whether a database stores information about an object identical to the object detected from the input image; and

providing, by the processor, information about wandering of the object according to whether the object re-wanders, wherein the input image is a motion picture comprising a plurality of frames,

wherein the detecting the object comprises detecting the object and positional information about the object from each of the plurality of frames, and

wherein, in the determining whether the object wanders, the object is determined as a wandering object if the object satisfies a preset wandering condition,

wherein the wandering condition is that at least one closed curve is formed by a path of the object calculated using the positional information about the object.

20. A method of detecting re-wandering, the method comprising:

detecting, by at least one processor, an object and positional information about the object from an input image;

determining, by the processor, whether the object wanders based on the positional information about the object;

in response to determining that the object wanders, determining whether the object re-wanders by determining whether a database stores information about an object identical to the object detected from the input image; and

providing, by the processor, information about wandering of the object according to whether the object re-wanders,

wherein the information is provided differently in accordance with a number of times of wandering by the object,

wherein the detecting the object comprises detecting the object and positional information about the object from each of a plurality of frames, and

wherein in response to determining that the object re-wanders, the providing the information comprises displaying images of the object detected in the detecting the object together with other images of the object stored in the database on a screen with reference to the positional information about the object.

Assignments (5)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2016
From: LEE, HWALSUK; YIN, SHIMIN; PARK, JUHYEONG
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 038294/0725 →
Priority Claims (1)
KR 10-2015-0101112 · Jul 16, 2015 · national
Continuity (1)
Related Publication 20170018091A1 · Jan 19, 2017