IP Library Granted Patent US 9,740,941
Granted Patent B2
US 9,740,941 · App. 14/702,860 · Granted Aug 22, 2017

Apparatus and method for visualizing loitering objects

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,740,941
App. No.
14/702,860
Granted
Aug 22, 2017
Kind
B2
Abstract

A method for visualizing loitering objects includes: detecting at least one object determined to have been in a selected area of an input image for a preset time period; obtaining representative still images of each of the detected at least one object in respective time periods during the preset time period; and displaying the representative still images in a time order, or generating a video summary in which images of each of the detected at least one object, respectively included in the representative still images, are displayed together on a single image with indication of the time order.

Claims (41)

1. A method of visualizing loitering objects, the method comprising:

detecting at least one object determined to have been in a selected area of an input image for a preset time period;

obtaining representative still images of each of the detected at least one object in respective time periods during the preset time period; and

displaying the representative still images in a time order in a screen, and generating a video summary in which images of each of the detected at least one object, respectively included in the representative still images, are displayed together on a single image in another screen,

wherein the generating the video summary comprises displaying a moving trajectory indicating a path of the object by using the representative still images obtained in respective time periods with respect to the object,

wherein the displaying the representative still images comprises displaying, in the time order, the representative still images along with time information which respectively indicates time points when the representative still images are captured by a camera, and

wherein the generating the video summary comprises displaying the video summary in which the representative still images along with time information which respectively indicates time points when the representative still images are captured by a camera are displayed, the representative still images along with time information displayed in the video summary in another screen being the same as the representative still images along with time information displayed in the time order in the screen.

2. The method of claim 1 , further comprising assigning an identifier to each of the detected at least one object,

wherein the identifier is displayed along with each of the detected at least one object on the representative still images or on the single image of the video summary.

3. The method of claim 2 , further comprising tracking a path of each of the detected at least one object to which the identifier is assigned,

wherein the obtaining the representative still images is performed while tracking the path of each of the at least one object.

4. The method of claim 1 , further comprising assigning an identifier to each of the detected at least one object,

wherein the identifier is displayed along with each of the detected at least one object on the representative still images.

5. The method of claim 1 ,

wherein the generating the video summary comprises tracking a path of each of the detected at least one object in the time order, and indicating the path on the single image.

6. The method of claim 5 , further comprising assigning an identifier to each of the detected at least one object, and indicating the identifier on the single image.

7. The method of claim 1 ,

wherein, in the generating the video summary, the images of each of the detected at least one object respectively included in the representative still images are displayed on the single image with indication of the time order.

8. The method of claim 1 , wherein each of the representative still images displays at least one of a front view, a side view, and a rear view of each of the at least one object.

9. The method of claim 1 , wherein the detected at least one object is at least one object which has appeared more than a predetermined number of times in the selected area for the preset time period.

10. An apparatus for visualizing loitering objects, the apparatus comprising at least one processor to implement:

an object detector configured to detect at least one object determined to have been in a selected area of an input image for a preset time period;

an image obtainer configured to obtain representative still images of each of the detected at least one object in respective time periods during the preset time period; and

a loitering visualizer configured to display the representative still images in a time order in a screen, and generate a video summary in which images of each of the detected at least one object, respectively included in the representative still images, are displayed together on a single image with indication of the time order in another screen,

wherein the loitering visualizer displays a moving trajectory indicating a path of the object by using the representative still images obtained in respective time periods with respect to the object,

wherein the loitering visualizer displays, in the time order, the representative still images along with time information which respectively indicates time points when the representative still images are captured by a camera, and

wherein the loitering visualizer displays the video summary in which the representative still images along with time information which respectively indicates time points when the representative still images are captured by a camera are displayed, the representative still images along with time information displayed in the video summary in another screen being the same as the representative still images along with time information displayed in the time order in the screen.

11. The apparatus of claim 10 , further comprising an object identifier configured to assign an identifier to each of the detected at least one object,

wherein the loitering visualizer is further configured to display the identifier along with each of the detected at least one object on the representative still images or on the single image of the video summary.

12. The apparatus of claim 11 , further comprising a path tracker configured to track a path of each of the detected at least one object to which the identifier is assigned,

wherein the image obtainer is configured to obtain the representative still images while the path tracker tracks a path of each of the at least one object.

13. The apparatus of claim 10 , further comprising an object identifier configured to assign an identifier to each of the detected at least one object,

wherein the loitering visualizer is further configured to display the identifier along with each of the detected at least one object on the representative still images.

14. The apparatus of claim 10 ,

wherein the loitering visualizer is further configured to track a path of each of the detected at least one object in the time order, and indicate the path on the single image.

15. The apparatus of claim 14 , further comprising an object identifier configured to assign an identifier to each of the detected at least one object,

wherein the loitering visualizer is further configured to indicate the identifier on the single image.

16. The apparatus of claim 10 ,

wherein, in the generating the video summary, the loitering visualizer is configured to display indication of the time order along with the images of each of the detected at least one object on the single image.

17. The apparatus of claim 10 , wherein each of the representative still images displays at least one of a front view, a side view, and a rear view of each of the at least one object.

18. The apparatus of claim 9 , wherein the detected at least one object is at least one object which has appeared more than a predetermined number of times in the selected area of the input image for the preset time period.

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 30, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036233/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2015
From: BAE, SOONMIN; SONG, MOOKYUNG
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 035554/0464 →