IP Library Granted Patent US 9,846,941
Granted Patent B2
US 9,846,941 · App. 14/667,530 · Granted Dec 19, 2017

Method for setting event rules and event monitoring apparatus using same

Inventors: Hee-yul Lee (Daegu, KR); Gwang-gook Lee (Seongnam-si, KR); Ki-mun Kim (Seongnam-si, KR)
Assignee: SK TELECOM CO., LTD.
G06T7/004G06K9/00771G06N5/025G06T7/246G06T2207/20021G06T2207/30196G06T2207/30232G06T2210/12G06T2210/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,846,941
App. No.
14/667,530
Granted
Dec 19, 2017
Kind
B2
Abstract

An event monitoring apparatus comprises a setting command input unit, an event rule generator, an image receiver, an object-of-interest tracker, an event determiner, and an event detection information generator.

Claims (50)

1. An event monitoring apparatus, comprising:

an event rule generator, implemented by one or more processors, configured to

set a boundary-of-interest based on a setting command input by a user operation through a setting command input unit,

set boundary reference values for determining a distance from the boundary-of-interest to object-of-interest and a sign value indicating whether the object-of-interest passes through the boundary-of-interest and

generate an event rule for detecting an event of the object-of-interest passing through the boundary-of-interest;

an image receiver, implemented by one or more processors, configured to receive at least one frame of captured images from an image capturer;

an object-of-interest tracker, implemented by one or more processors, configured to separate foreground pixels from pixels in the received frame by using background pixels designated by a predetermined criterion, and track the separated foreground pixels as the object-of-interest;

an event determiner, implemented by one or more processors, configured to check a distance and a sign value of the object-of-interest based on the boundary reference values, and determine whether the event has occurred or not by comparing the distance and the sign value with predetermined thresholds according to the event rule; and

an event detection information generator, implemented by one or more processors, configured to generate event detection information corresponding to the determined event, when the event determiner determines that the event has occurred.

2. The event monitoring apparatus of claim 1 ,

wherein the object-of-interest tracker is configured to separate the foreground pixels from the received frame by using the background pixels designated by a Gaussian model, and

wherein the foreground pixels are generated by using at least one of a mean, a variance and a weight of the pixels in the received frame.

3. The event monitoring apparatus of claim 2 , wherein the object-of-interest tracker is configured to

extract the object-of-interest by comparing at least one of color information, histogram and object shape of an object in motion between foreground images from a plurality of frames received from the image capturer, and

tracks the extracted object-of-interest.

4. The event monitoring apparatus of claim 1 , wherein, when the distance of the object-of-interest is greater than the predetermined threshold and the sign value of the object-of-interest is changed, the event determiner in configured to determine that the event has occurred.

5. The event monitoring apparatus of claim 1 , wherein the event rule generator comprises:

a boundary-of-interest setter configured to set the boundary-of-interest by using a line segment or a curve;

a boundary reference value setter configured to

set a predetermined distance value according to a distance from boundary-of-interest and a predetermined sign value with respect to the boundary-of-interest, and

generate the boundary reference values based on the predetermined distance value and the predetermined sign value; and

an event rule setter configured to set the event rule for detecting an event by using the boundary-of-interest and the boundary reference values, the event rule being set to determine the object-of-interest passing through the boundary-of-interest in a predetermined direction with respect to the boundary-of-interest as the event.

6. The event monitoring apparatus of claim 5 , wherein the boundary-of-interest setter is configured to set the boundary-of-interest by using at least one of a boundary line and a boundary region, the boundary line and the boundary region being set by (i) a touch of an interface for the frame or (ii) a coordinate value.

7. The event monitoring apparatus of claim 5 , wherein the boundary reference value setter is configured to

increase the predetermined distance value every time the distance with respect to the boundary-of-interest increases by a predetermined distance, and

set the predetermined sign value based on the boundary-of-interest.

8. The event monitoring apparatus of claim 7 , wherein the boundary reference value setter is configured to generate a distance-sign map for storing the distance and sign of the boundary-of-interest by using a plurality of the predetermined distance values and a plurality of the predetermined sign values.

9. The event monitoring apparatus of claim 1 , wherein the event detection information generator is configured to transmit the event detection information to a monitor unit, the monitor unit being configured to compute statistical information about the event by using the event detection information.

10. An event monitoring method performed by an event monitoring apparatus for setting event rules, the event monitoring apparatus including one or more processors to execute the method comprising:

setting a boundary-of-interest based on an inputted setting command;

setting boundary reference values for determining a distance from the boundary-of-interest to an object-of-interest and a sign value indicating whether the object-of-interest passes through the boundary-of-interest;

generating an event rule for detecting an event of an object-of-interest passing through the boundary-of-interest;

receiving at least one frame of captured images from an image capturer;

separating foreground pixels from pixels in the received frame by using background pixels designated by a predetermined criterion;

tracking the object-of-interest in the foreground pixels;

checking the distance and the sign value of the object-of-interest based on the boundary reference values;

comparing the distance and the sign value of the object-of-interest with predetermined thresholds according to the event rule; and

determining, when a distance value of the object-of-interest is greater than the predetermined threshold and the sign value of the object-of-interest is changed, that the event has occurred.

11. The method of claim 10 ,

wherein the boundary reference values comprises a predetermined distance value and a predetermined sign value,

wherein the predetermined distance value increases every time a distance from the boundary-of-interest increases by a predetermined distance, and

wherein the predetermined sign value is set to at least one of a positive sign and a negative sign with respect to the boundary-of-interest.

12. An event monitoring apparatus, comprising:

an image receiver, implemented by one or more processors, configured to receive at least one frame of captured images from an image capturer;

a setting command input unit, implemented by one or more processors, configured to receive a setting command input by a user operation;

a boundary-of-interest setter, implemented by one or more processors, configured to set a boundary region in at least one frame of the received images based on the setting command; and

an event rule generator, implemented by one or more processors, configured to

set boundary reference values including a distance and a sign value inside or outside the boundary region, and

generate an event rule for checking whether an object-of-interest in the frame crosses the boundary region.

13. The event monitoring apparatus of claim 12 , wherein the boundary-of-interest setter is configured to set the boundary region inside a closed curve including at least one line segment or at least one curve.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2015
From: LEE, HEE-YUL; LEE, GWANG-GOOK; KIM, KI-MUN
To: SK TELECOM CO., LTD.
Reel/Frame 035246/0178 →
Priority Claims (2)
KR 10-2012-0106799 · Sep 25, 2012 · national
KR 10-2012-0106801 · Sep 25, 2012 · national
Continuity (2)
Continuation PCTKR2013007612 · Aug 26, 2013
Related Publication 20150199810A1 · Jul 16, 2015