IP Library Granted Patent US 10,373,015
Granted Patent B2
US 10,373,015 · App. 15/000,359 · Granted Aug 6, 2019

System and method of detecting moving objects

Inventors: Youngmin Baek (Changwon-si, KR); Jikhan Jung (Changwon-si, KR); Jisung Kim (Changwon-si, KR)
Assignees: HANWHA TECHWIN CO., LTD.; HANWHA DEFENSE CO., LTD.; HANWHA PRECISION MACHINERY CO., LTD.
G06K9/6202G06T7/194G06T7/254G06T2207/20081G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,373,015
App. No.
15/000,359
Granted
Aug 6, 2019
Kind
B2
Abstract

Provided are a system and method of detecting moving objects. The system stores pixel information regarding each of pixels included in frames of the video in a storage, sets a background model comprising at least one background model element, the at least one background model element indicating at least one of a reference visual property and a reference usage time, determines whether the pixels are background pixels or foreground pixels by comparing the pixel information with the at least one background model element, and updating the background model based on a result of the comparing.

Claims (40)

1. A system for detecting a moving object in a video, the system comprising:

at least one memory configured to store pixel information regarding each of pixels included in frames of the video; and

at least one processor configured to implement:

a background model setting unit which sets a background model comprising at least one background model element, the at least one background model element indicating a reference visual property and a usage time;

a background pixel determining unit which determines whether the pixels are background pixels or foreground pixels by comparing pixel information of a first frame with the at least one background model element, and detects a moving object in the first frame based on pixels which are determined to be the foreground pixels according to the comparing; and

a background model updating unit which periodically updates the background model based on a result of the comparing,

wherein the background model updating unit

expands a range of the reference visual property to include a peripheral video property range when the compared pixel information corresponds to the peripheral video property range, the peripheral video property range representing a visual property range that does not belong to and is adjacent to the range of the reference visual property before the range of the reference visual property is expanded;

generates at least one background model element candidate comprising pixel information and usage time information of one of the foreground pixels which has a predetermined visual property; and

when a number of frames in which one of the at least one background model element candidate is used is greater than a predetermined number, updates the one of the at least one background model element candidate to one of the at least one background model element and deletes a background model element that has not been used for a longest time in the background model, and

wherein the background pixel determining unit detects a moving object in a second frame by comparing pixel information of the second frame with the expanded range of the reference visual property.

2. The system of claim 1 , wherein the background model updating unit deletes a background model element that has not been used at least for a predetermined time period in the background model.

3. The system of claim 1 , wherein the background model updating unit reduces the peripheral video property range included in the expanded range of the reference visual property by a predetermined rate when no pixels corresponding to the peripheral video property range are detected for a predetermined time period.

4. The system of claim 1 , wherein the background model updating unit updates the usage time in the at least one background model element according to the compared pixel information.

5. The system of claim 4 , wherein the usage time comprises:

a first time element which identifies a most recent frame in which a corresponding background model element is used,

a second time element which indicates a number of sequential frames in which the corresponding background model element is not used, and

a third time element which indicates a number of frames in which the corresponding background model element is used.

6. The system of claim 1 , wherein a number of the at least one background model element is greater than one, and

wherein a number of the at least one background model element candidate is smaller than the number of the at least one background model element.

7. The system of claim 1 , wherein the reference visual property indicates at least one of brightness, color, and grayscale.

8. A method of detecting a moving object in a video, the method comprising:

storing pixel information regarding each of pixels included in frames of the video in a storage;

setting a background model comprising at least one background model element, the at least one background model element indicating a reference visual property and a usage time;

determining whether the pixels are background pixels or foreground pixels by comparing pixel information of a first frame with the at least one background model element;

detecting a moving object in the first frame based on pixels which are determined to be the foreground pixels according to the comparing;

updating the background model based on a result of the comparing, wherein the updating comprises expanding a range of the reference visual property to include a peripheral video property range when the compared pixel information corresponds to the peripheral video property range, the peripheral video property range representing a visual property range that does not belong to and is adjacent to the range of the reference visual property before the range of the reference visual property is expanded;

generating at least one background model element candidate comprising pixel information and usage time information of one of the foreground pixels which has a predetermined visual property;

when a number of frames in which one of the at least one background model element candidate is used is greater than a predetermined number, updating the one of the at least one background model element candidate to one of the at least one background model element and deleting a background model element that has not been used for a longest time in the background model; and

detects a moving object in a second frame by comparing pixel information of the second frame with the expanded range of the reference visual property.

9. The method of claim 8 , wherein the updating comprises deleting a background model element that has not been used at least for a predetermined time period in the background model.

10. The method of claim 8 , wherein the updating comprises reducing the peripheral video property range included in the expanded range of the reference visual property by a predetermined rate when no pixels corresponding to the peripheral video property range are detected for a predetermined time period.

11. The method of claim 8 , wherein the updating comprises updating the usage time in the at least one background model element according to the compared pixel information.

12. The method of claim 11 , wherein the usage time comprises:

a first time element which identifies a most recent frame in which a corresponding background model element is used,

a second time element which indicates a number of sequential frames in which the corresponding background model element is not used, and

a third time element which indicates a number of frames in which the corresponding background model element is used.

13. The method of claim 8 , wherein a number of the at least one background model element is greater than one, and

wherein a number of the at least one background model element candidate is smaller than a number of the at least one background model element.

14. The method of claim 8 , wherein the reference visual property indicates at least one of brightness, color, and grayscale.

Assignments (10)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
MERGER Recorded Dec 23, 2022
From: HANWHA DEFENSE CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 062213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2020
From: HANWHA PRECISION MACHINERY CO., LTD.
To: HANWHA TECHWIN CO., LTD.; HANWHA DEFENSE CO., LTD.
Reel/Frame 054326/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049006/0133 →
PARTIAL ASSIGNMENT Recorded Apr 10, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA PRECISION MACHINERY CO., LTD
Reel/Frame 048853/0551 →
CHANGE OF NAME Recorded Feb 28, 2019
From: HANWHA LAND SYSTEMS CO., LTD.
To: HANWHA DEFENSE CO., LTD.
Reel/Frame 048473/0529 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2017
From: HANWHA TECHWIN CO., LTD.
To: HANWHA LAND SYSTEMS CO., LTD.; HANWHA TECHWIN CO., LTD.
Reel/Frame 043836/0851 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2016
From: BAEK, YOUNGMIN; JUNG, JIKHAN; KIM, JISUNG
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 037521/0485 →
Priority Claims (1)
KR 10-2015-0008767 · Jan 19, 2015 · national
Continuity (1)
Related Publication 20160210759A1 · Jul 21, 2016