IP Library Granted Patent US 10,089,746
Granted Patent B2
US 10,089,746 · App. 14/282,213 · Granted Oct 2, 2018

Motion detection system and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,089,746
App. No.
14/282,213
Granted
Oct 2, 2018
Kind
B2
Abstract

Provided are a motion detection system and method. The motion detection system includes a pixel-based detector configured to compare a previous frame and a present frame to extract pixel constituting a first foreground region, a region-based detector configured to extract a second foreground region based on peripheral pixels of a pixel to be inspected, and a motion determiner configured to detect, as a final motion region among pixel groups of the first foreground region, a pixel group comprising pixels corresponding to the second foreground region.

Claims (48)

1. A motion detection system comprising a processor, the processor implementing:

a pixel-based detector that compares a previous frame and a present frame to extract pixels constituting a first foreground region;

a region-based detector that determines a peripheral region centering around a pixel to be inspected, obtains a peripheral upper limit luminance and a peripheral lower limit luminance in accordance with a maximum luminance and a minimum luminance in the peripheral region, and extracts a second foreground region based on comparison of a luminance of the pixel to be inspected to the peripheral upper limit luminance and the peripheral lower limit luminance; and

a motion determiner that detects a final motion region that comprises pixels belonging to both the first foreground region and the second foreground region,

wherein the region-based detector extracts the second foreground region independently from an extracting of the pixel-based detector before the motion determiner detects the final motion region,

wherein the first foreground region comprises a plurality of pixel groups, and the final motion region comprises pixels included in one of the plurality of pixel groups of the first foreground region, the one of the plurality of pixel groups of the first foreground region overlapping with the second foreground region,

wherein the pixel-based detector comprises:

a first foreground detector that detects the first foreground region by using a background difference image technique; and

a labeler that groups pixels which are adjacent to each other among the pixels constituting the first foreground region into a plurality of pixel groups and assign an identification number to each of the plurality of pixel group.

2. The motion detection system of claim 1 , wherein the motion determiner selects the pixel group among the plurality of pixel groups of the first foreground region based on an identification number and determines whether pixels corresponding to the second foreground region are included in the selected pixel group.

3. The motion detection system of claim 2 , wherein the pixel groups of the first foreground region comprise at least one pixel group in which adjacent pixels of the first foreground region are grouped and assigned an identification number.

4. The motion detection system of claim 2 , wherein the motion determiner removes a pixel group among the plurality of pixel groups of the first foreground region not comprising pixels corresponding to the second foreground region from the final motion region.

5. The motion detection system of claim 1 , wherein the pixel-based detector further comprises:

a noise remover that removes noise formed by a pixel group in which a number of pixels is equal to or less than a reference number, among the plurality of pixel groups, by applying a filter to the first foreground region; and

an expander that expands a size of a foreground of the first foreground region through morphology dilation.

6. The motion detection system of claim 1 ,

wherein in response to a value of the luminance of the pixel to be inspected being between the peripheral upper limit luminance and the peripheral lower limit luminance, the pixel to be inspected is determined to be a background pixel, and

wherein in response to the value of the luminance of the pixel to be inspected exceeding a threshold value, the pixel to be inspected is determined to be a pixel of the second foreground region.

7. A motion detection method comprising:

determining a first foreground region that comprises pixels extracted from an image by comparing a previous frame and a present frame of the image;

determining a peripheral region centering around a pixel to be inspected;

obtaining a peripheral upper limit luminance and a peripheral lower limit luminance in accordance with a maximum luminance and a minimum luminance in the peripheral region;

extracting a second foreground region based on comparison of a luminance of the pixel to be inspected to the peripheral upper limit luminance and the peripheral lower limit luminance; and

detecting a final motion region that comprises pixels belonging to both the first foreground region and the second foreground region,

wherein the extracting comprises extracting the second foreground region independently from the determining of the first foreground region before the detecting of the final motion region, and

wherein the first foreground region comprises a plurality of pixel groups, and the final motion region comprises pixels included in one of the plurality of pixel groups of the first foreground region, the one of the plurality of pixel groups of the first foreground region overlapping with the second foreground region,

wherein the determining the first foreground region comprises:

detecting the first foreground region using a background difference image technique, and

grouping pixels which are adjacent to each other among the pixels constituting the first foreground region into a plurality of pixel groups and assigning an identification number to each of the plurality of pixel groups.

8. The motion detection method of claim 7 , wherein the detecting of the final motion region comprises selecting the pixel group among the plurality of pixel groups of the first foreground region based on an identification number, and determining whether pixels corresponding to the second foreground region are included in the selected pixel group.

9. The motion detection method of claim 8 , wherein the pixel groups of the first foreground region are configured as at least one pixel group in which adjacent pixels of the first foreground region are grouped and assigned an identification number.

10. The motion detection method of claim 8 , wherein the detecting of the pixel group comprises removing a pixel group among the pixel groups of the first foreground region not comprising pixels corresponding to the second foreground region from the final motion region.

11. The motion detection method of claim 7 , wherein the determining the first foreground region further comprises:

removing noise formed by a pixel group in which a number of pixels is equal to or less than a reference number, among the plurality of pixel groups, by applying a filter to the first foreground region, and

expanding a size of a foreground of the first foreground region through morphology dilation.

12. The motion detection method of claim 7 , wherein the extracting the second foreground region comprises, determining the pixel to be inspected as a background pixel in response to a value of the luminance of the pixel to be inspected being between the peripheral upper limit luminance and the peripheral lower limit luminance, and determining the pixel to be inspected as a pixel of the second foreground region in response to the value of the luminance of the pixel to be inspected exceeding a threshold value.

13. A non-transitory computer readable medium having recorded thereon a program, which when executed by a computer, causes the computer to execute a method comprising:

determining a first foreground region that comprises pixels extracted from an image by comparing a previous frame and a present frame of the image;

determining a peripheral region centering around a pixel to be inspected;

obtaining a peripheral upper limit luminance and a peripheral lower limit luminance in accordance with a maximum luminance and a minimum luminance in the peripheral region;

extracting a second foreground region based on comparison of a luminance of the pixel to be inspected to the peripheral upper limit luminance and the peripheral lower limit luminance; and

detecting a final motion region that comprises pixels belonging to both the first foreground region and the second foreground region,

wherein the extracting comprises extracting the second foreground region independently from the determining of the first foreground region before the detecting of the final motion region,

wherein the first foreground region comprises a plurality of pixel groups, and the final motion region comprises pixels included in one of the plurality of pixel groups of the first foreground region, the one of the plurality of pixel groups of the first foreground region overlapping with the second foreground region, and

wherein the determining the first foreground region comprises:

detecting the first foreground region using a background difference image technique, and

grouping pixels which are adjacent to each other among the pixels constituting the first foreground region into a plurality of pixel groups and assigning an identification number to each of the plurality of pixel groups.

14. The non-transitory computer readable medium of claim 13 , wherein the comparing the previous frame and the present frame comprises using a background difference image technique.

Assignments (11)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
MERGER Recorded Dec 23, 2022
From: HANWHA DEFENSE CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 062213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2020
From: HANWHA PRECISION MACHINERY CO., LTD.
To: HANWHA TECHWIN CO., LTD.; HANWHA DEFENSE CO., LTD.
Reel/Frame 054326/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049006/0133 →
PARTIAL ASSIGNMENT Recorded Apr 10, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA PRECISION MACHINERY CO., LTD
Reel/Frame 048853/0551 →
CHANGE OF NAME Recorded Feb 28, 2019
From: HANWHA LAND SYSTEMS CO., LTD.
To: HANWHA DEFENSE CO., LTD.
Reel/Frame 048473/0529 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2017
From: HANWHA TECHWIN CO., LTD.
To: HANWHA LAND SYSTEMS CO., LTD.; HANWHA TECHWIN CO., LTD.
Reel/Frame 043836/0851 →
CHANGE OF NAME Recorded Jul 30, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036233/0327 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2014
From: BAEK, YOUNG-MIN; LIM, JEONG-EUN; JUNG, JIK-HAN; KIM, JI-SUNG
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 032961/0626 →