IP Library Granted Patent US 9,972,094
Granted Patent B2
US 9,972,094 · App. 15/152,969 · Granted May 15, 2018

Foreground extracting method and apparatus

Inventors: ShiMin Yin (Changwon-si, KR); YeonGeol Ryu (Changwon-si, KR)
Assignee: Hanwha Techwin Co., Ltd.
G06T7/0083G06T2207/20144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,972,094
App. No.
15/152,969
Granted
May 15, 2018
Kind
B2
Abstract

A foreground extracting method is provided. The foreground extracting method includes: generating a plurality of sampling images; detecting contours from the sampling images to generate a plurality of contour images including a current frame and a previous frame; comparing first positions of a first plurality of pixels in a first decision-making area of the current frame with second positions of a second plurality of pixels in a second decision-making area of the previous frame; determining directions from the second positions to the first positions and distances between the first positions and the second positions; excluding, from the first decision-making area, at least one pixel of the first plurality of pixels in response to the distance of the at least one pixel being less than or equal to a preset critical magnitude.

Claims (31)

1. A foreground extracting method comprising:

sampling an input image at a plurality of different resolutions to generate a plurality of sampling images;

detecting contours respectively from the sampling images to generate a plurality of contour images comprising a current frame and a previous frame that precedes the current frame by a preset interval;

comparing first positions of a first plurality of pixels in a first decision-making area of the current frame with second positions of a second plurality of pixels in a second decision-making area of the previous frame;

determining directions from the second positions to the first positions and distances between the first positions and the second positions;

excluding, from the first decision-making area, at least one pixel of the second plurality of pixels in response to the distance of the at least one pixel being less than or equal to a preset critical magnitude; and

setting the first decision-making area having a highest resolution as a foreground area

wherein the preset interval decreases as a resolution of the current frame increase.

2. The foreground extracting method of claim 1 , wherein the input image is a motion picture comprising a plurality of frames, and the plurality of frames comprises the current frame and the previous frame,

the comparing and the determining are repeated while sequentially increasing resolution from a lowest resolution to the highest resolution, and

the first decision-making area encompasses an entire area of the current frame when the current frame has the lowest resolution.

3. The foreground extracting method of claim 1 , wherein the preset interval is inversely proportional to the resolution of the current frame.

4. The foreground extracting method of claim 1 , further comprising extracting a foreground by calculating motion paths of pixels included in the foreground area based on the directions and the distances and selecting at least one of the pixels in the foreground area as pixels of the foreground in response to the motion path of the at least one pixel satisfying a preset condition.

5. The foreground extracting method of claim 4 , wherein the preset condition is satisfied in response to a length of the motion path of the at least one pixel being greater than or equal to preset critical length.

6. The foreground extracting method of claim 4 , wherein the preset condition is satisfied in response to differences between motion directions of the pixels in the foreground area being less than or equal to a preset critical angle.

7. A non-transitory computer-readable storage medium storing a computer program to execute the foreground extracting method of claims 1 .

8. A foreground extracting apparatus comprising at least one processor to implement:

a sampling image generator configured to sample an input image at a plurality of different resolutions to generate a plurality of sampling images;

a contour image generator configured to detect contours respectively from the sampling images to generate a plurality of contour images comprising a current frame and a previous frame that precedes the current frame by a preset interval;

a calculator configured to compare first positions of a first plurality of pixels in a first decision-making area of the current frame with second positions of a second plurality pixels in a second decision-making area of the previous and determine directions from the second positions to the first positions and distances between the first positions and the second positions;

a decision-making area manager configured to exclude, from the first decision-making area, at least one pixel of the second plurality of pixels in response to the distance of the at least one pixel being less than or equal to a preset critical magnitude; and

a foreground area setting unit configured to set the first decision-making area having a highest resolution as a foreground area,

wherein the preset interval set decreases as the resolution of the current frame increases.

9. The foreground extracting apparatus of claim 8 , wherein the input image is a motion picture comprising a plurality of frames, and the plurality of frames comprises the current frame and the previous frame,

the calculator is further configured to repeat the comparing and the determining while sequentially increasing resolution from a lowest resolution to the highest resolution, and

the first decision-making area encompasses an entire area of the current frame when the current frame has the lowest resolution.

10. The foreground extracting apparatus of claim 8 , wherein the preset interval is inversely proportional to the resolution of the current frame.

11. The foreground extracting apparatus of claim 8 , further comprising a foreground extractor configured to extract a foreground by calculating motion paths of pixels included in the foreground area based on the directions and the distances and selecting at least one of the pixels as pixels of the foreground in response to the motion path of the at least one pixel satisfying a preset condition,

wherein the foreground extractor is implemented by the at least one processor.

12. The foreground extracting apparatus of claim 11 , wherein the preset condition is satisfied in response to a length of the motion path of the at least one pixel being greater than or equal to a preset critical length.

13. The foreground extracting apparatus of claim 11 , wherein the preset condition is satisfied in response to differences between motion directions of the pixels in the foreground area being less than or equal to a preset critical angle.

Assignments (7)
PARTIAL ASSIGNMENT Recorded Dec 6, 2023
From: HANWHA CO., LTD.
To: HANWHA ROBOTICS CORPORATION
Reel/Frame 065790/0865 →
PARTIAL ASSIGNMENT Recorded Nov 4, 2020
From: HANWHA PRECISION MACHINERY CO., LTD.
To: HANWHA CO., LTD.
Reel/Frame 054308/0056 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049005/0770 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA PRECISION MACHINERY CO., LTD.; HANWHA AEROSPACE CO., LTD.
Reel/Frame 048849/0310 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2016
From: YIN, SHIMIN; RYU, YEONGEOL
To: HANWHA TECHWIN CO., LTD
Reel/Frame 038565/0252 →
Priority Claims (1)
KR 10-2015-0129779 · Sep 14, 2015 · national
Continuity (1)
Related Publication 20170076171A1 · Mar 16, 2017