IP Library › Granted Patent US 10,062,170
Granted Patent B2
US 10,062,170 · App. 15/230,297 · Granted Aug 28, 2018

Apparatus and method for extracting object

Inventor: Jae-Hwan Kim (Daejeon, KR)
Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
G06T7/0042G06K9/00G06K9/4652G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,062,170
App. No.
15/230,297
Granted
Aug 28, 2018
Kind
B2
Abstract

According to one general aspect, an apparatus for extracting an object includes an image receiver configured to receive an image; a coupled saliency-map generator configured to generate a coupled saliency-map which is the sum of the product of a global saliency-map of the image and a predetermined weight value and a local saliency-map; an adaptive tri-map generator configured to generate an adaptive tri-map corresponding to the coupled saliency-map; an alpha matte generator configured to generate an alpha matte based on the adaptive tri-map; and an object detector configured to extract an object according to transparency of the alpha matte to generate an object image.

Claims (23)

1. An apparatus for extracting an object comprising:

an image receiver configured to receive an image;

a coupled saliency-map generator configured to generate a coupled saliency-map which is the sum of the product of a global saliency-map of the image and a predetermined weight value and a local saliency-map, wherein the local saliency-map is a saliency-map including pixels representing Euclidean distance between a mean color vector of each pixel of the image and a vector generated through Gaussian blur treatment for the image, and wherein the global saliency-map is a saliency-map defined based on space and color of regions which are segmented to each component after representing the image in a Gaussian mixture model composed of a plurality of components;

an adaptive tri-map generator configured to generate an adaptive tri-map corresponding to the coupled saliency-map, wherein the adaptive tri-map generator generates a tri-map from the coupled saliency-map through Gaussian blur and image clustering, selects a pixel, of which distance is the least to any one of mean color values of foreground region, background region and unknown region of the tri-map among pixels of the coupled saliency-map, as the shortest distance pixel, and generates the adaptive tri-map by replacing a pixel value of the tri-map, corresponding to the shortest distance pixel and a pixel adjacent to the shortest distance pixel, as a mean color value of the foreground region when the shortest distance pixel is identical to the mean color value of the foreground region and is located within the unknown region of the tri-map;

an alpha matte generator configured to generate, using a preconditioned conjugate gradient method, an alpha matte based on the adaptive tri-map; and

an object detector configured to extract an object according to transparency of the alpha matte to generate an object image.

2. The apparatus of claim 1 , wherein the alpha matte generator generates the alpha matte through a parallel processing using General-Purpose computing on Graphics Processing Unit (GPGPU).

3. The apparatus of claim 1 , further comprising:

an output interface configured to show extraction result of the object; and

an input interface configured to receive a tri-map correction input which requests for correcting the adaptive tri-map from a user,

wherein the adaptive tri-map generator corrects the adaptive tri-map based on the tri-map correction input.

4. A method for extracting an object using an apparatus for extracting an object from an image, the method comprising:

receiving the image;

generating a coupled saliency-map which is the sum of the product of a global saliency-map of the image and a predetermined weight value and a local saliency-map, wherein the local saliency-map is a saliency-map including pixels representing Euclidean distance between a mean color vector of each pixel of the image and a vector generated through Gaussian blur treatment for the image, and wherein the global saliency-map is a saliency-map defined based on space and color of regions which are segmented to each component after representing the image in a Gaussian mixture model composed of a plurality of components;

generating an adaptive tri-map corresponding to the coupled saliency-map, wherein generating the adaptive tri-map comprises generating a tri-map from the coupled saliency-map through Gaussian blur and image clustering, selecting a pixel, of which distance is the least to any one of mean color values of foreground region, background region and unknown region of the tri-map among pixels of the coupled saliency-map, as the shortest distance pixel, and generating the adaptive tri-map by replacing a pixel value of the tri-map, corresponding to the shortest distance pixel and a pixel adjacent to the shortest distance pixel, as a mean color value of the foreground region when the shortest distance pixel is identical to the mean color value of the foreground region and is located within the unknown region of the tri-map;

generating an alpha matte based on the adaptive tri-map using a preconditioned conjugate gradient method; and

extracting an object according to transparency of the alpha matte to generate an object image.

5. The method of claim 4 , wherein the generating an alpha matte based on the adaptive tri-map comprises generating the alpha matte through a parallel processing using General-Purpose computing on Graphics Processing Unit (GPGPU).

6. The method of claim 4 , further comprising:

showing extraction result of the object;

receiving a tri-map correction input which requests for correcting the adaptive tri-map from a user;

correcting the adaptive tri-map according to the tri-map correction input; and

generating an object image according to the corrected adaptive tri-map.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2016
From: KIM, JAE-HWAN
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 039371/0636 →
Priority Claims (1)
KR 10-2016-0034078 · Mar 22, 2016 · national
Continuity (1)
Related Publication 20170278246A1 · Sep 28, 2017