IP Library Granted Patent US 11,741,665
Granted Patent B2
US 11,741,665 · App. 16/832,049 · Granted Aug 29, 2023

Image processing apparatus and non-transitory computer readable medium storing image processing program

Inventors: Yuanyuan Cai (Kanagawa, JP); Makoto Sasaki (Kanagawa, JP)
Assignee: FUJIFILM Business Innovation Corp.
G06T15/30G06T7/187G06T7/194G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,741,665
App. No.
16/832,049
Granted
Aug 29, 2023
Kind
B2
Abstract

An image processing apparatus includes a processor configured to display boundaries each of which encloses a respective one of multiple candidate regions that correspond to foreground objects in an image, detect a single selecting operation, and extract a target region corresponding to one of the foreground objects from one or more candidate regions of the multiple candidate regions. The one or more candidate regions are selected by the single selecting operation.

Claims (61)

1. An image processing apparatus comprising:

a processor configured to:

display boundaries, each of which encloses a respective one of a plurality of candidate regions that correspond to foreground objects in an image, and each of the boundaries forming an enclosed boundary that corresponds to an object in the image;

detect a single selecting operation that is made on a side of at least one enclosed boundary, the selecting operation being a trace that overlaps the at least one enclosed boundary;

extract a target region corresponding to one of the foreground objects from one or more candidate regions of the plurality of candidate regions, the one or more candidate regions being selected by the single selecting operation and being enclosed by at least one enclosed boundary overlapping the trace;

set one or more seed points for a method of region growing at one or more points determined by using the trace and the boundaries;

clip an image corresponding to a foreground object out of the target region;

set the one or more seed points at one or more points corresponding to a background by using the trace and the boundaries;

clip an image corresponding to a foreground object out of the target region by excluding the background from the target region;

display rectangular boxes as the boundaries;

extract the one or more candidate regions enclosed by one or more of the rectangular boxes overlapping the trace; and

set the one or more seed points at one or more points included in each side of the rectangular boxes of the one or more candidate regions that are extracted.

2. The image processing apparatus according to claim 1 ,

wherein the processor is configured to:

set one of the one or more seed points at a mid-point of each side of the rectangular boxes.

3. The image processing apparatus according to claim 1 ,

wherein the processor is configured to:

set the one or more seed points at one or more pixels corresponding to each side of the rectangular boxes.

4. The image processing apparatus according to claim 1 ,

wherein the processor is configured to:

obtain color distributions of each of the rectangular boxes by using a Gaussian mixture model;

designate a color distribution histogram including pixels corresponding to four sides as a background color distribution; and

set the one or more seed points at one or more pixels having an average color of the background color distribution.

5. The image processing apparatus according to claim 1 ,

wherein the processor is configured to:

set the one or more seed points at one or more points that correspond to a foreground object and that are determined by using the trace and the boundaries; and

clip an image corresponding to the foreground object out of the target region.

6. The image processing apparatus according to claim 5 ,

wherein the processor is configured to:

extract the one or more candidate regions enclosed by one or more of the boundaries overlapping the trace; and

set one of the one or more seed points at each center of the boundaries of the one or more candidate regions that are extracted.

7. The image processing apparatus according to claim 1 ,

wherein the processor is further configured to:

reduce a size of the image; and

after the size of the image is reduced, the processor is further configured to:

extract a plurality of regions corresponding to the foreground objects from the image as the plurality of candidate regions;

obtain the boundaries;

restore the obtained boundaries to original sizes; and

execute display of the boundaries.

8. A non-transitory computer readable medium storing a program causing a computer to execute a process for image processing, the process comprising:

displaying boundaries, each of which encloses a respective one of a plurality of candidate regions that correspond to foreground objects in an image, and each of the boundaries forming an enclosed boundary that corresponds to an object in the image;

detecting a single selecting operation that is made on a side of at least one enclosed boundary, the selecting operation being a trace that overlaps the at least one enclosed boundary;

extracting a target region corresponding to one of the foreground objects from one or more candidate regions of the plurality of candidate regions, the one or more candidate regions being selected by the single selecting operation and being enclosed by at least one enclosed boundary overlapping the trace;

setting one or more seed points for a method of region growing at one or more points determined by using the trace and the boundaries;

clipping an image corresponding to a foreground object out of the target region;

setting the one or more seed points at one or more points corresponding to a background by using the trace and the boundaries;

clipping an image corresponding to a foreground object out of the target region by excluding the background from the target region;

displaying rectangular boxes as the boundaries;

extracting the one or more candidate regions enclosed by one or more of the rectangular boxes overlapping the trace; and

setting the one or more seed points at one or more points included in each side of the rectangular boxes of the one or more candidate regions that are extracted.

9. An image processing apparatus comprising:

means for displaying boundaries, each of which encloses a respective one of a plurality of candidate regions that correspond to foreground objects in an image, and each of the boundaries forming an enclosed boundary that corresponds to an object in the image;

means for detecting a single selecting operation that is made on a side of at least one enclosed boundary, the selecting operation being a trace that overlaps the at least one enclosed boundary;

means for extracting a target region corresponding to one of the foreground objects from one or more candidate regions of the plurality of candidate regions, the one or more candidate regions being selected by the single selecting operation and being enclosed by at least one enclosed boundary overlapping the trace;

means for setting one or more seed points for a method of region growing at one or more points determined by using the trace and the boundaries;

means for clipping an image corresponding to a foreground object out of the target region;

means for setting the one or more seed points at one or more points corresponding to a background by using the trace and the boundaries;

means for clipping an image corresponding to a foreground object out of the target region by excluding the background from the target region;

means for displaying rectangular boxes as the boundaries;

means for extracting the one or more candidate regions enclosed by one or more of the rectangular boxes overlapping the trace; and

means for setting the one or more seed points at one or more points included in each side of the rectangular boxes of the one or more candidate regions that are extracted.

Assignments (2)
CHANGE OF NAME Recorded Apr 28, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056078/0098 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2020
From: CAI, YUANYUAN; SASAKI, MAKOTO
To: FUJI XEROX CO., LTD.
Reel/Frame 052242/0875 →
Priority Claims (1)
JP 2019-170585 · Sep 19, 2019 · national
Continuity (1)
Related Publication 20210090324A1 · Mar 25, 2021