IP Library › Granted Patent US 12,632,920
Granted Patent B2
US 12,632,920 · App. 18/325,015 · Granted May 19, 2026

Image processing apparatus, method, and program for smoothing boundary of segmented region

Inventor: Satoshi Ihara (Tokyo, JP)
Assignee: FUJIFILM Corporation
G06T3/4007G06T7/11G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,632,920
App. No.
18/325,015
Granted
May 19, 2026
Kind
B2
Abstract

A processor is configured to convert a size of a target image to derive a size-converted image, segment the size-converted image into regions of at least one class by using a segmentation model constructed by machine-learning a neural network to derive a plurality of class images in which a pixel value of each pixel represents class-likeness for the at least one class, convert a size of at least one class image into the size of the target image to derive at least one converted class image, and segment the target image based on a pixel value in each pixel of the at least one converted class image.

Claims (26)

1 . An image processing apparatus comprising:

at least one processor, configured to:

convert a size of a target image to derive a size-converted image;

segment the size-converted image into regions of at least one class by using a segmentation model constructed by machine-learning a neural network to derive a plurality of class images in which a pixel value of each pixel represents class-likeness for the at least one class;

convert a size of at least one class image into the size of the target image to derive at least one converted class image; and

segment the target image based on a pixel value in each pixel of the at least one converted class image.

2 . The image processing apparatus according to claim 1 ,

wherein the size conversion is enlargement, reduction, or normalization in at least one direction in which pixels are arranged in the target image.

3 . The image processing apparatus according to claim 1 ,

wherein the pixel value of the class image is a score, which is derived by the neural network and represents a probability of being in the at least one class.

4 . The image processing apparatus according to claim 1 ,

wherein the at least one processor is configured to convert the size of the class image into the size of the target image through an interpolation calculation.

5 . The image processing apparatus according to claim 1 ,

wherein the at least one processor is configured to derive argmax of a pixel value of a corresponding pixel in the at least one converted class image to segment the target image.

6 . The image processing apparatus according to claim 1 ,

wherein the at least one processor is configured to sequentially perform derivation of the converted class image and segmentation of the target image for each class.

7 . An image processing method implemented by an image processing apparatus having at least one processor, the method comprising:

converting, by the at least one processor, a size of a target image to derive a size-converted image;

segmenting, by the at least one processor, the size-converted image into regions of at least one class by using a segmentation model constructed by machine-learning a neural network to derive a plurality of class images in which a pixel value of each pixel represents class-likeness for the at least one class;

converting, by the at least one processor, a size of at least one class image into the size of the target image to derive at least one converted class image; and

segmenting, by the at least one processor, the target image based on a pixel value in each pixel of the at least one converted class image.

8 . A non-transitory computer-readable storage medium that stores an image processing program causing a computer having at least one processor to execute:

a procedure of converting, by the at least one processor, a size of a target image to derive a size-converted image;

a procedure of segmenting, by the at least one processor, the size-converted image into regions of at least one class by using a segmentation model constructed by machine-learning a neural network to derive a plurality of class images in which a pixel value of each pixel represents class-likeness for the at least one class;

a procedure of converting, by the at least one processor, a size of at least one class image into the size of the target image to derive at least one converted class image; and

a procedure of segmenting, by the at least one processor, the target image based on a pixel value in each pixel of the at least one converted class image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2023
From: IHARA, SATOSHI
To: FUJIFILM CORPORATION
Reel/Frame 063786/0885 →
Priority Claims (1)
JP 2020-217837 · Dec 25, 2020 · national
Continuity (2)
Continuation PCTJP2021042481 · Nov 18, 2021
Related Publication 20230306556A1 · Sep 28, 2023
References Cited (54)
US 8031914B2 · Zhang · 2011 [cited by examiner]
US 10304193B1 · Wang · 2019 [cited by examiner]
US 10937178B1 · Srinivasan · 2021 [cited by examiner]
US 11403776B2 · Sadeghi · 2022 [cited by examiner]
US 11410388B1 · Taghavi · 2022 [cited by examiner]
US 11423563B2 · Duggal · 2022 [cited by examiner]
US 11810388B1 · Wang · 2023 [cited by examiner]
US 12020437B2 · Cha · 2024 [cited by examiner]
US 20170200067A1 · Zhou · 2017 [cited by examiner]
US 20170287137A1 · Lin · 2017 [cited by examiner]
US 20180218527A1 · Kunieda · 2018 [cited by examiner]
US 20180232887A1 · Lin · 2018 [cited by examiner]
US 20190147582A1 · Lee · 2019 [cited by examiner]
US 20190197723A1 · Tanaka · 2019 [cited by examiner]
US 20190239926A1 · Pavlovskaia · 2019 [cited by examiner]
US 20190347804A1 · Kim · 2019 [cited by examiner]
US 20200125887A1 · Nishii · 2020 [cited by examiner]
US 20200175700A1 · Zhang · 2020 [cited by examiner]
US 20200218948A1 · Mao · 2020 [cited by examiner]
US 20200218961A1 · Kanazawa · 2020 [cited by examiner]
US 20200234447A1 · Karmatha · 2020 [cited by examiner]
US 20200258234A1 · Wu · 2020 [cited by examiner]
US 20200387698A1 · Yi · 2020 [cited by examiner]
US 20210035277A1 · Ishikawa · 2021 [cited by examiner]
US 20210035342A1 · Glaser · 2021 [cited by examiner]
US 20210049397A1 · Chen · 2021 [cited by examiner]
US 20210081681A1 · Chiba · 2021 [cited by examiner]
US 20210084290A1 · Cho · 2021 [cited by examiner]
US 20210150410A1 · Liang · 2021 [cited by examiner]
US 20210182612A1 · Zeng · 2021 [cited by examiner]
US 20210326638A1 · Lee · 2021 [cited by examiner]
US 20210370993A1 · Qian · 2021 [cited by examiner]
US 20220068017A1 · Lee · 2022 [cited by examiner]
US 20220092291A1 · Lai · 2022 [cited by examiner]
US 20220172369A1 · Tang · 2022 [cited by examiner]
US 20220188554A1 · Huang · 2022 [cited by examiner]
US 20220375090A1 · Hwang · 2022 [cited by examiner]
US 20230033177A1 · Goel · 2023 [cited by examiner]
US 20230141734A1 · Zhou · 2023 [cited by examiner]
US 20230419682A1 · Lee · 2023 [cited by examiner]
US 20240071033A1 · Lee · 2024 [cited by examiner]
US 20240265681A1 · Chavez Cortes · 2024 [cited by examiner]
US 20240331114A1 · Zhou · 2024 [cited by examiner]
US 20250008230A1 · Liu · 2025 [cited by examiner]
US 20250139743A1 · Kim · 2025 [cited by examiner]
JP 2019211900 · 2019 [cited by applicant]
JP 2020038574 · 2020 [cited by applicant]
JP 2020119568 · 2020 [cited by applicant]
JP 2020528176 · 2020 [cited by applicant]
WO WO2016035338A1 · 2016 [cited by examiner]
“International Search Report (Form PCT/ISA/210) of PCT/JP2021/042481”, mailed on Feb. 1, 2022, with English translation thereof, pp. 1-5. [cited by applicant]
“Written Opinion of the International Searching Authority (Form PCT/ISA/237) of PCT/JP2021/042481”, mailed on Feb. 1, 2022, with English translation thereof, pp. 1-8. [cited by applicant]
“Notice of Reasons for Refusal of Japan Counterpart Application”, issued on Oct. 21, 2025, with English translation thereof, p. 1-p. 6. [cited by applicant]
“Decsion of Refusal of Japan Counterpart Application”, issued on Feb. 17, 2026, with English translation thereof, p. 1-p. 5. [cited by applicant]