IP Library › Granted Patent US 12,333,718
Granted Patent B2
US 12,333,718 · App. 17/955,810 · Granted Jun 17, 2025

Method for generating model by recognizing cross-section regions in units of pixels

Inventors: Yuki Sakaguchi (Isehara, JP); Yusuke Seki (Tokyo, JP); Akira Iguchi (Mishima, JP)
Assignee: TERUMO KABUSHIKI KAISHA
G06T7/0012G06T7/62G06T2207/10101G06T2207/10132G06T2207/20081G06T2207/30101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,718
App. No.
17/955,810
Granted
Jun 17, 2025
Kind
B2
Abstract

A computer is caused to perform processing of: acquiring a plurality of medical images generated based on signals detected by a catheter inserted into a lumen organ while the catheter is moving a sensor along a longitudinal direction of the lumen organ, the lumen organ including a main trunk, a side branch branched from the main trunk, and a bifurcated portion of the main trunk and the side branch; and recognizing a main trunk cross-section, a side branch cross-section, and a bifurcated portion cross-section by inputting the acquired medical images into a learning model configured to recognize the main trunk cross-section, the side branch cross-section, and the bifurcated portion cross-section.

Claims (41)

1. A non-transitory computer-readable storage medium storing a computer program which, when executed by a computer of a diagnostic imaging apparatus, causes the computer to perform processing of:

acquiring a plurality of medical images generated based on signals detected by a catheter inserted into a lumen organ while the catheter is moving a sensor along a longitudinal direction of the lumen organ, the lumen organ including a main trunk, a side branch branched from the main trunk, and a bifurcated portion of the main trunk and the side branch; and

recognizing, in units of pixels in the plurality of medical images, a main trunk cross-section region, a side branch cross-section region, and a bifurcated portion cross-section region by inputting the acquired medical images into a learning model configured to recognize the main trunk cross-section region, the side branch cross-section region, and the bifurcated portion cross-section region in units of pixels in the plurality of medical images.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein the processing further comprises:

recognizing at least the main trunk cross-section region or the side branch cross-section region by inputting an acquired first medical image into the learning model;

recognizing the bifurcated portion cross-section region by inputting an acquired second medical image into the learning model; and

discriminating between a main trunk portion and a side branch portion constituting the bifurcated portion cross-section region based on a recognition result based on the first medical image.

3. The non-transitory computer-readable storage medium according to claim 2 , wherein the processing further comprises:

specifying a bifurcating structure of the main trunk and the side branch based on a recognition result based on a plurality of first medical images; and

specifying the main trunk portion and the side branch portion included in the bifurcated portion cross-section region based on the specified bifurcating structure.

4. The non-transitory computer-readable storage medium according to claim 3 ,

wherein the learning model is configured to recognize a plaque formed in the bifurcated portion, and

the processing further comprises:

recognizing the bifurcated portion cross-section region and the plaque by inputting the acquired second medical image into the learning model; and

specifying a plaque portion included in the bifurcated portion cross-section region based on the bifurcating structure.

5. The non-transitory computer-readable storage medium according to claim 2 , wherein the processing further comprises:

specifying the bifurcating structure of the main trunk and the side branch based on the recognition result based on the plurality of first medical images, and calculating a cross-sectional diameter, a cross-sectional area, or a volume per unit length of the side branch.

6. The non-transitory computer-readable storage medium according to claim 2 , wherein the processing further comprises:

specifying the bifurcating structure of the main trunk and the side branch based on the recognition result based on the plurality of first medical images, and generating model images of the main trunk and the side branch.

7. The non-transitory computer-readable storage medium according to claim 1 , wherein the processing further comprises:

superimposing an image showing the main trunk portion or the side branch portion on a medical image including the bifurcated portion cross-section region.

8. The non-transitory computer-readable storage medium according to claim 1 ,

wherein the lumen organ is a blood vessel, and

the processing further comprises:

acquiring a medical image of the blood vessel generated based on signals detected by the catheter.

9. An information processing device comprising:

an acquisition unit configured to acquire a plurality of medical images generated based on signals detected by a catheter inserted into a lumen organ while the catheter is moving a sensor along a longitudinal direction of the lumen organ, the lumen organ including a main trunk, a side branch branched from the main trunk, and a bifurcated portion of the main trunk and the side branch; and

a learning model configured to recognize, when the acquired medical images are input, a main trunk cross-section region, a side branch cross-section region, and a bifurcated portion cross-section region in units of pixels in the plurality of medical images, and output information indicating the main trunk cross-section region, the side branch cross-section region, and the bifurcated portion cross-section region in units of pixels in the plurality of medical images.

10. The information processing device according to claim 9 , wherein the learning model is further configured to:

recognize at least the main trunk cross-section region or the side branch cross-section region based on an acquired first medical image;

recognize the bifurcated portion cross-section region based on an acquired second medical image; and

discriminate between a main trunk portion and a side branch portion constituting the bifurcated portion cross-section region based on a recognition result based on the first medical image.

11. The information processing device according to claim 10 , wherein the learning model is further configured to:

specify a bifurcating structure of the main trunk and the side branch based on a recognition result based on a plurality of first medical images; and

specify the main trunk portion and the side branch portion included in the bifurcated portion cross-section region based on the specified bifurcating structure.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein the learning model is further configured to:

recognize the bifurcated portion cross-section region and a plaque formed in the bifurcated portion based on the acquired second medical image; and

specify a plaque portion included in the bifurcated portion cross-section region based on the bifurcating structure.

13. A method for generating a model, the method comprising performing the following processing in a computer:

generating training data in which data indicating a lumen cross-section is attached to a plurality of medical images each including a main trunk cross-section region, a plurality of medical images each including the main trunk cross-section region and a side branch cross-section region, and a plurality of medical images each including a bifurcated portion cross-section region that are generated based on signals detected by a catheter inserted into a lumen organ while the catheter is moving a sensor along a longitudinal direction of the lumen organ, the lumen organ including a main trunk, a side branch branched from the main trunk, and a bifurcated portion of the main trunk and the side branch; and

generating, based on the generated training data, a learning model configured to recognize, in units of pixels in the plurality of medical images, the main trunk cross-section region, the side branch cross-section region, and the bifurcated portion cross-section region when the medical images are input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2022
From: SAKAGUCHI, YUKI; SEKI, YUSUKE; IGUCHI, AKIRA
To: TERUMO KABUSHIKI KAISHA
Reel/Frame 061252/0627 →
Priority Claims (1)
JP 2020-061513 · Mar 30, 2020 · national
Continuity (2)
Continuation PCTJP2021009343 · Mar 9, 2021
Related Publication 20230020596A1 · Jan 19, 2023
References Cited (30)
US 10349910B2 · Zhong · 2019 [cited by examiner]
US 11278259B2 · Yang · 2022 [cited by examiner]
US 20120083696A1 · Kitamura · 2012 [cited by applicant]
US 20150238121A1 · Tu et al. · 2015 [cited by applicant]
US 20150257850A1 · Sakamoto · 2015 [cited by applicant]
US 20170215838A1 · Park · 2017 [cited by examiner]
US 20170262733A1 · Gulsun et al. · 2017 [cited by applicant]
US 20180247414A1 · Novikov et al. · 2018 [cited by applicant]
US 20190180438A1 · Buckler et al. · 2019 [cited by applicant]
US 20210312636A1 · Tu et al. · 2021 [cited by applicant]
US 20230017334A1 · Sakaguchi · 2023 [cited by examiner]
US 20230222655A1 · Kusu · 2023 [cited by examiner]
US 20230230231A1 · Tu · 2023 [cited by examiner]
US 20230230244A1 · Kusu · 2023 [cited by examiner]
US 20240013385A1 · Tominaga · 2024 [cited by examiner]
US 20240013386A1 · Sakaguchi · 2024 [cited by examiner]
US 20240070855A1 · Mao · 2024 [cited by examiner]
CN 106408017A · 2017 [cited by applicant]
CN 109091167A · 2018 [cited by applicant]
JP 2012075702A · 2012 [cited by applicant]
JP 2019165970A · 2019 [cited by applicant]
WO 2015136853A1 · 2015 [cited by applicant]
WO 2020006853A1 · 2020 [cited by applicant]
Miyagawa, Makoto, et al. “Detecting vascular bifurcation in IVOCT images using convolutional neural networks with transfer learning.” IEEE Access 7, pp. 66167-66175 (Year: 2019). [cited by examiner]
Porto, C. D. N., et al. “Classification of bifurcations regions in IVOCT images using support vector machine and artificial neural network models.” Medical Imaging 2017: Computer-Aided Diagnosis. vol. 10134. SPIE (Year:… [cited by examiner]
International Search Report (PCT/ISA/210) with translation and Written Opinion (PCT/ISA/237) mailed on May 11, 2021, by the Japan Patent Office as the International Searching Authority for International Application No. … [cited by applicant]
Macedo et al., “A Bifurcation Identifier for IV-OCT using Orthogonal Least Squares and Supervised Machine Learning”, Computerized Medical Imaging and Graphics, (Sep. 21, 2015), vol. 46, pp. 237-248. [cited by applicant]
The extended European Search Report issued Jul. 27, 2023, by the European Patent Office in corresponding European Patent Application No. 21781271.8-1126. (8 pages). [cited by applicant]
The First Office Action issued on Sep. 20, 2024, by the State Intellectual Property Office of the People's Republic of China in corresponding Chinese Patent Application No. 202180024534.6 and an English translation of t… [cited by applicant]
English translation of the Office Action (Notice of Reasons for Refusal) issued on Jun. 4, 2024, in corresponding Japanese Patent Application No. 2022-511734. (3 pages). [cited by applicant]