IP Library › Granted Patent US 10,970,875
Granted Patent B2
US 10,970,875 · App. 16/453,687 · Granted Apr 6, 2021

Examination support device, examination support method, and examination support program

Inventor: Shinnosuke Hirakawa (Tokyo, JP)
Assignee: FUJIFILM Corporation
G06T7/74A61B1/00009A61B1/00045A61B1/045H04N5/23293G06T2207/10068G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,970,875
App. No.
16/453,687
Granted
Apr 6, 2021
Kind
B2
Abstract

An image acquisition unit acquires an actual endoscopic image that is generated by an endoscope inserted into a tubular structure of a subject and represents an inner wall of the tubular structure, and a virtual endoscopic image that is generated from a three-dimensional image including the tubular structure of the subject and spuriously represents the inner wall of the tubular structure. A conversion unit converts an expression form of the actual endoscopic image into an expression form of the virtual endoscopic image. A similarity calculation unit calculates similarity between the converted actual endoscopic image and the virtual endoscopic image.

Claims (22)

1. An examination support device comprising:

a processor configured to:

acquire an actual endoscopic image that is generated by an endoscope inserted into a tubular structure of a subject and represents an actual inner wall of the tubular structure, wherein the actual endoscopic image is generated by actually imaging the inner wall of the tubular structure, and therefore, the actual endoscopic image has an actual photo style expression form;

acquire a virtual endoscopic image that is generated from a three-dimensional image including the tubular structure of the subject and spuriously describes the inner wall of the tubular structure, wherein the three-dimensional image is obtained from a three-dimensional image photographing device by imaging the subject, and therefore, the virtual endoscopic image has a computer graphic style expression form;

convert the actual photo style expression form of the actual endoscopic image into the computer graphic style expression form of the virtual endoscopic image to acquire a converted actual endoscopic image; and

calculate similarity between the converted actual endoscopic image and the virtual endoscopic image.

2. The examination support device according to claim 1 , wherein the processor is further configured to:

estimate a position of the endoscope in the tubular structure using the virtual endoscopic image of which the calculated similarity is greater than or equal to a predetermined threshold value.

3. The examination support device according to claim 2 , wherein the processor is further configured to:

display the virtual endoscopic image corresponding to the estimated position of the endoscope and the converted actual endoscopic image on a display.

4. The examination support device according to claim 1 , wherein the processor is further configured to:

generate the virtual endoscopic image from the three-dimensional image.

5. An examination support method comprising:

acquiring an actual endoscopic image that is generated by an endoscope inserted into a tubular structure of a subject and represents an actual inner wall of the tubular structure, wherein the actual endoscopic image is generated by actually imaging the inner wall of the tubular structure, and therefore, the actual endoscopic image has an actual photo style expression form;

acquiring a virtual endoscopic image that is generated from a three-dimensional image including the tubular structure of the subject and spuriously describes the inner wall of the tubular structure, wherein the three-dimensional image is obtained from a three-dimensional image photographing device by imaging the subject, and therefore, the virtual endoscopic image has a computer graphic style expression form;

converting the actual photo style expression form of the actual endoscopic image into the computer graphic style expression form of the virtual endoscopic image to acquire a converted actual endoscopic image; and

calculating similarity between the converted actual endoscopic image and the virtual endoscopic image.

6. A non-transitory computer-readable storage medium that stores an examination support program causing a computer to execute:

acquiring an actual endoscopic image that is generated by an endoscope inserted into a tubular structure of a subject and represents an actual inner wall of the tubular structure, wherein the actual endoscopic image is generated by actually imaging the inner wall of the tubular structure, and therefore, the actual endoscopic image has an actual photo style expression form;

acquiring a virtual endoscopic image that is generated from a three-dimensional image including the tubular structure of the subject and spuriously describes the inner wall of the tubular structure, wherein the three-dimensional image is obtained from a three-dimensional image photographing device by imaging the subject, and therefore, the virtual endoscopic image has a computer graphic style expression form;

converting the actual photo style expression form of the actual endoscopic image into the computer graphic style expression form of the virtual endoscopic image to acquire a converted actual endoscopic image; and

calculating similarity between the converted actual endoscopic image and the virtual endoscopic image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2019
From: HIRAKAWA, SHINNOSUKE
To: FUJIFILM CORPORATION
Reel/Frame 049599/0987 →
Priority Claims (1)
JP JP2018-132896 · Jul 13, 2018 · national
Continuity (1)
Related Publication 20200020127A1 · Jan 16, 2020