IP Library Granted Patent US 10,694,933
Granted Patent B2
US 10,694,933 · App. 15/306,943 · Granted Jun 30, 2020

Image processing apparatus and image processing method for image display including determining position of superimposed zoomed image

Inventor: Kenta Yamaguchi (Kanagawa, JP)
Assignee: SONY CORPORATION
A61B1/3132A61B1/0005A61B1/00009A61B90/20G06T7/0012G06T7/73A61B2034/2057A61B2034/2065A61B2090/373G06T2207/10012G06T2207/10056G06T2207/10068G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,694,933
App. No.
15/306,943
Granted
Jun 30, 2020
Kind
B2
Abstract

A medical imaging apparatus including a controller including circuitry configured to control display on a display area of a medical image, control display on the display area of a superimposed image corresponding to the medical image such that the superimposed image is displayed overlapped on the medical image, detect a position of an important element within the medical image, and determine a position of the superimposed image within the display area, based on the detected position of the important element, such that the superimposed image does not overlap on the important element within the medical image.

Claims (45)

1. A medical imaging apparatus, comprising:

circuitry configured to:

control display on a display area of a medical image,

detect a position of an important element within the medical image,

estimate a remarkable point in the medical image in accordance with the important element,

determine a region of interest portion of the medical image, wherein the region of interest portion of the medical image includes the remarkable point and excludes the important element,

control display on the display area of a superimposed image corresponding to the medical image such that the superimposed image is displayed overlapped on the medical image, and

determine a position of the superimposed image within the display area, based on the detected position of the important element, such that the superimposed image does not overlap on the important element within the medical image, wherein the superimposed image is a zoomed image corresponding to the region of interest portion of the medical image.

2. The medical imaging apparatus according to claim 1 , wherein the circuitry is further configured to detect an overlap between a portion of the important element and a portion of the superimposed image within the display area and adjust, in response to the overlap being detected, the position of the superimposed image within the display area such that superimposed image is no longer overlapping on the portion of the important element within the medical image.

3. The medical imaging apparatus according to claim 1 , wherein the medical image includes a surgical image of a body.

4. The medical imaging apparatus according to claim 1 , wherein the important element is an important object or an important area.

5. The medical imaging apparatus according to claim 1 , wherein the superimposed image corresponds to the region of interest portion of the medical image and the region of interest portion is estimated from a three-dimensional posture of the important element.

6. The medical imaging apparatus according to claim 1 , wherein the important element is a surgical instrument.

7. The medical imaging apparatus according to claim 1 , wherein the circuitry is further configured to:

detect a second position of the important element within the medical image after a movement of the important element within the medical image,

detect a second overlap between the detected second position of the important element and the adjusted position of the superimposed image, and

further adjust, in response to the second overlap being detected, the adjusted position of the superimposed image within the display area such that the superimposed image is no longer overlapping on the detected second position of the important element within the medical image.

8. The medical imaging apparatus according to claim 1 , wherein the circuitry is configured to control display on the display area of a frame indicating the region of interest portion.

9. The medical imaging apparatus according to claim 1 , wherein the superimposed image is positioned in any one of four corners of the medical image.

10. The medical imaging apparatus according to claim 1 , wherein the superimposed image is subjected to a color conversion process.

11. A method for processing a medical image by a medical imaging apparatus including circuitry, the method comprising:

controlling display on a display area of a medical image,

detecting, by the circuitry, a position of an important element within the medical image,

estimating, by the circuitry, a remarkable point in the medical image in accordance with the important element,

determining, by the circuitry, a region of interest portion of the medical image, wherein the region of interest portion of the medical image includes the remarkable point and excludes the important element,

controlling display on the display area of a superimposed image corresponding to the medical image such that the superimposed image is displayed overlapped on the medical image, and

determining a position of the superimposed image within the display area, based on the detected position of the important element, such that the superimposed image does not overlap on the important element within the medical image, wherein the superimposed image is a zoomed image corresponding to the region of interest portion of the medical image.

12. A non-transitory computer readable medium having stored thereon a program that when executed by a computer causes the computer to implement a method for processing a medical image by a medical imaging apparatus including circuitry, the method comprising:

controlling display on a display area of a medical image;

detecting, by the circuitry, a position of an important element within the medical image,

estimating, by the circuitry, a remarkable point in the medical image in accordance with the important element,

determining, by the circuitry, a region of interest portion of the medical image, wherein the region of interest portion of the medical image includes the remarkable point and excludes the important element,

controlling display on the display area of a superimposed image corresponding to the medical image such that the superimposed image is displayed overlapped on the medical image; and

determining a position of the superimposed image within the display area, based on the detected position of the important element, such that the superimposed image does not overlap on the important element within the medical image, wherein the superimposed image is a zoomed image corresponding to the region of interest portion of the medical image.

13. A medical imaging system, comprising:

a medical imaging device that obtains a medical image;

a display device having a display area; and

circuitry configured to:

control display on the display area of the display device of the medical image obtained by the medical imaging device,

detect a position of an important element within the medical image,

estimate a remarkable point in the medical image in accordance with the important element,

determine a region of interest portion of the medical image, wherein the region of interest portion of the medical image includes the remarkable point and excludes the important element,

control display on the display area of the display device of a superimposed image corresponding to the medical image such that the superimposed image is displayed overlapped on the medical image, and

determine a position of the superimposed image within the display area, based on the detected position of the important element, such that the superimposed image does not overlap on the important element within the medical image, wherein the superimposed image is a zoomed image corresponding to the region of interest portion of the medical image.

14. The system according to claim 13 , wherein the medical imaging device is an endoscope or a surgical microscope.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2016
From: YAMAGUCHI, KENTA
To: SONY CORPORATION
Reel/Frame 040496/0504 →
Priority Claims (1)
JP 2014-115768 · Jun 4, 2014 · national
Continuity (1)
Related Publication 20170046842A1 · Feb 16, 2017
Cited By (1)
US 12,560,799