IP Library › Granted Patent US 11,419,696
Granted Patent B2
US 11,419,696 · App. 16/333,120 · Granted Aug 23, 2022

Control device, control method, and medical system

Inventors: Yasuhisa Kamikawa (Tokyo, JP); Jun Arai (Kanagawa, JP)
Assignee: SONY CORPORATION
A61B90/37A61B1/002A61B90/20A61B90/361G16H30/20A61B2090/367A61B2090/371A61B2090/373A61B2090/376A61B2090/3782
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,419,696
App. No.
16/333,120
Filed
Mar 13, 2019
Granted
Aug 23, 2022
Kind
B2
Art Unit
3793
USPC
600/427
Abstract

There is provided a control device that decides at least one medical image as a medical image to display or save from among medical images taken by a plurality of imaging devices, on a basis of imaging device status information that includes information about a position or an attitude for at least one of the plurality of imaging devices.

Claims (81)

1. A medical control device for a medical imaging system, comprising:

processing circuitry configured to

determine a status of each of a plurality of medical imaging devices based on medical imaging device status information that includes three dimensional position and attitude information of each of the plurality of medical imaging devices, wherein

the plurality of medical imaging devices includes a first medical imaging device of a first type and a second medical imaging device of a second type, different from the first type, and

the medical imaging device status information about the second medical imaging device includes information about a distance between the second medical imaging device and a focus point of the second medical imaging device;

select at least one medical image from among a plurality of medical images obtained by the plurality of medical imaging devices when the status of a corresponding medical imaging device satisfies a certain image decision condition, wherein the certain image decision condition includes that an observation target is included in the medical image;

determine whether or not the status of at least one of the plurality of medical imaging devices satisfies the certain image decision condition;

determine, when the first medical imaging device is tilted by a certain angle or more, that the status of the first medical imaging device satisfies the certain image decision condition;

determine, when the focus point of the second medical imaging device is aligned with the observation target, that the status of the second medical imaging device satisfies the certain image decision condition, and

select the at least one medical image from among a plurality of medical images obtained by the first medical imaging device and from among a plurality of medical images obtained by the second medical imaging device based on the respective status of the first medical imaging device and the second medical imaging device satisfying the certain image decision condition; and

output the selected at least one medical image from the plurality of medical images obtained by the plurality of medical imaging devices.

2. The medical control device according to claim 1 , wherein

the plurality of medical imaging devices includes at least one movable camera.

3. The medical control device according to claim 1 , wherein

the first medical imaging device is a movable camera which is a point of view camera, and the second medical imaging device is a surgical field camera, which is installed in a stationary manner inside an operating room.

4. The medical control device according to claim 1 , wherein

the processing circuitry is further configured to select at least two medical images from among the plurality of medical images obtained by the plurality of medical imaging devices.

5. The medical control device according to claim 1 , wherein

the processing circuitry is further configured to discard any medical images of the plurality of medical images obtained by the plurality of medical imaging devices that are not selected.

6. The medical control device according to claim 1 , wherein the processing circuitry is further configured to filter any remaining medical images of the plurality of medical images that are not selected by the processing circuitry by selectively displaying or recording only the selected at least one medical image.

7. The medical control device according to claim 1 , wherein the medical imaging device status information further includes occlusion information and images of the plurality of medical images having the occlusion information indicating surgical field occlusion are not selected.

8. A medical control device for a medical imaging system, comprising:

processing circuitry configured to

determine a status of each of a plurality of medical imaging devices based on medical imaging device status information that includes three dimensional position and attitude information of each of the plurality of medical imaging devices, wherein

the plurality of medical imaging devices includes a plurality of movable cameras, and

the medical imaging device status information about each of the plurality of movable cameras includes information about a position of the respective movable camera and information about a distance between the respective movable camera and a respective focus point of the movable cameras;

select at least one medical image from among a plurality of medical images obtained by the plurality of medical imaging devices when a status of a corresponding medical imaging device satisfies a certain image decision condition, wherein the certain image decision condition includes that an observation target is included in the medical image;

determine whether or not the status of at least one of the plurality of medical imaging devices satisfies the certain image decision condition, wherein when the respective focus point of the respective movable camera is aligned with the observation target, the processing circuitry is configured to determine that the status of the respective movable camera satisfies the certain image decision condition; and

output the selected at least one medical image from the plurality of medical images obtained by the plurality of medical imaging devices.

9. The medical control device according to claim 8 , wherein

at least one of the plurality of movable cameras is a wearable camera.

10. The medical control device according to claim 8 , wherein

at least one of the plurality of movable cameras is attached to a treatment tool used in a medical procedure.

11. The medical control device according to claim 8 , wherein

at least one of the plurality of movable cameras is a microscope camera that obtains an image of an observation target with a microscope being attached to a leading end of an arm.

12. The medical control device according to claim 8 , wherein

at least one of the plurality of movable cameras is an endoscope camera that obtains an image of an observation target with an endoscope being attached to a leading end of an arm.

13. The medical control device according to claim 8 , wherein

at least one of the plurality of movable cameras is an X-ray camera that obtains an X-ray tomographic image while moving relative to a patient body.

14. The medical control device according to claim 8 , wherein

at least one of the plurality of movable cameras is configured to obtain an ultrasound image inside a blood vessel while moving a catheter provided with a transducer on a leading end, inside the blood vessel.

15. A medical control device for a medical imaging system, comprising:

processing circuitry configured to determine a status of each of a plurality of medical imaging devices based on medical imaging device status information that includes three dimensional position and attitude information of each of the plurality of medical imaging devices, wherein the plurality of medical imaging devices includes a first medical imaging device of a first type and a second medical imaging device of a second type, different from the first type, and the medical imaging device status information about the second medical imaging device includes information about a distance between the second medical imaging device and a focus point of the second medical imaging device,

select at least one medical image from among a plurality of medical images obtained by the plurality of medical imaging devices when the status of a corresponding medical imaging device satisfies a certain image decision condition, wherein the certain image decision condition includes that an observation target is included in the medical image;

determine whether or not the status of at least one of the plurality of medical imaging devices satisfies the certain image decision condition;

determine, when a focus point of the first medical imaging device is aligned with the observation target, that the status of the first medical imaging device satisfies the certain image decision condition:

determine, when the focus point of the second medical imaging device is aligned with the observation target, that the status of the second medical imaging device satisfies the certain image decision condition, and

select the at least one medical image from among a plurality of medical images obtained by the first medical imaging device and from among a plurality of medical images obtained by the second medical imaging device based on the respective status of the first medical imaging device and the second medical imaging device satisfying the certain image decision condition; and

output the selected at least one medical image from the plurality of medical images obtained by the plurality of medical imaging devices,

wherein the second medical imaging device is a microscope camera configured to obtain an image of the observation target with a microscope attached to a leading end of an arm for the microscope camera, and the first medical imaging device is an endoscope camera configured to obtain an image of the observation target with an endoscope attached to a leading end of an arm for the endoscope.

16. A medical control device for a medical imaging system, comprising:

processing circuitry configured to

determine a status of each of a plurality of medical imaging devices based on medical imaging device status information that includes three dimensional position and attitude information of each of the plurality of medical imaging devices, wherein

the plurality of medical imaging devices includes an X-ray camera that obtains an X-ray tomographic image while moving relative to a patient body, and an ultrasound that obtains an ultrasound image inside a blood vessel while moving a catheter provided with a transducer for obtaining ultrasound images on a leading end inside the blood vessel,

the medical imaging device status information about the X-ray camera includes information about a position of the X-ray camera,

the medical imaging device status information about the ultrasound includes information about a position of the transducer;

select at least one medical image from among a plurality of medical images obtained by the plurality of medical imaging devices when a status of a corresponding medical imaging device satisfies a certain image decision condition, wherein the certain image decision condition includes that an observation target is included in the medical image;

determine whether or not the status of at least one of the plurality of medical imaging devices satisfies the certain image decision condition;

wherein the processing circuitry is further configured to

determine, when the position of the X-ray camera corresponds to the position of the ultrasound, that the status of the X-ray camera satisfies the certain image decision condition, and

select the at least one medical image from among an ultrasound image of the inside of the blood vessel obtained by the ultrasound and an X-ray tomographic image that includes a site being depicted by the ultrasound image from among a plurality of X-ray tomographic images depicting different sites in the patient body; and

output the selected at least one medical image from the plurality of medical images obtained by the plurality of medical imaging devices.

17. The medical control device according to claim 16 , wherein

when the at least one medical image displayed on a display device includes the ultrasound image and the X-ray tomographic image, the processing circuitry is further configured to overlay onto the X-ray tomographic image an icon indicating the site being depicted by the ultrasound image.

18. A medical control method, comprising:

determining a status of each of a plurality of medical imaging devices based on medical imaging device status information that includes three dimensional position and attitude information of each of the plurality of medical imaging devices, wherein

the plurality of medical imaging devices includes a plurality of movable cameras, and

the medical imaging device status information about each of the plurality of movable cameras includes information about a position of the respective movable camera and information about a distance between the respective movable camera and a respective focus point of the movable camera;

selecting at least one medical image from among a plurality of medical images obtained by the plurality of medical imaging devices when the status of a corresponding medical imaging device satisfies a certain image decision condition, wherein the certain image decision condition includes that an observation target is included in the medical image;

determining whether or not the status of at least one of the plurality of medical imaging devices satisfies the certain image decision condition, wherein, when the respective focus point of the respective movable camera is aligned with the observation target, determining that the status of the respective movable camera satisfies the certain image decision condition; and

outputting the selected at least one medical image from the plurality of medical images obtained by the plurality of medical imaging devices.

19. A medical imaging and control system, comprising:

a plurality of medical imaging devices; and

processing circuitry configured to

determine a status of each of a plurality of medical imaging devices based on medical imaging device status information that includes three dimensional position and attitude information of each of the plurality of medical imaging devices, wherein

the plurality of medical imaging devices includes a plurality of movable cameras, and

the medical imaging device status information about each of the plurality of movable cameras includes information about a position of the respective movable camera and information about a distance between the respective movable camera and a respective focus point of the movable camera;

select at least one medical image from among a plurality of medical images obtained by the plurality of medical imaging devices when the status of a corresponding medical imaging device satisfies a certain image decision condition, wherein the certain image decision condition includes that an observation target is included in the medical image;

determine whether or not the status of at least one of the plurality of medical imaging devices satisfies the certain image decision condition; and,

when the respective focus position is aligned with the observation target, the processing circuitry is configured to determine that the status of the respective movable camera satisfies the certain image decision condition; and

output the selected at least one medical image from the plurality of medical images obtained by the plurality of medical imaging devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2019
From: KAMIKAWA, YASUHISA; ARAI, JUN
To: SONY CORPORATION
Reel/Frame 048588/0734 →
Priority Claims (1)
JP JP2016-185146 · Sep 23, 2016 · national
Continuity (1)
Related Publication 20190328481A1 · Oct 31, 2019
Cited By (2)
US 12,238,265 US 12,316,965