IP Library › Granted Patent US 11,451,698
Granted Patent B2
US 11,451,698 · App. 16/617,528 · Granted Sep 20, 2022

Medical system and control unit

Inventors: Daisuke Kikuchi (Kanagawa, JP); Yuki Sugie (Kanagawa, JP); Yukihiro Nakamura (Kanagawa, JP); Kentaro Fukazawa (Tokyo, JP); Kenji Ikeda (Kanagawa, JP)
Assignee: SONY CORPORATION
H04N5/23203A61B1/045A61B90/20H04N5/247G02B21/0012G02B21/367H04N2005/2255
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,451,698
App. No.
16/617,528
Granted
Sep 20, 2022
Kind
B2
Abstract

In a case where a plurality of imaging apparatuses is used for a surgery, the appearance is regulated between images captured by the respective imaging apparatuses. According to the present disclosure, a medical system is provided, the medical system including a plurality of surgical imaging apparatuses and a control unit to which each of the surgical imaging apparatuses is connected, the control unit including a signal processing unit that links images captured by the respective surgical imaging apparatuses. With this configuration, in a case where a plurality of imaging apparatuses is arranged for a surgery, it becomes possible to regulate the appearance between images captured by the respective imaging apparatuses.

Claims (48)

1. A medical system comprising:

a plurality of surgical imaging apparatuses each having a different angle of view, the plurality of the surgical imaging apparatuses being physically separate apparatuses respectively; and

processing circuitry, to which each of the surgical imaging apparatuses is coupled, configured to

determine whether the plurality of the surgical imaging apparatuses image a same subject or different subjects concurrently, and

link images captured by respective ones of the plurality of the surgical imaging apparatuses in response to determining that the plurality of the surgical imaging apparatuses image the same subject concurrently, and not link the images captured by the respective ones of the plurality of the surgical imaging apparatuses in response to determining that the plurality of the surgical imaging apparatuses image the different subjects concurrently, wherein

the processing circuitry is further configured to, in response to determining that the plurality of the surgical imaging apparatuses image the same subject concurrently, perform a process of adapting a shake amount between the images captured by the respective ones of the plurality of the surgical imaging apparatuses, by tracking a first image of the images with a shake in accordance with a second image of the images without a shake or with a shake less than the shake of the first image, and correcting the shake in the first image by removing a shake component in the first image in accordance with the second image, and

the first image is captured by a first surgical imaging apparatus of the plurality of the surgical imaging apparatuses having a first angle of view, and the second image is captured by a second surgical imaging apparatus of the plurality of the surgical imagine apparatuses having a second angle of view different from the first angle of view.

2. The medical system according to claim 1 , wherein the plurality of the surgical imaging apparatuses include at least two different types of surgical imaging apparatuses of an endoscope, an extracorporeal scope, a microscope, or a surgical field camera.

3. The medical system according to claim 1 , wherein the processing circuitry is configured to switch whether or not to perform the linking, according to occurrence of an adjustment trigger.

4. The medical system according to claim 1 , wherein

the processing circuitry is configured to perform a process for the linking according to occurrence of an adjustment trigger, and

the adjustment trigger occurs by a user operation.

5. The medical system according to claim 1 , wherein

the processing circuitry is configured to:

obtain information regarding a state of an operating surgeon who performs a surgery; and

perform a process for the linking based on the obtained information.

6. The medical system according to claim 1 , wherein

the processing circuitry is configured to:

obtain identification information for identifying the plurality of the surgical imaging apparatuses; and

perform a process for the linking based on the obtained identification information.

7. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting colors between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

8. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting brightness between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

9. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting contrast between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

10. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting resolution between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

11. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting noise between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

12. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting a depth of field between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

13. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting a depth between stereoscopic images captured by the respective ones of the plurality of the surgical imaging apparatuses.

14. The medical system according to claim 1 , wherein the processing circuitry is configured to perform a process of adapting an angle of view between the images captured by the respective ones of the plurality of the surgical imaging apparatuses.

15. The medical system according to claim 1 , wherein the processing circuitry is configured to link an image captured by one of the plurality of the surgical imaging apparatuses with an image captured by another one of the plurality of the surgical imaging apparatuses as a reference.

16. The medical system according to claim 1 , wherein the processing circuitry is configured to link images captured by the plurality of the surgical imaging apparatuses with an arbitrary desired image as a reference.

17. A control unit comprising:

processing circuitry, to which each of a plurality of surgical imaging apparatuses is coupled, configured to

determine whether the plurality of the surgical imaging apparatuses image a same subject or different subjects concurrently,

link images captured by respective ones of the plurality of the surgical imaging apparatuses in response to determining that the plurality of the surgical imaging apparatuses image the same subject concurrently, and not link the images captured by the respective ones of the plurality of the surgical imaging apparatuses in response to determining that the plurality of the surgical imaging apparatuses image the different subjects concurrently, wherein

each of the plurality of the surgical imaging apparatuses has a different angle of view, the plurality of the surgical imaging apparatuses being physically separate apparatuses respectively,

the processing circuitry is further configured to, in response to determining that the plurality of the surgical imaging apparatuses image the same subject concurrently, perform a process of adapting a shake amount between the images captured by the respective ones of the plurality of the surgical imaging apparatuses, by tracking a first image of the images with a shake in accordance with a second image of the images without a shake or with a shake less than the shake of the first image, and correcting the shake in the first image by removing a shake component in the first image in accordance with the second image, and

the first image is captured by a first surgical imaging apparatus of the plurality of the surgical imaging apparatuses having a first angle of view, and the second image is captured by a second surgical imaging apparatus of the plurality of the surgical imaging apparatuses having a second angle of view different from the first angle of view.

18. A medical system comprising:

a plurality of surgical imaging apparatuses each having a different angle of view, the plurality of the surgical imaging apparatuses being physically separate apparatuses respectively;

a plurality of control units, each of the plurality of the surgical imaging apparatuses being coupled to one of the plurality of the control units; and

an integrated apparatus to which each of the plurality of the control units is coupled, the integrated apparatus including processing circuitry configured to

determine whether the plurality of the surgical imaging apparatuses image a same subject or different subjects concurrently, and

link images captured by respective ones of the plurality of the surgical imaging apparatuses in response to determining that the plurality of the surgical imaging apparatuses image the same subject concurrently, and not link the images captured by the respective ones of the plurality of the surgical imaging apparatuses in response to determining that the plurality of the surgical imaging apparatuses image the different subjects concurrently, wherein

the processing circuitry is further configured to, in response to determining that the plurality of the surgical imaging apparatuses image the same subject concurrently, perform a process of adapting a shake amount between the images captured by the respective ones of the plurality of the surgical imaging apparatuses, by tracking a first image of the images with a shake in accordance with a second image of the images without a shake or with a shake less than the shake of the first image, and correcting the shake in the first image by removing a shake component in the first image in accordance with the second image, and

the first image is captured by a first surgical imaging, apparatus of the plurality of the surgical imaging, apparatuses having a first angle of view, and the second image is captured by a second surgical imaging apparatus of the plurality of the surgical imaging apparatuses having a second angle of view different from the first angle of view.

19. The medical system according to claim 1 , wherein

the first image is an endoscopic image captured by an endoscope, and

the second image is an stationary exoscopic image captured by an exoscope.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2020
From: KIKUCHI, DAISUKE; SUGIE, YUKI; NAKAMURA, YUKIHIRO; FUKAZAWA, KENTARO; IKEDA, KENJI
To: SONY CORPORATION
Reel/Frame 051728/0447 →
Priority Claims (1)
JP JP2017-110569 · Jun 5, 2017 · national
Continuity (1)
Related Publication 20200128169A1 · Apr 23, 2020
Cited By (1)
US 12,731,218