Medical control device and medical observation system using a different wavelength band than that of fluorescence of an observation target to control focus or brightness

1 . A medical control device comprising:

circuitry configured to:

determine whether an image sensor to capture an image is operating in a first mode in which a fluorescence image of an observation target is to be and a second mode in which parameters of the image to be captured are controlled;

in response to the image sensor being in the first mode,

control an operation of a light source to emit excitation light in a first wavelength band,

acquire a captured image of the observation target irradiated with light in the first wavelength band, wherein the observation target fluoresces in response to the excitation light to output light in a third wavelength band, and

perform first image processing on the captured image of the observation target irradiated with the light in the first wavelength band which includes light in the third wavelength band;

in response to the image sensor being in the second mode,

control the operation of the light source to simultaneously emit excitation light in the first wavelength band and light in a second wavelength band different from the first wavelength band;

acquire a captured image obtained by capturing an image of an observation target irradiated with light in the first wavelength band and in the second wavelength band emitted from the light source, wherein the observation target fluoresces in response to the excitation light to output light in a third wavelength band and reflects light in the second wavelength band to output light in the second wavelength band, the captured image including light components in the second and third wavelengths bands, the second and third wavelength bands being different;

perform the first image processing on the captured image of light in the second and third wavelength bands;

calculate, based on the captured image acquired while the observation target is irradiated with light in the first wavelength band and in the second wavelength band, an evaluation value used for at least one of a first control for controlling a focal position of the image sensor configured to generate the captured image or a second control for controlling a brightness of the captured image, wherein a component of the light in the second wavelength band is used for the calculation of the evaluation value; and

perform, based on the evaluation value, at least one of the first control or the second control on the captured image of light in the second and third wavelength band subjected to the first image processing.

2 . The medical control device according to claim 1 , wherein the circuitry is configured to remove the component of light in the second wavelength band by demosaic processing, and when a component of light in each of a red wavelength band, a green wavelength band, and a blue wavelength band is given to each pixel included in the captured image, the component of light in the second wavelength band is deleted by deleting a light component in any of the red, green, and blue wavelength bands.

3 . The medical control device according to claim 1 , wherein the light in the second wavelength band does not include the third wavelength band.

4 . The medical control device according to claim 1 , wherein the circuitry is configured to sequentially calculate evaluation values used for the first control in a specific cycle in the second mode.

5 . The medical control device according to claim 1 , wherein the circuitry is configured to calculate the evaluation value used for the first control in response to a user operation, the user operation requesting execution of the first control in the second mode.

6 . The medical control device according to claim 1 , wherein the excitation light is light in a blue wavelength band by which protoporphyrin is excited.

7 . A medical observation system comprising:

the light source configured to emit excitation light in the first wavelength band and light in the second wavelength band different from the first wavelength band;

the image sensor configured to generate the captured image of the observation target; and

the medical control device according to claim 1 , the medical control device controlling an operation of each of the light source and the image sensor.

8 . The medical control device according to claim 1 , wherein the circuitry is configured to remove the component of the light in the second wavelength band contained in the captured image after the evaluation value is calculated in the second mode.

9 . The medical control device according to claim 8 , wherein the second wavelength band includes a green wavelength band.

10 . The medical control device according to claim 8 , wherein the circuitry is further configured to delete the component of light in the second wavelength band by white balance adjustment processing, and the component of the light in the second wavelength band is removed by multiplying, by a specific gain, a component of light in each of a red wavelength band, a green wavelength band, and a blue wavelength band contained in the captured image.

11 . The medical control device according to claim 8 , wherein the circuitry is further configured to delete the component of light in the second wavelength band by color correction matrix processing, and the component of the light in the second wavelength band is removed by multiplying a specific color correction matrix by an input matrix having, as a matrix element, a component of light in each of a red wavelength band, a green wavelength band, and a blue wavelength band contained in the captured image.

12 . The medical control device according to claim 8 , wherein the circuitry is configured to output the captured image with the component of the light in the second wavelength band removed as an image to be displayed.

13 . The medical control device according to claim 1 , wherein the second and third wavelength bands do not overlap.

14 . The medical control device according to claim 13 , wherein the first and second wavelength bands do not overlap.

15 . A medical control method comprising:

determining whether an image sensor is operating in a first mode or a second mode;

in response to the image sensor being in the first mode, acquiring a captured image of an observation target based on excitation light in a first wavelength band;

in response to the image sensor being in the second mode, controlling an operation of a light source configured to simultaneously emit excitation light in the first wavelength band and light in a second wavelength band different from the first wavelength band;

acquiring a captured image obtained by capturing an image of the observation target irradiated with light in the first wavelength band and in the second wavelength band emitted from the light source, wherein the observation target fluoresces in response to the excitation light to output light in a third wavelength band and reflects light in the second wavelength band to output light in the second wavelength band, the captured image including light components in the second and third wavelengths bands, the second and third wavelength bands being different;

calculating, based on the captured image acquired while the observation target is irradiated with light in the first wavelength band and in the second wavelength band, an evaluation value used for at least one of a first control for controlling a focal position of the image sensor configured to generate the captured image or a second control for controlling a brightness of the captured image, wherein a component of the light in the second wavelength band is used for the calculation of the evaluation value;

after calculating the evaluation value, removing the component of the light in the second wavelength band contained in the captured image;

performing, based on the evaluation value, at least one of the first control or the second control; and

outputting the captured image with the component of the light in the second wavelength band removed as an image to be displayed.

16 . The medical control method according to claim 15 , wherein, in response to the first control or the second control is to be performed, controlling the light source to simultaneously emit excitation light in the first wavelength band and image light in the second wavelength band.

17 . A non-transitory computer readable storage device having computer readable instructions that when executed by a processor cause the processor to:

determine whether an image sensor to capture an image is operating in a first mode in which a fluorescent image of an observation target is to be captured at a predetermined frame rate and a second mode in which parameters of the image to be captured are controlled;

in response to the image sensor being in the first mode,

control an operation of a light source to emit excitation light in a first wavelength band,

acquire a captured image of an observation target irradiated with light in the first wavelength band, wherein the observation target fluoresces in response to the excitation light to output light in a third wavelength band, and

perform first image processing on the captured image of the observation target irradiated with the light in the first wavelength band which light in the third wavelength band;

in response to the image sensor being in the second mode,

control the operation of the light source to simultaneously emit excitation light in the first wavelength band and light in a second wavelength band different from the first wavelength band;

acquire a captured image obtained by capturing an image of an observation target irradiated with light in the first wavelength band and in the second wavelength band emitted from the light source, wherein the observation target fluoresces in response to the excitation light to output light in a third wavelength band and reflects light in the second wavelength band to output light in the second wavelength band, the captured image including light components in the second and third wavelengths bands, the second and third wavelength bands being different;

perform the first image processing on the captured image of light in the second and third wavelength bands;

calculate, based on the captured image acquired while the observation target is irradiated with light in the first wavelength band and in the second wavelength band, an evaluation value used for at least one of a first control for controlling a focal position of the image sensor configured to generate the captured image or a second control for controlling a brightness of the captured image, wherein a component of the light in the second wavelength band is used for the calculation of the evaluation value; and

perform, based on the evaluation value, at least one of the first control or the second control on the captured image of light in the second and third wavelength band subjected to the first image processing.

18 . The non-transitory computer readable storage device according to claim 17 , wherein, after the evaluation value is calculated the processor is further caused to:

remove the component of the light in the second wavelength band contained in the captured image; and

output the captured image with the component of the light in the second wavelength band removed as an image to be displayed.

19 . The non-transitory computer readable storage device according to claim 17 , wherein the processor is configured to calculate an evaluation value used for the first control in response to a user operation, the user operation requesting execution of the first control.

20 . The non-transitory computer readable storage device according to claim 17 , wherein the processor is configured to sequentially calculate evaluation values used for the first control in a specific cycle.