Optical scanning observation apparatus

1. An optical scanning observation apparatus for generating image signals for neighboring pixels, wherein the image signal of each of the neighboring pixels has components of a predetermined number of colors, the optical scanning observation apparatus comprising:

a light source configured to be controlled to sequentially emit illumination lights of the predetermined number of colors;

a fiber configured to guide the illumination lights emitted by the light source and to emit the illumination lights from a tip part of the fiber;

an actuator configured to drive the tip part of the fiber; along a scanning trajectory to scan the illumination lights emitted from the tip of the fiber on to an object;

a controller configured to,

for generating the image signals for the neighboring pixels, control a ratio of number of light emissions among the predetermined number of colors by the light source such that a number of light emission of a color having a higher contribution to image quality is set higher than a number of light emission of each color of the remaining colors of the predetermined number of colors having a lower contribution to image quality; and

for a first pixel of the neighboring pixels, control the light source to sequentially emit illumination light of the color having the higher contribution to image quality and illumination light a first color of the remaining colors having the lower contribution to image quality; and

for a second pixel of the neighboring pixels, control the light source to sequentially emit illumination light of the color having the higher contribution to image quality and illumination light of a second color of the remaining colors having the lower contribution to image quality,

a photodetector configured to:

for the first pixel of the neighboring pixels:

convert detection light from the object scanned by the illumination light of the color having the higher contribution to image quality to a first color component signal for the first pixel; and

convert detection light from the object scanned by the illumination light of the first color of the remaining colors having the lower contribution to image quality to a second color component signal for the first pixel; and

for the second pixel of the neighboring pixels:

convert detection light from the object scanned by the illumination light of the color having the higher contribution to image quality to a first color component signal for the second pixel; and

convert detection light from the object scanned by the illumination light of the second color of the remaining colors having the lower contribution to image quality to a third color component signal for the second pixel; and

a processor configured to:

generate an image signal for the first pixel of the neighboring pixels based on the first color component signal for the first pixel and the second color component signal for the first pixel;

generate an interpolated second color component signal, corresponding to the second color of the remaining colors having the lower contribution to image quality, for the second pixel based on interpolation of the image signal for the first pixel; and

generate an image signal for the second pixel of the neighboring pixels based on the first color component signal for the second pixel, the interpolated second color component signal for the second pixel and the third color component signal for the second pixel.

2. The optical scanning observation apparatus according to claim 1 ,

wherein the image quality comprises image brightness or contrast or bandwidth, or any combination thereof.

3. The optical scanning observation apparatus according to claim 1 ,

wherein the processor is configured to extract, from image signals of an arbitrary image, the color having the higher contribution to image quality.

4. The optical scanning observation apparatus according to claim 1 ,

wherein the controller is configured to control the ratio of the number of light emissions among the predetermined number of colors by the light source based on a user input received through in input device.

5. The optical scanning observation apparatus according to claim 1 ,

wherein the controller is configured to retrieve the ratio of the number of light emissions among the predetermined number of colors by the light source from a memory.

6. The optical scanning observation apparatus according to claim 1 ,

wherein the neighboring pixels are neighboring pixels along the scanning trajectory of the tip of the fiber.

7. The optical scanning observation apparatus according to claim 1 ,

wherein the neighboring pixels are neighboring pixels of an image to be output to a display.

8. A method for generating image signals for neighboring pixels, wherein the image signal of each of the neighboring pixels has components of a predetermined number of colors, the method comprising:

controlling a light source to sequentially emit illumination lights of the predetermined number of colors;

controlling an actuator to drive a tip of a fiber, wherein the fiber guides the illumination lights emitted by the light source and emits the illumination lights from the tip of the fiber, along a scanning trajectory to scan the illumination lights emitted from the tip of the fiber on to an object;

for generating the image signals for the neighboring pixels, controlling a ratio of number of light emissions among the predetermined number of colors by the light source such that a number of light emission of a color having a higher contribution to image quality is set higher than a number of light emission of each color of the remaining colors of the predetermined number of colors having a lower contribution to image quality;

for a first pixel of the neighboring pixels, controlling the light source to sequentially emit illumination light of the color having the higher contribution to image quality and illumination light a first color of the remaining colors having the lower contribution to image quality;

for a second pixel of the neighboring pixels, controlling the light source to sequentially emit illumination light of the color having the higher contribution to image quality and illumination light of a second color of the remaining colors having the lower contribution to image quality;

for the first pixel of the neighboring pixels:

converting detection light from the object scanned by the illumination light of the color having the higher contribution to image quality to a first color component signal for the first pixel; and

converting detection light from the object scanned by the illumination light of the first color of the remaining colors having the lower contribution to image quality to a second color component signal for the first pixel;

for the second pixel of the neighboring pixels:

converting detection light from the object scanned by the illumination light of the color having the higher contribution to image quality to a first color component signal for the second pixel; and

converting detection light from the object scanned by the illumination light of the second color of the remaining colors having the lower contribution to image quality to a third color component signal for the second pixel;

generating an image signal for the first pixel of the neighboring pixels based on the first color component signal for the first pixel and the second color component signal for the first pixel;

generating an interpolated second color component signal, corresponding to the second color of the remaining colors having the lower contribution to image quality, for the second pixel based on interpolation of the image signal for the first pixel; and

generating an image signal for the second pixel of the neighboring pixels based on the first color component signal for the second pixel, the interpolated second color component signal for the second pixel and the third color component signal for the second pixel.

9. A non-transitory computer-readable storage device storing instructions that cause one or more processors to generate image signals for neighboring pixels, wherein the image signal of each of the neighboring pixels has components of a predetermined number of colors, the instructions causing the one or more processors to at least perform:

controlling a light source to sequentially emit illumination lights of the predetermined number of colors;

controlling an actuator to drive a tip of a fiber, wherein the fiber guides the illumination lights emitted by the light source and emits the illumination lights from the tip of the fiber, along a scanning trajectory to scan the illumination lights emitted from the tip of the fiber on to an object;

for generating the image signals for the neighboring pixels, controlling a ratio of number of light emissions among the predetermined number of colors by the light source such that a number of light emission of a color having a higher contribution to image quality is set higher than a number of light emission of each color of the remaining colors of the predetermined number of colors having a lower contribution to image quality;

for a first pixel of the neighboring pixels, controlling the light source to sequentially emit illumination light of the color having the higher contribution to image quality and illumination light a first color of the remaining colors having the lower contribution to image quality;

for a second pixel of the neighboring pixels, controlling the light source to sequentially emit illumination light of the color having the higher contribution to image quality and illumination light of a second color of the remaining colors having the lower contribution to image quality;

for the first pixel of the neighboring pixels:

converting detection light from the object scanned by the illumination light of the color having the higher contribution to image quality to a first color component signal for the first pixel; and

converting detection light from the object scanned by the illumination light of the first color of the remaining colors having the lower contribution to image quality to a second color component signal for the first pixel;

for the second pixel of the neighboring pixels:

converting detection light from the object scanned by the illumination light of the color having the higher contribution to image quality to a first color component signal for the second pixel; and

converting detection light from the object scanned by the illumination light of the second color of the remaining colors having the lower contribution to image quality to a third color component signal for the second pixel;

generating an image signal for the first pixel of the neighboring pixels based on the first color component signal for the first pixel and the second color component signal for the first pixel;

generating an interpolated second color component signal, corresponding to the second color of the remaining colors having the lower contribution to image quality, for the second pixel based on interpolation of the image signal for the first pixel; and

generating an image signal for the second pixel of the neighboring pixels based on the first color component signal for the second pixel, the interpolated second color component signal for the second pixel and the third color component signal for the second pixel.