IP Library Granted Patent US 10,799,088
Granted Patent B2
US 10,799,088 · App. 16/071,299 · Granted Oct 13, 2020

Image processing device, image processing method and recording medium

Inventors: Koji Kashima (Kanagawa, JP); Tsuneo Hayashi (Tokyo, JP)
Assignee: SONY CORPORATION
A61B1/00009A61B1/00043G02B5/3083G06T7/0012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,799,088
App. No.
16/071,299
Granted
Oct 13, 2020
Kind
B2
Abstract

A medical imaging system having an image sensor, a birefringent mask coupled to the image sensor, and processing circuitry that obtains image data from the image sensor, and performs processing on the image data based on unique optical characteristics of a coupled medical device, wherein the processing includes selecting at least one of depth of field expansion and blur improvement based on the unique optical characteristics.

Claims (44)

1. A medical imaging system, comprising:

an image sensor;

a birefringent mask coupled to the image sensor; and

processing circuitry configured to

obtain image data from the image sensor coupled to a coupled medical device,

perform processing on the image data based on unique optical characteristics of the coupled medical device,

select at least one of depth of field expansion and blur improvement based on the unique optical characteristics,

set a first point spread function on condition that processing is on light in a first wavelength band, and

set a second point spread function, different than the first point spread function, on condition that processing is on light in a second wavelength band, different from the first wavelength band.

2. The medical imaging system according to claim 1 , wherein the processing uses one or more point spread functions (PSFs) extracted from a non-transitory memory, the non-transitory memory being configured to store a plurality of PSFs associated with the coupled medical device.

3. The medical imaging system according to claim 2 , wherein the stored plurality of PSFs associated with each medical device of a plurality of medical devices are generated at one of a time of manufacturing before sale, a time before surgery, and a time during surgery.

4. The medical imaging system according to claim 1 , wherein the process includes selecting by giving priority to one of depth of field expansion and blur improvement.

5. The medical imaging system according to claim 1 , further comprising:

a lens barrel.

6. The medical imaging system according to claim 5 , wherein the image sensor is within a camera head.

7. The medical imaging system according to claim 6 , wherein the birefringent mask is between the camera head and the lens barrel.

8. The medical imaging system according to claim 6 , wherein the birefringent mask is incorporated into one of the lens barrel and the camera head.

9. The medical imaging system according to claim 6 , wherein the birefringent mask is detachable from both the lens barrel and the camera head.

10. The medical imaging system according to claim 1 , wherein the images are generated by giving priority to at least one of depth of the field expansion and the blur improvement based on a medical use of the imaging.

11. The medical imaging system according to claim 1 , wherein the processing circuitry is further configured to generate the output images by being configured to select one of one or more modified point spread functions (PSFs) generated from point spread functions (PSFs) stored in a memory.

12. The medical imaging system according to claim 11 , where the modified point spread functions (PSFs) are generated by assigning a weight to the point spread functions (PSFs) stored in the memory.

13. The medical imaging system according to claim 12 , wherein the weight is assigned based on a fineness of a sample.

14. The medical imaging system according to claim 12 , wherein the weight is assigned based on a degree of focus.

15. The medical imaging system according to claim 12 , wherein the weight is assigned based on a color of a subject.

16. The medical imaging system according to claim 15 , wherein the weight is assigned to emphasize a red component when considering tissue.

17. The medical imaging system according to claim 12 , wherein the weight is assigned and/or one of the one or more modified point spread functions (PSFs) is selected based on an observation method.

18. The medical imaging system according to claim 17 , wherein the weight is assigned and/or one of the one or more modified point spread functions (PSFs) is selected to prioritize depth of field when in water and when approaching deep portions of the nose, ear and brain, to improve blur when treatment is performed on a blood vessel on a surface of a brain, and to prioritize red frequencies when near-infrared fluorescence observation is being performed.

19. The medical imaging system according to claim 12 , wherein the weight is assigned and/or one of the one or more modified point spread functions (PSFs) is selected based on an observation target.

20. The medical imaging system according to claim 19 , wherein the weight is assigned and/or one of the one or more modified point spread functions (PSFs) is selected to prioritize depth of field when observing an organ in an abdominal cavity or a thoracic cavity and prioritize blur when observing a blood vessel stream.

21. The medical imaging system according to claim 19 , wherein the observation target is determined based on user selection.

22. The medical imaging system according to claim 11 , wherein the processing circuitry is further configured to generate the output images by being configured to select one of the one or more modified point spread functions (PSFs) generated from the point spread functions (PSFs) stored in the memory based on an auto focus (AF) state or a manual focus state.

23. A medical image processing apparatus, comprising:

processing circuitry configured to

obtain image data from an image sensor coupled to a coupled medical device and to a birefringent mask,

perform processing on the image data based on unique optical characteristics of a coupled medical device,

select at least one of depth of field expansion and blur improvement based on the unique optical characteristics,

set a first point spread function on condition that processing is on light in a first wavelength band, and

set a second point spread function, different than the first point spread function, on condition that processing is on light in a second wavelength band, different from the first wavelength band.

24. A medical image processing method, comprising:

obtaining image data from an image sensor coupled to a coupled medical device and to a birefringent mask;

performing processing on the image data based on unique optical characteristics of a coupled medical device, the processing including selecting at least one of depth of field expansion and blur improvement based on the unique optical characteristics;

setting a first point spread function on condition that processing is on light in a first wavelength band;

setting a second point spread function, different than the first point spread function, on condition that processing is on light in a second wavelength band, different from the first wavelength band; and

outputting the generated images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2018
From: KASHIMA, KOJI; HAYASHI, TSUNEO
To: SONY CORPORATION
Reel/Frame 046592/0453 →
Priority Claims (1)
JP 2016-045244 · Mar 9, 2016 · national
Continuity (1)
Related Publication 20190328208A1 · Oct 31, 2019
Cited By (1)
US 12,295,547