Depth and contour detection for anatomical targets
Techniques for detecting depth contours of an anatomical target and for enhancing imaging of the anatomical target are provided. In an example, a reference pattern of light can be projected across an anatomical target and an image of the reflected light pattern upon the anatomical target can be captured. The captured light pattern can be analyzed to determine contour information, which can then be used to provide 3D cues to enhance a 2-dimensional image of the anatomical target.
1. An image enhancement system for enhancing a two-dimensional display image, the image enhancement system comprising:
image processing circuitry configured to perform operations, the operations comprising:
receiving an image signal that represents a two-dimensional camera image of a surface of an anatomical target being illuminated by light having a first pattern of lines;
detecting, from the two-dimensional camera image, a second pattern of lines, the second pattern of lines including at least some lines that are distorted in at least one of spacing or thickness compared to the first pattern of lines;
determining contour information of the surface of the anatomical target based on the distortion of the second pattern of lines compared to the first pattern of lines; and
generating an enhanced two-dimensional image that includes the two-dimensional camera image with adjusted shading based on the contour information.
2. The image enhancement system of claim 1 , wherein the image processing circuitry is configured to perform operations for generating the enhanced two-dimensional image to include three-dimensional cues based on the contour information and to not include the second pattern of lines.
3. The image enhancement system of claim 1 , further comprising:
a first illumination source configured to project the light having the first pattern of lines at the surface of the anatomical target via a first optical path that extends through an endoscope or a laparoscope to the anatomical target.
4. The image enhancement system of claim 3 , wherein the first illumination source is configured to generate coherent, polarized light.
5. The image enhancement system of claim 3 , further comprising:
a second illumination source configured to illuminate the anatomical target via a second optical path.
6. The image enhancement system of claim 5 , wherein the second illumination source is part of an endoscopic or laparoscopic system that includes the endoscope or the laparoscope.
7. The image enhancement system of claim 3 , further comprising:
a camera configured to generate the image signal from the two-dimensional camera image of the surface of the anatomical target being illuminated by the first pattern of lines.
8. The image enhancement system of claim 7 , wherein the camera is positioned at a distal end of the endoscope or the laparoscope.
9. The image enhancement system of claim 7 , wherein the camera is located directly adjacent to the anatomical target with no intervening optical elements between the camera and the anatomical target.
10. The image enhancement system of claim 1 , further comprising:
a display configured to display the enhanced two-dimensional image.
11. A method for enhancing a two-dimensional display image, the method comprising:
receiving, with processing circuitry, an image signal that represents a two-dimensional camera image of a surface of an anatomical target being illuminated by light having a first pattern of lines;
detecting, with the processing circuitry, from the two-dimensional camera image, a second pattern of lines, the second pattern of lines including at least some lines that are distorted in at least one of spacing or thickness compared to the first pattern of lines;
determining, with the processing circuitry, contour information of the surface of the anatomical target based on the distortion of the second pattern of lines compared to the first pattern of lines; and
generating, with the processing circuitry, an enhanced two-dimensional image that includes the two-dimensional camera image with adjusted shading based on the contour information.
12. The method of claim 11 , wherein the enhanced two-dimensional image includes three-dimensional cues based on the contour information and does not include the second pattern of lines.
13. The method of claim 11 , further comprising:
projecting, with a first illumination source, the light having the first pattern of lines at the surface of the anatomical target via a first optical path that extends through an endoscope or a laparoscope to the anatomical target.
14. The method of claim 13 , further comprising:
illuminating the anatomical target, via a second optical path, with a second illumination source that is part of an endoscopic or laparoscopic system that includes the endoscope or the laparoscope.
15. The method of claim 13 , further comprising:
generating, with a camera, the image signal from the two-dimensional camera image of the surface of the anatomical target being illuminated by the light having the first pattern of lines, the camera being positioned at a distal end of the endoscope or the laparoscope, the camera being located directly adjacent to the anatomical target with no intervening optical elements between the camera and the anatomical target.
16. A non-transitory computer-readable storage medium storing instructions for enhancing a two-dimensional display image, the instructions, when executed by processing circuitry, cause the processing circuitry to perform operations, the operations comprising:
receiving, with processing circuitry, an image signal that represents a two-dimensional camera image of a surface of an anatomical target being illuminated by light having a first pattern of lines;
detecting, with the processing circuitry, from the two-dimensional camera image, a second pattern of lines, the second pattern of lines including at least some lines that are distorted in at least one of spacing or thickness compared to the first pattern of lines;
determining, with the processing circuitry, contour information of the surface of the anatomical target based on the distortion of the second pattern of lines compared to the first pattern of lines; and
generating, with the processing circuitry, an enhanced two-dimensional image that includes the two-dimensional camera image with adjusted shading based on the contour information.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the enhanced two-dimensional image includes three-dimensional cues based on the contour information and does not include the second pattern of lines.
18. The non-transitory computer-readable storage medium of claim 16 , wherein the operations further comprise:
projecting, with a first illumination source, the light having the first pattern of lines at the surface of the anatomical target via a first optical path that extends through an endoscope or a laparoscope to the anatomical target.
19. The non-transitory computer-readable storage medium of claim 18 , wherein the operations further comprise:
illuminating the anatomical target, via a second optical path, with a second illumination source that is part of an endoscopic or laparoscopic system that includes the endoscope or the laparoscope.
20. The non-transitory computer-readable storage medium of claim 18 , wherein the operations further comprise:
generating, with a camera, the image signal from the two-dimensional camera image of the surface of the anatomical target being illuminated by the light having the first pattern of lines, the camera being positioned at a distal end of the endoscope or the laparoscope, the camera being located directly adjacent to the anatomical target with no intervening optical elements between the camera and the anatomical target.