Contrast enhancement for medical imaging
A method of visualizing tissue of a subject includes receiving a fluorescence image of the tissue of the subject, wherein the fluorescence image comprises a plurality of intensity values, a first portion of the intensity values are associated with a first fluorescence emission that is from fluorescence agent that is preferentially accumulated or activated in a target region in the tissue and a second portion of the intensity values are associated with a second fluorescence emission that is from fluorescence agent that is not located within the target region in the tissue; generating an enhanced fluorescence image by reducing one or more of the intensity values that are below a threshold intensity value to increase contrast between the target region in the tissue and areas that are associated with the fluorescence agent that is not located within the target region in the tissue; and displaying the enhanced fluorescence image.
1. A method of visualizing tissue of a subject, the method comprising:
receiving a fluorescence image of the tissue of the subject, wherein the fluorescence image comprises a plurality of intensity values;
analyzing the plurality of intensity values to determine a threshold intensity value such that intensity values that are associated with a first fluorescence emission that is from fluorescence agent that is preferentially accumulated or activated in a target region in the tissue are above the threshold intensity value and intensity values that are associated with a second fluorescence emission that is from fluorescence agent that is located in non-target regions in the tissue are below the threshold intensity value;
generating an enhanced fluorescence image by applying a non-linear transfer function to the intensity values that are below the threshold intensity value, wherein the non-linear transfer function is configured to reduce the intensity values that are below the threshold intensity value in accordance with a difference between the threshold intensity value and the intensity values that are below the threshold intensity value; and
displaying the enhanced fluorescence image in which intensity values corresponding to the non-target regions in the tissue are reduced relative to corresponding intensity values in the received fluorescence image and intensity values in the enhanced fluorescence image corresponding to the target region in the tissue are unchanged relative to corresponding intensity values in the received fluorescence image such that contrast in the enhanced fluorescence image is increased between the target region in the tissue and the non-target regions in the tissue, wherein at least a portion of the target region is diagnosed or treated based on the displayed enhanced fluorescence image.
2. The method of claim 1 , wherein the threshold intensity value is based on a percentage of intensity values in the fluorescence image that are equal to or below a predefined percentile.
3. The method of claim 2 , wherein the percentage is at least 75% and the corresponding predefined percentile is at least the 75th.
4. The method of claim 1 , wherein the threshold intensity value is based on a maximum intensity value in the fluorescence image.
5. The method of claim 4 , wherein the threshold intensity value is a predefined percentage of the maximum intensity value.
6. The method of claim 5 , wherein the predefined percentage is at least 75%.
7. The method of claim 1 , wherein generating the enhanced fluorescence image comprises increasing one or more intensity values that are above the threshold intensity value.
8. The method of claim 1 , wherein the non-linear transfer function comprises a power function.
9. The method of claim 8 , wherein the power function is based on a power of at least 2.
10. The method of claim 1 , further comprising illuminating the tissue with fluorescence excitation light.
11. The method of claim 1 , further comprising receiving the first fluorescence emission from the fluorescence agent that is preferentially accumulated or activated in the target region in the tissue and the second fluorescence emission from fluorescence agent that is not located within the target region in the tissue.
12. The method of claim 11 , further comprising receiving the first fluorescence emission and the second fluorescence emission using an endoscope.
13. The method of claim 11 , further comprising receiving the first fluorescence emission and the second fluorescence emission using an open field imager.
14. The method of claim 1 , further comprising locating an area of the tissue having target cells based on the displayed enhanced fluorescence image.
15. The method of claim 1 , wherein the enhanced fluorescence image is displayed in combination with a visible light image.
16. The method of claim 15 , wherein the visible light image is a white light image.
17. The method of claim 15 , wherein displaying the enhanced fluorescence image comprises at least one of overlaying the enhanced fluorescence image on the visible light image, displaying the enhanced fluorescence image picture in picture, and displaying the enhanced fluorescence image side by side with the visible light image.
18. The method of claim 1 , wherein the fluorescence image was generated by an imager and the fluorescence image comprises imager pixel intensity values.
19. The method of claim 1 , wherein the fluorescence image is based on an image generated by a fluorescence imager.
20. The method of claim 19 , wherein a number of intensity values in the fluorescence image is different than a number of pixels in the fluorescence imager.
21. The method of claim 1 , wherein at least one of the fluorescence agent that is preferentially accumulated or activated in a target region in the tissue and the fluorescence agent that is not located within the target region in the tissue comprises at least one of Indocyanine green, Methylene Blue, proflavine, aminolevulinic acid or a derivative or product thereof, hexaminolevulinate, methyl aminolevulinate, a cathepsin activatable probe, a protease activatable probe, fluorescent lectin, an HSP90 inhibitor, a chlorotoxin, 7-aa peptide-IRDye800CW, a c-Met targeting peptide, a folate receptor targeter, a tumor-specific integrin receptor binder, an anti-EGFR binding peptide, an anti-EGFR affibody, a GRPR receptor binding peptide, a VEGF antibody, an EGFR antibody, and a carbonic anhydrase IX antibody.
22. The method of claim 1 , wherein the fluorescence agent that is preferentially accumulated or activated in a target region in the tissue and the fluorescence agent that is not located within the target region in the tissue are the same type of fluorescence agent.
23. The method of claim 1 , wherein the fluorescence image is received from an imager.
24. The method of claim 1 , wherein the fluorescence image is received from a memory.
25. The method of claim 1 , wherein the enhanced fluorescence image is displayed during a surgical procedure on the subject.
26. The method of claim 25 , wherein the surgical procedure is a prostate or a spinal surgery and the target region comprises a nerve, wherein the surgical procedure is a lower pelvic surgery and the target region comprises a ureter, wherein the surgical procedure is a hepatobiliary surgery and the target region comprises a biliary duct, or wherein the surgical procedure comprises a tumor removal and the target region comprises the tumor.
27. The method of claim 1 , wherein the fluorescence image is a video frame.
28. The method of claim 1 , wherein the fluorescence agent that is preferentially accumulated or activated in a target region in the tissue is bound to cells targeted by the fluorescence agent and the fluorescence agent that is not located within the target region in the tissue is not bound to cells targeted by the fluorescence agent.
29. The method of claim 1 , wherein the region targeted by the fluorescence agent comprises at least one of a tumor, a nerve, a ureter, and a biliary duct.
30. A system for visualizing tissue of a subject, the system comprising:
a display;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a fluorescence image of the tissue of the subject, wherein the fluorescence image comprises a plurality of intensity values;
analyzing the plurality of intensity values to determine a threshold intensity value such that intensity values that are associated with a first fluorescence emission that is from fluorescence agent that is preferentially accumulated or activated in a target region in the tissue are above the threshold intensity value and intensity values that are associated with a second fluorescence emission that is from fluorescence agent that is located in non-target regions in the tissue are below the threshold intensity value;
generating an enhanced fluorescence image by applying a non-linear transfer function to the intensity values that are below the threshold intensity value, wherein the non-linear transfer function is configured to reduce the intensity values that are below the threshold intensity value in accordance with a difference between the threshold intensity value and the intensity values that are below the threshold intensity value; and
displaying the enhanced fluorescence image in which intensity values corresponding to the non-target regions in the tissue are reduced relative to corresponding intensity values in the received fluorescence image and intensity values in the enhanced fluorescence image corresponding to the target region in the tissue are unchanged relative to corresponding intensity values in the received fluorescence image such that contrast in the enhanced fluorescence image is increased between the target region in the tissue and the non-target regions in the tissue, wherein the displayed enhanced fluorescence image is configured to be used to diagnose and/or treat at least a portion of the target region.
31. The system of claim 30 , further comprising a light source for providing fluorescence excitation light to the tissue of the subject.
32. The system of claim 30 , further comprising an imager for generating the fluorescence image.
33. The system of claim 32 , wherein the imager is an endoscopic imager or an open field imager.
34. A non-transitory computer readable storage medium storing one or more programs for execution by one or more processors of a system for visualizing tissue of a subject, the one or more programs comprising instructions for causing the system to:
receive a fluorescence image of the tissue of the subject, wherein the fluorescence image comprises a plurality of intensity values;
analyze the plurality of intensity values to determine a threshold intensity value such that intensity values that are associated with a first fluorescence emission that is from fluorescence agent that is preferentially accumulated or activated in a target region in the tissue are above the threshold intensity value and intensity values that are associated with a second fluorescence emission that is from fluorescence agent that is located in non-target regions in the tissue are below the threshold intensity value;
generate an enhanced fluorescence image by applying a non-linear transfer function to the intensity values that are below the threshold intensity value, wherein the non-linear transfer function is configured to reduce the intensity values that are below the threshold intensity value in accordance with a difference between the threshold intensity value and the intensity values that are below the threshold intensity value; and
display the enhanced fluorescence image in which intensity values corresponding to the non-target regions in the tissue are reduced relative to corresponding intensity values in the received fluorescence image and intensity values in the enhanced fluorescence image corresponding to the target region in the tissue are unchanged relative to corresponding intensity values in the received fluorescence image such that contrast in the enhanced fluorescence image is increased between the target region in the tissue and the non-target regions in the tissue, wherein the displayed enhanced fluorescence image is configured to be used to diagnose and/or treat at least a portion of the target region.