Methods and systems for adaptive imaging for low light signal enhancement in medical visualization
Adaptive imaging methods and systems for generating enhanced low light video of an object for medical visualization are disclosed and include acquiring, with an image acquisition assembly, a sequence of reference frames and/or a sequence of low light video frames depicting the object, assessing relative movement between the image acquisition assembly and the object based on at least a portion of the acquired sequence of reference video frames or the acquired sequence of low light video frames, adjusting a level of image processing of the low light video frames based at least in part on the relative movement between the image acquisition assembly and the object, and generating a characteristic low light video output from a quantity of the low light video frames, wherein the quantity of the low light video frames is based on the adjusted level of image processing of the low light video frames.
1. An adaptive imaging method for generating enhanced low-intensity light video of an object for medical visualization, comprising:
acquiring, with an image acquisition assembly, a sequence of low light video frames depicting the object;
receiving a sequence of reference video frames;
assessing relative movement between the image acquisition assembly and the object based on the reference video frames;
adjusting a level of image processing of the low light video frames based at least in part on the relative movement between the image acquisition assembly and the object; and
generating a characteristic low light video output from a quantity of the low light video frames, wherein the quantity of the low light video frames is based on the adjusted level of image processing of the low light video frames;
wherein adjusting the level of image processing of the low light video frames comprises adjusting the quantity of low light video frames from which the characteristic low light video output is generated,
wherein adjusting the quantity of low light video frames comprises setting the quantity of low light video frames to a first predetermined value if the relative movement between the image acquisition assembly and the object is below a first motion threshold,
wherein setting the quantity of low light video frames to the first predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the first predetermined value over a series of frames of the characteristic low light video output, and
wherein adjusting the quantity of low light video frames comprises setting the quantity of low light video frames to a second predetermined value if the relative movement between the image acquisition assembly and the object is above the first motion threshold, the second predetermined value being lower than the first predetermined value.
2. The method of claim 1 , wherein the sequence of reference video frames comprises frames from the sequence of low light video frames.
3. The method of claim 1 , further comprising acquiring, with the image acquisition assembly, a sequence of higher intensity light video frames generally having a higher light intensity than the low light video frames, wherein the sequence of higher intensity light video frames are acquired substantially simultaneously with the sequence of low light video frames.
4. The method of claim 3 , wherein the sequence of reference video frames comprises frames from the sequence of higher intensity light video frames.
5. The method of claim 1 , wherein assessing relative movement between the image acquisition assembly and the object comprises measuring changes in pixel intensities in a plurality of the reference video frames.
6. The method of claim 1 , wherein assessing relative movement between the image acquisition assembly and the object comprises determining a representative pixel intensity for each of a plurality of subregions in the plurality of reference video frames, and characterizing the changes in representative pixel intensity for the subregions in the plurality of the reference video frames.
7. The method of claim 1 , wherein setting the quantity of low light video frames to the second predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the second predetermined value over a series of frames of the characteristic low light video output.
8. The method of claim 7 , wherein adjusting the quantity of low light video frames comprises:
setting the quantity of low light video frames to the second predetermined value if the relative movement between the image acquisition assembly and the object is above the first motion threshold and below a second motion threshold higher than the first motion threshold; and
setting the quantity of low light video frames to a third predetermined value, if the relative movement between the image acquisition assembly and the object is above the first and second motion thresholds, the third predetermined value being lower than the first and second predetermined values.
9. The method of claim 8 , wherein setting the quantity of low light video frames to the third predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the third predetermined value over a series of frames of the characteristic low light video output.
10. The method of claim 9 , wherein adjusting the quantity of low light video frames comprises gradually increasing or decreasing the quantity of low light video frames toward a predetermined value over a series of frames of the characteristic low light video output.
11. The method of claim 1 , wherein generating the characteristic low light video output comprises determining a sum of pixel intensities of the quantity of the low light video frames on a region-by-region basis.
12. The method of claim 11 , wherein generating the characteristic low light video output further comprises dividing the sum of pixel intensities by the square root of the quantity of the low light video frames.
13. The method of claim 1 , wherein generating the characteristic low light video output from the quantity of the low light video frames comprises averaging pixel intensities of the quantity of the low light video frames on a region-by-region basis.
14. The method of claim 13 , further comprising adjusting a low light video frame exposure period based at least in part on the relative movement between the image acquisition assembly and the object.
15. The method of claim 1 , further comprising displaying at least one of the characteristic low light video output and the reference video frames on a display.
16. The method of claim 1 , further comprising controlling a timing scheme of a visible light source illuminating the object, an excitation light source illuminating the object, and the image acquisition assembly based at least in part on the relative movement between the image acquisition assembly and the object.
17. The method of claim 1 , wherein the method is performed continuously.
18. The method of claim 1 , wherein the sequence of low light video frames comprises a sequence of fluorescence video frames.
19. The method of claim 1 , wherein the sequence of low light video frames comprises a sequence of reflected light video frames.
20. The method of claim 1 , wherein the sequence of reference video frames comprises a sequence of reflected light video frames.
21. An adaptive imaging system for generating enhanced low-intensity light video of an object for medical visualization, comprising:
an image acquisition assembly configured to acquire a sequence of low light video frames depicting the object;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
assessing relative movement between the image acquisition assembly and the object based on reference video frames;
adjusting a level of image processing of the low light video frames based at least in part on the relative movement between the image acquisition assembly and the object; and
generating a characteristic low light video output from a quantity of the low light video frames, wherein the quantity of the low light video frames is based on the adjusted level of image processing of the low light video frames,
wherein adjusting the level of image processing of the low light video frames comprises adjusting the quantity of low light video frames from which the characteristic low light video output is generated,
wherein adjusting the quantity of low light video frames comprises setting the quantity of low light video frames to a first predetermined value if the relative movement between the image acquisition assembly and the object is below a first motion threshold,
wherein setting the quantity of low light video frames to the first predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the first predetermined value over a series of frames of the characteristic low light video output, and
wherein adjusting the quantity of low light video frames comprises setting the quantity of low light video frames to a second predetermined value if the relative movement between the image acquisition assembly and the object is above the first motion threshold, the second predetermined value being lower than the first predetermined value.
22. A fluorescence imaging agent for use with the method of claim 1 for imaging an object during blood flow imaging, tissue perfusion imaging, lymphatic imaging, or a combination thereof.