Granted Patent B2

US 12,525,340 · App. 18/364,462 · Granted Jan 13, 2026

Inventors: John J.P. Fengler (North Vancouver, CA); Paul Roald Westwick (Vancouver, CA); Frederick Allen Moore (Vancouver, CA)

Assignee: Stryker Corporation

G16H30/40A61B1/000095A61B1/043A61B1/045A61B1/05A61B1/0638A61B1/0655A61B1/0669A61B1/0684A61B1/07A61B5/0071A61B6/481A61B6/5205G02B23/12G06T5/50H04N23/11H04N23/70H04N23/74H04N23/951A61B1/00186A61B1/0646A61B1/3132A61B5/1121A61B5/6869A61B5/6875A61B5/7221A61B5/7264A61B2505/05A61B2562/0219A61B2562/0233A61B2576/00G06T2207/10064G06T2207/10068G06T2207/20008G06T2207/30004H04N23/555

Abstract

Claims (41)

1 . An adaptive imaging method for generating enhanced low-intensity light video of an object for medical visualization, comprising:

acquiring, with an image acquisition assembly, a sequence of low light video frames depicting the object;

receiving a sequence of reference video frames;

assessing relative movement between the image acquisition assembly and the object based on the reference video frames;

adjusting a level of image processing of the low light video frames based at least in part on the relative movement between the image acquisition assembly and the object, wherein adjusting the level of image processing of the low light video frames is performed after acquiring the low light video frames; and

generating a characteristic low light video output from a quantity of the low light video frames, wherein the quantity of the low light video frames is based on the adjusted level of image processing of the low light video frames.

2 . The method of claim 1 , wherein the sequence of reference video frames comprises frames from the sequence of low light video frames.

3 . The method of claim 1 , further comprising acquiring, with the image acquisition assembly, a sequence of higher intensity light video frames generally having a higher light intensity than the low light video frames, wherein the sequence of higher intensity light video frames are acquired substantially simultaneously with the sequence of low light video frames.

4 . The method of claim 3 , wherein the sequence of reference video frames comprises frames from the sequence of higher intensity light video frames.

5 . The method of claim 1 , wherein assessing relative movement between the image acquisition assembly and the object comprises measuring changes in pixel intensities in a plurality of the reference video frames.

6 . The method of claim 1 , wherein assessing relative movement between the image acquisition assembly and the object comprises determining a representative pixel intensity for each of a plurality of subregions in the plurality of reference video frames, and characterizing the changes in representative pixel intensity for the subregions in the plurality of the reference video frames.

7 . The method of claim 1 , wherein adjusting the level of image processing of the low light video frames comprises adjusting the quantity of low light video frames from which the characteristic low light video output is generated.

8 . The method of claim 1 , wherein adjusting the quantity of low light video frames comprises setting the quantity of low light video frames to a first predetermined value if the relative movement between the image acquisition assembly and the object is below a first motion threshold.

9 . The method of claim 8 , wherein setting the quantity of low light video frames to the first predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the first predetermined value over a series of frames of the characteristic low light video output.

10 . The method of claim 9 , wherein adjusting the quantity of low light video frames comprises setting the quantity of low light video frames to a second predetermined value if the relative movement between the image acquisition assembly and the object is above the first motion threshold, the second predetermined value being lower than the first predetermined value.

11 . The method of claim 10 , wherein setting the quantity of low light video frames to the second predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the second predetermined value over a series of frames of the characteristic low light video output.

12 . The method of claim 11 , wherein adjusting the quantity of low light video frames comprises:

setting the quantity of low light video frames to the second predetermined value if the relative movement between the image acquisition assembly and the object is above the first motion threshold and below a second motion threshold higher than the first motion threshold; and

setting the quantity of low light video frames to a third predetermined value, if the relative movement between the image acquisition assembly and the object is above the first and second motion thresholds, the third predetermined value being lower than the first and second predetermined values.

13 . The method of claim 12 , wherein setting the quantity of low light video frames to the third predetermined value comprises gradually increasing or decreasing the quantity of low light video frames to the third predetermined value over a series of frames of the characteristic low light video output.

14 . The method of claim 13 , wherein adjusting the quantity of low light video frames comprises gradually increasing or decreasing the quantity of low light video frames toward a predetermined value over a series of frames of the characteristic low light video output.

15 . The method of claim 1 , wherein generating the characteristic low light video output comprises determining a sum of pixel intensities of the quantity of the low light video frames on a region-by-region basis.

16 . The method of claim 15 , wherein generating the characteristic low light video output further comprises dividing the sum of pixel intensities by a quotient determined based on the quantity of the low light video frames.

17 . The method of claim 1 , wherein generating the characteristic low light video output from the quantity of the low light video frames comprises averaging pixel intensities of the quantity of the low light video frames on a region-by-region basis.

18 . The method of claim 17 , further comprising adjusting a low light video frame exposure period based at least in part on the relative movement between the image acquisition assembly and the object.

19 . The method of claim 1 , further comprising displaying at least one of the characteristic low light video output and the reference video frames on a display.

20 . The method of claim 1 , further comprising controlling a timing scheme of a visible light source illuminating the object, an excitation light source illuminating the object, and the image acquisition assembly based at least in part on the relative movement between the image acquisition assembly and the object.

21 . The method of claim 1 , wherein the method is performed continuously.

22 . The method of claim 1 , wherein the sequence of low light video frames comprises a sequence of fluorescence video frames.

23 . The method of claim 1 , wherein the sequence of low light video frames comprises a sequence of reflected light video frames.

24 . The method of claim 1 , wherein the sequence of reference video frames comprises a sequence of reflected light video frames.

25 . The method of claim 1 , wherein the acquiring is performed at a constant exposure period setting.

26 . An adaptive imaging system for generating enhanced low-intensity light video of an object for medical visualization, comprising:

an image acquisition assembly configured to acquire a sequence of low light video frames depicting the object;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

assessing relative movement between the image acquisition assembly and the object based on reference video frames;

adjusting a level of image processing of the low light video frames based at least in part on the relative movement between the image acquisition assembly and the object, wherein adjusting the level of image processing of the low light video frames is performed after acquiring the low light video frames; and

generating a characteristic low light video output from a quantity of the low light video frames, wherein the quantity of the low light video frames is based on the adjusted level of image processing of the low light video frames.

27 . The system of claim 26 , wherein the acquiring is performed at a constant exposure period setting.

Assignments (1)

Continuity (4)

References Cited (400)