IP Library Granted Patent US 11,425,322
Granted Patent B2
US 11,425,322 · App. 17/221,972 · Granted Aug 23, 2022

Comprehensive fixed pattern noise cancellation

Inventors: Laurent Blanquart (Westlake Village, CA); John Richardson (Westlake Village, CA)
Assignee: DePuy Synthes Products, Inc.
H04N5/365A61B1/00006A61B1/00009A61B1/00057G06T5/002G06T5/50G06T2207/20224
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,425,322
App. No.
17/221,972
Filed
Apr 5, 2021
Granted
Aug 23, 2022
Kind
B2
Art Unit
2486
USPC
348/65
Abstract

The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments having cancelled fixed pattern noise.

Claims (44)

1. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:

actuating an emitter to emit a plurality of pulses of electromagnetic radiation to cause illumination within the light deficient environment;

pulsing the emitter at a predetermined interval corresponding to a sensing interval of a pixel array; and

sensing reflected electromagnetic radiation from a pulse with the pixel array to create an image frame in a plurality of cycles, each cycle including an integration period of the pixel array, wherein a duration of the integration period is variable from cycle to cycle in the plurality of cycles wherein said pixel array is actuated at a sensing interval that corresponds to the pulse interval of said emitter;

stopping the emitter from pulsing for a single iteration;

creating a dark frame by sensing the pixel array while the emitter is not pulsing a pulse;

creating one or more reference frames, using said dark frame, for use in removing fixed pattern noise;

removing fixed pattern noise from the image frame by subtracting stored reference data; and

creating a stream of images by combining a plurality of image frames to form a video stream;

wherein the method further comprises computing reference data for a particular integration duration by interpolating between two or more dark reference buffers established at two or more different integration times having two or more different duration lengths.

2. The method of claim 1 ,

wherein one or more dark frames are created from one or more sensing of the pixel array while the emitter is not issuing electromagnetic energy, and

wherein the one or more dark frames are created, interspersed within the image frames.

3. The method of claim 1 , wherein said one or more reference frames are created upon startup of a system comprising a laser emitter and pixel array and stored within memory associated with the system.

4. The method of claim 3 , wherein a plurality of reference frames may be established at different exposure times.

5. The method of claim 1 , further comprising enhancing the precision of the one or more reference frames with continued sampling of subsequent single dark frames.

6. The method of claim 5 , further comprising enhancing the precision of an existing reference frame by factoring in subsequent dark frame data, using exponential smoothing.

7. The method of claim 1 , wherein each image frame is enhanced before being integrated into the video stream.

8. The method in claim 7 , wherein the method further comprises subtracting data from a single dark reference buffer from an image frame.

9. The method of claim 1 , wherein the method further comprises subtracting said reference data from an image frame.

10. The method of claim 1 , wherein the emitter is a laser to emit a laser pulse of a wavelength of electromagnetic radiation to cause illumination within the light deficient environment.

11. The method of claim 1 , wherein the emitter is an LED emitter to emit an LED pulse of a wavelength of electromagnetic radiation to cause illumination within the light deficient environment.

12. A system for digital imaging system for use in ambient light deficient environments comprising:

one or more processors;

one or more memory devices operably coupled to the one or more processors and storing executable and operational data, the executable and operational data effective to cause the one or more processors to:

actuate a laser emitter to emit a plurality of pulses of electromagnetic radiation to cause illumination within the light deficient environment;

pulse the laser emitter at a predetermined interval corresponding to a sensing interval of a pixel array;

sense reflected electromagnetic radiation from the pulse with the pixel array to create an image frame in a plurality of cycles, wherein each cycle in the plurality of cycles includes an integration time of the pixel array, wherein a duration of the integration time is variable from cycle to cycle in the plurality of cycles, wherein said the pixel array is actuated at a sensing interval that corresponds to the pulse interval of said laser emitter;

stop the emitter from pulsing for a single iteration;

sense the pixel array while the emitter is not pulsing a pulse to create a dark frame;

create one or more reference frames, using said dark frame, for use in removing fixed pattern noise;

remove fixed pattern noise from an image frame by subtracting values derived from one or more dark reference frames; and

create a stream of images by combining a plurality of image frames to form a video stream;

wherein the executable and operational data is effective to cause the one or more processors to compute the reference data for a particular integration duration by interpolating between two or more dark reference buffers established at two or more different integration times having two or more different duration lengths.

13. The system of claim 12 ,

wherein one or more dark frames are created from one or more sensing of the pixel array while the emitter is not issuing electromagnetic energy, and

wherein the one or more dark frames are created, interspersed within the image frames.

14. The system of claim 12 , wherein said one or more reference frames are created upon startup of a system comprising the laser emitter and pixel array and stored within memory associated with the system.

15. The system of claim 14 , wherein a plurality of reference frames may be established at different exposure times.

16. The system of claim 12 , wherein the executable and operational data is effective to cause the one or more processors to enhance the precision of the one or more reference frames with continued sampling of subsequent single dark frames.

17. The system of claim 16 , wherein the executable and operational data effective to cause the one or more processors to enhance the precision of an existing reference frames by factoring in subsequent dark frame data, using exponential smoothing.

18. The system of claim 12 , wherein each image frame is enhanced before being integrated into the video stream.

19. The system of claim 18 , wherein the executable and operational data is effective to cause the one or more processors to subtract data from a single dark reference buffer from an image frame.

20. The system of claim 12 , wherein the executable and operational data is effective to cause the one or more processors to subtract said reference data from an image frame.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2021
From: BLANQUART, LAURENT; RICHARDSON, JOHN
To: OLIVE MEDICAL CORPORATION
Reel/Frame 055819/0769 →
MERGER AND CHANGE OF NAME Recorded Apr 5, 2021
From: OLIVE MEDICAL CORPORATION; DEPUY SYNTHES PRODUCTS, INC.
To: DEPUY SYNTHES PRODUCTS, INC.
Reel/Frame 055819/0803 →
Continuity (5)
Continuation 16420420 · May 23, 2019
Continuation 14214789 · Mar 15, 2014
Provisional Application 61790590 · Mar 15, 2013
Provisional Application 61790983 · Mar 15, 2013
Related Publication 20210235031A1 · Jul 29, 2021
Cited By (4)
US 12,238,265 US 12,316,965 US 12,470,831 US 12,647,691