IP Library Granted Patent US 9,509,917
Granted Patent B2
US 9,509,917 · App. 13/952,564 · Granted Nov 29, 2016

Wide dynamic range using monochromatic sensor

Inventors: Laurent Blanquart (Westlake Village, CA); John Richardson (Calabasa, CA)
Assignee: DePuy Synthes Products, Inc.
H04N5/2354A61B1/045H04N5/35554H04N5/37457H04N9/07H04N13/0239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,509,917
App. No.
13/952,564
Granted
Nov 29, 2016
Kind
B2
Abstract

A digital imaging method for use with an endoscope in ambient light deficient environments is disclosed. In an implementation, the method may include illuminating the environment with pulsed electromagnetic radiation and sensing differing exposures of reflected electromagnetic radiation with a pixel array of an image sensor. The method may further include receiving image data from the pixel array that corresponds to the differing exposures. The method may include creating exposed frames from the image data, where each frame corresponds with a different exposure. The method may further include emitting pulses of electromagnetic radiation during a blanking period. The method may further include creating a display frame from the exposed frames. The method may further include creating a stream of images by sequentially combining display frames taken using the differing exposures to provide increased dynamic range.

Claims (39)

1. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:

illuminating the environment with pulsed electromagnetic radiation;

sensing a plurality of differing exposures of reflected electromagnetic radiation with a pixel array of an image sensor;

receiving image data from said pixel array corresponding to the plurality of differing exposures of reflected electromagnetic radiation;

creating a plurality of exposed frames from said image data, wherein each exposed frame corresponds to a different exposure;

emitting pulses of electromagnetic radiation during a predefined portion of a frame readout period of the image sensor during which pulse sensitive pixels are not being read;

creating a single display frame from the plurality of exposed frames; and

creating a stream of images by sequentially combining a plurality of display frames taken using the plurality of differing exposures to provide increased dynamic range.

2. The method of claim 1 , wherein the pulsed electromagnetic radiation is pulsed in a pattern of red, green, blue, and green.

3. The method of claim 1 , wherein the pulsed electromagnetic radiation is pulsed in a pattern of luminance, chrominance blue, luminance, and chrominance red.

4. The method of claim 1 , wherein the pulsed electromagnetic radiation is pulsed in a four cycle pattern.

5. The method of claim 1 , wherein the pulsed electromagnetic radiation is pulsed in a three cycle pattern.

6. The method of claim 1 , wherein the pulsed electromagnetic radiation comprises pulses in red, green, and blue color space and luminance, chromared, and chromablue color space.

7. The method of claim 1 , comprising horizontal binning during a charge period of a pixel array operation.

8. The method of claim 1 , further comprising varying the pattern of a frame exposure period.

9. The method of claim 1 , further comprising creating a three dimensional image stream by combining the image frames of a plurality of pixel arrays disposed on a plurality of substrates that are offset relative a scene.

10. The method of claim 1 , wherein the pixel array is disposed on a first substrate and supporting circuitry is disposed remotely on a second substrate.

11. The method of claim 1 , further comprising pulsing an emitter to produce a pattern of green long exposed combined with green short exposed then blue then green long exposed combined with green short exposed then red in a cycle.

12. The method of claim 1 , further comprising pulsing an emitter to produce a pattern of green long exposed combined with green short exposed then blue long exposed combined with blue short exposed then green long exposed combined with green short exposed then red long exposed combined with red short exposed in a cycle.

13. The method of claim 1 , further comprising pulsing an emitter to produce a pattern of luminance long exposed combined with luminance short exposed then chrominance blue then luminance long exposed combined with luminance short exposed then chrominance red in a cycle.

14. The method of claim 1 , further comprising pulsing an emitter to produce a pattern of luminance long exposed combined with luminance short exposed then chrominance blue long exposed combined with chrominance blue short exposed then luminance long exposed combined with luminance short exposed then chrominance red long exposed combined with chrominance red short exposed in a cycle.

15. The method of claim 1 , further comprising pulsing an emitter to produce a pattern having of chrominance blue and chrominance red within the same frame.

16. The method of claim 1 , further comprising pulsing an emitter to produce a pattern having of blue and red within the same frame.

17. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:

illuminating the environment with pulsed electromagnetic radiation;

sensing a plurality of differing exposures of reflected electromagnetic radiation with a pixel array of an image sensor;

receiving image data from said pixel array corresponding to the plurality of differing exposures of reflected electromagnetic radiation;

creating a plurality of exposed frames from said image data, wherein each exposed frame corresponds to a different exposure;

emitting pulses of electromagnetic radiation during a predefined portion of a frame readout period of the image sensor during which pulse sensitive pixels are not being read;

creating a stream of images by sequentially combining a plurality of display frames taken using the plurality of differing exposures to provide increased dynamic range; and

pulsing an emitter to produce a pattern of luminance long exposed combined with luminance short exposed then chrominance blue then luminance long exposed combined with luminance short exposed then chrominance red in a cycle.

18. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:

illuminating the environment with pulsed electromagnetic radiation;

sensing a plurality of differing exposures of reflected electromagnetic radiation with a pixel array of an image sensor;

receiving image data from said pixel array corresponding to the plurality of differing exposures of reflected electromagnetic radiation;

creating a plurality of exposed frames from said image data, wherein each exposed frame corresponds to a different exposure;

emitting pulses of electromagnetic radiation during a predefined portion of a frame readout period of the image sensor during which pulse sensitive pixels are not being read;

creating a stream of images by sequentially combining a plurality of display frames taken using the plurality of differing exposures to provide increased dynamic range; and

pulsing an emitter to produce a pattern of luminance long exposed combined with luminance short exposed then chrominance blue long exposed combined with chrominance blue short exposed then luminance long exposed combined with luminance short exposed then chrominance red long exposed combined with chrominance red short exposed in a cycle.

Assignments (1)
MERGER AND CHANGE OF NAME Recorded Mar 9, 2016
From: OLIVE MEDICAL CORPORATION; DEPUY SYNTHES PRODUCTS, INC.
To: DEPUY SYNTHES PRODUCTS, INC.
Reel/Frame 037935/0963 →
Continuity (4)
Provisional Application 61790719 · Mar 15, 2013
Provisional Application 61790487 · Mar 15, 2013
Provisional Application 61676289 · Jul 26, 2012
Related Publication 20140160260A1 · Jun 12, 2014