IP Library › Granted Patent US 10,721,411
Granted Patent B2
US 10,721,411 · App. 15/520,824 · Granted Jul 21, 2020

Smart photonic imaging method and apparatus

Inventor: Nabeel Agha Riza (Cork, IE)
Assignee: University College Cork—National University of Ireland, Cork
H04N5/2355G03B17/17H04N5/2254H04N5/2258H04N5/238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,721,411
App. No.
15/520,824
Granted
Jul 21, 2020
Kind
B2
Abstract

The present invention provides a method for performing high dynamic range optical image detection of a scene comprising: imaging incident light from a scene onto an object plane; determining the locations of those pixels in the object plane of higher brightness; detecting the optical irradiance values of those pixels of higher brightness to produce a first detected image; detecting the optical irradiance values of those pixels of lower brightness to produce a second detected image; and generating a high dynamic range optical irradiance map of the scene by combining the first detected image and the second detected image into a single image.

Claims (40)

1. A method for performing high dynamic range optical image detection of a scene comprising:

imaging incident light from a scene into two parallel channels simultaneously using a variable beam splitter device onto an object plane of a 2D spatial light modulator (SLM) device and onto an object plane of a 2-D photo detector array, wherein the variable beam splitter device directs light in a first direction onto the object plane of the 2D SLM device and directs light in a second direction onto the object plane of the 2-D photo detector array;

determining locations of pixels, in the object plane of the 2D SLM device, having a first brightness level;

detecting, by two point photo detectors, optical irradiance values of the pixels, to produce a first detected image;

detecting, by the 2-D photo detector array, optical irradiance values of pixels, in the object plane of the 2-D photo detector array, having a second brightness level to produce a second detected image, wherein the first brightness level is higher than the second brightness level; and

generating a dynamic range optical irradiance map of the scene by combining the first detected image and the second detected image into a single image.

2. The method of claim 1 , wherein the 2D SLM device comprises a digital micromirror device (DMD).

3. The method of claim 2 , further comprising:

setting the DMD to its −θ degree tilt state to direct sampled light from the object plane of the DMD for detection of the optical irradiance values of the pixels of the first brightness level by a first point photo detector; and

setting the DMD to its +θ degree tilt state to direct sampled light from the object plane of the DMD for detection of the optical irradiance values of the pixels of the first brightness level by a second point photo detector.

4. The method of claim 2 , wherein the imaging comprises imaging different on-axis focal planes in the scene to provide 3-D imaging, and wherein the method further comprises operating the DMD in its confocal pin-hole mode for 3-D imaging and programming the DMD with a pinhole in either the DMD −θ degree tilt state or the DMD +θ degree tilt state to acquire 3-D image data.

5. The method of claim 1 , further comprising detecting the optical irradiance values of the pixels of the first brightness level and the pixels of the second brightness level simultaneously.

6. The method of claim 1 , further comprising separating vertical and horizontal linear components of light polarizations prior to detecting the optical irradiance values of the pixels of the first brightness level.

7. The method of claim 6 , further comprising providing a pair of point photo detectors to detect each of the vertical and horizontal linear components of the light polarizations separately.

8. The method of claim 1 , further comprising operating the 2D SLM device in a time modulation mode.

9. The method of claim 8 , wherein the 2D SLM device comprises a multi-pixel optical display device, and wherein the method further comprises:

time modulating incident light irradiance of one or more of the pixels on the object plane of the 2D SLM device at a specific temporal frequency to detect time modulating signals,

intermediate frequency (IF) band amplifying and filtering each detected time modulating signal; and

performing a fast Fourier transform of the filtered signal so as to detect relative optical irradiance values for time modulated pixel locations in the object plane of the 2D SLM device so as to reconstruct the first detected image at the object plane of the 2D SLM device.

10. The method of claim 9 , further comprising independently controlling the time modulation of the incident light irradiance for each of the one or more pixels, and wherein each pixel of the one or more pixels is time modulated at a different selected frequency.

11. The method of claim 9 , further comprising optical wavelength coding each of the one or more pixels on the object plane of the 2D SLM device.

12. The method of claim 8 , wherein the 2D SLM device comprises a multi-pixel optical spatial modulation device, and wherein the method further comprises simultaneously time modulating incident light irradiance of one or more of the pixels on the object plane of the 2D SLM device using a binary code sequence to give each of the one or more pixels a spread spectrum in an electrical frequency domain.

13. The method of claim 12 , wherein the binary code sequence in time comprises a code division multiple access (CDMA) binary sequence code,

and wherein the method further comprises:

amplifying and filtering a multi-pixel CDMA signal comprising a sum of the one or more time modulated pixels;

data sampling the filtered multi-pixel CDMA signal; and

performing CDMA signal processing on the data sampled multi-pixel CDMA signal,

wherein the performing comprises:

dividing the multi pixel CDMA signal into one or more replicas corresponding to the one or more time modulated pixels; and

inputting each of the one or more replicas to a corresponding time integrating correlator provided with the CDMA binary sequence code associated with a time modulated pixel, wherein an output of the correlator corresponds to an optical irradiance value of the time modulated pixel.

14. The method of claim 1 , further comprising:

comparing an optical irradiance value of each pixel in the object plane of the 2D SLM device to a predetermined threshold irradiance value; and

determining that the pixel is of the first brightness level if its optical irradiance value is higher than the predetermined threshold irradiance value,

wherein the pixels of the second brightness level correspond to the pixels in the object plane of the 2D SLM device which are determined to have an optical irradiance value equal to or lower than the predetermined threshold irradiance value.

15. An apparatus for performing high dynamic range optical image detection of a scene comprising:

means for imaging incident light from a scene into two parallel channels simultaneously using a variable beam splitter device onto an object plane of a 2D spatial light modulator (SLM) device and onto an object plane of a 2-D photo detector array, wherein the variable beam splitter device directs light in a first direction onto the object plane of the 2D SLM device and directs light in a second direction onto the object plane of the 2-D photo detector array;

means for determining locations of pixels, in the object plane of the 2D SLM device, having a first brightness level;

means for detecting optical irradiance values of the pixels to produce a first detected image;

means for detecting optical irradiance values of pixels, in the object plane of the 2-D photo detector array, having a second brightness level to produce a second detected image wherein the first brightness level is higher than the second brightness level; and

means for generating a dynamic range optical irradiance map of the scene by combining the first detected image and the second detected image into a single image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2017
From: RIZA, NABEEL AGHA
To: UNIVERSITY COLLEGE CORK - NATIONAL UNIVERSITY OF IRELAND, CORK
Reel/Frame 044322/0043 →
Priority Claims (2)
GB 1418678.7 · Oct 21, 2014 · national
GB 1422684.9 · Dec 18, 2014 · national
Continuity (1)
Related Publication 20190109973A1 · Apr 11, 2019