System and method for active multispectral imaging and optical communications
View Patent ↗Provided is a system and method for active multispectral imaging having a transmitter that uses narrowband optical radiation to dynamically illuminate an object with modulated structured light in multiple spectral bands, and a receiver that includes an independent panchromatic imager. The transmitter and receiver can be operated in a bistatic decoupled configuration to enable passive multispectral synthesis, illumination-invariant sensing, optical communications, and the ability for the transmitter to emit a sequence of spectral bands in an order that is unknown to the receiver, and the receiver is able to passively decode the spectral identity from a band identifier embedded in the modulated structured light. The receiver passively decodes embedded high-bandwidth simplex communications while reconstructing calibrated multispectral images at video frame rates.
1. A system for multispectral imaging, detection, and active reflectance, the system comprising:
a transmitter comprising one or more sets of narrowband light emitters, the transmitter configured to cause an optical output of at least a band of light in a transmitted amplitude-modulated pattern, wherein the transmitted pattern is associated with the band of light; and
a receiver having a sensor configured to detect reflectance of light from one or more objects, the receiver configured to determine the band of light of the reflectance by identifying the received amplitude-modulated pattern in the reflectance, matching the received pattern with the transmitted pattern, and assigning the received pattern to an associated color band based on the matching.
2. The system of claim 1 , wherein the transmitted pattern is further associated with a code corresponding to one or more data units, and the receiver is configured to decode the received pattern into the one or more data units by identifying the received amplitude-modulated pattern in the reflectance, matching the received pattern with the transmitted pattern, and assigning the received pattern to an associated data unit based on the matching.
3. The system of claim 1 , wherein matching the received pattern with the transmitted pattern comprises:
sampling the reflectance from an object that is illuminated by the transmitter;
parsing the sampled reflectance into a plurality of frames of panchromatic images, wherein each frame is captured over one color band interval;
determining a mean intensity of all pixels of a frame for each frame of the plurality of frames;
determining a mean ambient intensity of ambient reflectance periods;
calibrating the mean intensity of all pixels of the frame against the mean ambient intensity to determine a calibrated mean intensity for the frame; and
correlating the calibrated mean intensity with a set of amplitude values associated with color bands to match the received pattern with the transmitted pattern.
4. The system of claim 1 , wherein the sensor comprises a panchromatic sensor.
5. The system of claim 1 , wherein the receiver is configured to reconstruct a color image from at least three panchromatic images of the same scene, wherein the at least three panchromatic images are identified to be captured from reflectance of a red band of light, a green band of light, and a blue band of light, respectively, wherein the red band, the green band, and the blue band were outputted from the transmitter.
6. The system of claim 1 , wherein the narrowband light emitters include an array of light-emitting diodes emitting light in a plurality of spectral bands.
7. The system of claim 1 , where in the narrowband light emitters include laser sources.
8. The system of claim 1 , where in the narrowband light emitters include quantum dot light-emitting diodes.
9. The system of claim 1 , wherein the narrowband light emitters are driven by pulse-width-modulated signals.
10. The system of claim 1 , wherein transmitter is configured to cause the output of a sequence of bands of light, and the receiver is configured to determine the sequence of the bands of light from the reflectance without prior knowledge of the sequence's order.
11. A system for multispectral imaging, detection, and active reflectance, the system comprising:
a transmitter comprising one or more sets of narrowband light emitters, the transmitter configured to cause an optical output of at least a band of light in a transmitted amplitude-modulated pattern, wherein the transmitted pattern is associated a data unit; and
a receiver having a sensor configured to detect reflectance of light from one or more objects, the receiver configured to determine the data unit of the reflectance by identifying the received amplitude-modulated pattern in the reflectance, matching the received pattern with the transmitted pattern, and assigning the received pattern to an associated data unit based on the matching.
12. A method for multispectral imaging, detection, and active reflectance, the system comprising:
outputting, from one or more sets of narrowband light emitters of a transmitter, an optical output of at least a band of light in a transmitted amplitude-modulated pattern, wherein the transmitted pattern is associated with the band of light; and
detecting, by a receiver having a sensor, reflectance of light from one or more objects;
determining, by the receiver, the band of light of the reflectance by identifying the received amplitude-modulated pattern in the reflectance, matching the received pattern with the transmitted pattern, and assigning the received pattern to an associated color band based on the matching.
13. The method of claim 12 , wherein the transmitted pattern is further associated with a code corresponding to one or more data units, and the receiver is configured to decode the received pattern into the one or more data units by identifying the received amplitude-modulated pattern in the reflectance, matching the received pattern with the transmitted pattern, and assigning the received pattern to an associated data unit based on the matching.
14. The method of claim 12 , wherein matching the received pattern with the transmitted pattern comprises:
sampling the reflectance from an object that is illuminated by the transmitter;
parsing the sampled reflectance into a plurality of frames of panchromatic images, wherein each frame is captured over one color band interval;
determining a mean intensity of all pixels of a frame for each frame of the plurality of frames;
determining a mean ambient intensity of ambient reflectance periods;
calibrating the mean intensity of all pixels of the frame against the mean ambient intensity to determine a calibrated mean intensity for the frame; and
correlating the calibrated mean intensity with a set of amplitude values associated with color bands to match the received pattern with the transmitted pattern.
15. The method of claim 12 , wherein the sensor comprises a panchromatic sensor.
16. The method of claim 12 , further comprising reconstructing a color image from at least three panchromatic images of a scene, wherein the at least three panchromatic images are identified to be captured from reflectance of a red band of light, a green band of light, and a blue band of light, respectively, wherein the red band, the green band, and the blue band were outputted from the transmitter.
17. The method of claim 12 , wherein the narrowband light emitters include an array of light-emitting diodes emitting light in a plurality of spectral bands.
18. The method of claim 12 , where in the narrowb and light emitters include laser sources.
19. The method of claim 12 , where in the narrowband light emitters include quantum dot light-emitting diodes.
20. The method of claim 12 , wherein the narrowband light emitters are driven by pulse-width-modulated signals.
21. The method of claim 12 , wherein transmitter is configured to cause the output of a sequence of bands of light, and the receiver is configured to determine the sequence of the bands of light from the reflectance without prior knowledge of the sequence's order.