High resolution multispectral image capture
The use of a hybrid camera tool may capture high resolution multispectral images without sacrificing resolution in exchange for spectral accuracy. The capture of a high resolution multispectral image may include forming a high spatial resolution image based on a portion of incoming light and generating a high spectral resolution image that includes multispectral samples based on another portion of the incoming light. The high resolution multispectral image is then synthesized by consolidating the high spatial resolution image with the high spectral resolution image.
1. A device, comprising:
a beam splitter to split incoming light into a first light portion and a second light portion;
a first camera that records a red, green, blue (RGB) image based on the first light portion;
an occlusion mask including multiple openings that subsample light radiance representing a first spectrum of light that is substantially similar to a second spectrum of the second light portion incident to the occlusion mask, the multiple openings permitting at least some, but not all, of the light radiance of the second light portion to pass directly through to provide multispectral samples;
a second camera that records a grayscale image that includes the multispectral samples; and
an image consolidation engine configured to:
determine a spatial resolution based at least in part on the RGB image;
determine a spectral resolution based at least in part on the grayscale image; and
determine a consolidated image having the determined spatial resolution and the determined spectral resolution based at least in part on the RGB image and the grayscale image.
2. The device of claim 1 , further comprising an opaque enclosure that includes an aperture to pass the incoming light to the beam splitter, the opaque enclosure at least enclosing the beam splitter, the occlusion mask, and a prism.
3. The device of claim 1 , further comprising a mirror that reflects the first light portion from the beam splitter to the first camera at an angle that reduces a distance between the first camera and the second camera.
4. The device of claim 1 , further comprising a prism or another spectrally dispersive optical component that disperses the second light portion across the second camera along an initial direction, wherein the second camera comprises a plurality of sensor elements and the device is further configured to average the multispectral samples provided by ones of the sensor elements along a second direction that is substantially perpendicular to the initial direction.
5. The device of claim 1 , further comprising a filter that filters the second light portion to remove one or more spectrum bands of the second light portion.
6. The device of claim 1 , wherein the occlusion mask includes multiple openings that permit at least some of the light radiance of the second light portion to pass directly through the occlusion mask.
7. A device, comprising:
a beam splitter to split incoming light from a scene into a first light portion and a second light portion;
a first camera that records a red, green, blue (RGB) image based on the first light portion;
an occlusion mask that subsamples light radiance representing a first spectrum of the second light portion that is substantially similar to a second spectrum of the second light portion incident to the occlusion mask, the occlusion mask preventing transmission of overlapping spectra from different scene points in the scene and providing multispectral samples from the second light portion;
a second camera that records a grayscale image that includes the multispectral samples; and
an image consolidation engine configured to:
determine a spatial resolution based at least in part on the RGB image;
determine a spectral resolution based at least in part on the grayscale image; and
determine a consolidated image having the determined spatial resolution and the determined spectral resolution.
8. The device of claim 7 , further comprising an opaque enclosure that includes an aperture to pass the incoming light to the beam splitter, the opaque enclosure at least enclosing the beam splitter, the occlusion mask, and a prism.
9. The device of claim 7 , further comprising a mirror that reflects the first light portion from the beam splitter to the first camera at an angle that reduces a distance between the first camera and the second camera.
10. The device of claim 7 , further comprising a prism or another spectrally dispersive optical component that disperses the second light portion across the second camera along an initial direction, wherein the second camera comprises a plurality of sensor elements and the device is further configured to average the multispectral samples provided by ones of the sensor elements along a second direction that is substantially perpendicular to the initial direction.
11. The device of claim 7 , further comprising a filter that filters the second light portion to remove one or more spectrum bands of the second light portion.
12. The device of claim 7 , wherein the occlusion mask includes multiple openings that permit at least some of the light radiance of the second light portion to pass directly through the occlusion mask.
13. A device, comprising:
a beam splitter to split incoming light into a first light portion and a second light portion;
a first camera that records a red, green, blue (RGB) image based on the first light portion;
a second camera that records a grayscale image, the second camera comprising sensor elements arranged in horizontal rows and in vertical rows;
an occlusion mask including multiple openings that allow a subsample of a full spectrum of light radiance from the second light portion to provide multispectral samples, wherein the subsample represents a substantially similar spectrum of light radiance as the second light portion incident to the occlusion mask; and
a spectrally dispersive optical component that disperses the multispectral samples to provide dispersed samples, wherein:
the second camera records the grayscale image that is formed by the dispersed samples; and:
the spectrally dispersive optical component is configured to disperse at least one of:
the multispectral samples along the horizontal rows, the device further configured to average samples provided by multiple sensor elements along at least one vertical row; or
the multispectral samples along the vertical rows, the device further configured to average samples provided by multiple sensor elements along at least one horizontal row.
14. The device of claim 13 , further comprising an image consolidation engine configured to:
determine a spatial resolution based at least in part on the RGB image;
determine a spectral resolution based at least in part on the grayscale image; and
determine a consolidated image having the determined spatial resolution and the determined spectral resolution.
15. The device of claim 13 , further comprising an opaque enclosure that includes an aperture to pass the incoming light to the beam splitter, the opaque enclosure at least enclosing the beam splitter, the occlusion mask, and the prism.
16. The device of claim 13 , further comprising a mirror that reflects the first light portion from the beam splitter to the first camera at an angle that reduces a distance between the first camera and the second camera.
17. The device of claim 13 , further comprising a filter that filters the second light portion to remove one or more spectrum bands of the second light portion.
18. The device of claim 13 , wherein the multiple openings permit at least some of the light radiance of the second light portion to pass directly through to provide the multispectral samples.