Multispectral imaging for navigation systems and methods
Multispectral imaging and navigation systems and related techniques are provided to improve the operation of manned or unmanned mobile platforms, including mobile sensor or survey platforms. A multispectral navigation system includes a multispectral imaging system and a logic device configured to communicate with the multispectral imaging system. The multispectral imaging system includes a multispectral imaging module configured to provide multispectral image data corresponding to a projected course for a mobile platform. The logic device is configured to receive the multispectral image data, receive orientation and/or position data corresponding to the multispectral image data, and generate maneuvering obstacle information corresponding to the projected course based on the orientation and/or position data and the multispectral image data.
1. A system comprising:
a multispectral imaging system located on a mobile platform, wherein the multispectral imaging system comprises:
a multispectral imaging module configured to provide multispectral image data as the mobile platform maneuvers within a scene; and
an imaging controller and/or a module controller configured to detect a presence of a characteristic of the scene along a course of the mobile platform within the scene based on the multispectral image data; and
a logic device configured to communicate with the multispectral imaging system, wherein the logic device is configured to:
receive the multispectral image data from the multispectral imaging module, wherein the multispectral image data comprises a near-infrared (NIR) image, visible (VIS) image, and longwave ultraviolet (LWUV) image;
combine corresponding pixels of the NIR image, VIS image, and LWUV image based on brightness to create a multispectral image comprising pixels that exhibit increased contrast relative to the pixels of the NIR image, VIS, image, and LWUV image;
identify, using the increased contrast, an obstacle within the scene; and
generate maneuvering information for the mobile platform to avoid the identified obstacle.
2. The system of claim 1 , further comprising a communication module configured to establish a wireless communication link with a base station associated with the mobile platform, wherein:
the multispectral imaging system is configured to be coupled to the mobile platform; and
the logic device is configured to receive the multispectral image data from the multispectral imaging system as the mobile platform maneuvers along a course and to report the generated maneuvering information corresponding to the course over the wireless communication link to the base station.
3. The system of claim 1 , further comprising:
a gimbal system coupled to the mobile platform and configured to mount the multispectral imaging system to the mobile platform and orient the multispectral imaging system relative to the mobile platform.
4. The system of claim 1 , further comprising:
a power supply coupled to and/or within a housing of the multispectral imaging system and configured to power the multispectral imaging system.
5. The system of claim 1 , wherein:
the multispectral imaging module comprises:
a focal plane array (FPA) sensitive to three differentiated spectrums comprising a NIR band, VIS band, and LWUV ultraviolet band, and
a filter system configured to provide spatially and spectrally differentiated light to the FPA;
a lens system comprising one or more achromatic lenses configured to focus multispectral light through the filter system and onto the FPA; and
the filter system comprises a Bayer filter coupled to and adjoining an active surface of the FPA.
6. The system of claim 5 , wherein:
the module controller is configured to demosaic raw multispectral image data provided by the FPA based, at least in part, on a pattern of filter elements within the Bayer filter of the multispectral imaging module and/or a time of day corresponding to capture of the raw multispectral image data.
7. The system of claim 1 , wherein:
the module controller is configured to control an FPA of the multispectral imaging module to adjust an integration time associated with the FPA such that the FPA operates at a midwell exposure value for each of the NIR image, VIS image, and LWUV image based on ambient light levels of the scene.
8. The system of claim 1 , wherein:
the imaging system controller and/or module controller is configured to:
combine the corresponding pixels by subtracting values of the corresponding pixels of at least two images of the NIR image, VIS image, and LWUV image; and
identify the object by:
identifying a threshold based on the combining of the corresponding pixels; and
classifying the object based on the threshold and the multispectral image.
9. The system of claim 1 , further comprising a user interface associated with the mobile platform, wherein the logic device is configured to:
render a display view comprising the maneuvering information via a display of the user interface.
10. The system of claim 1 , wherein the logic device is configured to:
determine the course for the mobile platform intersects a maneuvering obstacle based, at least in part, on the generated maneuvering information; and
adjust the course of the mobile platform to avoid the maneuvering obstacle.
11. A method comprising:
receiving multispectral image data from a multispectral imaging system located on a mobile platform and comprising a multispectral imaging module configured to provide multispectral image data as the mobile platform maneuvers within a scene, wherein the multispectral image data comprises a near-infrared (NIR) image, visible (VIS) image, and longwave ultraviolet (LWUV) image;
combining corresponding pixels of the NIR image, VIS image, and LWUV image to create a multispectral image comprising pixels that exhibit increased contrast relative to the pixels of the NIR image, VIS, image, and LWUV image;
identifying, using the increased contrast, an obstacle within the scene;
generating maneuvering information for the mobile platform to avoid the identified obstacle.
12. The method of claim 11 , further comprising:
establishing a wireless communication link with a base station associated with the mobile platform; and
reporting the generated maneuvering information corresponding to a course over the wireless communication link to the base station, wherein the multispectral imaging system is configured to be coupled to the mobile platform, and wherein the receiving the multispectral image data comprises receiving the multispectral image data from the multispectral imaging system as the mobile platform maneuvers along the course.
13. The method of claim 11 , wherein the multispectral imaging system comprises:
a gimbal system coupled to the mobile platform and configured to mount the multispectral imaging system to the mobile platform and orient the multispectral imaging system relative to the mobile platform.
14. The method of claim 11 , wherein the multispectral imaging system comprises:
a power supply coupled to and/or within a housing of the multispectral imaging system and configured to power the multispectral imaging system.
15. The method of claim 11 , wherein:
the multispectral imaging module comprises:
a focal plane array (FPA) sensitive to three differentiated spectrums comprising a NIR band, VIS band, and LWUV ultraviolet band, and
a filter system configured to provide spatially and spectrally differentiated light to the FPA,
a lens system comprising one or more achromatic lenses configured to focus multispectral light through the filter system and onto the FPA; and
the filter system comprises a Bayer filter coupled to and adjoining an active surface of the FPA.
16. The method of claim 11 , further comprising:
demosaicing raw multispectral image data provided by a focal plane array (FPA) of the multispectral imaging module based, at least in part, on a pattern of filter elements within a Bayer filter of the multispectral imaging module and/or a time of day corresponding to capture of the raw multispectral image data.
17. The method of claim 11 , further comprising:
controlling an FPA of the multispectral imaging module to adjust an integration time associated with the FPA such that the FPA operates at a midwell exposure value for each of the NIR image, VIS image, and LWUV image based on ambient light levels of the scene.
18. The method of claim 11 , wherein:
combining the corresponding pixels comprises subtracting values of the corresponding pixels of at least two images of the NIR image, VIS image, and LWUV image; and
identifying the object comprises:
identifying a threshold based on the combining of the corresponding pixels; and
classifying the object based on the threshold and the multispectral image.
19. The method of claim 11 , further comprising:
rendering a display view comprising the maneuvering information via a display of a user interface associated with the mobile platform.
20. The method of claim 11 , further comprising:
determining the course for the mobile platform intersects a maneuvering obstacle based, at least in part, on the generated maneuvering information; and
adjusting the course of the mobile platform to avoid the maneuvering obstacle.
21. The system of claim 9 , wherein the multispectral image comprises each differentiated spectrum mapped into an R, G, or B channel.
22. The method of claim 19 , wherein the multispectral image comprises each differentiated spectrum mapped into an R, G, or B channel.