Systems and methods for multi-channel imaging based on multiple exposure settings
A multi-channel image capture system includes: a multi-channel image sensor including a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band; an image signal processor coupled to the multi-channel image sensor, the image signal processor being configured to: store a first plurality of capture parameters and a second plurality of capture parameters; control the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters; control the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters; and transmit the first image frame and the second image frame to a host processor.
1. A multi-channel image capture system comprising:
a multi-channel image sensor comprising a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band;
an image signal processor coupled to the multi-channel image sensor, the image signal processor being configured to:
store a first plurality of capture parameters and a second plurality of capture parameters;
control the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters;
control the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters; and
transmit the first image frame and the second image frame to a host processor
a projection source configured to emit light in the first band and not in the second band;
the host processor; and
a memory storing instructions that, when executed by the host processor, cause the host processor to:
control the projection source to emit light in the first band while the multi-channel image sensor captures the first image frame according to the first plurality of capture parameters.
2. The multi-channel image capture system of claim 1 , wherein the memory further stores instructions that, when executed by the host processor, cause the host processor to:
control the projection source to stop emitting light in the first band while the multi-channel image sensor captures the second image frame according to the second plurality of capture parameters.
3. The multi-channel image capture system of claim 2 , wherein the projection source is configured to emit no light in the second band.
4. The multi-channel image capture system of claim 2 , wherein the projection source is configured to emit light at a first power level in the first band and to emit light at a second power level in the second band.
5. The multi-channel image capture system of claim 1 , further comprising a second multi-channel image sensor comprising a plurality of first pixels configured to detect light in the first band and a plurality of second pixels configured to detect light in the second band.
6. The multi-channel image capture system of claim 5 , further comprising a second image signal processor, the second image signal processor being configured to:
store the first plurality of capture parameters and the second plurality of capture parameters;
control the second multi-channel image sensor to capture a third image frame according to the first plurality of capture parameters;
control the second multi-channel image sensor to capture a fourth image frame according to the second plurality of capture parameters; and
transmit the third image frame and the fourth image frame to the host processor.
7. The multi-channel image capture system of claim 1 , wherein the image signal processor is configured to capture, consecutively, the first image frame based on the first plurality of capture parameters, the second image frame based on the second plurality of capture parameters, and a third image frame based on a the first plurality of capture parameters.
8. The multi-channel image capture system of claim 1 , wherein the image signal processor is configured to capture, consecutively, two image frames based on the first plurality of capture parameters and two image frames based on the second plurality of capture parameters.
9. The multi-channel image capture system of claim 1 , wherein the multi-channel image sensor comprises a plurality of third pixels configured to detect light in a third band, and
wherein the image signal processor is further configured to:
store a third plurality of capture parameters;
control the multi-channel image sensor to capture a third image frame according to the third plurality of capture parameters; and
transmit the third image frame to a host processor.
10. The multi-channel image capture system of claim 1 , wherein the image signal processor is further configured to receive the first plurality of capture parameters and the second plurality of capture parameters from the host processor.
11. The multi-channel image capture system of claim 1 , wherein the image signal processor is configured using a micro-script.
12. The multi-channel image capture system of claim 11 , wherein the image signal processor is configured to receive the micro-script from the host processor.
13. A multi-channel image capture system comprising:
a multi-channel image sensor comprising a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band; and
an image signal processor directly coupled to the multi-channel image sensor, the image signal processor being configured to:
store a first plurality of capture parameters and a second plurality of capture parameters;
control the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters;
control the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters; and
transmit the first image frame and the second image frame to a host processor,
wherein the first band is an invisible light band and the second band is in a visible light band.
14. A multi-channel image capture system comprising:
a multi-channel image sensor comprising a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band;
an image signal processor directly coupled to the multi-channel image sensor, the image signal processor being configured to:
store a first plurality of capture parameters and a second plurality of capture parameters;
control the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters;
control the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters; and
transmit the first image frame and the second image frame to a host processor; and
a focusable optical system configured to focus light onto the multi-channel image sensor,
wherein the first plurality of capture parameters comprises a first focus setting and the second plurality of capture parameters comprises a second focus setting,
wherein the image signal processor is configured to control the focusable optical system in accordance with the first focus setting to focus light in the first band onto the multi-channel image sensor when capturing the first image frame and to control the focusable optical system in accordance with the second focus setting to focus light in the second band onto the multi-channel image sensor when capturing the second image frame.
15. A multi-channel image capture system comprising:
a multi-channel image sensor comprising a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band; and
an image signal processor directly coupled to the multi-channel image sensor, the image signal processor being configured to:
store a first plurality of capture parameters and a second plurality of capture parameters;
control the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters;
control the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters; and
transmit the first image frame and the second image frame to a host processor; and
wherein the image signal processor is further configured to compute the first plurality of capture parameters and the second plurality of capture parameters in accordance with an initial image captured by the multi-channel image sensor.
16. The multi-channel image capture system of claim 15 , wherein the first plurality of capture parameters are calculated based on a quantum efficiency of the first pixels in the first band, a range in values of the initial image, and a power level supplied to a projection source configured to emit light in the first band.
17. A multi-channel image capture system comprising:
a multi-channel image sensor comprising a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band;
an image signal processor directly coupled to the multi-channel image sensor, the image signal processor being configured to:
store a first plurality of capture parameters and a second plurality of capture parameters;
control the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters;
control the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters; and
transmit the first image frame and the second image frame to a host processor; and
wherein the image signal processor is configured to compute an aggregate image from the first image frame and the second image frame and configured to transmit the first image frame and the second image frame to the host processor as the aggregate image.
18. A method for controlling a multi-channel image capture system comprising a multi-channel image sensor comprising a plurality of first pixels configured to detect light in a first band and a plurality of second pixels configured to detect light in a second band different from the first band, the method comprising:
storing, by an image processor directly coupled to the multi-channel image sensor, a first plurality of capture parameters and a second plurality of capture parameters;
controlling, by the image processor, the multi-channel image sensor to capture a first image frame according to the first plurality of capture parameters;
controlling, by the image processor, the multi-channel image sensor to capture a second image frame according to the second plurality of capture parameters;
transmitting, by the image processor, the first image frame and the second image frame to a host processor;
capturing an initial image; and
computing the first plurality of capture parameters and the second plurality of capture parameters in accordance with quantum efficiencies of the first pixels in the first band and of the second pixels in the second band, the initial image, and a power level supplied to an illumination source.