Dynamic vision sensor color camera
A dynamic vision sensor (DVS) color camera (DVS-CCam) operable to acquire a color image of a scene, the DVS-CCam including a DVS photosensor comprising DVS pixels, an illuminator operable to transmit a light pattern characterized by temporal changes in intensity and color to illuminate a scene, an optical system configured to collect and focus on the pixels of the DVS photosensor light reflected by features in the scene from the light pattern transmitted by the illuminator, and a processor configured to process DVS signals generated by the DVS pixels responsive to temporal changes in the reflected light to provide a color image of the scene.
1 . A dynamic vision sensor (DVS) color camera (DVS-CCam) operable to acquire a color image of a scene, the DVS-CCam comprising:
a DVS photosensor comprising DVS pixels;
an illuminator operable to transmit a light pattern characterized by temporal changes in intensity and color to illuminate a scene;
an optical system configured to collect and focus on the DVS pixels light reflected by features in the scene from the light pattern transmitted by the illuminator;
a processor configured to process DVS signals generated by the DVS pixels responsive to temporal changes in the reflected light to provide a color image of the scene; and
a neural network (NN) configured to provide a color to a feature vector based on a pixel response value associated with a DVS pixel.
2 . The DVS-CCam of claim 1 , wherein the transmitted light pattern comprises temporally contiguous light pulses.
3 . The DVS-CCam of claim 1 , wherein the transmitted light pattern comprises discrete temporally separated light pulses.
4 . The DVS-CCam of claim 1 , wherein the transmitted light pattern comprises red, green, and blue light.
5 . The DVS-CCam of claim 1 , wherein each pixel of the DVS pixels generates a stream of DVS image signals responsive to a change in light intensity during the temporal changes in the reflected light.
6 . The DVS-CCam of claim 1 wherein information associated with the color image is used for reconstructing a next image.
7 . The DVS-CCam of claim 1 , wherein the DVS photosensor comprises an event-based photosensor.
8 . The DVS-CCam of claim 1 , wherein the NN is configured to extract spectral components from visible light other than RGB light for generating hyperspectral images.
9 . The DVS-CCam of claim 1 , wherein the NN comprises a contracting part, an expanding part, and a plurality of layers connecting the contracting part and the expanding part.
10 . The DVS-CCam of claim 9 , wherein the contracting part reduces spatial dimensions and increases a number of channels.
11 . The DVS-CCam of claim 9 , wherein the expanding part increases spatial dimensions and reduces a number of channels to a reduced number of channels.