Vision sensor, image processing device including the same, and operating method of the vision sensor
Provided are a vision sensor, an image processing device including the same, and an operating method of the vision sensor. The vision sensor includes a pixel array including a plurality of pixels, a synchronization control module configured to receive a synchronization signal from an external image sensor and generate an internal trigger signal based on the synchronization signal, an event detection circuit configured to receive the internal trigger signal and detect whether an event has occurred in the plurality of pixels and generate event signals corresponding to pixels in which the event has occurred, and an interface circuit configured to receive the event signals and transmit to an external processor vision sensor data based on the trigger signal and at least one of the event signals, where the vision sensor data includes matching information for timing image frame information generated by the image sensor and the event signals generated by the vision sensor.
1 . An image processing device comprising:
a complementary metal-oxide-semiconductor image sensor (CIS) configured to generate image data of an object; and
a vision sensor configured to receive a synchronization signal from the CIS and generate event signals of the object and a timestamp based on the synchronization signal,
wherein the CIS is configured to transmit the image data to a single processor, and
wherein the vision sensor is configured to transmit the event signals and timestamp to the single processor aperiodically.
2 . The image processing device of claim 1 , wherein the CIS and the vision sensor are implemented as a single chip.
3 . The image processing device of claim 1 , wherein the CIS, the vision sensor, and the processor are implemented as a single chip.
4 . The image processing device of claim 1 ,
wherein the vision sensor further comprises a voltage generator configured to generate threshold voltages to be used to detect events, and
wherein the voltage generator is configured to change voltage levels of the threshold voltages.
5 . The image processing device of claim 1 , wherein the timestamp includes information of time where the event signals are generated.
6 . The image processing device of claim 1 , wherein the CIS is configured to generate the synchronization signal based on at least one of shutter signal information, read signal information and image frame information.
7 . The image processing device of claim 4 , wherein the voltage generator is configured to change the voltage levels of the threshold voltages to be provided to pixels of a region of interest (ROI).
8 . The image processing device of claim 7 , wherein the voltage generator is configured to differently change the voltage levels of the threshold voltages for each of a plurality of ROI.
9 . The image processing device of claim 1 ,
wherein the vision sensor further comprises an event detection circuit configured to generate a plurality of event signals between a period of a first image frame information of the CIS and a second image frame information of the CIS.
10 . An image processing device comprising:
a complementary metal-oxide-semiconductor image sensor (CIS) configured to generate image data of an object; and
a vision sensor including:
a first plurality of pixels configured to generate events in response to a change in light, the events being related to a movement of the object, and
an event detection circuit configured to generate event signals based on the events and a synchronization signal received from the CIS,
wherein the CIS is configured to transmit the image data to a single processor,
wherein the event detection circuit is configured to process the events in a frame unit,
wherein the vision sensor is configured to transmit the event signals and timestamp to the single processor,
wherein the event detection circuit is configured to generate event signals N times between a period of a first image frame information of the CIS and a second image frame information of the CIS, and
wherein N is an integer greater than 1.
11 . The image processing device of claim 10 ,
wherein the vision sensor further comprises a voltage generator configured to generate threshold voltages to be used to detect the events, and
wherein the voltage generator is configured to change voltage levels of the threshold voltages.
12 . The image processing device of claim 10 , wherein the CIS and the vision sensor are implemented as a single chip.
13 . The image processing device of claim 10 , wherein the CIS is configured to generate the synchronization signal based on at least one of shutter signal information, read signal information, and image frame information.
14 . The image processing device of claim 10 , wherein the timestamp includes information of time where the event signals are generated.
15 . The image processing device of claim 11 , wherein the voltage generator is configured to differently change the voltage levels of the threshold voltages for each of a plurality of regions of interest (ROI).
16 . An image processing device comprising:
a complementary metal-oxide-semiconductor image sensor (CIS) configured to generate image data of an object; and
a vision sensor including:
a first plurality of pixels configured to generate events in response to a change in light, the events being related to a movement of the object, and
an event detection circuit configured to generate event signals based on the events and a synchronization signal received from the CIS,
wherein the CIS and the vision sensor are configured to transmit the image data and the event signals to a single processor,
wherein the vision sensor is configured to transmit the event signals to the single processor periodically, and
wherein the event detection circuit is configured to process the events in a frame unit.
17 . The image processing device of claim 16 ,
wherein the vision sensor further comprises a voltage generator configured to generate threshold voltages to be used to detect the events, and
wherein the voltage generator is configured to change voltage levels of the threshold voltages.
18 . The image processing device of claim 16 , wherein the CIS is configured to generate the synchronization signal based on at least one of shutter signal information, read signal information, and image frame information.
19 . The image processing device of claim 16 ,
wherein the event detection circuit is configured to generate event signals N times between a period of a first image frame information of the CIS and a second image frame information of the CIS, and
wherein N is an integer greater than 1.
20 . The image processing device of claim 16 , wherein the CIS and the vision sensor are implemented as a single chip.