Photoelectric conversion apparatus and device for outputting gradation and event patterns at different rates
A conversion apparatus includes a pixel array unit in which a plurality of first pixels that generates gradation signals indicating amounts of incident light and a plurality of second pixels that generates event signals are two-dimensionally disposed, a reading unit configured to read the gradation signals and the event signals from the pixel array unit, and a control unit configured to change an output data rate of the gradation signals and an output data rate of the event signals, wherein a first pattern for outputting the gradation signals at a first output data rate and outputting the event signals at a second output data rate and a second pattern for outputting the gradation signals at a third output data rate different from the first output data rate and outputting the event signals at a fourth output data rate different from the second output data rate are switched.
1 . A conversion apparatus comprising:
a pixel array unit in which a plurality of first pixels that generates gradation signals indicating amounts of incident light and a plurality of second pixels that generates event signals are two-dimensionally disposed;
a reading unit configured to read the gradation signals and the event signals from the pixel array unit; and
a control unit configured to change an output data rate of the gradation signals and an output data rate of the event signals,
wherein a first pattern for outputting the gradation signals at a first output data rate and outputting the event signals at a second output data rate and a second pattern for outputting the gradation signals at a third output data rate different from the first output data rate and outputting the event signals at a fourth output data rate different from the second output data rate are switched.
2 . The conversion apparatus according to claim 1 , wherein in a case where the first output data rate is greater than the third output data rate, the second output data rate is smaller than the fourth output data rate, and in a case where the first output data rate is smaller than the third output data rate, the second output data rate is greater than the fourth output data rate.
3 . The conversion apparatus according to claim 1 , wherein the control unit controls the pixel array unit, thereby changing at least one of the output data rate of the gradation signals and the output data rate of the event signals.
4 . The conversion apparatus according to claim 3 , wherein the control unit controls the reading unit, thereby changing at least one of the output data rate of the gradation signals and the output data rate of the event signals.
5 . The conversion apparatus according to claim 3 , wherein the control unit controls the pixel array unit and changes the number of times at least either the gradation signals or the event signals are read from the pixel array unit, thereby changing at least one of the output data rate of the corresponding gradation signals and the output data rate of the corresponding event signals.
6 . The conversion apparatus according to claim 3 , wherein the control unit controls the pixel array unit and changes a cycle in which at least either the gradation signals or the event signals are read from the pixel array unit, thereby changing at least one of the output data rate of the corresponding gradation signals and the output data rate of the corresponding event signals.
7 . The conversion apparatus according to claim 1 , wherein the control unit controls the reading unit, thereby changing at least one of the output data rate of the gradation signals and the output data rate of the event signals.
8 . The conversion apparatus according to claim 7 , wherein the control unit controls the reading unit to decrease the number of signals to be output from the reading unit compared to the number of signals corresponding to at least either the gradation signals or the event signals to be input to the reading unit in a predetermined length of time, thereby changing at least one of the output data rate of the corresponding gradation signals and the output data rate of the corresponding event signals.
9 . The conversion apparatus according to claim 7 , wherein the control unit controls the reading unit to change a cycle in which at least either the gradation signals or the event signals are output from the reading unit, thereby changing at least one of the output data rate of the corresponding gradation signals and the output data rate of the corresponding event signals.
10 . The conversion apparatus according to claim 1 , wherein the control unit switches the first and second patterns according to a set mode.
11 . The conversion apparatus according to claim 1 , wherein the pixel array unit is divided into a plurality of pixel regions, each including at least one of the first pixels and at least one of the second pixels, and the control unit controls one pixel region of the plurality of pixel regions in the first pattern and controls the other pixel region in the second pattern.
12 . The conversion apparatus according to claim 11 , further comprising a region setting unit configured to set the plurality of pixel regions using at least either the gradation signals or the event signals.
13 . The conversion apparatus according to claim 12 , wherein the region setting unit includes a spiking neural network connected to the second pixels and sets the plurality of pixel regions using the spiking neural network.
14 . The conversion apparatus according to claim 12 , wherein the region setting unit includes a convolutional neural network connected to the second pixels and sets the plurality of pixel regions using the convolutional neural network.
15 . The conversion apparatus according to claim 1 , wherein the first pixels generate the event signals, and the second pixels generate the gradation signals.
16 . The conversion apparatus according to claim 1 , wherein distance information is acquired using at least either the gradation signals or the event signals.
17 . The conversion apparatus according to claim 1 , wherein the output data rate of the gradation signals is a data rate at which the gradation signals are output from the pixel array unit through the reading unit to outside the conversion apparatus, and the output data rate of the event signals is a data rate at which the event signals are output from the pixel array unit through the reading unit to outside the conversion apparatus.
18 . The conversion apparatus according to claim 1 , wherein the event signals indicate changes in the amounts of the incident light.
19 . A moving body comprising:
the conversion apparatus according to claim 1 ; and
a control apparatus configured to control a movement of the moving body.
20 . A device comprising:
the conversion apparatus according to claim 1 , and
at least any of:
an optical apparatus configured to guide light to the conversion apparatus;
a control apparatus configured to control the conversion apparatus;
a processing apparatus configured to process a signal output from the conversion apparatus;
a display apparatus configured to display information obtained by the conversion apparatus;
a storage apparatus configured to store information obtained by the conversion apparatus; and
a mechanical apparatus configured to operate based on information obtained by the conversion apparatus.