Data processing device and data processing method
The present technology relates to a data processing device and a data processing method capable of suppressing power consumption. A vehicle information acquisition unit acquires vehicle information that can be acquired by a vehicle, and a control unit controls, according to the vehicle information, a frame rate of frame data generated on the basis of event data representing the occurrence of an event that occurs in an accumulation time from a start of frame generation to an end of frame generation and is a change in an electrical signal of a pixel that generates the electrical signal by performing photoelectric conversion. A data processing unit generates the frame data of the frame rate controlled by the control unit. In the present technology, the present technology can be applied to, for example, a case where frame data is generated from event data output by a dynamic vision sensor (DVS).
1. A data processing device, comprising:
a processor configured to:
receive vehicle information, wherein the vehicle information is acquired by a first vehicle;
control, based on the vehicle information and number of events per unit time, a frame rate of frame data, wherein
the frame data is generated based on event data,
the event data represents occurrence of an event that occurs in an accumulation time from a start of frame generation to an end of frame generation,
the event is a change in an electrical signal of a pixel, and
the pixel generates the electrical signal based on photoelectric conversion; and
generate the frame data of the frame rate.
2. The data processing device according to claim 1 , wherein the processor is further configured to control a frame interval which is an interval between pieces of frame data generated continuously.
3. The data processing device according to claim 1 , wherein the processor is further configured to control a frame width that is a time from the start of frame generation to the end of frame generation of the frame data.
4. The data processing device according to claim 1 , wherein the processor is further configured to control a start interval that is an interval from a start of generation of first piece of frame data to a start of generation of a second piece of frame data that is next to the first piece of frame data.
5. The data processing device according to claim 1 , wherein the processor is further configured to:
perform object recognition based on the frame data, and
control the frame rate based on a recognition result of the object recognition.
6. The data processing device according to claim 5 , wherein
the processor is further configured to control the frame rate based on a second vehicle recognized by the object recognition, and
the second vehicle is different from the first vehicle.
7. The data processing device according to claim 6 , wherein the processor is further configured to control the frame rate based on a proportion of the second vehicle recognized by the object recognition in the frame data.
8. The data processing device according to claim 5 , further comprising
a camera configured to output frame data of a color image, wherein the processor is further configured to perform the object recognition based on the frame data generated according to the event data and the frame data of the color image.
9. The data processing device according to claim 1 , wherein
the vehicle information includes a vehicle speed of the first vehicle, and
the processor is further configured to control the frame rate based on the vehicle speed of the first vehicle.
10. The data processing device according to claim 1 , wherein
the vehicle information includes a relative speed of an object with respect to the first vehicle, and
the processor is further configured to control the frame rate based on the relative speed of the object.
11. The data processing device according to claim 7 , wherein the processor is further configured to control the frame rate based on a relative speed of an object having a highest relative speed among a plurality of objects or an object designated by a user.
12. The data processing device according to claim 1 , wherein
the vehicle information includes steering wheel information related to an operation of a steering wheel of the first vehicle, and
the processor is further configured to control the frame rate based on the steering wheel information.
13. The data processing device according to claim 1 , wherein the processor is further configured to control the frame rate for each area in which an object appears in the frame data.
14. The data processing device according to claim 1 , further comprising
a sensor configured to perform the photoelectric conversion and output the event data.
15. A data processing method, comprising:
receiving vehicle information, wherein the vehicle information is acquired by a vehicle;
controlling, based on the vehicle information and number of events per unit time, a frame rate of frame data, wherein
the frame data is generated based on event data,
the event data represents occurrence of an event that occurs in an accumulation time from a start of frame generation to an end of frame generation,
the event is a change in an electrical signal of a pixel, and
the pixel generates the electrical signal based on photoelectric conversion; and
generating the frame data of the frame rate.
16. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:
receiving vehicle information, wherein the vehicle information is acquired by a vehicle;
controlling, based on the vehicle information and number of events per unit time, a frame rate of frame data, wherein
the frame data is generated based on event data,
the event data represents occurrence of an event that occurs in an accumulation time from a start of frame generation to an end of frame generation,
the event is a change in an electrical signal of a pixel, and
the pixel generates the electrical signal based on photoelectric conversion; and
generating the frame data of the frame rate.