Sensor device and signal processing method
A sensor device includes an array sensor having a plurality of detection elements arrayed in one or two dimensional manner, a signal processing unit configured to acquire a detection signal by the array sensor and perform signal processing, and a calculation unit. The calculation unit detects an object from the detection signal by the array sensor, and gives an instruction, to the signal processing unit, on region information generated on the basis of the detection of the object as region information regarding the acquisition of the detection signal from the array sensor or the signal processing for the detection signal.
1. A sensor device comprising:
an array sensor having a plurality of detection elements arrayed in one or two dimensional manner;
a signal processing unit configured to acquire a detection signal by the array sensor and perform signal processing; and
a calculation unit configured to detect an object from the detection signal by the array sensor, and give an instruction, to the signal processing unit, on region information generated on a basis of the detection of the object as region information regarding the acquisition of the detection signal from the array sensor or the signal processing for the detection signal;
wherein the calculation unit identifies a class for the object detected from the detection signal obtained from the array sensor, and generates the region information corresponding to the object, using a template indicating an acquisition region of the detection signal corresponding to the identified class; and
wherein the template indicates a first acquisition region of the detection signal for a first class and a different second acquisition region of the detection signal for a second class.
2. The sensor device according to claim 1 , further comprising:
an output unit configured to output the detection signal processed by the signal processing unit to an external device.
3. The sensor device according to claim 1 , wherein
the signal processing unit includes an acquisition unit that selectively acquires the detection signal for the detection element of the array sensor, and
the acquisition unit acquires the detection signal of the detection element selected on a basis of the region information from the calculation unit, as one frame of the detection signal.
4. The sensor device according to claim 3 , wherein
the calculation unit detects an object for the detection signal acquired from the array sensor in a state where the acquisition unit does not select the detection element based on the region information, and gives an instruction, to the signal processing unit, on the region information generated on the basis of the detection of the object as region information to be used for acquisition of the detection signal of a subsequent frame from the array sensor by the acquisition unit.
5. The sensor device according to claim 4 , wherein
the calculation unit detects an object for the detection signal acquired from the array sensor in a state where the acquisition unit has selected the detection element based on the region information, and regenerates the region information on a basis of the detection of the object, and gives an instruction, to the signal processing unit, on the region information as region information to be used for acquisition of the detection signal of a subsequent frame from the array sensor by the acquisition unit.
6. The sensor device according to claim 5 , wherein
the calculation unit detects an object for the detection signal acquired from the array sensor in the state where the acquisition unit has selected the detection element based on the region information, and gives an instruction on acquisition of the detection signal from the array sensor in the state where the acquisition unit does not select the detection element based on the region information in a subsequent frame in a case where a target object has not been detected.
7. The sensor device according to claim 1 , wherein
the calculation unit obtains a bounding box surrounding a region of the object detected from the detection signal by the array sensor, and generates the region information on a basis of the bounding box.
8. The sensor device according to claim 7 , wherein
the calculation unit enlarges the bounding box and generates the region information.
9. The sensor device according to claim 1 , wherein
the calculation unit determines a region on a detection element to detection element basis for the detected object and generates the region information.
10. The sensor device according to claim 1 , wherein
the calculation unit detects an object for a frame as a keyframe of the detection signal obtained from the array sensor, and generates the region information on a basis of the detection of the object.
11. The sensor device according to claim 10 , wherein
the keyframe is a frame at predetermined time intervals.
12. The sensor device according to claim 10 , wherein
the keyframe is a frame at timing based on a command from an external device.
13. The sensor device according to claim 1 , wherein
the calculation unit identifies a class for the object detected from the detection signal obtained from the array sensor, determines whether or not the identified class is a target class, and generates the region information corresponding to the object of the target class.
14. The sensor device according to claim 13 , further comprising:
an output unit configured to output any or all of the detection signal processed by the signal processing unit, information of the identified class, the number of detected objects, and information of presence or absence of a target class in response to a request of an external device.
15. The sensor device according to claim 1 , wherein
the signal processing unit includes a compression processing unit that performs compression processing for the detection signal from the array sensor, and
the compression processing unit performs the compression processing according to a compression rate different for each region on a basis of the region information from the calculation unit.
16. The sensor device according to claim 15 , wherein
the compression processing unit performs the compression processing at a low compression rate in a region specified by the region information, and performs the compression processing at a high compression rate in the other regions.
17. The sensor device according to claim 1 , wherein
the calculation unit
sets an active area for the detection signal to be acquired from the array sensor on a basis of information regarding past region information, and
detects an object from the detection signal of the active area, and gives an instruction, to the signal processing unit, on the region information generated on a basis of the detection of the object as region information regarding the acquisition of the detection signal from the array sensor or the signal processing for the detection signal.
18. The sensor device according to claim 17 , wherein
the calculation unit sets, for a plurality of pieces of the region information generated in a past predetermined period, the active area so as to include a detection region in the object detection based on each piece of the region information.
19. The sensor device according to claim 17 , wherein
the signal processing unit includes an acquisition unit that selectively acquires the detection signal for the detection element of the array sensor,
the acquisition unit acquires the detection signal of the detection element selected on a basis of the region information from the calculation unit, as one frame of the detection signal, and
the calculation unit instructs the acquisition unit to acquire the detection signal of the active area from the array sensor in a subsequent frame in a case where the calculation unit detects an object for the detection signal acquired from the array sensor and a target object is not detected in a state where the acquisition unit has selected the detection element according to the region information.
20. The sensor device according to claim 17 , wherein
the calculation unit detects an object from the detection signal of the active area for a frame as a keyframe of the detection signal obtained from the array sensor, and generates the region information on a basis of the detection of the object.
21. The sensor device according to claim 1 , further comprising:
a threshold setting unit configured to set a threshold of all or some of parameters to be used in signal processing of the signal processing unit or detection processing by the array sensor, and set the parameters of the processing for the acquisition region indicated by the template on a basis of the threshold.
22. A signal processing method in a sensor device including an array sensor having a plurality of detection elements arrayed in one or two dimensional manner, and a signal processing unit that acquires a detection signal by the array sensor and performs signal processing, the signal processing method comprising:
detecting an object from the detection signal by the array sensor,
identifying a class for the detected object,
generating region information corresponding to the object, using a template indicating an acquisition region of the detection signal corresponding to the identified class, and
giving an instruction, to the signal processing unit, on region information generated on a basis of the detection of the object as region information regarding the acquisition of the detection signal from the array sensor or the signal processing for the detection signal; and
wherein the template indicates a first acquisition region of the detection signal for a first class and a different second acquisition region of the detection signal for a second class.
23. The signal processing method according to claim 22 , further comprising:
setting an active area for the detection signal acquired from the array sensor on a basis of past region information; and
detecting an object from the detection signal of the active area as the detection signal by the array sensor.
24. The signal processing method according to claim 22 , further comprising:
setting a threshold of all or some of parameters to be used in signal processing of the signal processing unit or detection processing by the array sensor, and setting the parameters of the processing for the acquisition region indicated by the template on a basis of the threshold.
25. The signal processing method according to claim 22 ,
wherein a densified part of the first acquisition region has a first geometric shape; and
wherein a densified part of the second acquisition region has a different second geometric shape.
26. The sensor device according to claim 1 ,
wherein a densified part of the first acquisition region has a first geometric shape; and
wherein a densified part of the second acquisition region has a different second geometric shape.