Imaging device, electronic equipment, and imaging method that change processing based on detected temperature
An imaging device, electronic equipment, and an imaging method capable of controlling a temperature rise are provided. The imaging device (CIS 2 ) according to the present disclosure includes an imaging unit ( 22 ), an information processing unit (DNN processing unit 23 ), a temperature detection unit ( 25 ), and a control unit (CIS control unit 21 ). The imaging unit ( 22 ) captures an image and generates image data. The information processing unit (DNN processing unit 23 ) performs processing with respect to the image data read from the imaging unit ( 22 ). The temperature detection unit ( 25 ) detects temperature. The control unit (CIS control unit 21 ) changes the processing performed by the information processing unit (DNN processing unit 23 ) according to the temperature detected by the temperature detection unit ( 25 ).
1. An imaging device comprising:
an image sensor configured to capture an image and generate image data;
a first electronic controller configured to perform processing with respect to the image data read from the image sensor, the first electronic controller including an electronic processor and a memory, the memory including a plurality of deep neural networks (DNNs), each of the plurality of DNNs having a depth of layers;
a temperature sensor configured to detect temperature; and
a second electronic controller configured to change the processing performed by the first electronic controller according to the temperature detected by the temperature sensor.
2. The imaging device according to claim 1 , further comprising:
a noise detection circuitry configured to detect an amount of noise generated in an analog circuit of the image sensor, wherein
the second electronic controller is further configured to control an operation of the first electronic controller according to the noise detected by the noise detection circuitry.
3. The imaging device according to claim 1 , wherein
the first electronic controller is further configured to perform DNN processing using one DNN of the plurality of DNNs with respect to the image data, and
the second electronic controller is further configured to change a first depth of layers of the one DNN.
4. The imaging device according to claim 3 , wherein
the second electronic controller is further configured to change from the one DNN to a second DNN of the plurality of the DNNs, the second DNN having a second depth of layer that is different from the first depth of layers of the one DNN.
5. The imaging device according to claim 3 , wherein
the second electronic controller is further configured to change the depth of layers, on which the processing is to be performed by the first electronic controller, among all layers in one of the DNNs.
6. The imaging device according to claim 1 , wherein
the second electronic controller is further configured to change an operation clock of the first electronic controller.
7. The imaging device according to claim 1 , wherein
the second electronic controller is further configured to thin out the image data to be processed by the first electronic controller.
8. The imaging device according to claim 1 , wherein
the second electronic controller is further configured to change a data amount of the image data in one frame which data is to be processed by the first electronic controller.
9. The imaging device according to claim 1 , wherein
the second electronic controller is further configured to change a frame rate of the image data to be processed by the first electronic controller.
10. The imaging device according to claim 1 , further comprising
an object recognition circuitry that recognizes a plurality of objects from the image data and calculates scores of the plurality of objects, wherein
the second electronic controller is further configured to select data of the plurality of objects, which data is to be processed by the first electronic controller, from the image data in one frame on the basis of the scores of the plurality of objects.
11. The imaging device according to claim 1 , wherein
the temperature sensor is provided in a vicinity of a heat source.
12. The imaging device according to claim 1 , wherein
the temperature sensor is provided in a vicinity of a generation source of noise.
13. The imaging device according to claim 1 , wherein
the temperature sensor is provided at a central position in the imaging device.
14. An electronic apparatus comprising:
an imaging device including
an image sensor configured to capture an image and generate image data,
a first electronic controller configured to perform processing with respect to the image data read from the image sensor, the first electronic controller including an electronic processor and a memory, the memory including a plurality of deep neural networks (DNNs), each of the plurality of DNNs having a depth of layers,
a temperature sensor configured to detect a temperature, and
a second electronic controller configured to change an operation of the first electronic controller according to the temperature detected by the temperature sensor.
15. The electronic apparatus according to claim 14 , further comprising:
a noise detection circuitry configured to detect an amount of noise generated in an analog circuit of the image sensor, wherein
the second electronic controller is further configured to control the operation of the first electronic controller according to the noise detected by the noise detection circuitry.
16. The electronic apparatus according to claim 14 , wherein
the first electronic controller is further configured to perform DNN processing using one DNN of the plurality of DNNs with respect to the image data, and
the second electronic controller is further configured to change a first depth of layers of the one DNN.
17. The electronic apparatus according to claim 16 , wherein
the second electronic controller is further configured to change from the one DNN to a second DNN of the plurality of the DNNs, the second DNN having a second depth of layer that is different from the first depth of layers of the one DNN.
18. The electronic apparatus according to claim 16 , wherein
the second electronic controller is further configured to change the depth of layers, on which the processing is to be performed by the first electronic controller, among all layers in one of the DNNs.
19. The electronic apparatus according to claim 14 , wherein
the second electronic controller is further configured to change an operation clock of the first electronic controller.
20. An imaging method comprising:
capturing, with an image sensor, an image and generating image data;
processing, with a first electronic controller, the image data that is generated, the first electronic controller including an electronic processor and a memory, the memory including a plurality of deep neural networks (DNNs), each of the plurality of DNNs having a depth of layers;
detecting, with a temperature sensor, a temperature; and
changing, with a second electronic controller, the processing by the first electronic controller on the image data according to the temperature that is detected.