Electronic device employing thermal sensor and image sensor
There is provided a recognition system adaptable to a portable device or a wearable device. The recognition system senses a body heat using a thermal sensor, and performs functions such as the living body recognition, image denoising and body temperature prompting according to detected results.
1 . An electronic device, comprising:
a bolometer, configured to acquire and output a two-dimensional thermal image, each pixel of the two-dimensional thermal image indicating a temperature value;
an image sensor, configured to acquire and output image information;
a display screen, wherein the bolometer and the image sensor are arranged adjacent to a side of the display screen, and adjacent to each other along the side of the display screen; and
a processor, coupled with the bolometer and the image sensor to respectively receive the two-dimensional thermal image and the image information, and configured to perform an object recognition according to the image information,
wherein
before the bolometer is turned on, the processor is configured to perform the object recognition to recognize whether an object in the image information is a registered face image,
in response to the object recognition not recognizing the object, the processor is configured to not turn on the bolometer,
in response to the object recognition recognizing the object, the processor is configured to turn on the bolometer, and
after the bolometer is turned on, the processor is further configured to
identify a region in the two-dimensional thermal image having temperature values larger than a temperature threshold as a processed region,
determine an image region in the image information corresponding to the processed region,
ignore objects in the image information outside the image region to eliminate interference from ambient light, and
remove a non-human image among object images in the image information.
2 . The electronic device as claimed in claim 1 , wherein the processor is further configured to recognize whether the object in the image information has a skin material to distinguish a fake in a photo or video as the non-human image.
3 . The electronic device as claimed in claim 1 , wherein when the bolometer is turned on, only a part of pixels of the bolometer corresponding to an object region of the object in the image information is turned on.
4 . The electronic device as claimed in claim 1 , wherein a field of view of the image sensor is partially overlapped with that of the bolometer.
5 . The electronic device as claimed in claim 1 , wherein after the bolometer is turned on, the processor is further configured to perform a living body recognition according to a regional heat distribution comprising a nose having a temperature higher than temperatures of eyes and a mouth in the two-dimensional thermal image compared with locations of facial features of the nose, the eyes and the mouth identified in the image information to remove the non-human image.
6 . The electronic device as claimed in claim 1 , wherein after the bolometer is turned on, the processor is further configured to perform a living body recognition by comparing a current regional heat distribution in the two-dimensional thermal image with a pre-stored temperature distribution to remove the non-human image.
7 . The electronic device as claimed in claim 1 , wherein the electronic device is a portable device, a wearable device, a security system, a control system of a gate or a vehicle.
8 . An electronic device, comprising:
a bolometer, configured to acquire and output a two-dimensional thermal image, each pixel of the two-dimensional thermal image indicating a temperature value;
an image sensor, configured to acquire and output image information;
a display screen, wherein the bolometer and the image sensor are arranged adjacent to a side of the display screen, and adjacent to each other along the side of the display screen; and
a processor, coupled with the bolometer and the image sensor to respectively receive the two-dimensional thermal image and the image information, and configured to
perform an object recognition to recognize whether an object is a registered face image according to the image information,
identify a region in the two-dimensional thermal image having temperature values larger than a temperature threshold as a processed region,
determine an image region in the image information corresponding to the processed region,
ignore objects in the image information outside the image region to eliminate interference from ambient light, and
remove a non-human image among object images in the image information according to the two-dimensional thermal image.
9 . The electronic device as claimed in claim 8 , wherein the processor is further configured to recognize whether an object in the image information has a skin material to distinguish a fake in a photo or video as the non-human image.
10 . The electronic device as claimed in claim 8 , wherein only a part of pixels of the bolometer corresponding to an object region of the object in the image information is turned on.
11 . The electronic device as claimed in claim 8 , wherein a field of view of the image sensor is partially overlapped with that of the bolometer.
12 . The electronic device as claimed in claim 8 , wherein the processor is further configured to perform a living body recognition according to a regional heat distribution comprising a nose having a temperature higher than temperatures of eyes and a mouth in the two-dimensional thermal image compared with locations of facial features of the nose, the eyes and the mouth identified in the image information to remove the non-human image.
13 . The electronic device as claimed in claim 8 , wherein the processor is further configured to perform a living body recognition by comparing a current regional heat distribution in the two-dimensional thermal image with a pre-stored temperature distribution to remove the non-human image.
14 . The electronic device as claimed in claim 8 , wherein the electronic device is a portable device, a wearable device, a security system, a control system of a gate or a vehicle.