Display device, image processing method and electronic device

1 . A display device, comprising an LCD screen, wherein

the LCD screen comprises a backlight source provided with a plurality of zones;

each zone is provided with visible light sources; and

at least one zone is provided with infrared light sources;

wherein the infrared light sources are configured to emit infrared light having different bands, and the infrared light of the different bands, after irradiating an object, is collected by a multispectral infrared camera and used for three-dimensional reconstruction of the object based on a photometric stereo method; and

wherein the plurality of zones comprises a first zone, a second zone, and a third zone, the first zone comprises a plurality of first infrared light sources configured to emit infrared light having a first band, the second zone comprises a plurality of second infrared light sources configured to emit infrared light having a second band, and the third zone comprises a plurality of third infrared light sources configured to emit infrared light having a third band, wherein the first band, the second band, and the third band are different from each other.

2 . The display device according to claim 1 , wherein

each zone is provided with infrared light sources; and

the infrared light sources in one zone have a different infrared band compared with the infrared light sources in another zone.

3 . The display device according to claim 2 , wherein the infrared light sources in one zone have a different light source direction compared with the infrared light sources in another zone.

4 . The display device according to claim 1 , wherein the zones of the backlight source are arranged in a polygonal structure.

5 . The display device according to claim 1 , wherein within the zone, a number of the visible light sources is greater than a number of the infrared light sources, and the visible light sources are arranged surrounding the infrared light sources.

6 . The display device according to claim 1 , wherein at least one of the multispectral infrared camera or a color camera is provided outside the LCD screen.

7 . An image processing method, comprising:

identifying a viewpoint area on a LCD screen of a user, wherein a backlight source of the LCD screen is provided with infrared light sources in at least one zone;

calling a combination of cameras corresponding to the viewpoint area to perform image acquisition, wherein the combination of cameras comprises at least one of a color camera or a multispectral infrared camera, and the acquired image comprises at least one frame of color image acquired by each camera; and

calling a respective method according to a number of directions of the infrared light sources to reconstruct a normal vector, for performing a three-dimensional reconstruction of an object based on the normal vector;

wherein the infrared light sources are configured to emit infrared light having different bands, and the infrared light of the different bands, after irradiating the object, is collected by the multispectral infrared camera and used for three-dimensional reconstruction of the object based on a photometric stereo method; and

wherein the at least one zone comprises a first zone, a second zone, and a third zone, the first zone comprises a plurality of first infrared light sources configured to emit infrared light having a first band, the second zone comprises a plurality of second infrared light sources configured to emit infrared light having a second band, and the third zone comprises a plurality of third infrared light sources configured to emit infrared light having a third band, wherein the first band, the second band, and the third band are different from each other.

8 . The image processing method according to claim 7 , wherein

the combination of cameras comprises several multispectral infrared cameras; and

the method further comprises:

extracting image channel information from the acquired multi-frame color image based on band information of the infrared light sources; and

calculating the normal vector using a photometric stereo algorithm based on the extracted image channel information.

9 . The image processing method according to claim 7 , wherein

the combination of cameras comprises several color cameras and multispectral infrared cameras; and

the method further comprises:

extracting image channel information from the acquired multi-frame color image based on band information of the infrared light sources; and

calculating the normal vector using a photometric stereo algorithm based on the extracted image channel information.

10 . The image processing method according to claim 7 , wherein

the combination of cameras comprises several color cameras; and

the method further comprises:

calling the combination of cameras corresponding to the viewpoint area to perform image acquisition for acquiring a color image;

acquiring a second image in an infrared mode by other cameras;

extracting image channel information from the acquired color image and second image according to band information of the infrared light sources; and

calculating the normal vector using a shadow recovery algorithm based on the extracted image channel information.

11 . An electronic device, comprising:

a processor; and

a memory, having executable instructions for the processor stored thereon,

wherein the processor is configured to perform an image processing method when executing the executable instructions, and

wherein the image processing method comprises:

identifying a viewpoint area on a LCD screen of a user, wherein a backlight source of the LCD screen is provided with infrared light sources in at least one zone;

calling a combination of cameras corresponding to the viewpoint area to perform image acquisition, wherein the combination of cameras comprises at least one of a color camera or a multispectral infrared camera, and the acquired image comprises at least one frame of color image acquired by each camera; and

calling a respective method according to a number of directions of the infrared light sources to reconstruct a normal vector, for performing a three-dimensional reconstruction of an object based on the normal vector;

wherein the infrared light sources are configured to emit infrared light having different bands, and the infrared light of the different bands, after irradiating the object, is collected by the multispectral infrared camera and used for three-dimensional reconstruction of the object based on a photometric stereo method; and

wherein the at least one zone comprises a first zone, a second zone, and a third zone, the first zone comprises a plurality of first infrared light sources configured to emit infrared light having a first band, the second zone comprises a plurality of second infrared light sources configured to emit infrared light having a second band, and the third zone comprises a plurality of third infrared light sources configured to emit infrared light having a third band, wherein the first band, the second band, and the third band are different from each other.

12 . The electronic device according to claim 11 , wherein

the combination of cameras comprises several multispectral infrared cameras; and

the method further comprises:

extracting image channel information from the acquired multi-frame color image based on band information of the infrared light sources; and

calculating the normal vector using a photometric stereo algorithm based on the extracted image channel information.

13 . The electronic device according to claim 11 , wherein

the combination of cameras comprises several color cameras and multispectral infrared cameras; and

the method further comprises:

extracting image channel information from the acquired multi-frame color image based on band information of the infrared light sources; and

calculating the normal vector using a photometric stereo algorithm based on the extracted image channel information.

14 . The electronic device according to claim 11 , wherein

the combination of cameras comprises several color cameras; and

the method further comprises:

calling the combination of cameras corresponding to the viewpoint area to perform image acquisition for acquiring a color image;

acquiring a second image in an infrared mode by other cameras;

extracting image channel information from the acquired color image and second image according to band information of the infrared light sources; and

calculating the normal vector using a shadow recovery algorithm based on the extracted image channel information.