Processing images captured by a camera behind a display

1. A method comprising, by an electronic device:

capturing, by a camera disposed behind a display panel of the electronic device, an original image through a semi-transparent pixel region of the display panel, wherein the original image comprises one or more color components;

creating a reconstructed image, corresponding to the original image, that corrects for a modulation of light passing through the semi-transparent pixel region of the display panel, comprising:

determining, for each of a plurality of pixel regions of the original image, a point spread function (PSF) for the respective pixel region for each of the one or more of color components;

performing, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs; and

generating the reconstructed image based on the deconvolutions of the one or more color components of the plurality of pixel regions of the original image.

2. The method of claim 1 , wherein the one or more color components comprises:

a red color component;

a green color component; and

a blue color component.

3. The method of claim 1 , wherein determining the PSF for the respective pixel region for each of the one or more color components comprises selecting, from a memory of the electronic device, a plurality of premeasured PSFs corresponding to the one or more color components, respectively.

4. The method of claim 1 , wherein the respective PSFs are premeasured based at least in part on a predetermined calibration process performed with respect to the camera and the display panel.

5. The method of claim 1 , wherein performing, for the plurality of pixel regions of the original image, the deconvolution of each of the one or more color components comprises performing a Richardson-Lucy deconvolution of each of the one or more color components.

6. The method of claim 1 , wherein performing, for the plurality of pixel regions of the original image, the deconvolution of each of the one or more color components comprises performing a Tikhonov regularized inverse filter deconvolution of each of the one or more color components.

7. The method of claim 1 , wherein generating the reconstructed image corresponding to the original image comprises removing a blurring effect of the original image.

8. The method of claim 1 , wherein generating the reconstructed image corresponding to the original image comprises performing a color correction of each of the one or more color components of the plurality of pixel regions of the original image.

9. An electronic device comprising:

a display panel;

a camera disposed behind the display panel;

one or more non-transitory computer-readable storage media including instructions; and

one or more processors coupled to the storage media and the camera, the one or more processors configured to execute the instructions to:

capture, by the camera, an original image through a semi-transparent pixel region of the display panel, wherein the original image comprises one or more color components;

create a reconstructed image, corresponding to the original image, that corrects for a modulation of light passing through the semi-transparent pixel region of the display panel, comprising:

determine, for a plurality of pixel regions of the original image, a point spread function (PSF) for each of the one or more color components;

perform, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs; and

generate the reconstructed image based on the deconvolutions of the one or more color components of the plurality of pixel regions of the original image.

10. The electronic device of claim 9 , wherein the one or more color components comprises:

a red color component;

a green color component; and

a blue color component.

11. The electronic device of claim 9 , wherein the instructions to determine the PSF for each of the one or more color components comprises instructions to select, from a memory of the electronic device, a plurality of premeasured PSFs corresponding to the one or more color components, respectively.

12. The electronic device of claim 9 , wherein the respective PSFs are premeasured based at least in part on a predetermined calibration process performed with respect to the camera and the display panel.

13. The electronic device of claim 9 , wherein the instructions to perform, for the plurality of pixel regions of the original image, the deconvolution of each of the one or more color components comprises instructions to perform a Richardson-Lucy deconvolution of each of the one or more color components.

14. The electronic device of claim 9 , wherein the instructions to perform, for the plurality of pixel regions of the original image, the deconvolution of each of the one or more color components comprises instructions to perform a Tikhonov regularized inverse filter deconvolution of each of the one or more color components.

15. The electronic device of claim 9 , wherein the instructions to generate the reconstructed image corresponding to the original image comprises instructions to remove a blurring effect of the original image.

16. The electronic device of claim 9 , wherein the instructions to generate the reconstructed image corresponding to the original image comprises instructions to perform a color correction of each of the one or more color components of the plurality of pixel regions of the original image.

17. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of an electronic device, cause the one or more processors to:

capture, by a camera disposed behind a display panel of the electronic device, an original image through a semi-transparent pixel region of a display panel, wherein the original image comprises one or more color components;

create a reconstructed image, corresponding to the original image, that corrects for a modulation of light passing through the semi-transparent pixel region of the display panel, comprising:

determine, for a plurality of pixel regions of the original image, a point spread function (PSF) for each of the one or more color components;

perform, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs; and

generate the reconstructed image based on the deconvolutions of the one or more color components of the plurality of n pixel regions of the original image.

18. The non-transitory computer-readable medium of claim 17 , wherein the one or more color components comprises:

a red color component;

a green color component; and

a blue color component.

19. The non-transitory computer-readable medium of claim 17 , wherein the instructions to perform, for the plurality of pixel regions of the original image, the deconvolution of each of the one or more color components comprises instructions to perform a Richardson-Lucy deconvolution of each of the one or more color components.

20. The non-transitory computer-readable medium of claim 17 , wherein the instructions to perform, for the plurality of pixel regions of the original image, the deconvolution of each of the one or more color components comprises instructions to perform a Tikhonov regularized inverse filter deconvolution of each of the one or more color components.