Ray tracing in a display
An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may include ray tracing circuitry that is configured to, using ray tracing, a three-dimensional image, and deflection measurements for the array of pixels, output a display calibration map that includes, for each pixel in the array of pixels, a corresponding location on a two-dimensional image. The display may also include pixel mapping circuitry configured to, using the display calibration map from the ray tracing circuitry, map the two-dimensional image to respective pixels on the array of pixels to obtain pixel data for the array of pixels.
1. An electronic device comprising:
a display that includes an array of pixels and a lenticular lens film formed over the array of pixels;
ray tracing circuitry configured to, using ray tracing, a three-dimensional image, and deflection measurements for the array of pixels, output a display calibration map that includes, for each pixel in the array of pixels, a corresponding location on a two-dimensional image; and
pixel mapping circuitry configured to, using the display calibration map from the ray tracing circuitry, map the two-dimensional image to respective pixels on the array of pixels to obtain pixel data for the array of pixels.
2. The electronic device defined in claim 1 , wherein the lenticular lens film spreads light from the array of pixels in a horizontal direction.
3. The electronic device defined in claim 2 , wherein each pixel in the array of pixels has a corresponding deflection measurement of the deflection measurements and wherein the deflection measurement for each pixel represents a horizontal deflection of light emitted by that pixel.
4. The electronic device defined in claim 3 , wherein the ray tracing circuitry is configured to use the deflection measurement for a pixel to trace a ray in an opposite direction of the light emitted by that pixel.
5. The electronic device defined in claim 4 , wherein the ray tracing circuitry is configured to determine where the ray in the opposite direction intersects a three-dimensional surface from the three-dimensional image.
6. The electronic device defined in claim 1 , wherein the display operates at a frame rate and wherein the ray tracing circuitry is configured to output the display calibration map at a second frequency that is lower than the frame rate.
7. The electronic device defined in claim 6 , wherein the frame rate is at least 50 times greater than the second frequency.
8. The electronic device defined in claim 1 , further comprising:
pre-mapping processing circuitry configured to process the two-dimensional image before the two-dimensional image is provided to the pixel mapping circuitry.
9. The electronic device defined in claim 8 , wherein the pre-mapping processing circuitry is configured to dither the two-dimensional image.
10. The electronic device defined in claim 9 , wherein the pre-mapping processing circuitry is configured to tone map the two-dimensional image.
11. The electronic device defined in claim 10 , wherein the pre-mapping processing circuitry is configured to, after tone mapping, adjust the two-dimensional image based on an ambient light level.
12. The electronic device defined in claim 11 , wherein the pre-mapping processing circuitry is configured to, after tone mapping, perform a white point calibration for the two-dimensional image.
13. The electronic device defined in claim 12 , wherein the pre-mapping processing circuitry is configured to, before tone mapping, pre-process the two-dimensional image.
14. The electronic device defined in claim 13 , wherein pre-processing the two-dimensional image comprises applying an anisotropic low-pass filter to the two-dimensional image.
15. The electronic device defined in claim 1 , further comprising:
post-mapping processing circuitry configured to process the pixel data for the array of pixels after the two-dimensional image is provided to the pixel mapping circuitry.
16. The electronic device defined in claim 15 , wherein the post-mapping processing circuitry is configured to perform burn-in compensation on the pixel data.
17. The electronic device defined in claim 16 , wherein the post-mapping processing circuitry is configured to selectively apply dimming factors to the pixel data.
18. The electronic device defined in claim 17 , wherein the post-mapping processing circuitry is configured to convert the pixel data to voltage levels.
19. An electronic device comprising:
one or more sensors that are configured to capture a two-dimensional image and a three-dimensional image; and
a display with an array of pixels overlapped by lenticular lenses, wherein the display is configured to:
receive the three-dimensional image from the one or more sensors;
based on the three-dimensional image and deflection measurements for the array of pixels, use ray tracing to obtain a display calibration map that includes, for each pixel in the array of pixels, a corresponding location on the two-dimensional image;
using the display calibration map, map the two-dimensional image to respective pixels on the array of pixels to obtain pixel data for the array of pixels; and
display the pixel data for the array of pixels.
20. A method of operating an electronic device with at least one sensor and a display having an array of pixels overlapped by lenticular lenses, the method comprising:
based on a three-dimensional image from the at least one sensor and deflection measurements for the array of pixels, using ray tracing to obtain a display calibration map that includes, for each pixel in the array of pixels, a corresponding location on a two-dimensional image;
using the display calibration map, mapping the two-dimensional image to respective pixels on the array of pixels to obtain pixel data for the array of pixels; and
displaying the pixel data for the array of pixels.