Crosstalk correction in displays
An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. Display pipeline circuitry for the lenticular display may implement crosstalk correction. Crosstalk correction may be performed before pixel mapping using stored crosstalk calibration profiles, crosstalk correction may be performed by ray tracing multiple beams per pixel, and/or crosstalk correction may be performed after pixel mapping using a kernel lookup table.
1 . A method of operating an electronic device with a camera configured to capture a first image and a lenticular display having a plurality of lenticular lenses over an array of pixels, the method comprising:
for each pixel in the first image, determining a corresponding crosstalk calibration profile based on stored crosstalk calibration profile information, a position of that pixel, and a depth associated with that pixel;
for each pixel in the first image, determining crosstalk using the crosstalk calibration profile for that pixel;
obtaining a second image by applying a sharpening filter to the first image using the determined crosstalk for each pixel; and
mapping the second image to the display.
2 . The method defined in claim 1 , wherein determining crosstalk using the crosstalk calibration profile for that pixel comprises determining crosstalk using an input texture of the first image and the crosstalk calibration profile for that pixel.
3 . The method defined in claim 1 , wherein the second image is a two-dimensional image of content and wherein mapping the second image to the display comprises generating a plurality of views of the content.
4 . The method defined in claim 1 , wherein mapping the second image to the display comprises mapping the second image to a third image with more pixels than the second image and wherein the method further comprises displaying the third image on the display.
5 . The method defined in claim 1 , further comprising:
before determining the corresponding crosstalk calibration profile for each pixel in the first image, adjusting one or more brightness magnitudes in the first image.
6 . The method defined in claim 1 , further comprising:
after mapping the second image to the display, adjusting one or more brightness magnitudes in the second image.
7 . The method defined in claim 1 , wherein the second image is equal to the first image plus a difference between the first image and the determined crosstalk multiplied by a scaling factor.
8 . The method defined in claim 1 , wherein mapping the second image to the display comprises mapping the second image to the display based on a third image captured by an additional camera, wherein the third image comprises a three-dimensional image.
9 . A method of operating an electronic device with a display having an array of pixels and a plurality of lenticular lenses that overlaps the array of pixels, the method comprising:
estimating contributions for each pixel in the array of pixels of an input two-dimensional image of content to a first three-dimensional image in a plurality of directions through the plurality of lenticular lenses;
generating a second three-dimensional image having a plurality of views of the content; and
based on the estimated contributions for each pixel, mitigating crosstalk between different pixels in the array of pixels associated with different views of the plurality of views.
10 . The method defined in claim 9 , wherein estimating contributions for each pixel in the array of pixels of the input two-dimensional image to the first three-dimensional image in the plurality of directions through the plurality of lenticular lenses comprises ray tracing multiple rays for each pixel in the array of pixels using stored ray information and wherein each pixel in the array of pixels has at least one corresponding deflection angle and display exit point in the stored ray information.
11 . The method defined in claim 10 , wherein ray tracing multiple rays for each pixel in the array of pixels comprises:
ray tracing a principle ray for each pixel in the array of pixels; and
ray tracing one or more secondary rays for each pixel in the array of pixels.
12 . The method defined in claim 11 , wherein information from ray tracing the principle ray for each pixel in the array of pixels is used to determine a pixel map associated with the principle ray for each pixel and wherein information from ray tracing the one or more secondary rays for each pixel in the array of pixels is used to determine one or more additional pixel maps that are each associated with a respective secondary ray for each pixel.
13 . The method defined in claim 12 , wherein mitigating crosstalk between different pixels in the array of pixels associated with different views of the plurality of views comprises:
using the pixel map and the additional pixel maps to obtain a plurality of images for the array of pixels; and
combining the plurality of images using a weighted average to obtain a representation of blur caused by crosstalk.
14 . The method defined in claim 13 , wherein mitigating crosstalk between different pixels in the array of pixels associated with different views of the plurality of views comprises:
applying a sharpening filter to the second three-dimensional image using the representation of blur caused by crosstalk.
15 . The method defined in claim 9 , wherein the first three-dimensional image is captured by a first camera in the electronic device and wherein the input two-dimensional image is captured by a second camera in the electronic device.
16 . A method of operating an electronic device with a lenticular display having a plurality of lenticular lenses over an array of pixels, the method comprising:
mapping a two-dimensional image of content to the array of pixels to obtain a three-dimensional image having a plurality of views of the content;
for each pixel in the array of pixels, determining a corresponding blur kernel;
applying the blur kernels to the three-dimensional image in a convolution pass to mitigate crosstalk;
after applying the blur kernels to the three-dimensional image in the convolution pass to mitigate crosstalk, adjusting one or more brightness magnitudes in the three-dimensional image; and
after adjusting the one or more brightness magnitudes in the three-dimensional image, displaying the three-dimensional image on the display.
17 . The method defined in claim 16 , wherein adjusting the one or more brightness magnitudes in the three-dimensional image comprises performing a processing operation selected from the group consisting of: border masking, burn-in compensation, panel response correction, color compensation, and dithering.
18 . The method defined in claim 16 , further comprising:
before mapping the two-dimensional image of the content to the array of pixels to obtain the three-dimensional image having the plurality of views of the content, adjusting additional brightness magnitudes in the two-dimensional image.
19 . The method defined in claim 18 , wherein adjusting additional brightness magnitudes in the two-dimensional image comprises performing a processing operation selected from the group consisting of: filtering, anisotropic resizing, tone mapping, and saturation adjustment.
20 . The method defined in claim 16 , wherein determining the corresponding blur kernel comprises determining the corresponding blur kernel using a lookup table based on a position of each pixel relative to an overlapping lenticular lens of the plurality of lenticular lenses.