Controlling characteristics of light output from LED walls
A computer-generated scene is generated as background for a live action set, for display on a panel of light emitting diodes (LEDs). Characteristics of light output by the LED panel are controlled such that the computer-generated scene rendered on the LED panel, when captured by a motion picture camera, has high fidelity to the original computer-generated scene. Consequently, the scene displayed on the screen more closely simulates the rendered scene from the viewpoint of the camera. Thus, a viewpoint captured by the camera appears more realistic and/or truer to the creative intent.
1. A computer-implemented method for controlling individual pixels of a display screen displaying an input image, the computer-implemented method comprising:
receiving, by at least one processor, an output image from a camera capturing the display screen, wherein the output image includes one or more output image pixels; determining, by the at least one processor, a camera position and a camera orientation relative to the display screen;
estimating, by the at least one processor, a difference in a perceptual aspect between each of the one or more output image pixels and each of one or more correlated pixels of the input image based on a geometric relation between the camera and the one or more correlated pixels of the input image, wherein the geometric relation is based on the camera position and the camera orientation; and
based on the estimated difference, adjusting, by the at least one processor, at least one parameter for controlling a display of the input image on the display screen.
2. The computer-implemented method of claim 1 , wherein the perceptual aspect includes a measured difference in appearance or an expected calculated difference in appearance based on a geometric factor.
3. The computer-implemented method of claim 1 , the computer-implemented method further comprising:
determining, by the at least one processor, that the difference in the perceptual exceeds a perceptual threshold.
4. The computer-implemented method of claim 1 , wherein the at least one parameter includes a luminance measure or an equivalent measure of output from one or more individual pixels of the display screen.
5. The computer-implemented method of claim 1 , wherein the geometric relation is a smooth function across neighboring pixels.
6. The computer-implemented method of claim 1 , the computer-implemented method further comprising:
determining, by the at least one processor, the camera position and the camera orientation based on a predefined plan for motion of the camera, or sensor data indicating the camera position and the camera orientation.
7. The computer-implemented method of claim 1 , wherein estimating the difference comprises looking up the difference in the perceptual aspect based at least on part on an angular offset.
8. A computer system for controlling individual pixels of a display screen displaying an input image, the computer system comprising:
a memory having processor-readable instructions stored therein; and
one or more processors configured to access the memory and execute the processor-readable instructions, which when executed by the one or more processors configures the one or more processors to perform a plurality of functions, including functions for:
receiving, by the one or more processors, an output image from a camera capturing the display screen, wherein the output image includes one or more output image pixels;
determining, by the one or more processors, a camera position and a camera orientation relative to the display screen;
estimating, by the one or more processors, a difference in a perceptual aspect between each of the one or more output image pixels and each of one or more correlated pixels of the input image based on a geometric relation between the camera and the one or more correlated pixels of the input image, wherein the geometric relation is based on the camera position and the camera orientation; and
based on the estimated difference, adjusting, by the one or more processors, at least one parameter for controlling a display of the input image on the display screen.
9. The computer system of claim 8 , wherein the perceptual aspect includes a measured difference in appearance or an expected calculated difference in appearance based on a geometric factor.
10. The computer system of claim 8 , the functions further comprising:
determining, by the one or more processors, that the difference in the perceptual exceeds a perceptual threshold.
11. The computer system of claim 8 , wherein the at least one parameter includes a luminance measure or an equivalent measure of output from one or more individual pixels of the display screen.
12. The computer system of claim 8 , wherein the geometric relation is a smooth function across neighboring pixels.
13. The computer system of claim 8 , the functions further comprising:
determining, by the one or more processors, the camera position and the camera orientation based on a predefined plan for motion of the camera, or sensor data indicating the camera position and the camera orientation.
14. The computer system of claim 8 , wherein estimating the difference comprises looking up the difference in the perceptual aspect based at least on part on an angular offset.
15. A non-transitory computer-readable medium containing instructions for controlling individual pixels of a display screen displaying an input image, the instructions comprising:
receiving an output image from a camera capturing the display screen, wherein the output image includes one or more output image pixels;
determining a camera position and a camera orientation relative to the display screen;
estimating a difference in a perceptual aspect between each of the one or more output image pixels and each of one or more correlated pixels of the input image based on a geometric relation between the camera and the one or more correlated pixels of the input image, wherein the geometric relation is based on the camera position and the camera orientation; and
based on the estimated difference, adjusting at least one parameter for controlling a display of the input image on the display screen.
16. The non-transitory computer-readable medium of claim 15 , wherein the perceptual aspect includes a measured difference in appearance or an expected calculated difference in appearance based on a geometric factor.
17. The non-transitory computer-readable medium of claim 15 , the instructions further comprising:
determining that the difference in the perceptual exceeds a perceptual threshold.
18. The non-transitory computer-readable medium of claim 15 , wherein the at least one parameter includes a luminance measure or an equivalent measure of output from one or more individual pixels of the display screen.
19. The non-transitory computer-readable medium of claim 15 , wherein the geometric relation is a smooth function across neighboring pixels.
20. The non-transitory computer-readable medium of claim 15 , the instructions further comprising:
determining the camera position and the camera orientation based on a predefined plan for motion of the camera, or sensor data indicating the camera position and the camera orientation.