Image capture device with adaptive white balance correction using a switchable white reference
This disclosure relates to image capture devices with the ability to perform adaptive white balance correction using a switchable white reference (SWR). In some embodiments, the image capture device utilizes “true white” information to record images that better represent users' perceptions. In other embodiments, the same SWR and camera that dynamically sample ambient lighting conditions are used to determine “true white” in near real-time. In other embodiments, the image capture device comprises a display screen that utilizes the “true white” information in near real-time to dynamically adjust the display. In other embodiments, face detection techniques and/or ambient light sensors may be used to determine which device camera is most closely-aligned with the direction that the user of the device is currently looking in, and using it to capture a “true white” image in the direction that most closely corresponds to the ambient lighting conditions that currently dominate the user's perception.
1. An apparatus, comprising:
two or more cameras, each camera comprising an image sensor and a switchable white reference element configured to switch between a first transparent mode and a second diffusive mode;
a display;
a memory having, stored therein, computer program code; and
one or more processing units operatively coupled to the memory and configured to execute instructions in the computer program code that cause the one or more processing units to:
determine a first operational mode of the apparatus; and
if the first operational mode is not determined to be a camera mode—
attempt to detect a face of a user of the apparatus using one or more of the two or more cameras; and
if the face of a user of the apparatus is detected and if the camera most closely aligned with a direction that the detected user's face is currently looking in is reading greater than a minimum threshold ambient light level—
configure the switchable white reference element of the apparatus camera most closely aligned with a direction that the detected user's face is looking in into the second diffusive mode;
capture a first reference white image using the apparatus camera most closely aligned with a direction that the detected user's face is looking in;
determine a first white point for the first reference white image; and
adjust a color composition of the display based, at least in part, on the determined first white point for the first reference white image.
2. The apparatus of claim 1 , wherein the first transparent mode of a respective camera of the two or more cameras comprises a mode wherein light passes through the respective camera's switchable white reference element to the respective camera's respective image sensor without scattering.
3. The apparatus of claim 1 , wherein the second diffusive mode of a respective camera of the two or more cameras comprises a mode wherein light passes through the respective camera's switchable white reference element to the respective camera's respective image sensor with scattering.
4. The apparatus of claim 1 , wherein the one or more processing units are further configured to execute instructions in the computer program code that cause the one or more processing units to determine the first operational mode of the apparatus at predetermined time intervals.
5. The apparatus of claim 1 , wherein the switchable white reference element of at least one of the two or more cameras comprises at least one of the following: a polymer-dispersed liquid crystal display (PDLC), a reverse mode polymer stabilized cholesteric texture (PSCT), and an electro-wetting display.
6. The apparatus of claim 1 , wherein the instructions in the computer program code further cause the one or more processing units to:
if the first operational mode is determined to be a camera mode—
configure the switchable white reference element of the apparatus camera being utilized in the camera mode into the second diffusive mode;
capture a second reference white image using the apparatus camera being utilized in the camera mode;
determine a second white point for the second reference white image;
configure the switchable white reference element of the apparatus camera being utilized in the camera mode into the first transparent mode;
obtain a first captured image from the image sensor of the apparatus camera being utilized in the camera mode; and
adjust a color composition of the first captured image based, at least in part, on the second determined white point for the second reference white image.
7. The apparatus of claim 6 , wherein the instructions in the computer program code further cause the one or more processing units to:
if the first operational mode is not determined to be a camera mode, and the face of a user of the apparatus is detected, and if the camera most closely aligned with a direction that the detected user's face is currently looking in is not reading greater than a minimum threshold ambient light level, or
if the first operational mode is not determined to be a camera mode, and no face of a user of the apparatus is detected—
configure the switchable white reference element of the apparatus camera reading the greatest ambient light level into the second diffusive mode;
capture a third reference white image using the apparatus camera reading the greatest ambient light level;
determine a third white point for the third reference white image; and
adjust a color composition of the display based, at least in part, on the third determined white point for the third reference white image.
8. A non-transitory program storage device, readable by a programmable control device and comprising instructions stored thereon to cause one or more processing units to:
determine a first operational mode of an apparatus, the apparatus comprising:
two or more cameras, each camera comprising an image sensor and a switchable white reference element configured to switch between a first transparent mode and a second diffusive mode; and
a display; and
if the first operational mode is not determined to be a camera mode—
attempt to detect a face of a user of the apparatus using one or more of the two or more cameras; and
if the face of a user of the apparatus is detected and if the camera most closely aligned with a direction that the detected user's face is currently looking in is reading greater than a minimum threshold ambient light level—
configure the switchable white reference element of the apparatus camera most closely aligned with a direction that the detected user's face is looking in into the second diffusive mode;
cause the apparatus to capture a first reference white image using the apparatus camera most closely aligned with a direction that the detected user's face is looking in;
determine a first white point for the first reference white image; and
adjust a color composition of the display based, at least in part, on the determined first white point for the first reference white image.
9. The non-transitory program storage device of claim 8 , wherein the first transparent mode of a respective camera of the two or more cameras of the apparatus comprises a mode wherein light passes through the respective camera's switchable white reference element to the respective camera's respective image sensor without scattering.
10. The non-transitory program storage device of claim 8 , wherein the second diffusive mode of a respective camera of the two or more cameras of the apparatus comprises a mode wherein light passes through the respective camera's switchable white reference element to the respective camera's respective image sensor with scattering.
11. The non-transitory program storage device of claim 8 , wherein the one or more processing units are further configured to execute instructions that cause the one or more processing units to determine the first operational mode of the apparatus at predetermined time intervals.
12. The non-transitory program storage device of claim 8 , wherein the switchable white reference element of at least one of the two or more cameras of the apparatus comprises at least one of the following: a polymer-dispersed liquid crystal display (PDLC), a reverse mode polymer stabilized cholesteric texture (PSCT), and an electro-wetting display.
13. The non-transitory program storage device of claim 8 , further comprising instructions stored thereon to cause the one or more processing units to:
if the first operational mode is determined to be a camera mode—
configure the switchable white reference element of the apparatus camera being utilized in the camera mode into the second diffusive mode;
cause the apparatus to capture a second reference white image using the apparatus camera being utilized in the camera mode;
determine a second white point for the second reference white image;
configure the switchable white reference element of the apparatus camera being utilized in the camera mode into the first transparent mode;
cause the apparatus to obtain a first captured image from the image sensor of the apparatus camera being utilized in the camera mode; and
adjust a color composition of the first captured image based, at least in part, on the second determined white point for the second reference white image.
14. The non-transitory program storage device of claim 13 , further comprising instructions stored thereon to cause the one or more processing units to:
if the first operational mode is not determined to be a camera mode, and the face of a user of the apparatus is detected, and if the camera most closely aligned with a direction that the detected user's face is currently looking in is not reading greater than a minimum threshold ambient light level, or
if the first operational mode is not determined to be a camera mode, and no face of a user of the apparatus is detected—
configure the switchable white reference element of the apparatus camera reading the greatest ambient light level into the second diffusive mode;
cause the apparatus to capture a third reference white image using the apparatus camera reading the greatest ambient light level;
determine a third white point for the third reference white image; and
adjust a color composition of the display based, at least in part, on the third determined white point for the third reference white image.
15. A computer-implemented method, comprising:
determining a first operational mode of an apparatus, the apparatus comprising:
two or more cameras, each camera comprising an image sensor and a switchable white reference element configured to switch between a first transparent mode and a second diffusive mode; and
a display; and
if the first operational mode is not determined to be a camera mode—
attempting to detect a face of a user of the apparatus using one or more of the two or more cameras; and
if the face of a user of the apparatus is detected and if the camera most closely aligned with a direction that the detected user's face is currently looking in is reading greater than a minimum threshold ambient light level—
configuring the switchable white reference element of the apparatus camera most closely aligned with a direction that the detected user's face is looking in into the second diffusive mode;
causing the apparatus to capture a first reference white image using the apparatus camera most closely aligned with a direction that the detected user's face is looking in;
determining a first white point for the first reference white image; and
adjusting a color composition of the display based, at least in part, on the determined first white point for the first reference white image.
16. The computer-implemented method of claim 15 , wherein the second diffusive mode of a respective camera of the two or more cameras of the apparatus comprises a mode wherein light passes through the respective camera's switchable white reference element to the respective camera's respective image sensor with scattering.
17. The computer-implemented method of claim 15 , wherein the one or more processing units are further configured to execute instructions that cause the one or more processing units to determine the first operational mode of the apparatus at predetermined time intervals.
18. The computer-implemented method of claim 15 , wherein the switchable white reference element of at least one of the two or more cameras of the apparatus comprises at least one of the following: a polymer-dispersed liquid crystal display (PDLC), a reverse mode polymer stabilized cholesteric texture (PSCT), and an electro-wetting display.
19. The computer-implemented method of claim 15 , further comprising:
if the first operational mode is determined to be a camera mode—
configuring the switchable white reference element of the apparatus camera being utilized in the camera mode into the second diffusive mode;
causing the apparatus to capture a second reference white image using the apparatus camera being utilized in the camera mode;
determining a second white point for the second reference white image;
configuring the switchable white reference element of the apparatus camera being utilized in the camera mode into the first transparent mode;
causing the apparatus to obtain a first captured image from the image sensor of the apparatus camera being utilized in the camera mode; and
adjusting a color composition of the first captured image based, at least in part, on the second determined white point for the second reference white image.
20. The computer-implemented method of claim 19 , further comprising:
if the first operational mode is not determined to be a camera mode, and the face of a user of the apparatus is detected, and if the camera most closely aligned with a direction that the detected user's face is currently looking in is not reading greater than a minimum threshold ambient light level, or
if the first operational mode is not determined to be a camera mode, and no face of a user of the apparatus is detected—
configuring the switchable white reference element of the apparatus camera reading the greatest ambient light level into the second diffusive mode;
causing the apparatus to capture a third reference white image using the apparatus camera reading the greatest ambient light level;
determining a third white point for the third reference white image; and
adjusting a color composition of the display based, at least in part, on the third determined white point for the third reference white image.