Handheld electronic device and camera providing flash compensation of images, and associated method
View Patent ↗An improved handheld electronic device and camera apparatus upon which can be executed an improved method enable a modular camera to be used in conjunction with a flash. In one implementation, compensation parameters that are intended for use in a non-flash situation are overwritten with compensation parameters that are configured to compensate for the combined effects of the camera and the flash and are used by an embedded compensation routine executed on the camera. In another implementation, an image signal is processed by the embedded compensation routine using the original compensation parameters, but if it is determined that the image signal is a flash image signal, the image signal is further processed by the embedded compensation routine employing an additional set of parameters which compensate the image signal for the effect of the flash.
1. A handheld electronic device comprising:
an input apparatus comprising a camera apparatus and being structured to provide input to a processor apparatus;
an output apparatus structured to receive output signals from the processor apparatus and to provide output;
the camera apparatus comprising a camera and a flash;
the camera comprising a sensor, a camera lens, and a processor system having a lens shading routine executable thereon;
the flash comprising a light source and a flash lens;
the lens shading routine being structured to employ compensation parameters stored in a plurality of storage registers in performing a processing operation on an image signal from the sensor, the lens shading routine being further structured to be executable on the processor system to cause the camera apparatus to perform operations comprising:
storing compensation parameters for processing a non-flash image in the storage registers of the camera;
overwriting at least a portion of the storage registers to provide compensation parameters for processing a flash image;
processing a flash image signal in accordance with the compensation parameters for processing a flash image; and
overwriting the storage registers to restore the compensation parameters for processing a non-flash image when processing of the flash image signal is completed.
2. The handheld electronic device of claim 1 wherein the operations further comprise:
processing a non-flash image signal in accordance with the compensation parameters for processing a non-flash image.
3. The handheld electronic device of claim 2 wherein the operations further comprise employing as the compensation parameters for processing a flash image both the compensation parameters for processing a non-flash image and a number of additional compensation parameters configured to compensate the image signal for signal variations attributable to at least a portion of the flash.
4. The handheld electronic device of claim 1 , wherein the input apparatus further comprises a keypad.
5. The handheld electronic device of claim 1 , wherein the input apparatus further comprises a mouse, trackwheel or trackball.
6. The handheld electronic device of claim 1 , wherein the output apparatus further comprises a display to display the processed flash image.
7. The handheld electronic device of claim 1 , wherein the flash lens comprises a Fresnel lens.
8. The handheld electronic device of claim 1 , wherein the light source comprises a plurality of light emitting diodes (LEDs).
9. The handheld electronic device of claim 1 wherein the sensor comprises a plurality of R pixels, a plurality of G pixels, and a plurality of B pixels distributed about the sensor, wherein the light source comprises a source of electromagnetic energy and an absorption/emission layer, the absorption/emission layer overlying the source of electromagnetic energy and having a thickness (T) in an on-axis direction away from the source of electromagnetic energy, and wherein the second compensation parameters comprise an R compensation parameter subset, a G compensation parameter subset, and a B compensation parameter subset, and the operations further comprise:
receiving as a portion of the flash image signal at least one R pixel signal, at least one G pixel signal, and at least one B pixel signal;
individually processing the R, G and B pixel signals with the R, G, and B compensation parameter subsets, respectively; and
employing as the compensation parameters in the R, G, and B compensation parameter subsets compensation parameters that have been selected to compensate for spectral variations resulting from off-axis transmission of electromagnetic energy a greater distance through the absorption/emission layer than the thickness (T).
10. A method of operating a camera apparatus to process an image signal, the camera apparatus comprising a camera and a flash, the camera comprising a sensor, a camera lens, and a processor system having a lens shading routine executable thereon, the flash comprising a light source and a flash lens, the method comprising:
storing compensation parameters for processing a non-flash image in storage registers of the camera;
overwriting at least a portion of the storage registers to provide compensation parameters for processing a flash image;
processing a flash image signal in accordance with the compensation parameters for processing a flash image; and
overwriting the storage registers to restore the compensation parameters for processing a non-flash image when processing of the flash image signal is completed.
11. The method of claim 10 , further comprising processing a non-flash image signal in accordance with the compensation parameters for processing a non-flash image.
12. The method of claim 10 , further comprising employing as the compensation parameters for processing a flash image both the compensation parameters for processing a non-flash image and a number of additional compensation parameters configured to compensate the image signal for signal variations attributable to at least a portion of the flash.
13. The method of claim 10 , wherein the sensor comprises a plurality of R pixels, a plurality of G pixels, and a plurality of B pixels distributed about the sensor, wherein the light source comprises a source of electromagnetic energy and an absorption/emission layer, the absorption/emission layer overlying the source of electromagnetic energy and having a thickness (T) in an on-axis direction away from the source of electromagnetic energy, and wherein the second compensation parameters comprise an R compensation parameter subset, a G compensation parameter subset, and a B compensation parameter subset, and further comprising:
receiving as a portion of the flash image signal at least one R pixel signal, at least one G pixel signal, and at least one B pixel signal;
individually processing the R, G and B pixel signals with the R, G, and B compensation parameter subsets, respectively; and
employing as the compensation parameters in the R, G, and B compensation parameter subsets compensation parameters that have been selected to compensate for spectral variations resulting from off-axis transmission of electromagnetic energy a greater distance through the absorption/emission layer than the thickness (T).
14. A camera apparatus comprising:
a camera comprising a sensor, a camera lens, and a processor system having a lens shading routine executable thereon;
a flash comprising a light source and a flash lens;
the lens shading routine being structured to employ compensation parameters stored in storage registers in performing a processing operation on an image signal from the sensor, the lens shading routine being further structured to be executable on the processor system to cause the camera apparatus to perform operations comprising:
storing compensation parameters for processing a non-flash image in the storage registers of the camera;
overwriting at least a portion of the storage registers to provide compensation parameters for processing a flash image;
processing a flash image signal in accordance with the compensation parameters for processing a flash image; and
overwriting the storage registers to restore the compensation parameters for processing a non-flash image when processing of the flash image signal is completed.
15. The camera apparatus of claim 14 wherein the operations further comprise:
processing a non-flash image signal in accordance with the compensation parameters for processing a non-flash image.
16. The camera apparatus of claim 15 wherein the operations further comprise employing as the compensation parameters for processing a flash image both the compensation parameters for processing a non-flash image and a number of additional compensation parameters configured to compensate the image signal for signal variations attributable to at least a portion of the flash.
17. The camera apparatus of claim 14 wherein the sensor comprises a plurality of R pixels, a plurality of G pixels, and a plurality of B pixels distributed about the sensor, wherein the light source comprises a source of electromagnetic energy and an absorption/emission layer, the absorption/emission layer overlying the source of electromagnetic energy and having a thickness (T) in an on-axis direction away from the source of electromagnetic energy, and wherein the second compensation parameters comprise an R compensation parameter subset, a G compensation parameter subset, and a B compensation parameter subset, and the operations further comprise:
receiving as a portion of the flash image signal at least one R pixel signal, at least one G pixel signal, and at least one B pixel signal;
individually processing the R, G and B pixel signals with the R, G, and B compensation parameter subsets, respectively; and
employing as the compensation parameters in the R, G, and B compensation parameter subsets compensation parameters that have been selected to compensate for spectral variations resulting from off-axis transmission of electromagnetic energy a greater distance through the absorption/emission layer than the thickness (T).
18. The camera apparatus of claim 14 , wherein the flash lens comprises a Fresnel lens.
19. The camera apparatus of claim 14 , wherein the light source comprises a plurality of light emitting diodes (LEDs).
20. The camera apparatus of claim 14 , further comprising a display to display the processed flash image.