Handheld electronic device and camera providing flash compensation of images, and associated method
View Patent ↗An improved handheld electronic device and camera apparatus upon which can be executed an improved method enable a modular camera to be used in conjunction with a flash. In one implementation, compensation parameters that are intended for use in a non-flash situation are overwritten with compensation parameters that are configured to compensate for the combined effects of the camera and the flash and are used by an embedded compensation routine executed on the camera. In another implementation, an image signal is processed by the embedded compensation routine using the original compensation parameters, but if it is determined that the image signal is a flash image signal, the image signal is further processed by the embedded compensation routine employing an additional set of parameters which compensate the image signal for the effect of the flash.
1. A method of operating a camera apparatus that comprises a camera and a flash, the camera comprising a sensor, a camera lens, and a processor system having a routine executable thereon, the flash comprising a light source and a flash lens, the routine being a lens shading routine structured to employ a number of compensation parameters in performing a predetermined processing operation on an image signal from the sensor, the method comprising:
processing a non-flash image signal with at least a portion of the routine;
employing a number of first compensation parameters as the compensation parameters in said processing a non-flash image signal;
processing a flash image signal with at least a portion of the routine;
employing a number of second compensation parameters as the compensation parameters in said processing a flash image signal, the first compensation parameters and the second compensation parameters being at least partially different,
wherein the sensor comprises a plurality of R pixels, a plurality of G pixels, and a plurality of B pixels distributed about the sensor, wherein the light source comprises a source of electromagnetic energy and an absorption/emission layer, the absorption/emission layer overlying the source of electromagnetic energy and having a thickness (T) in an on-axis direction away from the source of electromagnetic energy, and wherein the second compensation parameters comprise an R compensation parameter subset, a G compensation parameter subset, and a B compensation parameter subset, and further comprising:
receiving as a portion of a flash image signal at least one R pixel signal, at least one G pixel signal, and at least one B pixel signal;
individually processing the R, G, and B pixel signals with the R, G, and B compensation parameter subsets, respectively; and
employing as the compensation parameters in the R, G, and B compensation parameter subsets compensation parameters that have been selected to compensate for spectral variations resulting from off-axis transmission of electromagnetic energy a greater distance through the absorption/emission layer than the thickness (T).
2. The method of claim 1 , further comprising:
employing as the first compensation parameters a set of compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the camera; and
employing as the second compensation parameters a set of compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the camera and attributable to at least a portion of the flash.
3. The method of claim 2 , further comprising employing as the second compensation parameters a set of compensation parameters that are used by the at least portion of the routine in place of the first compensation parameters and that are configured to compensate an image signal for the combined signal variation attributable to at least a portion of the camera and at least a portion of the flash.
4. The method of claim 3 , further comprising overwriting in a number of predetermined storage registers on the processor system the first compensation parameters with the second compensation parameters preparatory for said processing a flash image signal.
5. The method of claim 3 , further comprising, responsive to said processing a flash image signal, overwriting in the predetermined storage registers the second compensation parameters with the first compensation parameters.
6. The method of claim 2 , further comprising employing as the second compensation parameters both the first compensation parameters and a number of additional compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the flash.
7. The method of claim 6 , further comprising:
employing the first compensation parameters in one portion of said processing a flash image signal; and
employing the additional compensation parameters in another portion of said processing a flash image signal.
8. A camera apparatus comprising:
a camera comprising a sensor, a camera lens, and a processor system having a routine executable thereon;
a flash comprising a light source and a flash lens;
the routine being structured to employ a number of compensation parameters in performing a predetermined processing operation on an image signal from the sensor, the routine being further structured to be executable on the processor system to cause the camera apparatus to perform operations comprising:
processing a non-flash image signal with at least a portion of the routine;
employing a number of first compensation parameters as the compensation parameters in said processing a non-flash image signal;
processing a flash image signal with at least a portion of the routine;
employing a number of second compensation parameters as the compensation parameters in said processing a flash image signal, the first compensation parameters and the second compensation parameters being at least partially different,
wherein the sensor comprises a plurality of R pixels, a plurality of G pixels, and a plurality of B pixels distributed about the sensor;
wherein the light source comprises a source of electromagnetic energy and an absorption/emission layer, the absorption/emission layer overlying the source of electromagnetic energy and having a thickness (T) in an on-axis direction away from the source of electromagnetic energy;
wherein the second compensation parameters comprise an R compensation parameter subset, a G compensation parameter subset, and a B compensation parameter subset; and
wherein the operations further comprise:
receiving as a portion of a flash image signal at least one R pixel signal, at least one G pixel signal, and at least one B pixel signal;
individually processing the R, G, and B pixel signals with the R, G, and B compensation parameter subsets, respectively; and
employing as the compensation parameters in the R, G, and B compensation parameter subsets compensation parameters that have been selected to compensate for spectral variations resulting from off-axis transmission of electromagnetic energy a greater distance through the absorption/emission layer than the thickness (T).
9. The camera apparatus of claim 8 wherein the operations further comprise:
employing as the first compensation parameters a set of compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the camera; and
employing as the second compensation parameters a set of compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the camera and attributable to at least a portion of the flash.
10. The camera apparatus of claim 9 wherein the operations further comprise employing as the second compensation parameters a set of compensation parameters that are used by the at least portion of the routine in place of the first compensation parameters and that are configured to compensate an image signal for the combined signal variation attributable to at least a portion of the camera and at least a portion of the flash.
11. The camera apparatus of claim 10 wherein the operations further comprise overwriting in a number of predetermined storage registers on the processor system the first compensation parameters with the second compensation parameters preparatory for said processing a flash image signal.
12. The camera apparatus of claim 10 wherein the operations further comprise, responsive to said processing a flash image signal, overwriting in the predetermined storage registers the second compensation parameters with the first compensation parameters.
13. The camera apparatus of claim 9 wherein the operations further comprise employing as the second compensation parameters both the first compensation parameters and a number of additional compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the flash.
14. The camera apparatus of claim 13 wherein the operations further comprise:
employing the first compensation parameters in one portion of said processing a flash image signal; and
employing the additional compensation parameters in another portion of said processing a flash image signal.
15. A handheld electronic device comprising:
processor apparatus:
an input apparatus comprising a camera apparatus and being structured to provide input to the processor apparatus;
an output apparatus structured to receive output signals from the processor apparatus and to provide output;
the camera apparatus comprising a camera and a flash;
the camera comprising a sensor, a camera lens, and a processor system having a routine executable thereon;
the flash comprising a light source and a flash lens;
the routine being structured to employ a number of compensation parameters in performing a predetermined processing operation on an image signal from the sensor, the routine being further structured to be executable on the processor system to cause the camera apparatus to perform operations comprising:
processing a non-flash image signal with at least a portion of the routine;
employing a number of first compensation parameters as the compensation parameters in said processing a non-flash image signal;
processing a flash image signal with at least a portion of the routine;
employing a number of second compensation parameters as the compensation parameters in said processing a flash image signal, the first compensation parameters and the second compensation parameters being at least partially different,
wherein the sensor comprises a plurality of R pixels, a plurality of G pixels, and a plurality of B pixels distributed about the sensor;
wherein the light source comprises a source of electromagnetic energy and an absorption/emission layer, the absorption/emission layer overlying the source of electromagnetic energy and having a thickness (T) in an on-axis direction away from the source of electromagnetic energy;
wherein the second compensation parameters comprise an R compensation parameter subset, a G compensation parameter subset, and a B compensation parameter subset; and
wherein the operations further comprise:
receiving as a portion of a flash image signal at least one R pixel signal, at least one G pixel signal, and at least one B pixel signal;
individually processing the R, G, and B pixel signals with the R, G, and B compensation parameter subsets, respectively; and
employing as the compensation parameters in the R, G, and B compensation parameter subsets compensation parameters that have been selected to compensate for spectral variations resulting from off-axis transmission of electromagnetic energy a greater distance through the absorption/emission layer than the thickness (T).
16. The handheld electronic device of claim 15 wherein the operations further comprise:
employing as the first compensation parameters a set of compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the camera; and
employing as the second compensation parameters a set of compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the camera and attributable to at least a portion of the flash.
17. The handheld electronic device of claim 16 wherein the operations further comprise employing as the second compensation parameters a set of compensation parameters that are used by the at least portion of the routine in place of the first compensation parameters and that are configured to compensate an image signal for the combined signal variation attributable to at least a portion of the camera and at least a portion of the flash.
18. The handheld electronic device of claim 16 wherein the operations further comprise employing as the second compensation parameters both the first compensation parameters and a number of additional compensation parameters configured to compensate an image signal for signal variations attributable to at least a portion of the flash.