Method and apparatus for compensating for camera error in a multi-camera stereo camera system
A system and method multi-camera error compensation including recording a plurality of raw images via a plurality of digital cameras and an application processor processing with a multi-view stereo imaging system one or more plural image frames from the raw images captured by the plurality of digital cameras. The plural images may be stored in memory and the detection conducted for calibration loss of at least one digital camera via the processor executing instructions for a multi-camera error compensating system to determine loss of calibration in plural images. The multi-camera error compensating system conducts dynamic recalibration of plural image calibration parameters based on at least one plural image frame and in response to detection of calibration loss via the multi-camera error compensating system and a processor reprocesses the plural image frame from a reprocessing queue according to the recalibrated plural image parameters.
1. A method multi-camera error compensation comprising:
recording a plurality of raw images via a plurality of digital cameras;
consolidating the plurality of raw images into a plural image frame, wherein the plural image frame is a composite image based on blending at least a portion of the plurality of raw images into the composite image;
processing, via a processor executing instructions for a multi-view stereo imaging system, the plural image frame from the raw images captured by the plurality of digital cameras;
storing the plural image frame in a memory;
detecting calibration loss of at least one digital camera via the processor executing instructions for a multi-camera error compensating system via assessment of the plural image frame;
conducting dynamic recalibration of plural image calibration parameters based on at least one plural image frame and in response to detection of calibration loss via the multi-camera error compensating system; and
updating, via the processor, a calibration database for the multi-view stereo imaging system to the recalibrated plural image parameters for processing future plural image frames.
2. The method of claim 1 further comprising:
dynamically detecting calibration loss of at least one digital camera via periodic assessment of plural image frames for deviation from expected behavior from a pre-existing calibration operation level.
3. The method of claim 1 wherein the plural image frame is flagged as decalibrated.
4. The method of claim 1 further comprising:
determining whether any user action has been performed to modify or consume the stored plural image and if so warning the user of the decalibrated plural image frame.
5. The method of claim 1 further comprising:
adding the stored plural image frame to the reprocessing queue if no user action has been performed to modify or consume the stored plural image.
6. The method of claim 1 further comprising:
detecting calibration loss of the at least one digital camera via the processor executing instructions for a multi-camera error compensating system via background processing to avoid interruption of a user unless loss of calibration is determined.
7. The method of claim 1 further comprising:
executing dynamic recalibration of plural image calibration parameters for future processing of plural images in background processing unless loss of calibration interferes with user activity accessing decalibrated plural images.
8. An information handling system comprising:
a plurality of digital cameras for recording raw images for consolidation into a plural image frame, wherein the plural image frame is a composite image based on blending at least a portion of a plurality of raw images consolidated to form the plural image frame;
the processor operatively coupled to the plurality of digital cameras for processing plural imaging functions via execution of instructions for a multi-view stereo imaging system;
a memory operatively coupled to the processor, the memory for storing the plural image frame;
the processor executing instructions for a multi-camera error compensating system to conduct dynamic detection of calibration loss of at least one digital camera via periodic assessment of plural image frames for deviation from expected behavior from a pre-existing calibration operation level;
the multi-camera error compensating system conducting dynamic recalibration of plural image calibration parameters for future processing of plural images based on at least one assessed plural image frame and in response to detection of calibration loss; and
the processor interrupting use of the plural image frame in processing the plural image when calibration loss is determined.
9. The information handling system of claim 8 wherein the processor operatively coupled to the plurality of digital cameras for processing plural imaging functions includes three-dimensional (3D) imaging by determination of depth values for parts of the plural image frame.
10. The information handling system of claim 8 wherein dynamically recalibration of the plural image calibration parameters includes recalibrating depth distance for objects recorded in the plural image frame.
11. The information handling system of claim 8 further comprising:
the multi-camera error compensating system reprocessing the plural image frame according to recalibrated plural image parameters.
12. The information handling system of claim 11 further comprising:
the multi-camera error compensating system detecting calibration loss of the at least one digital camera via background processing to avoid interruption of a user unless loss of calibration is determined.
13. The information handling system of claim 8 wherein the multi-camera error compensating system flags plural image frames identified as decalibrated and stores the decalibrated flag designations in memory.
14. The information handling system of claim 8 further comprising:
the multi-camera error compensating system executing dynamic recalibration of plural image calibration parameters for future processing of plural images in background processing unless loss of calibration interferes with user activity accessing decalibrated plural images.
15. A method for multi-camera error compensation comprising:
recording a plurality of raw images via a plurality of digital cameras;
consolidating the plurality of raw images into a plural image frame, wherein the plural image frame is a composite image based on at least a portion of the plurality of raw images;
processing, via a processor executing instructions for a multi-view stereo imaging system, the plural image frame from the raw images captured by the plurality of digital cameras;
storing the plural image frame in a memory;
dynamically detecting calibration loss of at least one digital camera via the processor executing instructions for a multi-camera error compensating system via periodic assessment of plural image frames for deviation from expected behavior from a pre-existing calibration operation level;
executing dynamic recalibration of plural image calibration parameters for future processing of plural images based on at least one assessed plural image frame and in response to detection of calibration loss; and
the processor interrupting use of the plural image frame in processing the plural image when calibration loss is determined.
16. The method of claim 15 wherein the processing plural image frame from the raw images captured by the plurality of digital cameras includes determination of a depth values for three-dimensional (3D) image processing of the plural image frame.
17. The method of claim 15 further comprising:
flagging one or more plural image frames as decalibrated and storing the decalibration flag designation in memory.
18. The method of claim 15 further comprising:
determining whether the decalibrated plural image frame that has been modified by user action after determination of loss of calibration and warning a user of the decalibration upon access to the decalibrated plural image frame.
19. The method of claim 15 further comprising:
detecting calibration loss of the at least one digital camera via the processor executing instructions for a multi-camera error compensating system via background processing to avoid interruption of a user unless loss of calibration is determined.
20. The method of claim 15 further comprising:
executing dynamic recalibration of plural image calibration parameters for future processing of plural images in background processing unless loss of calibration interferes with user activity accessing decalibrated plural images.