Systems and methods for developing and verifying image processing standards for mobile deposit
Systems and methods are provided for assessing whether mobile deposit processing engines meet specified standards for mobile deposit of financial documents. A mobile deposit processing engine (MDE) is evaluated to determine if it can perform technical capabilities for improving the quality of and extracting content from an image of a financial document. A verification process then begins, where the MDE performs the image quality enhancements and text extraction steps on sets of images from a test deck. The results of the processing of the test deck are then evaluated by comparing confidence levels with thresholds to determine if each set of images should be accepted or rejected. Further analysis determines whether any of the sets of images were falsely accepted or rejected in error. An overall error rate is then compared with minimum accuracy criteria, and if the criteria are met, the MDE meets the standard for mobile deposit.
1. A method for verifying image processing standards for mobile deposit of a financial document, the method comprising benchmarking a plurality of mobile deposit processing engines, which are each different from each other, by, for each of the plurality of mobile deposit processing engines:
by the mobile deposit processing engine, for each of a plurality of test images in a test deck representing financial documents captured by a mobile device,
performing an image processing transaction on the test image to improve at least one aspect of image quality of the test image and attempt to identify at least one feature in the test image, and
produce a result comprising either an acceptance or rejection of the test image based on the image processing transaction; and, by a verification server,
comparing the results produced by the mobile deposit processing engine to known results for the test deck to calculate one or more error rates for the mobile deposit processing engine,
comparing the one or more error rates with one or more accuracy criteria, and
either verifying or rejecting the mobile deposit processing engine based on the comparison of the one or more error rates with the one or more accuracy criteria.
2. The method of claim 1 , wherein the plurality of test images comprise pairs of test images, and wherein each pair of test images comprises a first image of a front side of a check and a second image of a back side of the check.
3. The method of claim 1 , wherein a first subset of the plurality of test images are images which should be accepted according to a predetermined standard, and a second subset of the plurality of test images are images which should be rejected according to the predetermined standard.
4. The method of claim 1 , wherein improving at least one aspect of the image quality of the test image comprises one or more of correcting a geometric distortion, cropping, or binarizing the test image.
5. The method of claim 1 , wherein the at least one feature comprises at least one of a MICR line, a payment amount, or an endorsement signature.
6. The method of claim 5 , wherein the image processing transaction is accepted if the MICR line and the payment amount were correctly identified.
7. The method of claim 6 , wherein the image processing transaction is accepted if the image quality meets a defined image quality threshold.
8. The method of claim 1 , wherein the one or more accuracy criteria comprise a maximum threshold of one or more of false image quality acceptances, false image quality rejections, false MICR line acceptances, false payment amount acceptances, false payment amount rejections, false image quality rejections, or incorrect image quality rejections.
9. The method of claim 8 , wherein the mobile deposit processing engine is verified only if all of the one or more accuracy criteria are met by the one or more error rates.
10. A system for verifying image processing standards for mobile deposit of a financial document, comprising:
at least one hardware processor; and
a verification service configured to, when executed by the at least one hardware processor, benchmark a plurality of mobile deposit processing engines, which are each different from each other, by, for each of the plurality of mobile deposit processing engines,
executing the mobile deposit processing engine to, for each of a plurality of test images in a test deck representing financial documents captured by a mobile device,
perform an image processing transaction on the test image to improve at least one aspect of image quality of the test image and attempt to identify at least one feature in the test image, and
produce a result comprising either an acceptance or rejection of the test image based on the image processing transaction,
comparing the results produced by the mobile deposit processing engine to known results for the test deck to calculate one or more error rates for the mobile deposit processing engine,
comparing the one or more error rates with one or more accuracy criteria, and
either verifying or rejecting the mobile deposit processing engine based on the comparison of the one or more error rates with the one or more accuracy criteria.
11. The system of claim 10 , wherein the plurality of test images comprise pairs of test image, and wherein each pair of test images comprises a first image of a front side of a check and a second image of a back side of the check.
12. The system of claim 10 , wherein a first subset of the plurality of test images are images which should be accepted according to a predetermined standard, and a second subset of the plurality of test images are images which should be rejected according to the predetermined standard.
13. The system of claim 10 , wherein improving the at least one aspect of the image quality of the test image comprises one or more of correcting a geometric distortion, cropping, or binarizing the test image.
14. The system of claim 10 , wherein the at least one feature comprises at least one of a MICR line, a payment amount, or an endorsement signature.
15. The system of claim 14 , wherein the image processing transaction is accepted if the MICR line and the payment amount were correctly identified.
16. The system of claim 15 , wherein the image processing transaction is accepted if the image quality meets a defined image quality threshold.
17. The system of claim 10 , wherein the one or more accuracy criteria comprise a maximum threshold of one or more of false image quality acceptances, false image quality rejections, false MICR line acceptances, false payment amount acceptances, false payment amount rejections, false image quality rejections, or incorrect image quality rejections.
18. The system of claim 17 , wherein the mobile deposit processing engine is verified only if all of the one or more accuracy criteria are met by the one or more error rates.