Systems and methods for mobile image capture and content processing of driver's licenses
Systems and methods are provided for processing and extracting content from an image captured using a mobile device. In one embodiment, an image is captured by a mobile device and corrected to improve the quality of the image. The corrected image is then further processed by adjusting the image, identifying the format and layout of the document, binarizing the image and extracting the content using optical character recognition (OCR). Multiple methods of image adjusting may be implemented to accurately assess features of the document, and a secondary layout identification process may be performed to ensure that the content being extracted is properly classified.
1. A computer-implemented method of processing an image of a driver's license in order to verify identity in relation to a transaction, comprising:
presenting through a user interface of a mobile device a menu related to the transaction;
receiving via the user interface, a selection of an option related to the transaction;
receiving an image of one or more documents or objects captured by a camera included in the mobile device;
extract information from the images for use in the transaction;
receiving an image of a driver's license captured by a mobile device;
cropping the image of the driver's license to produce a cropped image of the driver's license, wherein cropping the image of the driver's license includes using a rounded corner detection test;
determining whether the document is a driver's license based on whether one or more rounded corners are identified when cropping the image of the driver's license using the rounded corner detection test, wherein the rounded corner detection test comprises approximating connected points of edge pixels of the cropped image with a spline and estimating a curvature of the spline;
when the document is determined to be a driver's license,
identifying a layout of the driver's license,
binarizing the cropped image to produce a binarized image,
outputting the binarized image of the driver's license,
performing an optical character recognition on the binarized image to extract text from the driver's license, and
verifying the identity of the user in relation to the transaction, based on text extracted from the binarized image.
2. The method of claim 1 , further comprising cropping the image of the driver's license through a rectangular shape detection test.
3. The method of claim 1 , further comprising identifying the document in the image of the driver's license by performing the rounded corner detection test to identify at least one rounded corner of the driver's license.
4. The method of claim 1 , wherein cropping the image of the driver's license around the driver's license further comprises determining coordinates of four corners of the driver's license based on results of: a rectangular shape detection test; a feature matching test;
and the rounded corner detection test.
5. The method of claim 1 , if the image is determined to be of a driver's license, the method further comprises determining an aspect ratio of the driver's license and comparing the aspect ratio of the driver's license to at least one stored aspect ratio of a driver's license.
6. The method of claim 1 , wherein binarizing the cropped image includes identifying a photo area from an array of vertical contours and an array of horizontal contours and removing the photo area on the driver's license prior to binarizing the cropped image.