Mobile check deposit
Methods and systems for remote check deposit are disclosed. A check for deposit is processed without the need for a server to receive any image of the check initially. Instead, optical character recognition (OCR) data is received at the server from a mobile device. Verification processing for the check is then performed using the OCR data. If the verification process is successful, a confirmation notification is sent to the mobile device. Subsequently, after sending the confirmation notification, a check image is received, from which the OCR data was determined. The check is, in turn, processed for deposit using the received check image.
1 . A method for processing a check image of a check, the method comprising:
receiving a check image of a check, the check image captured by an image capture device of a mobile device, wherein the check image includes:
a first region having a first set of characters of a first font; and
a second region having a second set of characters of a second font, wherein the second region corresponds to a Magnetic Ink Character Recognition (MICR) line of the check;
causing the mobile device to perform a first optical character recognition (OCR) process on the first region; and
causing the mobile device to perform a second OCR process on the second region to generate extracted MICR digits corresponding to the second set of characters, wherein the second OCR process includes:
determining a respective integer value represented by each respective character of the second set of characters, the determining including:
generating a conforming outer perimeter of the respective character; and
comparing the conforming outer perimeter of the respective character with one or more templates of a set of template conforming outer perimeters for each integer zero through nine of the second font,
wherein the respective integer value corresponds to the template having a best fit based on the comparing,
wherein the extracted MICR digits include the respective integer values of the respective characters of the second set of characters.
2 . The method of claim 1 , wherein the second OCR process further includes:
causing the mobile device to perform the first OCR process on the second region to generate a set of one or more bounding boxes for the second region; and
generating conforming outer perimeter images based on the set of one or more bounding boxes, wherein the conforming outer perimeter images each include a conforming outer perimeter of a corresponding character,
wherein the method further comprises discarding characters identified by the first OCR process on the second region prior to determining the respective integer value.
3 . The method of claim 1 , further comprising:
isolating the second set of characters within the second region from a background, wherein the isolating includes:
calculating a vertical projection of a second region snippet, wherein calculating the vertical projection includes summing intensity values along columns within the second region snippet;
calculating a horizontal projection of the second region snippet, wherein calculating the horizontal projection includes summing intensity values across rows within the second region snippet; and
applying a vertical mask based on the vertical projection and applying a horizontal mask based on the horizontal projection.
4 . The method of claim 1 , further comprising:
generating the conforming outer perimeter of the respective character without generating a portion corresponding to closed typographical counters formed within digits zero, six, eight, and nine.
5 . The method of claim 2 ,
wherein the set of template conforming outer perimeters consists of conforming outer perimeters for each integer between zero and through nine of a single font; and
wherein the extracted MICR digits consist of the respective integers assigned to each respective conforming outer perimeter image of the conforming outer perimeter images.
6 . The method of claim 1 , further comprising:
preprocessing the check image before causing the mobile device to perform the first OCR process and the second OCR process to convert the check image into a black and white check image.
7 . The method of claim 6 , wherein the preprocessing the check image includes:
detecting corner points on the check image to generate a perspective fixed check image; and
cropping the check image to generate a cropped check image including the second region,
wherein the second OCR process is performed on the cropped check image.
8 . The method of claim 7 , further comprising:
preprocessing the cropped check image to convert the cropped check image into a black and white cropped check image before the second OCR process is performed on the cropped check image.
9 . The method of claim 8 ,
wherein the preprocessing the cropped check image includes image thresholding, and
wherein the preprocessing the cropped check image includes inverting color of the second set of characters on the black and white cropped check image.
10 . The method of claim 1 , further comprising:
determining a number of characters present in the second region;
determining a length of the second region in pixels;
using the number of characters present in the second region and the length of the second region in pixels to calculate a scaling factor; and
scaling the check image based on the scaling factor.
11 . The method of claim 1 , further comprising:
calculating a horizontal projection by summing pixel intensities along rows of the second region;
calculating a vertical projection by summing pixel intensities along columns of the second region;
computing a horizontal threshold value;
computing a vertical threshold value;
creating a horizontal mask based on comparing the horizontal projection to the horizontal threshold value;
creating a vertical mask based on comparing the vertical projection to the vertical threshold value; and
applying the horizontal and vertical masks to the second region.
12 . The method of claim 1 , wherein the second OCR process further includes:
extracting a routing number within the second set of characters, the extracting including:
detecting a conforming outer perimeter of a leading symbol preceding the routing number in the second set of characters;
detecting a conforming outer perimeter of a closing symbol following the routing number in the second set of characters; and
determining that the extracted MICR digits for the respective characters between the leading symbol and the closing symbol are the routing number,
wherein the leading symbol and the closing symbol are non-numerical symbols.
13 . The method of claim 12 , further comprising:
comparing the extracted routing number to a collection of known routing numbers to determine if the extracted routing number is a valid routing number.
14 . The method of claim 13 , further comprising:
based on the comparing, determining that the extracted routing number is not a valid routing number and presenting, on a user interface of the mobile device, a prompt for a user to recapture another image of the check.
15 . The method of claim 13 , further comprising:
based on the comparing, determining that the extracted routing number is not a valid routing number and presenting, on a user interface of the mobile device, a prompt for a user to edit the extracted routing number.
16 . The method of claim 2 , wherein causing the mobile device to perform the first OCR process on the second region to generate a set of one or more bounding boxes for the second region comprises:
generating a bounding box around the second set of characters; and
generating a bounding box around each respective character of the second set of characters.
17 . The method of claim 16 ,
wherein the second region includes marks from a signature on the check, and
wherein causing the mobile device to perform the first OCR process on the second region to generate a set of one or more bounding boxes for the second region includes eliminating the marks from the signature in the second region.
18 . The method of claim 1 , further comprising:
providing the extracted MICR digits to a server for processing; and
providing the check image to the server for processing,
wherein either or both of: (1) the check image is provided to the server for the first time only after sending the extracted MICR digits to the server for processing and (2) the check image is captured in response to receiving a user actuation causing the image capture device to capture the check image.
19 . The method of claim 1 ,
wherein the first OCR process extracts check data from the first region, the check data comprising at least one of a payor name, a payee name, a date, a check amount, or a memo note, and
wherein the second OCR process further includes extracting a routing number, an account number, and a check number from the second set of characters.
20 . The method of claim 1 , further comprising:
performing fraud detection.