IP Library Granted Patent US 9,747,509
Granted Patent B2
US 9,747,509 · App. 14/633,992 · Granted Aug 29, 2017

Automatically capturing and cropping image of check from video sequence for banking or other computing application

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,747,509
App. No.
14/633,992
Granted
Aug 29, 2017
Kind
B2
Abstract

A mobile device with camera automatically captures an image of a check from a video sequence. A computing application assesses quality metrics of a frame of the video and, if acceptable, initiates capture of the check in that frame without user selection. Metrics include an aspect ratio of the check, image quality of the routing transit symbols that delineate a routing transit number on a MICR line of the check, distances between the routing transit symbols and to an edge of the check, recognition of digits of the routing transit number, checksum of the routing transit numbers, and image sharpness. Other embodiments note cropping of the check from the background of the image, properly orienting the check for viewing, and providing color coded visual feedback to users about the quality of the image frame about the check, to name a few.

Claims (34)

1. A mobile computing device, comprising:

a housing;

a controller in the housing hosting a computing application with executable instructions, the computing application for depositing or transferring funds of an amount of a check; and

a camera maneuvered by a user manipulating the housing, the camera when activated by the computing application delivers to the controller for processing a video sequence of a plurality of frames of images of the check, wherein the controller is configured to

find in a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a magnetic ink character recognition (MICR) line of the check,

determine a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check,

calculate a ratio of the first distance to the second distance;

determine values for each digit of the routing transit number; and

capture an image of the check without user selection from the single frame upon the ratio being within a predetermined acceptable range,

wherein the first distance is parallel to the second distance.

2. The mobile computing device of claim 1 , wherein the controller is further configured to crop the check from the single frame, including eliminating background pixels.

3. The mobile computing device of claim 1 , wherein the controller is further configured to assess stability of the video sequence.

4. The mobile computing device of claim 1 , wherein the controller is further configured to determine an orientation of the check in the single frame.

5. The mobile computing device of claim 4 , wherein the controller is further configured to find said both routing transit symbols relative to only a bottom or top portion of the check depending on said orientation.

6. The mobile computing device of claim 4 , further including a display wherein the controller is further configured to rotate the check for viewing on the display from left-to-right if the orientation of the check is upside-down.

7. The mobile computing device of claim 1 , wherein the controller is further configured to calculate a checksum of the routing transit number.

8. The mobile computing device of claim 1 , wherein the controller is further configured to calculate a sharpness of the image of the check in the single frame.

9. The mobile computing device of claim 1 , wherein the controller is further configured to calculate a possible bounding border of the check in the single frame.

10. The mobile computing device of claim 9 , further including a display, wherein the controller is further configured to display to a user the possible bounding border with color-coding according to a calculated quality of the possible bounding border.

11. The mobile computing device of claim 1 , wherein the controller is further configured to compare said each digit of the routing transit number to templates of digits ranging from values 0 to 9 and selecting a best matching image template therefore.

12. The mobile computing device of claim 1 , wherein the controller is further configured to calculate an image width to an image height of the check in the single frame to determine an aspect ratio of the check, wherein an acceptable range of aspect ratios ranges from about 1.7 to about 3.1.

13. The mobile computing device of claim 1 , wherein the controller is further configured to determine said first and second distances from an (x, y) position coordinate of a bounding box about said both routing transit symbols.

14. A method, comprising:

receiving at a controller of a mobile computing device from a camera of the mobile computing device a video sequence having a plurality of frames of an image of a check;

finding in bit values corresponding to pixels of a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a magnetic ink character recognition (MICR) line of the check;

determining a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check;

calculating a ratio of the first distance to the second distance;

comparing each digit of the routing transit number to templates of digits ranging from 0 to 9 to determine a value for said each digit by selecting a best matching image template therefore; and

upon the ratio being within a predetermined acceptable range and the values for said each digit being determinable, capturing the image of the check from the single frame without user selection,

wherein the first distance is parallel to the second distance.

15. The method of claim 14 , further including determining an aspect ratio of the check.

16. The method of claim 14 , further including calculating a checksum corresponding to the values of the routing transit number.

17. The method of claim 14 , further including rotating the check for properly-oriented viewing on a display of the mobile computing device if an orientation of the check is upside-down.

18. The method of claim 14 , further including assessing stability of the video sequence.

Assignments (8)
SECURITY INTEREST Recorded Jan 5, 2026
From: LEXMARK INTERNATIONAL, INC.
To: BANK TRUST COMPANY, NATIONAL ASSOCIATION
Reel/Frame 074202/0192 →
SECURITY INTEREST Recorded Jan 5, 2026
From: LEXMARK INTERNATIONAL, INC.
To: BANK TRUST COMPANY, NATIONAL ASSOCIATION
Reel/Frame 074202/0293 →
SECURITY INTEREST Recorded Sep 23, 2025
From: LEXMARK INTERNATIONAL, INC.
To: CITIBANK, N.A.
Reel/Frame 073007/0118 →
SECURITY INTEREST Recorded Sep 23, 2025
From: LEXMARK INTERNATIONAL, INC.
To: JEFFERIES FINANCE LLC
Reel/Frame 073007/0346 →
RELEASE OF SECURITY INTEREST Recorded Jan 18, 2024
From: CHINA CITIC BANK CORPORATION LIMITED, GUANGZHOU BRANCH, AS COLLATERAL AGENT
To: LEXMARK INTERNATIONAL, INC.
Reel/Frame 066345/0026 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT U.S. PATENT NUMBER PREVIOUSLY RECORDED AT REEL: 046989 FRAME: 0396. ASSIGNOR(S) HEREBY CONFIRMS THE PATENT SECURITY AGREEMENT. Recorded Oct 24, 2018
From: LEXMARK INTERNATIONAL, INC.
To: CHINA CITIC BANK CORPORATION LIMITED, GUANGZHOU BRANCH, AS COLLATERAL AGENT
Reel/Frame 047760/0795 →
PATENT SECURITY AGREEMENT Recorded Aug 30, 2018
From: LEXMARK INTERNATIONAL, INC.
To: CHINA CITIC BANK CORPORATION LIMITED, GUANGZHOU BRANCH, AS COLLATERAL AGENT
Reel/Frame 046989/0396 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2015
From: EID, AHMED HAMAD MOHAMED; CHOLEWO, TOMASZ JAN; DANIEL, STUART WILLARD; SIMPSON, STACY LEE
To: LEXMARK INTERNATIONAL, INC.
Reel/Frame 035054/0590 →