Granted Patent B1

US 12,632,899 · App. 19/321,167 · Granted May 19, 2026

Inventors: Michael Patrick Bueche, Jr. (San Antonio, TX); Bharat Prasad (San Antonio, TX); Minya Liang (San Antonio, TX); Reynaldo Medina (San Antonio, TX); Charles Lee Oakes, III (Boerne, TX)

Assignee: United Services Automobile Association (USAA)

G06Q40/02G06T7/13G06V10/60G06T2207/20164

Abstract

Claims (87)

1 . A system enabling mobile check deposit auto-capture functionality via video frame processing, the system comprising:

a mobile device of a user, the user's mobile device including a camera, a processor, and a memory coupled to the processor, the memory storing:

a software abstraction layer for controlling the camera, the software abstraction layer comprising instructions that, when executed by the processor, control the camera; and

a downloaded app, the downloaded app associated with a bank to control check deposit by controlling the camera through the software abstraction layer, the downloaded app comprising instructions that, when executed by the processor, cause the user's mobile device to perform operations including:

providing instructions to the user for capturing an image of a check;

generating a live video of the check in a field of view of the camera, the downloaded app causing the live video to be generated by controlling the camera through the software abstraction layer;

overlaying an alignment guide on the live video of the check in the field of view of the camera;

monitoring the live video of the check in the field of view of the camera with respect to at least one monitoring criterion;

determining that a video frame of the live video of the check satisfies the at least one monitoring criterion and then automatically capturing the video frame, the determining including dividing the video frame into segments comprising check data and background data and analyzing the segments to determine that the video frame satisfies the at least one monitoring criterion;

when the video frame of the live video of the check in the field of view of the camera is determined to satisfy the at least one monitoring criterion, providing feedback advising the user that the check has been captured;

using a wireless network, transmitting a digital image of the check from the user's mobile device and submitting the check for mobile check deposit in the bank after automatically capturing the video frame, wherein the digital image is the captured video frame or is based on the captured video frame; and

confirming that the mobile check deposit can go forward after optical character recognition is performed on the check in the digital image, a magnetic ink character recognition (MICR) line on the check in the digital image is recognized, and an amount payable on the check in the digital image is validated;

a server, remote from the user's mobile device, comprising a processor coupled to a memory storing instructions that, when executed by the processor, cause the server to perform operations including:

receiving the digital image of the check transmitted by the user's mobile device, and

processing the digital image of the check including performing optical character recognition on the check in the digital image and verifying that the digital image of the check is acceptable for mobile check deposit, the user's mobile device receiving an indication of a result of the server's processing after the transmitting the digital image of the check from the user's mobile device; and

a computer comprising a processor coupled to a memory storing instructions that, when executed by the processor, cause the computer to update a balance of an account at a financial institution of the user to reflect an amount of funds associated with the check submitted for mobile check deposit by the user's mobile device, after the submitting the check for mobile check deposit in the bank, the confirming that the mobile check deposit can go forward, and the verifying that the digital image of the check is acceptable for mobile check deposit.

2 . The system of claim 1 , wherein the downloaded app causes the user's mobile device to perform additional operations including:

before determining that the video frame of the live video of the check satisfies the at least one monitoring criterion, determining that a different video frame of the live video of the check does not satisfy the at least one monitoring criterion; and

after determining that the different video frame of the live video of the check does not satisfy the at least one monitoring criterion, providing feedback to the user.

3 . The system of claim 1 , wherein the at least one monitoring criterion is a plurality of monitoring criteria based on two or more selected from a group consisting of light contrast, light brightness, check positioning, check dimensions, character spacing, skewing, warping, corner detection, edge detection, and magnetic ink character recognition (MICR) line detection.

4 . The system of claim 3 , wherein the plurality of monitoring criteria includes a criterion based on magnetic ink character recognition (MICR) line detection.

5 . The system of claim 3 , wherein the plurality of monitoring criteria includes criteria based on light brightness, skewing, and warping.

6 . The system of claim 1 , wherein the confirming that the mobile check deposit can go forward is performed after the transmitting the digital image of the check from the user's mobile device.

7 . The system of claim 1 , wherein the digital image is a modified version of the captured video frame.

8 . The system of claim 1 , wherein the wireless network is a cellular network.

9 . A system enabling mobile check deposit auto-capture functionality via video frame processing, the system comprising:

a mobile device of a user, the user's mobile device including a camera, a processor, and a memory coupled to the processor, the memory storing a downloaded app, the downloaded app associated with a bank to control check deposit by controlling the camera, the system being configured to perform operations including:

providing instructions to the user for capturing an image of a check;

generating a live video of the check in a field of view of the camera, the downloaded app causing the live video to be generated by controlling the camera;

monitoring the live video of the check in the field of view of the camera with respect to at least one monitoring criterion;

determining that a video frame of the live video of the check satisfies the at least one monitoring criterion and then automatically capturing the video frame;

when the video frame of the live video of the check in the field of view of the camera is determined to satisfy the at least one monitoring criterion, providing feedback advising the user that the check has been captured;

using a wireless network, transmitting a digital image of the check from the user's mobile device and submitting the check for mobile check deposit in the bank after automatically capturing the video frame, the digital image of the check being the captured video frame or being based on the captured video frame; and

processing the digital image of the check including performing optical character recognition and verifying that the digital image of the check is acceptable for mobile check deposit; and

a bank computer programmed to update a balance of an account at a financial institution of the user to reflect an amount of funds associated with the check submitted for mobile check deposit by the user's mobile device, after the check is submitted for mobile check deposit in the bank and verifying that the digital image of the check is acceptable for mobile check deposit.

10 . The system of claim 9 , wherein the system is configured to perform additional operations including:

before determining that the video frame of the live video of the check satisfies the at least one monitoring criterion, determining that a different video frame of the live video of the check does not satisfy the at least one monitoring criterion; and

after determining that the different video frame of the live video of the check does not satisfy the at least one monitoring criterion, providing feedback to the user.

11 . The system of claim 9 , further comprising one or more computers programmed to perform operations comprising the monitoring, the determining, or both the monitoring and the determining.

12 . The system of claim 9 , wherein the at least one monitoring criterion is a plurality of monitoring criteria based on two or more selected from a group consisting of light contrast, light brightness, check positioning, check dimensions, character spacing, skewing, warping, corner detection, edge detection, and magnetic ink character recognition (MICR) line detection.

13 . The system of claim 12 , wherein the plurality of monitoring criteria includes criteria based on light brightness, skewing, and warping.

14 . The system of claim 9 , wherein the system is configured to perform additional operations including:

confirming that the mobile check deposit can go forward after optical character recognition is performed on the check in the digital image, a magnetic ink character recognition (MICR) line on the check in the digital image is recognized, and an amount payable on the check in the digital image is validated,

wherein the confirming that the mobile check deposit can go forward is performed after the transmitting the digital image of the check from the user's mobile device.

15 . The system of claim 14 , wherein the user's mobile device receives an indication of a result of the processing the digital image of the check before the confirming step.

16 . The system of claim 11 , wherein the one or more computers include the bank computer.

17 . The system of claim 9 , wherein the determining includes dividing the video frame into segments comprising check data and background data and analyzing the segments to determine that the video frame satisfies the at least one monitoring criterion.

18 . A system enabling mobile check deposit auto-capture functionality via video frame processing, the system comprising:

a mobile device of a user, the user's mobile device including a camera, a processor, and a memory coupled to the processor, the memory storing:

a software abstraction layer, the software abstraction layer comprising instructions that, when executed by the processor, control the camera; and

a downloaded app, the downloaded app associated with a bank to control check deposit by controlling the camera through the software abstraction layer, the downloaded app comprising instructions that, when executed by the processor, cause the user's mobile device to perform operations including:

providing instructions to the user for capturing an image of a check;

generating a live video of the check in a field of view of the camera, the downloaded app causing the live video to be generated by controlling the camera through the software abstraction layer;

monitoring the live video of the check in the field of view of the camera with respect to at least one monitoring criterion;

determining that a video frame of the live video of the check satisfies the at least one monitoring criterion and then automatically capturing the video frame;

when the video frame of the live video of the check in the field of view of the camera is determined to satisfy the at least one monitoring criterion, providing feedback advising the user that the check has been captured; and

using a wireless network, transmitting a digital image of the check from the user's mobile device and submitting the check for mobile check deposit in the bank after automatically capturing the video frame, wherein the digital image is the captured video frame or is based on the captured video frame; and

a computer comprising a processor coupled to a memory storing instructions that, when executed by the processor, cause the computer to update a balance of an account at a financial institution of the user to reflect an amount of funds associated with the check submitted for mobile check deposit by the user's mobile device, after the submitting the check for mobile check deposit.

19 . The system of claim 18 , wherein the downloaded app causes the user's mobile device to perform additional operations including:

before determining that the video frame of the live video of the check satisfies the at least one monitoring criterion, determining that a different video frame of the live video of the check does not satisfy the at least one monitoring criterion; and

after determining that the different video frame of the live video of the check does not satisfy the at least one monitoring criterion, providing feedback to the user.

20 . The system of claim 18 , wherein the at least one monitoring criterion is a plurality of monitoring criteria based on two or more selected from a group consisting of light contrast, light brightness, check positioning, check dimensions, character spacing, skewing, warping, corner detection, edge detection, and magnetic ink character recognition (MICR) line detection.

21 . The system of claim 20 , wherein the plurality of monitoring criteria being based on magnetic ink character recognition (MICR) line detection and one or both of corner detection and edge detection.

22 . The system of claim 20 , wherein the plurality of monitoring criteria includes criteria based on light brightness, skewing, and warping.

23 . The system of claim 18 , wherein the downloaded app causes the user's mobile device to perform additional operations including:

confirming that the mobile check deposit can go forward after optical character recognition is performed on the check, a magnetic ink character recognition (MICR) line on the check is recognized, and an amount payable on the check is validated,

wherein the confirming that the mobile check deposit can go forward is performed after the transmitting the digital image of the check from the user's mobile device.

24 . The system of claim 18 , wherein the digital image is a modified version of the captured video frame.

25 . The system of claim 18 , wherein the determining includes dividing the video frame into segments comprising check data and background data and analyzing the segments to determine that the video frame satisfies the at least one monitoring criterion.

26 . A system enabling mobile check deposit auto-capture functionality via video frame processing, the system comprising:

a mobile device of a user, the user's mobile device including a camera, a processor, and a memory coupled to the processor, the memory storing:

a software abstraction layer, the software abstraction layer comprising instructions that, when executed by the processor, control the camera; and

a downloaded app, the downloaded app associated with a bank to control check deposit by controlling the camera through the software abstraction layer, the downloaded app comprising instructions that, when executed by the processor, cause the user's mobile device to perform operations including:

providing instructions to the user for capturing a check;

generating a live video of the check in a field of view of the camera, the downloaded app causing the live video to be generated by controlling the camera through the software abstraction layer;

monitoring the live video of the check in the field of view of the camera with respect to at least one monitoring criterion;

determining that a video frame of the live video of the check satisfies the at least one monitoring criterion and then automatically capturing the video frame;

when the video frame of the live video of the check in the field of view of the camera is determined to satisfy the at least one monitoring criterion, providing feedback advising the user that the check has been captured; and

using a wireless network, transmitting a digital image of the check from the user's mobile device and submitting the check for mobile check deposit in the bank after automatically capturing the video frame, wherein the digital image is the captured video frame or is based on the captured video frame;

the system configured to perform image processing operations on an image of the check, the image processing operations including performing optical character recognition and verifying that the image of the check is acceptable for mobile check deposit, wherein the image of the check is the digital image transmitted by the user's mobile device or is based on the digital image transmitted by the user's mobile device; and

a computer programmed to update a balance of an account at a financial institution of the user to reflect an amount of funds associated with the check submitted for mobile check deposit by the user's mobile device, after the submitting the check for mobile check deposit in the bank and the verifying that the image of the check is acceptable for mobile check deposit.

27 . The system of claim 26 , wherein the downloaded app causes the user's mobile device to perform additional operations including:

before determining that the video frame of the live video of the check satisfies the at least one monitoring criterion, determining that a different video frame of the live video of the check does not satisfy the at least one monitoring criterion; and

after determining that the different video frame of the live video of the check does not satisfy the at least one monitoring criterion, providing feedback to the user.

28 . The system of claim 26 , wherein the at least one monitoring criterion is a plurality of monitoring criteria based on two or more selected from a group consisting of light contrast, light brightness, check positioning, check dimensions, character spacing, skewing, warping, corner detection, edge detection, and magnetic ink character recognition (MICR) line detection.

29 . The system of claim 28 , wherein the plurality of monitoring criteria includes a criterion based on magnetic ink character recognition (MICR) line detection.

30 . The system of claim 26 , wherein the determining includes dividing the video frame into segments comprising check data and background data and analyzing the segments to determine that the video frame satisfies the at least one monitoring criterion.

Assignments (1)

Continuity (9)

References Cited (400)