IP Library › Granted Patent US 12,260,381
Granted Patent B1
US 12,260,381 · App. 18/503,778 · Granted Mar 25, 2025

Active OCR

Inventors: Keegan Franklin (Tucson, AZ); James Brighter (Reston, VA); Megan OBrien (New Orleans, LA); John Maillett (Arlington, VA); Jane Justiz (McLean, VA)
Assignee: Capital One Services, LLC
G06Q20/108G06V30/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,381
App. No.
18/503,778
Filed
Nov 7, 2023
Granted
Mar 25, 2025
Kind
B1
Art Unit
3691
USPC
705/42
Abstract

A computer implemented method, system and non-transitory computer-readable device for a remote deposit environment activating, on a client device, a financial application, wherein the financial application is configured to instantiate a customer interface (UI) on the client device. Upon receiving a customer request, based on interactions with the UI, the method implements an electronic deposit of a financial instrument by activating a camera on the client device to generate a live stream of image data of a field of view of at least one camera, wherein the live stream includes imagery of at least a portion of the financial instrument. The method continues by extracting, based on the live stream of image data and by an optical character recognition program resident on the client device, one or more data fields from the financial instrument and communicating the extracted one or more data fields to a remote deposit server to complete the electronic deposit.

Claims (34)

1. A computer implemented method for a remote deposit environment, comprising:

receiving a customer request, based on interactions with an application that is configured to instantiate a user interface (UI) on a client device, to electronically deposit a financial instrument;

based on the customer request, activating a camera on the client device to generate a live stream of image data of a field of view of the camera, wherein the live stream includes imagery of at least a portion of the financial instrument;

converting, by the client device, the live stream to a plurality of byte arrays, wherein a first byte array of the plurality of byte arrays includes at least a first data field of the financial instrument and a second byte array of the plurality of byte arrays includes at least a second data field of the financial instrument;

extracting, by the client device, from the plurality of byte arrays and by an optical character recognition (OCR) program resident on the client device, the first data field from the first byte array and the second data field from the second byte array; and

communicating, by the client device, the extracted first and second data fields to a remote deposit server.

2. The computer implemented method of claim 1 , wherein the live stream comprises a raw image live stream.

3. The computer implemented method of claim 1 , wherein the plurality of byte arrays each comprises a byte array output stream object.

4. The computer implemented method of claim 1 , wherein the remote deposit server is configured to process at least the first and second data fields to complete the remote deposit.

5. The computer implemented method of claim 1 , wherein the optical character recognition program is configured with a trained machine learning OCR model.

6. The computer implemented method of claim 1 , wherein the client device is a mobile client device.

7. A system, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

receive a customer request, based on interactions with an application that is configured to instantiate a user interface (UI) on a client device, to deposit a financial instrument;

based on the customer request, activate a camera on the client device to generate a live stream of image data of a field of view of the camera, wherein the live stream includes imagery of at least a portion of the financial instrument;

convert, by the client device, the live stream to a plurality of byte arrays, wherein a first byte array of the plurality of byte arrays includes at least a first data field of the financial instrument and a second byte array of the plurality of byte arrays includes at least a second data field of the financial instrument;

extract, by the client device, based on the plurality of byte arrays and by an optical character recognition (OCR) program resident on the client device, the first data field from the first byte array of the plurality of byte arrays and the second data field from the second byte array of the plurality of byte arrays; and

communicate, by the client device, the extracted first and second data fields to a remote deposit server.

8. The system of claim 7 , wherein the live stream comprises a raw image live stream.

9. The system of claim 7 , wherein the plurality of byte arrays each comprises a byte array output stream object.

10. The system of claim 7 , wherein the remote deposit server is configured to process at least the first and second data fields to complete the deposit.

11. The system of claim 7 , wherein the optical character recognition program is configured with a trained machine learning OCR model.

12. The system of claim 7 , wherein the client device is a mobile client device.

13. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:

receiving a customer request, based on interactions with an application that is configured to instantiate a user interface (UI) on a client device, to electronically deposit a financial instrument;

based on the customer request, activating a camera on the client device to generate a live stream of image data of a field of view of the camera, wherein the live stream includes imagery of at least a portion of the financial instrument;

converting, by the client device, the live stream to a plurality of byte arrays, wherein a first byte array of the plurality of byte arrays includes at least a first data field of the financial instrument and a second byte array of the plurality of byte arrays includes at least a second data field of the financial instrument;

extracting, by the client device, based on the plurality of byte arrays and by an optical character recognition (OCR) program resident on the client device, the first data field from the first byte array of the plurality of byte arrays and the second data field from the second byte array of the plurality of byte arrays; and

communicating, by the client device, the extracted first and second data fields to a remote deposit server.

14. The non-transitory computer-readable device of claim 13 , wherein the live stream comprises a raw image live stream.

15. The non-transitory computer-readable device of claim 13 , wherein the plurality of byte arrays each comprises a byte array output stream object.

16. The non-transitory computer-readable device of claim 13 , wherein the optical character recognition program is configured with a trained machine learning OCR model.

17. The non-transitory computer-readable device of claim 13 , wherein the remote deposit server is configured to process at least the first and second data fields to complete the deposit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: FRANKLIN, KEEGAN; BRIGHTER, JAMES; OBRIEN, MEGAN; MAILLETT, JOHN; JUSTIZ, JANE
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 065485/0887 →
Continuity (1)
Provisional Application 63584379 · Sep 21, 2023
References Cited (122)
US 7391934B2 · Goodall et al. · 2008 [cited by applicant]
US 7421107B2 · Lugg · 2008 [cited by applicant]
US 7587066B2 · Cordery et al. · 2009 [cited by applicant]
US 7698222B1 · Bueche · 2010 [cited by applicant]
US 7702588B2 · Gilder et al. · 2010 [cited by applicant]
US 7856402B1 · Kay · 2010 [cited by applicant]
US 7905396B2 · Tidwell et al. · 2011 [cited by applicant]
US 7949587B1 · Morris et al. · 2011 [cited by applicant]
US 8027928B1 · Hecht, Jr. et al. · 2011 [cited by applicant]
US 8050997B1 · Nosek et al. · 2011 [cited by applicant]
US 8060442B1 · Hecht et al. · 2011 [cited by applicant]
US 8296230B2 · Davis et al. · 2012 [cited by applicant]
US 8300917B2 · Borgia et al. · 2012 [cited by applicant]
US 8406500B2 · Najari et al. · 2013 [cited by applicant]
US 8464933B1 · Prasad et al. · 2013 [cited by applicant]
US 8582862B2 · Nepomniachtchi et al. · 2013 [cited by applicant]
US 8605982B2 · Jackson et al. · 2013 [cited by applicant]
US 8638363B2 · King et al. · 2014 [cited by applicant]
US 8688579B1 · Ethington · 2014 [cited by examiner]
US 8708227B1 · Oakes, III et al. · 2014 [cited by applicant]
US 8745073B2 · Mulligan et al. · 2014 [cited by applicant]
US 8811711B2 · Calman · 2014 [cited by examiner]
US 8958605B2 · Amtrup et al. · 2015 [cited by applicant]
US 8959033B1 · Oakes, III et al. · 2015 [cited by applicant]
US 8977571B1 · Bueche, Jr. · 2015 [cited by examiner]
US 8995012B2 · Heit et al. · 2015 [cited by applicant]
US 9064248B2 · Huff et al. · 2015 [cited by applicant]
US 9324073B2 · Nepomniachtchi et al. · 2016 [cited by applicant]
US 9384392B2 · Weber et al. · 2016 [cited by applicant]
US 9569756B1 · Bueche, Jr. et al. · 2017 [cited by applicant]
US 9640041B2 · Block et al. · 2017 [cited by applicant]
US 9652690B2 · Eid et al. · 2017 [cited by applicant]
US 9672510B2 · Roach et al. · 2017 [cited by applicant]
US 9721177B2 · Lee et al. · 2017 [cited by applicant]
US 9747509B2 · Eid et al. · 2017 [cited by applicant]
US 9779392B1 · Prasad et al. · 2017 [cited by applicant]
US 9852406B2 · Doyle et al. · 2017 [cited by applicant]
US 10026119B2 · Green et al. · 2018 [cited by applicant]
US 10192108B2 · Nepomniachtchi et al. · 2019 [cited by applicant]
US 10210522B1 · Medina et al. · 2019 [cited by applicant]
US 10217375B2 · Waldron et al. · 2019 [cited by applicant]
US 10402790B1 · Clark et al. · 2019 [cited by applicant]
US 10460381B1 · Pollack et al. · 2019 [cited by applicant]
US 10504185B1 · Buentello · 2019 [cited by applicant]
US 10552810B1 · Ethington et al. · 2020 [cited by applicant]
US 10635898B1 · Pribble et al. · 2020 [cited by applicant]
US 10692230B2 · Anderson et al. · 2020 [cited by applicant]
US 10699146B2 · Shustorovich et al. · 2020 [cited by applicant]
US 10706466B1 · Ethington et al. · 2020 [cited by applicant]
US 10762579B2 · Riechers et al. · 2020 [cited by applicant]
US 10769598B1 · Oakes, III · 2020 [cited by examiner]
US 10789496B2 · Kotovich et al. · 2020 [cited by applicant]
US 10853771B2 · Enobakhare · 2020 [cited by applicant]
US 10855914B1 · Prasad et al. · 2020 [cited by applicant]
US 10909362B2 · Nepomniachtchi et al. · 2021 [cited by applicant]
US 11064111B1 · Prasad et al. · 2021 [cited by applicant]
US 11127008B1 · Buentello et al. · 2021 [cited by applicant]
US 11145169B2 · Pratten et al. · 2021 [cited by applicant]
US 11157731B2 · Nepomniachtchi et al. · 2021 [cited by applicant]
US 11159733B2 · Mukul · 2021 [cited by applicant]
US 11200550B1 · Singfield · 2021 [cited by applicant]
US 11216884B1 · Buentello · 2022 [cited by examiner]
US 11244319B2 · Navarro et al. · 2022 [cited by applicant]
US 11282086B1 · Medina, III et al. · 2022 [cited by applicant]
US 11295377B1 · Ethington et al. · 2022 [cited by applicant]
US 11295378B1 · Voutour et al. · 2022 [cited by applicant]
US 11315217B2 · Ilic et al. · 2022 [cited by applicant]
US 11321709B1 · Kolchin · 2022 [cited by applicant]
US 11373150B1 · Bueche, Jr. et al. · 2022 [cited by applicant]
US 11449841B1 · Srinivasarangan et al. · 2022 [cited by applicant]
US 11516383B2 · Ilic et al. · 2022 [cited by applicant]
US 11531973B1 · Prasad et al. · 2022 [cited by applicant]
US 11562332B1 · Oakes, III et al. · 2023 [cited by applicant]
US 11610294B2 · Dewitt et al. · 2023 [cited by applicant]
US 11640627B2 · Fotso et al. · 2023 [cited by applicant]
US 11676285B1 · Backlund et al. · 2023 [cited by applicant]
US 11694268B1 · Buentello · 2023 [cited by applicant]
US 11704627B2 · Gordon et al. · 2023 [cited by applicant]
US 11710210B1 · Medina, III · 2023 [cited by applicant]
US 11915310B1 · Voutour · 2024 [cited by examiner]
US 20060036537A1 · Lawrence et al. · 2006 [cited by applicant]
US 20080140579A1 · Agarwal · 2008 [cited by applicant]
US 20120040717A1 · Levy et al. · 2012 [cited by applicant]
US 20130198069A1 · Latimer · 2013 [cited by applicant]
US 20130204783A1 · Klose et al. · 2013 [cited by applicant]
US 20140074697A1 · Foster · 2014 [cited by applicant]
US 20140075582A1 · Hierro · 2014 [cited by examiner]
US 20140114852A1 · Rajagopal et al. · 2014 [cited by applicant]
US 20140122332A1 · Viera et al. · 2014 [cited by applicant]
US 20150120564A1 · Smith et al. · 2015 [cited by applicant]
US 20170270508A1 · Roach et al. · 2017 [cited by applicant]
US 20200042955A1 · Widdows · 2020 [cited by applicant]
US 20200389600A1 · Capurso et al. · 2020 [cited by applicant]
US 20210360149A1 · Mukul · 2021 [cited by applicant]
US 20220180551A1 · Lui · 2022 [cited by examiner]
US 20220335393A1 · Gupta et al. · 2022 [cited by applicant]
US 20220343301A1 · Edwards et al. · 2022 [cited by applicant]
US 20220358575A1 · Smith · 2022 [cited by applicant]
US 20230060395A1 · Roach et al. · 2023 [cited by applicant]
US 20230060464A1 · Ceesay · 2023 [cited by applicant]
US 20230084370A1 · Bradford · 2023 [cited by applicant]
US 20230133158A1 · Kolchin · 2023 [cited by applicant]
US 20230196319A1 · Ng et al. · 2023 [cited by applicant]
US 20230196706A1 · Scott · 2023 [cited by applicant]
US 20230281629A1 · Shevyrev · 2023 [cited by examiner]
US 20230351785A1 · Fitzgerald · 2023 [cited by examiner]
CA 3114180A1 · 2020 [cited by examiner]
CN 107544916A · 2018 [cited by examiner]
CN 111526382B · 2022 [cited by examiner]
EP 2136338A1 · 2009 [cited by examiner]
Brittain, Blake: USAA wins $218 mln. verdict from PNC in mobile-deposit tech trial, May 16, 2022, Reuters, pp. 1-9 (Year: 2022). [cited by examiner]
Geeksforgeeks: Java Program to Convert File to Byte Array, Apr. 22, 2022, pages1-11 (Year: 2022). [cited by examiner]
Jung et al.: Real-time car tracking system based on surveillance video, 2018, EURASIP Journal of Image and Video Processiing, pp. 1-13 (Year: 2018). [cited by examiner]
Njoku, Januarius: How to Convert Stream to Byte Array in C#, May 29, 2023, pp. 1-9 (Year: 2023). [cited by examiner]
Brittain, Blake: USAA wins $218mil verdict from PNC in mobile-deposit tech trial, May 16, 2022, Reuters, pp. 1-9 (Year: 2022). [cited by examiner]
Geeksforgeeks: Java Program to Convert File to Byte Array, Apr. 22, 2022, pp. 1-11 (Year: 2022). [cited by examiner]
Adnan et al. an Analytical Study of Information Extraction from Unstructured and Multidimensional Big Data, 2019, Journal of Big Data, pp. 1-33 (Year: 2019). [cited by examiner]
Smith, Ray: An Overview of the Tessseract OCR Engine, Sep. 2007, pp. 1-7 (Year: 2007). [cited by examiner]
Ung et al.: Real-time car tracking system based on surveillance video, 2018, EURASIP Journal of Image and Video Processiing, pp. 1-13 (Year: 2018). [cited by examiner]
Rose, Lydia M. “Modernizing check fraud detection with machine learning.” PhD dissertation. Utica College. 2018. [cited by applicant]
remotedepositcapture.com, “Ensenta Business Mobile with Multi-Check”, Available from the Internet at https://www.remotedepositcapture.com/RDC/media/RDC-Forum/Submitted-Sponsor-Brochures/EnsentaBusinessMobileMultiCheck-e… [cited by applicant]
Bills, Steve, “Automated Amount Scanning Is Trend in Remote-Deposit,” American Banker, New York, NY, Aug. 30, 2005, (3 pgs). [cited by applicant]