IP Library Granted Patent US 10,706,477
Granted Patent B1
US 10,706,477 · App. 15/418,870 · Granted Jul 7, 2020

Augmented reality account statement

Inventor: Vincent Le chevalier (San Jose, CA)
Assignee: Wells Fargo Bank, N.A.
G06Q40/12G06K9/00087G06K9/00449G06K9/00671G06Q40/02G06T19/006H04L63/0861G06F7/02G06Q20/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,706,477
App. No.
15/418,870
Granted
Jul 7, 2020
Kind
B1
Abstract

An augmented reality system enables consumers to access additional data and services when reviewing printed account statements. A built-in camera of a mobile device captures an image of the account statement. The captured image is processed to correlate the account statement to an account provider, effectively unlocking a set of customized services related to the account statement being reviewed. The mobile device displays customized services for the user to view and interact with.

Claims (46)

1. A method for augmenting an account statement associated with an account, the method comprising:

capturing an image of the account statement with a camera of a mobile device;

processing the image to generate processed image data;

correlating the processed image data with reference data to identify an institution corresponding to the account statement;

acquiring enhanced data, the enhanced data related to the account statement;

displaying the enhanced data on a display of the mobile device, the enhanced data including a repurchase link being overlaid upon a transaction on the account statement, wherein overlay of the repurchase link includes:

displaying the image of the account statement on the display;

overlaying the repurchase link on top of the transaction of the account statement on the display, until selection of another transaction, so that the repurchase link is a selectable augmented reality visualization on top of the transaction on the account statement; and

allowing selection of a command for a listing associated with the transaction, the command including to flag the listing or download the listing; and

responsive to detecting a selection of the repurchase link, sending a command to a server to reauthorize the transaction.

2. The method according to claim 1 , wherein processing the image includes at least one of: image alignment, aspect ratio normalization, page layout analysis, line and word detection, and character segmentation.

3. The method according to claim 2 , wherein the reference data include a plurality of aspects associated with one or more account providers.

4. The method according to claim 3 , wherein the processed image data include statement template data.

5. The method according to claim 4 , wherein correlating the processed image data includes comparing the statement template data to a set of pre-existing statement templates; and

if no pre-existing statement template is found, adding the statement template to the set of pre-existing statement templates.

6. The method according to claim 1 , wherein the processed image data include transaction data, and further comprising:

acquiring stored transaction data for the account; and

correlating the transaction data with the stored transaction data.

7. The method according to claim 1 , further comprising:

authenticating a user associated with the account statement;

in an authenticated user mode, displaying additional enhanced data on the display; and

in an unauthenticated user mode, displaying limited enhanced data on the display.

8. The method according to claim 7 , wherein displaying limited enhanced data includes limiting the enhanced data to information related to transactions on the account statement.

9. The method according to claim 8 , wherein authenticating a user includes receiving authentication data including a fingerprint of the user.

10. The method according to claim 1 , the enhanced data including information specific to a transaction on the account statement.

11. The method according to claim 10 , the information specific to a transaction including offers related to a merchant associated with the transaction.

12. The method according to claim 10 , the information specific to a transaction including a listing of items purchased during the transaction.

13. The method according to claim 1 , the enhanced data including historical analysis of the account, the historical analysis including a listing of previous related transactions; and

the enhanced data including analysis of transactions with an identified merchant, the transactions being made with a plurality of different accounts.

14. The method according to claim 1 , wherein the image is a frame of live video acquired by the camera.

15. An augmented reality system, comprising:

a processing unit; and

system memory, the system memory including instructions that, when executed by the processing unit, cause the augmented reality system to:

capture an image of an account statement associated with an account;

process the image to generate processed image data, the processed image data including statement template data;

correlate the processed image data with reference data to identify an institution corresponding to the account statement including comparing the statement template data to a set of pre-existing statement templates, the reference data including a plurality of aspects associated with one or more account providers;

acquire enhanced data, the enhanced data being limited if the user is not authenticated and the enhanced data without limitations if the user is authenticated;

display the enhanced data on a display of a mobile device, the enhanced data including a repurchase link associated with a transaction on the account statement, the repurchase link being overlaid upon the transaction in the augmented reality system, wherein overlay of the repurchase link includes to:

display the image of the account statement on the display;

overlay the repurchase link on top of the transaction of the account statement on the display, until selection of another transaction, so that the repurchase link is a selectable augmented reality visualization on top of the transaction on the account statement; and

allow selection of a command for a listing associated with the transaction, the command including to flag the listing or download the listing; and

responsive to detecting a selection of the repurchase link, send a command to a server to reauthorize the transaction.

16. The augmented reality system according to claim 15 , wherein processing the image includes at least one of: image alignment, aspect ratio normalization, page layout analysis, line and word detection, and character segmentation; and

wherein the instructions further cause the augmented reality system to authenticate a user, wherein authenticating a user includes receiving authentication data including a fingerprint of the user.

17. The augmented reality system according to claim 15 , the enhanced data including at least one of: information specific to a transaction on the account statement and historical analysis of the account, the historical analysis including a listing of previous related transactions.

18. The augmented reality system according to claim 17 , the information specific to a transaction on the account statement including at least one of: offers related to a merchant associated with the transaction and a listing of items purchased during the transaction.

Assignments (2)
STATEMENT OF CHANGE OF ADDRESS OF ASSIGNEE Recorded Jun 17, 2025
From: WELLS FARGO BANK, N.A.
To: WELLS FARGO BANK, N.A.
Reel/Frame 071649/0465 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: LE CHEVALIER, VINCENT
To: WELLS FARGO BANK, N.A.
Reel/Frame 041142/0696 →
Continuity (1)
Provisional Application 62440504 · Dec 30, 2016