IP Library Granted Patent US 11,232,304
Granted Patent B2
US 11,232,304 · App. 16/408,512 · Granted Jan 25, 2022

Systems and methods of augmenting objects associated with personal data

Inventors: Miguel Navarro (Ewing, NJ); Levi Sutter (Westampton, NJ); Sadia Zaidi (Robbinsville, NJ); Mohamed Abbas (Jersey City, NJ)
Assignee: The Toronto-Dominion Bank
G06K9/00671G06F21/6245G06K9/00456H04L63/0876H04L67/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,232,304
App. No.
16/408,512
Granted
Jan 25, 2022
Kind
B2
Abstract

Systems and methods of augmenting objects associated with personal data. A system includes a communication module, a processor, and a memory. The memory stores instructions that, when executed, configure the processor to authenticate a client device based on a credential associated with an account record. The processor receives, from the client device, an indication of a document marker and obtains, from the account record, personal data associated with the document marker. The processor transmits, to the client device, display data based on the personal data. The display data configures the client device to display an augmented reality output based on the personal data and at least one further image of the document. The personal data may include dynamic data varying over time. The display data configuring the client device to display the augmented output may be based on current personal data obtained from the account record.

Claims (63)

1. A computing system comprising:

a communication module;

a processor coupled to the communication module; and

a memory coupled to the processor, the memory storing instructions that, when executed, configure the processor to:

authenticate a client device based on a credential associated with an account record;

receive, from the client device, an image of a non-user specific account statement template document, the non-user specific account statement template document including one or more section headers;

identify one or more section headers in the image of the non-user specific account statement template document as document markers;

obtain, from the account record, current personal data associated with the authenticated client device for data types identified by the document markers, the current personal data including dynamic data which varies over time;

generate display data for configuring the client device to display an augmented reality output based on the current personal data obtained from the account record, the augmented reality output converting the non-user specific account statement template document to a user specific account statement document that includes at least some of the current personal data displayed in relation to the document markers; and

transmit, to the client device, the display data for configuring the client device to display the augmented reality output based on the current personal data and at least one further image of the non-user specific account statement template document.

2. The computing system of claim 1 , wherein the personal data includes banking account data having dynamically changing value over time, and wherein the current personal data includes a current market value of an account associated with the banking account data.

3. The computing system of claim 1 , wherein obtaining the personal data associated with the authenticated client device for data types identified by the document markers is subsequent to authenticating the client device based on the credential.

4. The computing system of claim 1 , wherein the augmented reality output includes a live-view display of the non-user specific account statement template document.

5. The computing system of claim 1 , wherein the instructions, when executed, further configure the processor to identify the document markers using image recognition.

6. The computing system of claim 1 , wherein the augmented reality output includes at least one of graphs or charts associated with the current personal data.

7. The computing system of claim 1 , wherein the document markers include at least one of a keyword, a barcode, or a graphical symbol.

8. The computing system of claim 1 , wherein the instructions, when executed, further configure the processor to:

receive, from the client device, a user selected subset of the augmented reality output; and

transmit, to the client device, further display data for displaying the user selected subset of the augmented reality output at the client device.

9. A computer-implemented method of augmenting objects associated with personal data, the method comprising:

authenticating a client device based on a credential associated with an account record;

receiving, from the client device, an image of a non-user specific account statement template document, the non-user specific account statement template document including one or more section headers;

identifying one or more section headers in the image of the non-user specific account statement template document as document markers;

obtaining, from the account record, current personal data associated with the authenticated client device for data types identified by the document markers, the current personal data including dynamic data which varies over time;

generating display data for configuring the client device to display an augmented reality output based on the current personal data obtained from the account record, the augmented reality output converting the non-user specific account statement template document to a user specific account statement document that includes at least some of the current personal data displayed in relation to the document markers; and

transmitting, to the client device, the display data for configuring the client device to display the augmented reality output based on the current personal data and at least one further image of the non-user specific account statement template document.

10. The method of claim 9 , wherein obtaining the personal data associated with the authenticated client device for data types identified by the document markers is subsequent to authenticating the client device based on the credential.

11. The method of claim 9 , wherein the augmented reality output includes a live-view display of the non-user specific account statement template document.

12. The method of claim 9 , wherein the method further comprises identifying the document markers using image recognition.

13. The method of claim 9 , wherein the augmented reality output includes at least one of graphs or charts associated with the current personal data.

14. The method of claim 9 , wherein the document markers include at least one of a keyword, a barcode, or a graphical symbol.

15. The method of claim 9 , further comprising:

receiving, from the client device, a user selected subset of the augmented reality output; and

transmitting, to the client device, further display data for displaying the user selected subset of the augmented reality output at the client device.

16. A non-transitory computer-readable storage medium storing instructions for augmenting objects associated with personal data, the instructions, when executed by a processor of a computing device, cause the computing device to:

authenticate a client device based on a credential associated with an account record;

receive, from the client device, an image of a non-user specific account statement template document, the non-user specific account statement template document including one or more section headers;

identify one or more section headers in the image of the non-user specific account statement template document as document markers;

obtain, from the account record, current personal data associated with the authenticated client device for data types identified by the document markers, the current personal data including dynamic data which varies over time;

generate display data for configuring the client device to display an augmented reality output based on the current personal data obtained from the account record, the augmented reality output converting the non-user specific account statement template document to a user specific account statement document that includes at least some of the current personal data displayed in relation to the document markers; and

transmit, to the client device, the display data for configuring the client device to display the augmented reality output based on the current personal data and at least one further image of the non-user specific account statement template document.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the personal data includes banking account data having dynamically changing value over time, and wherein the current personal data includes a current market value of an account associated with the banking account data.

18. The computing system of claim 1 , wherein the instructions, when executed, further configure the processor to:

authenticate a second client device based on a credential associated with a second account record;

receive, from the second client device, an image of a non-user specific account statement template document, the non-user specific account statement template document including one or more section headers;

identify one or more section headers in the image of the non-user specific account statement template document as document markers;

obtain, from the second account record, current personal data associated with the authenticated second client device for data types identified by the document markers, the current personal data including dynamic data which varies over time;

generate display data for configuring the second client device to display an augmented reality output based on the current personal data obtained from the second account record, the augmented reality output converting the non-user specific account statement template document to a user specific account statement document that includes at least some of the current personal data displayed in relation to the document markers; and

transmit, to the second client device, the display data for configuring the second client device to display the augmented reality output based on the current personal data and at least one further image of the non-user specific account statement template document.

19. The method of claim 9 , further comprising:

authenticating a second client device based on a credential associated with a second account record;

receiving, from the second client device, an image of a non-user specific account statement template document, the non-user specific account statement template document including one or more section headers;

identifying one or more section headers in the image of the non-user specific account statement template document as document markers;

obtaining, from the second account record, current personal data associated with the authenticated second client device for data types identified by the document markers, the current personal data including dynamic data which varies over time;

generating display data for configuring the second client device to display an augmented reality output based on the current personal data obtained from the second account record, the augmented reality output converting the non-user specific account statement template document to a user specific account statement document that includes at least some of the current personal data displayed in relation to the document markers; and

transmitting, to the second client device, the display data for configuring the second client device to display the augmented reality output based on the current personal data and at least one further image of the non-user specific account statement template document.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions, when executed by a processor of a computing device, further cause the computing device to:

authenticate a second client device based on a credential associated with a second account record;

receive, from the second client device, an image of a non-user specific account statement template document, the non-user specific account statement template document including one or more section headers;

identify one or more section headers in the image of the non-user specific account statement template document as document markers;

obtain, from the second account record, current personal data associated with the authenticated second client device for data types identified by the document markers, the current personal data including dynamic data which varies over time;

generate display data for configuring the second client device to display an augmented reality output based on the current personal data obtained from the second account record, the augmented reality output converting the non-user specific account statement template document to a user specific account statement document that includes at least some of the current personal data displayed in relation to the document markers; and

transmit, to the second client device, the display data for configuring the second client device to display the augmented reality output based on the current personal data and at least one further image of the non-user specific account statement template document.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2020
From: NAVARRO, MIGUEL; SUTTER, LEVI; ZAIDI, SADIA; ABBAS, MOHAMED
To: THE TORONTO-DOMINION BANK
Reel/Frame 053846/0164 →
Continuity (1)
Related Publication 20200356776A1 · Nov 12, 2020
Cited By (24)
US 12,499,241 US 12,517,812 US 12,536,264 US 12,541,894 US 12,566,541 US 12,585,435 US 12,591,559 US 12,592,301 US 12,625,680 US 12,641,178 US 12,645,429 US 12,645,689 US 12,645,838 US 12,646,051 US 12,650,836 US 12,657,566 US 12,670,334 US 12,670,640 US 12,682,179 US 12,688,620 US 12,693,842 US 12,699,556 US 12,705,398 US 12,711,683