IP Library › Granted Patent US 12,067,138
Granted Patent B2
US 12,067,138 · App. 17/583,115 · Granted Aug 20, 2024

Systems and methods for linking a screen capture to a user support session

Inventors: Thomas H. Scott (Richmond, VA); Jude Pierre Anasta (Hudson, NY); Fayaz Khan (Souderton, PA); Patrick Blinkhorn (Silver Spring, MD); Mary Sweeney (Wilmington, DE); Tejen Shrestha (Arlington, VA); Joseph Amburgey (Alexandria, VA)
Assignee: CAPITAL ONE SERVICES, LLC
G06F21/6218G06F9/451G06F9/543G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,067,138
App. No.
17/583,115
Granted
Aug 20, 2024
Kind
B2
Abstract

Systems and methods for linking a screen capture to a user support session are disclosed. The system may receive a screen capture initiation request from a user device. The system may capture a first data object indicative of a first graphical user interface associated with the user device. The system may provide, to the user device, the first graphical user interface for a predetermined period of time. The system may track, by the one or more processors, one or more inputs from the user device that indicate the presence of one or more articles of sensitive information within the graphical user interface. The system may mask the one or more articles of sensitive information within the graphical user interface, generate a second data object indicative of the graphical user interface having the masked articles of sensitive information, and store the second data object in a data repository.

Claims (65)

1. A system for linking a screen capture to a user support session, the system comprising:

one or more processors; and

a non-transitory memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors are configured to cause the system to:

receive, by an API implemented by the one or more processors, a screen capture initiation request from a user device;

capture, by the API, a first data object indicative of a first graphical user interface associated with the user device;

provide, to the user device, the first graphical user interface for a predetermined period of time, the first graphical user interface comprising a request for a user of the user device to identify one or more first articles of sensitive information within the first graphical user interface;

track, by the one or more processors via the API, one or more inputs received from the user device indicating a position of the one or more first articles of sensitive information within the first graphical user interface over the predetermined period of time;

mask, by the API, the one or more first articles of sensitive information within the first graphical user interface;

identify, by the API, one or more second data entries within the first data object indicative of one or more second articles of sensitive information displayed by the first graphical user interface;

mask, by the API, the one or second articles of sensitive information within the first graphical user interface by modifying the one or more second data entries;

automatically generate a second data object indicative of a second graphical user interface, the second graphical user interface comprising the masked one or more first articles of sensitive information and the masked one or more second articles of sensitive information; and

store, by the API, the second data object in a data repository.

2. The system of claim 1 , wherein the instructions, when executed by the one or more processors are configured to cause the system to:

receive metadata from the user device, the metadata associated with the screen capture initiation request;

receive, from an agent terminal, a request for the second data object;

provide the second data object to the agent terminal, thereby facilitating display of the second graphical user interface on the agent terminal.

3. The system of claim 2 , wherein the metadata comprises a user identifier, a user session identifier, and a timestamp associated with the screen capture initiation request.

4. The system of claim 1 , wherein identifying the one or more second articles of sensitive information displayed by the first graphical user interface further comprises implementing a trained machine learning model to identify the one or more second articles of sensitive information.

5. The system of claim 4 , wherein the trained machine learning model is configured to identify articles of sensitive information based on or more heuristics comprising identifying data entry fields associated with one or more articles of sensitive information, identifying one or more phrases proximate to the identified data entry fields indicative of one or more articles of sensitive information, a format of one or more data entry fields indicative of one or more articles of sensitive information, and combinations thereof.

6. The system of claim 5 , wherein the tracked one or more inputs further comprise:

an indication of one or more second articles of sensitive information identified by the trained machine learning model that should be unmasked prior to the second data object being stored in the data repository or a data entry field associated with the user support session;

wherein an indication of the one or more first articles of sensitive information received from the user device are used to update the trained machine learning model to automatically identify the one or more first articles of sensitive information.

7. The system of claim 1 , wherein the one or more first articles of sensitive information comprise sensitive information selected from a password, a social security number, an account number, a credit card number, and combinations thereof.

8. The system of claim 1 , wherein the screen capture initiation request is received by the API in response to a chatbot user support session initiated by the user of the user device.

9. A system for linking a screen capture to a user support session, the system comprising:

one or more processors; and

a non-transitory memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors are configured to cause the system to:

receive, from a user device, a support request comprising a user identifier;

initiate a chatbot support session with the user device;

transmit, by an API implemented by the one or more processors, a screen capture initiation request to the user device;

receive, by the API, an approval of the screen capture initiation request;

capture, by the API, a first data object indicative of a first graphical user interface associated with the user device;

identify, by the API, one or more first data entries within the first data object indicative of one or more first articles of sensitive information displayed by the first graphical user interface;

mask, by the API, the one or more first articles of sensitive information within the first graphical user interface by modifying the one or more first data entries;

provide, to the user device, a modified graphical user interface for a predetermined period of time, the modified graphical user interface comprising the masked one or more first articles of sensitive information and a request for a user of the user device to identify one or more second articles of sensitive information within the modified graphical user interface;

track, by the one or more processors via the API, one or more inputs received from the user device indicating a position of the one or more second articles of sensitive information within the modified graphical user interface over the predetermined period of time;

mask, by the API, the one or more second articles of sensitive information within the modified graphical user interface;

automatically generate a second data object indicative of a second graphical user interface, the second graphical user interface comprising the masked one or more first articles of sensitive information and masked one or more second articles of sensitive information;

store, by the API, the second data object and the user identifier associated with the support request in a data repository;

provide, the second data object and the user identifier to an agent terminal; and

transfer the chatbot support session to the agent terminal.

10. The system of claim 9 , wherein identifying the one or more first articles of sensitive information displayed by the first graphical user interface further comprises implementing a trained machine learning model to identify the one or more first articles of sensitive information.

11. The system of claim 10 , wherein the trained machine learning model is configured to identify articles of sensitive information based on or more heuristics comprising identifying data entry fields associated with one or more articles of sensitive information, identifying one or more phrases proximate to the identified data entry fields indicative of one or more articles of sensitive information, a format of one or more data entry fields indicative of one or more articles of sensitive information, and combinations thereof.

12. The system of claim 11 , wherein the tracked one or more inputs received from the user device are used to update the trained machine learning model to automatically identify the one or more second articles of sensitive information.

13. The system of claim 9 , wherein the one or more first articles of sensitive information and the one or more second articles of sensitive information comprise sensitive information selected from a password, a social security number, an account number, a credit card number, and combinations thereof.

14. The system of claim 9 , wherein the one or more inputs received from the user device further indicate a data entry field associated with the support request.

15. A computer-implemented method for linking a screen capture to a user support session, the method comprising:

receiving, from a user device, a support request comprising a user identifier;

initiating a chatbot support session with the user device;

transmitting, by an API implemented by one or more processors, a screen capture initiation request to the user device;

receiving, by the API, an approval of the screen capture initiation request;

capturing, by the API, a first data object indicative of a first graphical user interface associated with the user device;

identifying, by the API, one or more first data entries within the first data object indicative of one or more first articles of sensitive information displayed by the first graphical user interface;

masking, by the API, the one or more first articles of sensitive information within the first graphical user interface by modifying the one or more first data entries;

providing, to the user device, a modified graphical user interface for a predetermined period of time, the modified graphical user interface comprising the masked one or more first articles of sensitive information and a request for a user of the user device to identify one or more second articles of sensitive information within the modified graphical user interface;

tracking, by the one or more processors via the API, one or more inputs received from the user device indicating a position of the one or more second articles of sensitive information within the modified graphical user interface over the predetermined period of time;

masking, by the API, the one or more second articles of sensitive information within the modified graphical user interface;

automatically generating a second data object indicative of a second graphical user interface, the second graphical user interface comprising the masked one or more first articles of sensitive information and masked one or more second articles of sensitive information;

storing, by the API, the second data object in a data repository;

providing, the second data object to an agent terminal; and

transferring the chatbot support session to the agent terminal.

16. The method of claim 15 , wherein identifying the one or more first articles of sensitive information displayed by the first graphical user interface further comprises implementing a trained machine learning model to identify the one or more first articles of sensitive information.

17. The method of claim 16 , wherein the trained machine learning model is configured to identify articles of sensitive information based on or more heuristics comprising identifying data entry fields associated with one or more articles of sensitive information, identifying one or more phrases proximate to the identified data entry fields indicative of one or more articles of sensitive information, a format of one or more data entry fields indicative of one or more articles of sensitive information, and combinations thereof.

18. The method of claim 17 , wherein the tracked one or more inputs received from the user device are used to update the trained machine learning model to automatically identify the one or more second articles of sensitive information.

19. The method of claim 15 , wherein the one or more inputs received from the user device further indicate a data entry field associated with the support request.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2022
From: SCOTT, THOMAS H.; ANASTA, JUDE PIERRE; KHAN, FAYAZ; BLINKHORN, PATRICK; SWEENEY, MARY; SHRESTHA, TEJEN; AMBURGEY, JOSEPH
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 058749/0607 →
Continuity (1)
Related Publication 20230237180A1 · Jul 27, 2023