Granted Patent B2

US 12,367,672 · App. 18/471,161 · Granted Jul 22, 2025

Inventors: Michael Anthony Dascola (Clayton, NC); Jacob Atticus Grady (Raleigh, NC); Kaitlyn Stahl (Raleigh, NC)

Assignee: Truist Bank

G06V20/20A61B5/112G06F3/013G06F21/32G06Q30/0269G06T7/207G06T7/74G06V40/171H04L63/105H04L2463/082

Abstract

Claims (49)

1. An augmented reality customer interaction system, comprising:

a camera device configured to:

track movements of a customer and a customer service representative to different locations in an area adjacent to a first side of a transparent panel or to a second side of the transparent panel, and

capture personally identifying characteristics of the customer and the customer service representative; and

a projection system configured to determine locations on the second side of the transparent panel at which customer interaction data is to be projected and project the customer interaction data such that the locations of the projected customer interaction data follow the movements of the customer and a relationship is maintained, based on the personally identifying characteristics, between the customer service representative, the locations of the projected customer interaction data, and the different locations of the customer, the customer interaction data based on the personally identifying characteristics,

wherein the customer interaction data is visible only to a first person located in an area adjacent to the second side of the transparent panel while the customer is visible to the first person, and wherein the first person is the customer service representative.

2. The augmented reality customer interaction system of claim 1 , wherein the customer interaction data is retrieved from a data store based on the personally identifying characteristics.

3. The augmented reality customer interaction system of claim 1 , wherein components of the projection system are integrated into the transparent panel.

4. The augmented reality customer interaction system of claim 1 , wherein the camera device is further configured to determine an eye gaze location of the first person on the second side of the transparent panel,

wherein the projection system is configured to project the customer interaction data on the second side of the transparent panel at a location determined by the eye gaze location of the first person.

5. The augmented reality customer interaction system of claim 1 , further comprising sensors configured to:

identify a second person in the area adjacent to the second side of the transparent panel; and

determine a second location on the second side of the transparent panel on which the customer interaction data is to be projected, wherein the second location is based on a second location of the customer in the area adjacent to the first side of the transparent surface, and a third location of the second person in the area adjacent to the second side of the transparent surface; and

wherein the projection system is configured to project the customer interaction data at the determined second location on the transparent panel.

6. The augmented reality customer interaction system of claim 1 , further comprising sensors configured to:

track movements of the first person in the area adjacent to the second side of the transparent panel and movements of the customer in the area adjacent to the first side of the transparent panel, wherein a location on the second side of the transparent panel on which the customer interaction data is to be projected is determined based on the movements of the customer and the movements of the first person.

7. The augmented reality customer interaction system of claim 1 , further comprising:

biometric sensors configured to collect biometric data from the customer;

cameras configured to collect a height measurement of the customer;

cameras configured to collect a gait profile of the customer;

cameras configured to collect ear features of the customer; or

microphones configured to collect a voiceprint of the customer,

wherein a customer profile is determined from customer characteristics stored in a data store based on the biometric data, the height measurement, the gait profile, the ear features, or the voiceprint.

8. The augmented reality customer interaction system of claim 1 , wherein the customer interaction data includes strategies for interactions with the customer based on retrieved data associated with a customer profile, and

wherein the interaction strategies include a product or service offering, or identification of a security risk.

9. A method comprising:

capturing, with a camera device configured to track movements of a customer and a customer service representative to different locations in an area adjacent to a first side of a transparent panel or a second side of a transparent panel, personally identifying characteristics of the customer and the customer service representative; and

projecting, with a projection system configured to determine locations on a second side of the transparent panel at which customer interaction data is to be projected, the customer interaction data such that the locations of the projected customer interaction data follow the movements of the customer and a relationship is maintained, based on the personally identifying characteristics, between the customer service representative, the locations of the projected customer interaction data, and the different locations of the customer, the customer interaction data based on the personally identifying characteristics,

wherein the customer interaction data is visible only to a first person located in an area adjacent to the second side of the transparent panel while the customer is visible to the first person, and wherein the first person is the customer service representative.

10. The method of claim 9 , further comprising retrieving the customer interaction data from a data store based on the personally identifying characteristics.

11. The method of claim 9 , further comprising:

determining an eye gaze location of the first person in the area adjacent to the second side of the transparent panel, and

projecting the customer interaction data on the second side of the transparent panel at a location determined by the eye gaze location of the first person.

12. The method of claim 9 , further comprising:

identifying a second person in the second area adjacent to the second side of the transparent panel; and

determining a second location on the second side of the transparent panel on which the customer interaction data is to be projected, wherein the second location is based on a second location of the customer in the first area adjacent to the first side of the transparent panel and a third location of the second person in the second area adjacent to the second side of the transparent panel; and

projecting the customer interaction data at the determined second location on the second side of the transparent panel.

13. The method of claim 9 , further comprising:

tracking movements of the first person in the area adjacent to the second side of the transparent panel and movements of the customer in the area adjacent to the first side of the transparent panel; and

determining a location on the second side of the transparent panel on which the customer interaction data is to be projected based on the movements of the customer and the movements of the first person.

14. The method of claim 9 , further comprising:

collecting biometric data from the customer with biometric sensors;

collecting a height measurement of the customer with one or more cameras;

collecting a gait profile of the customer with the one or more cameras;

collecting ear features of the customer cameras with the one or more cameras; or

collecting a voiceprint of the customer with one or more microphones; and

determining a customer profile from customer characteristics stored in a data store based on the biometric data, the height measurement, the gait profile, the ear features, or the voiceprint.

15. The method of claim 9 , wherein the customer interaction data includes strategies for interactions with the customer based on data associated with a customer profile retrieved from a data store, and

wherein the interaction strategies include a product or service offering, or identification of a security risk.

Assignments (1)

Continuity (4)

References Cited (26)