Granted Patent B2

US 12,417,582 · App. 18/473,798 · Granted Sep 16, 2025

Inventor: Vijay Kumar Yarabolu (Hyderabad, IN)

Assignee: Bank of America Corporation

G06T17/00G06F3/012G06F3/013G06F3/014H04L9/3213

Abstract

Claims (65)

1. A system, comprising:

a memory configured to store a user identification for a user, image data utilized to render an extended reality (XR) environment on an XR device associated with the user, and a plurality of XR applications executable within the XR environment; and

one or more processors operably coupled to the memory and configured to:

render, on one or more displays of the XR device, the XR environment, wherein the XR environment is configured to facilitate user interactions with the plurality of XR applications while executing within the XR environment;

detect, based on sensor data obtained from one or more sensors of the XR device, a sequence of user interactions with at least one XR application of the plurality of XR applications;

identify, based at least in part upon the sequence of user interactions with the at least one XR application and the user identification, a historical user interaction data associated with the user;

generate a first trust token based on the identified historical user interaction data; and

receive an interaction to finalize execution of the sequence of user interactions, and, in response:

access a second trust token associated with the at least one XR application;

compare the first trust token with the second trust token;

validate the second trust token based at least in part upon the comparison of the first trust token with the second trust token;

validate each user interaction of the sequence of user interactions based at least in part upon the identified historical user interaction data; and

in response to validating the second trust token and the user interactions of the sequence of user interactions, finalize execution of the sequence of user interactions.

2. The system of claim 1 , wherein the one or more processors are configured to identify the historical user interaction data by deriving a relational graph based on the sequence of user interactions with the at least one XR application and the user identification.

3. The system of claim 2 , wherein the derived relational graph comprises a plurality of nodes each corresponding to a respective one of the sequence of user interactions with the at least one XR application, and wherein a final node of the derived relational graph corresponds to the interaction to finalize execution of the sequence of user interactions.

4. The system of claim 1 , wherein the one or more processors are further configured to:

determine, based on the sensor data, one or more device-specific patterns associated with the XR device; and

generate the first trust token based on the identified historical user interaction data and the one or more device-specific patterns.

5. The system of claim 1 , wherein the one or more processors are further configured to:

receive, from the at least one XR application, the second trust token, wherein the second trust token comprises an access token configured to permit access to an application programming interface (API) associated with the at least one XR application; and

validate the second trust token based at least in part upon whether the first trust token matches to the second trust token.

6. The system of claim 1 , wherein the one or more processors are configured to finalize execution of the sequence of user interactions by causing the at least one XR application to execute a predetermined action.

7. The system of claim 1 , wherein the identified historical user interaction data comprises one or more of a head pose pattern of the user, an eye gaze pattern of the user, a hand gesture pattern of the user, a body movement pattern of the user, or a clickstream of the user.

8. A method, comprising:

rendering, on one or more displays of an extended reality (XR) device associated with a user, an XR environment, wherein the XR environment is configured to facilitate user interactions with a plurality of XR applications while executing within the XR environment;

detecting, based on sensor data obtained from one or more sensors of the XR device, a sequence of user interactions with at least one XR application of the plurality of XR applications;

identifying, based at least in part upon the sequence of user interactions with the at least one XR application and a user identification, a historical user interaction data associated with the user;

generating a first trust token based on the identified historical user interaction data; and

receiving an interaction to finalize execution of the sequence of user interactions, and, in response:

accessing a second trust token associated with the at least one XR application;

comparing the first trust token with the second trust token;

validating the second trust token based at least in part upon the comparison of the first trust token with the second trust token;

validating each user interaction of the sequence of user interactions based at least in part upon the identified historical user interaction data; and

in response to validating the second trust token and the user interactions of the sequence of user interactions, finalizing execution of the sequence of user interactions.

9. The method of claim 8 , wherein identifying the historical user interaction data comprises deriving a relational graph based on the sequence of user interactions with the at least one XR application and the user identification.

10. The method of claim 9 , wherein the derived relational graph comprises a plurality of nodes each corresponding to a respective one of the sequence of user interactions with the at least one XR application, and wherein a final node of the derived relational graph corresponds to the interaction to finalize execution of the sequence of user interactions.

11. The method of claim 8 , further comprising:

determining, based on the sensor data, one or more device-specific patterns associated with the XR device; and

generating the first trust token based on the identified historical user interaction data and the one or more device-specific patterns.

12. The method of claim 8 , further comprising:

receiving, from the at least one XR application, the second trust token, wherein the second trust token comprises an access token configured to permit access to an application programming interface (API) associated with the at least one XR application; and

validating the second trust token based at least in part upon whether the first trust token matches to the second trust token.

13. The method of claim 8 , wherein finalizing execution of the sequence of user interactions comprises causing the at least one XR application to execute a predetermined action.

14. The method of claim 8 , wherein the identified historical user interaction data comprises one or more of a head pose pattern of the user, an eye gaze pattern of the user, a hand gesture pattern of the user, a body movement pattern of the user, or a clickstream of the user.

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a system, cause the one or more processors to:

render, on one or more displays of an extended reality (XR) device associated with a user, an XR environment, wherein the XR environment is configured to facilitate user interactions with a plurality of XR applications while executing within the XR environment;

detect, based on sensor data obtained from one or more sensors of the XR device, a sequence of user interactions with at least one XR application of the plurality of XR applications;

identify, based at least in part upon the sequence of user interactions with the at least one XR application and a user identification, a historical user interaction data associated with the user;

generate a first trust token based on the identified historical user interaction data;

access a second trust token associating with the at least one XR application based at least in part upon; and

receive an interaction to finalize execution of the sequence of user interactions, and, in response:

access a second trust token associated with the at least one XR application;

compare the first trust token with the second trust token;

validate the second trust token based at least in part upon the comparison of the first trust token with the second trust token;

validate each user interaction of the sequence of user interactions based at least in part upon the identified historical user interaction data; and

in response to validating the second trust token and the user interactions of the sequence of user interactions, finalize execution of the sequence of user interactions.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions to identify the historical user interaction data further cause the one or more processors to derive a relational graph based on the sequence of user interactions with the at least one XR application and the user identification.

17. The non-transitory computer-readable medium of claim 16 , wherein the derived relational graph comprises a plurality of nodes each corresponding to a respective one of the sequence of user interactions with the at least one XR application, and wherein a final node of the derived relational graph corresponds to the interaction to finalize execution of the sequence of user interactions.

18. The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the one or more processors to:

determine, based on the sensor data, one or more device-specific patterns associated with the XR device; and

generate the first trust token based on the identified historical user interaction data and the one or more device-specific patterns.

19. The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the one or more processors to:

receive, from the at least one XR application, the second trust token, wherein the second trust token comprises an access token configured to permit access to an application programming interface (API) associated with the at least one XR application; and

validate the second trust token based at least in part upon whether the first trust token matches to the second trust token.

20. The non-transitory computer-readable medium of claim 15 , wherein the identified historical user interaction data comprises one or more of a head pose pattern of the user, an eye gaze pattern of the user, a hand gesture pattern of the user, a body movement pattern of the user, or a clickstream of the user.

Assignments (1)

Continuity (1)

References Cited (27)