Granted Patent B2

US 12,585,749 · App. 17/445,014 · Granted Mar 24, 2026

Inventors: Abdelkadar M'Hamed Benkreira (Washington, DC); Michael Mossoba (Arlington, VA); Joshua Edwards (Philadelphia, PA)

Assignee: Capital One Services, LLC

G06F21/36G06F3/044G06F21/35G06F21/83G06Q20/1085G06Q20/322G06T19/006G07F19/201

Abstract

Claims (83)

1 . A first device, comprising:

one or more memory devices; and

one or more processors, coupled to the one or more memory devices, configured to:

determine, based on capturing an image of a second device via a camera of the first device, identifying information associated with the second device;

establish, by the first device and based on the identifying information, a communication session with the second device;

cause, based on establishing the communication session, an augmented reality (AR) overlay to be implemented and displayed on the first device,

the AR overlay being displayed on the first device to overlay an image of a screen associated with an input interface of the second device,

the AR overlay including second information related to authenticating a user of the first device with the second device, and

the AR overlay displaying one or more input elements of at least one of varying sizes, varying shapes, or at varying locations of the input interface of the second device;

determine, by the first device, that the input interface of the second device received an input from the user, wherein the determination is based on at least one of:

monitoring the input interface of the second device via the camera of the first device using one or more computer vision techniques, or

receiving, by the first device and from the second device, information related to the input via a wireless communication connection between the first device and the second device; and

perform, by the first device and based on determining whether an interaction occurred with the input interface of the second device, an action displaying supplemental information related to at least one of the second information, the AR overlay, or the second device.

2 . The first device of claim 1 , wherein the AR overlay is displayed to present the one or more input elements in a random layout.

3 . The first device of claim 1 , wherein the one or more input elements are different for at least one of:

different users,

different transactions, or

different devices.

4 . The first device of claim 1 , wherein the one or more processors are configured to:

cause translation of information associated with the interaction with the input interface of the second device; and

cause verification of information associated with the translation of information.

5 . The first device of claim 1 , wherein the one or more processors are configured to:

cause translation of information associated with the interaction with the input interface of the second device,

the interaction with the input interface of the second device being based on a random layout of the one or more input elements displayed by the AR overlay, and

the random layout of the one or more input elements being different from a layout of the input interface of the second device; and

cause verification of information associated with the translation of information.

6 . The first device of claim 1 , wherein the input interface of the second device is a keypad or a touch capacitive screen.

7 . The first device of claim 1 , wherein the one or more processors, to perform the action, are configured to:

authorize a transaction with the second device based on information indicating the interaction and the second information.

8 . A method, comprising:

determining, by a first device and based on capturing an image of a second device via a camera of the first device, identifying information associated with the second device;

establishing, by the first device and based on the identifying information, a communication session with the second device;

causing, by the first device and based on establishing the communication session, an augmented reality (AR) overlay to be implemented and displayed on the first device,

the AR overlay being displayed on the first device to overlay an image of a screen associated with an input interface of the second device,

the AR overlay including second information related to authenticating a user of the first device with second device, and

the AR overlay displaying one or more input elements of at least one of varying sizes, varying shapes, or at varying locations of the input interface of the second device;

determining, by the first device, that the input interface of the second device received an input from the user, wherein the determination is based on at least one of:

monitoring the input interface of the second device via the camera of the first device using one or more computer vision techniques, or

receiving, by the first device and from the second device, information related to the input via a wireless communication connection between the first device and the second device; and

performing, by the first device, based on determining whether an interaction occurred with the input interface of the second device, an action displaying supplemental information related to at least one of the second information, the AR overlay, or the second device.

9 . The method of claim 8 , wherein the AR overlay is displayed to present the one or more input elements in a random layout.

10 . The method of claim 8 , wherein the one or more input elements are different for at least one of:

different users,

different transactions, or

different devices.

11 . The method of claim 8 , further comprising:

causing translation of information associated with the interaction with the input interface of the second device; and

causing verification of information associated with the translation of information.

12 . The method of claim 8 , further comprising:

causing translation of information associated with the interaction with the input interface of the second device,

the interaction with the input interface of the second device being based on a random layout of the one or more input elements displayed by the AR overlay, and

the random layout of the one or more input elements being different from a layout of the input interface of the second device; and

causing verification of information associated with the translation of information.

13 . The method of claim 8 , wherein the input interface of the second device is a keypad or a touch capacitive screen.

14 . The method of claim 8 , wherein performing the action comprises:

authorizing a transaction with the second device based on information indicating the interaction and the second information.

15 . A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:

one or more instructions that, when executed by one or more processors of a first device, cause the first device to:

determine, based on capturing an image of a second device via a camera of the first device, identifying information of the second device;

establish, by the first device and based on the identifying information, a communication session with the second device;

cause, based on establishing the communication session, an augmented reality (AR) overlay to be implemented and displayed on the first device,

the AR overlay being displayed on the first device to overlay an image of a screen associated with an input interface of the second device,

the AR overlay including second information related to authentication of a user, related to the first device, with the second device, and

the AR overlay displaying one or more input elements of at least one of varying sizes, varying shapes, or at varying locations of the input interface of the second device;

determine, by the first device, that the input interface of the second device received an input from the user, wherein the determination is based on at least one of:

monitoring the input interface of the second device via the camera of the first device using one or more computer vision techniques, or

receiving, by the first device and from the second device, information related to the input via a wireless communication connection between the first device and the second device; and

perform, by the first device and based on determining whether an interaction occurred with the input interface of the second device, an action displaying supplemental information related to at least one of the second information, the second device, or the AR overlay.

16 . The non-transitory computer-readable medium of claim 15 , wherein the AR overlay is displayed to present the one or more input elements in a random layout.

17 . The non-transitory computer-readable medium of claim 15 , wherein the one or more input elements are different for at least one of:

different users,

different transactions, or

different devices.

18 . The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions further cause the first device to:

cause translation of information associated with the interaction with the input interface of the second device; and

cause verification of information associated with the translation of information.

19 . The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions further cause the first device to:

cause translation of information associated with the interaction with the input interface of the second device,

the interaction with the input interface of the second device being based on a random layout of the one or more input elements displayed by the AR overlay, and

the random layout of the one or more input elements being different from a layout of the input interface of the second device; and

cause verification of information associated with the translation of information.

20 . The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, that cause the first device to perform the action, cause the first device to:

authorize a transaction with the second device based on information indicating the interaction and the second information.

Assignments (1)

Continuity (3)

References Cited (24)