Granted Patent B2

US 12,307,432 · App. 18/322,197 · Granted May 20, 2025

Inventors: Sashikanth Chandrasekaran (Belmont, CA); Dmitry Kalenichenko (Marina del Rey, CA); Timothy Raymond Zwiebel (Mountain View, CA)

Assignee: GOOGLE LLC

G06Q20/202G06Q20/206G06Q20/3224G06Q20/40145G06T7/74G06V20/46G06V40/166G06V40/167G06V40/172G06T2207/10016G06T2207/30201G06T2207/30232

Abstract

Claims (70)

1. A computer-implemented method to identify users at locations, comprising:

receiving, by one or more processors at a location and from one or more computing devices, one or more templates, each template associated with a corresponding user associated with a corresponding user computing device that received a broadcasted identifier at the location and retransmitted the broadcasted identifier to the one or more computing devices, each template comprising a representation of at least one of a respective facial image or a respective audio recording of the corresponding user;

obtaining, by the one or more processors, at least one of a facial image or an audio recording of a particular user at the location;

determining, by the one or more processors, a similarity between the at least one of the facial image or the audio recording of the particular user at the location and each of the one or more templates; and

identifying, by the one or more processors, a particular template of the one or more templates as corresponding to the at least one of the facial image or the audio recording of the particular user based on a determined similarity between the at least one of the facial image or the audio recording and the particular template satisfying a threshold indicating that the particular template corresponds to the at least one of the facial image or the audio recording of the particular user.

2. The computer-implemented method of claim 1 , wherein:

the location is a merchant location;

the one or more processors are part of a merchant system at the merchant location; and

the one or more computing devices are remote from the merchant location.

3. The computer-implemented method of claim 1 , further comprising:

generating, by the one or more processors, a template for the particular user based on the at least one of the facial image or the audio recording of the particular user at the location.

4. The computer-implemented method of claim 1 , further comprising:

receiving, by the one or more processors, a request to identify a first user; and

transmitting, by the one or more processors, a response to the request to identify the first user, the response include an indication of the particular user.

5. The computer-implemented method of claim 4 , wherein:

the request to identify the first user is received from a merchant system point of sale device; and

the response to the request to identify the first user is transmitted to the merchant system point of sale device.

6. The computer-implemented method of claim 5 , further comprising, processing, by the merchant system point of sale device, a transaction using payment account information associated with the particular user.

7. The computer-implemented method of claim 1 , further comprising:

capturing, by one or more image capture devices, a video feed of an environment, wherein the environment includes the particular user located in proximity to one or more merchant system point of sale devices; and

extracting, by the one or more processors, the at least one of the facial image or the audio recording of the particular user from the video feed.

8. The computer-implemented method of claim 7 , further comprising, by the one or more processors:

determining, based on a frame of the video feed, a position of a face of the particular user and positions of each of the one or more merchant system point of sale devices at a location associated with a merchant system; and

assigning, based on distances between the face of the particular user and each of the one or more merchant system point of sale devices in the frame of the video feed, the particular user to a particular point of sale device of the one or more merchant system point of sale devices;

wherein an indication of an identity of the particular user further comprises an identifier of the particular point of sale device and an indication of an assignment of the particular user to the particular point of sale device.

9. A computer-implemented method to identify users at locations, comprising:

receiving, by one or more processors and from a user computing device at a location of a merchant system, an account identifier of a user and a merchant identifier, wherein the user computing device received the merchant identifier from a broadcast at the location of the merchant system and retransmitted the merchant identifier to the one or more processors;

identifying the location of the merchant system associated with the merchant identifier;

adding a template corresponding to the account identifier of the user to a current customer log comprising templates of users currently at the location of the merchant system, the template comprising a representation of at least one of a respective facial image or a respective audio recording of the user;

transmitting, to the merchant system at the location, the current customer log, wherein the merchant system identifies the user based on a determined similarity between the at least one of the respective facial image or the respective audio recording of the user from the template and at least one of a facial image or an audio recording of the user at the location satisfying a threshold indicating that the template corresponds to the at least one of the respective facial image or the respective audio recording of the user.

10. The computer-implemented method of claim 9 , wherein:

the location is a merchant location; and

the one or more processors are remote from the merchant location.

11. The computer-implemented method of claim 9 , wherein:

the merchant identifier is a merchant beacon identifier received from a merchant beacon device located at the location of the merchant system.

12. The computer-implemented method of claim 9 , further comprising, by the one or more processors:

determining that the user computing device is no longer in proximity of the merchant system; and

removing the template of the user from the current customer log.

13. The computer-implemented method of claim 12 , wherein determining that the user computing device is no longer in proximity of the merchant system comprises determining that a subsequent transmission of the account identifier and the merchant identifier is not received from the user computing device within a threshold amount of time.

14. The computer-implemented method of claim 9 , further comprising, by the one or more processors:

receiving a particular template associated with an identified user, a transaction total, and a merchant account identifier from a merchant computing device at the location of the merchant system;

determining, based on the particular template, an account identifier associated with the identified user;

transmitting, to a point of sale device, one or more payment account information items associated with the account identifier;

receiving, from the point of sale device, an indication of a selection of a particular payment account information item for use in a transaction;

generating a transaction authorization request comprising the transaction total, the merchant account identifier, and the particular payment account information item;

transmitting the transaction authorization request to an issuer system associated with the particular payment account information item;

receiving, from the issuer system, data comprising an authorization of the transaction authorization request; and

transmitting, to the point of sale device for display on the point of sale device, a message regarding authorization of the transaction.

15. One or more non-transitory computer-readable media having computer-readable instructions embodied thereon that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:

receiving, by the one or more processors at a location and from one or more computing devices, one or more templates, each template associated with a corresponding user associated with a corresponding user computing device that received a broadcasted identifier at the location and retransmitted the broadcasted identifier to the one or more computing devices, each template comprising a representation of at least one of a respective facial image or a respective audio recording of the corresponding user;

obtaining at least one of a facial image or an audio recording of a particular user at the location;

determining a similarity between the at least one of the facial image or the audio recording of the particular user at the location and each of the one or more templates; and

identifying a particular template of the one or more templates as corresponding to the at least one of the facial image or the audio recording of the particular user based on a determined similarity between the at least one of the facial image or the audio recording and the particular template satisfying a threshold indicating that the particular template corresponds to the at least one of the facial image or the audio recording of the particular user.

16. The one or more non-transitory computer-readable media of claim 15 , wherein:

the location is a merchant location;

the one or more processors are part of a merchant system at the merchant location; and

the one or more computing devices are remote from the merchant location.

17. The one or more non-transitory computer-readable media of claim 15 , wherein the operations further comprise:

generating a template for the particular user based on the at least one of the facial image or the audio recording of the particular user at the location.

18. The one or more non-transitory computer-readable media of claim 15 , wherein the operations further comprise:

receiving a request to identify a first user; and

transmitting a response to the request to identify the first user, the response includes an indication of the particular user.

19. The one or more non-transitory computer-readable media of claim 18 , wherein:

the request to identify the first user is received from a merchant system point of sale device;

the response to the request to identify the first user is transmitted to the merchant system point of sale device; and

the operations further comprise, processing, by the merchant system point of sale device, a transaction using payment account information associated with the particular user.

20. The one or more non-transitory computer-readable media of claim 15 , wherein the operations further comprise:

determining, based on a frame of a video feed, a position of a face of the particular user and positions of each of one or more point of sale devices at a location associated with a merchant system; and

assigning, based on distances between the face of the particular user and each of the one or more point of sale devices in the frame of the video feed, the particular user to a particular point of sale device of the one or more point of sale devices,

wherein an indication of an identity of the particular user further comprises an identifier of the particular point of sale device and an indication of an assignment of the particular user to the particular point of sale device.

Assignments (2)

Continuity (4)

References Cited (106)