IP Library Granted Patent US 9,916,010
Granted Patent B2
US 9,916,010 · App. 14/715,105 · Granted Mar 13, 2018

Gesture recognition cloud command platform, system, method, and apparatus

Inventors: Theodore Harris (San Francisco, CA); Scott Edington (Arlington, VA); Patrick Faith (Pleasanton, CA)
Assignee: VISA INTERNATIONAL SERVICE ASSOCIATION
G06F3/017G06K9/00268G06K9/00288G06K9/00335G06Q30/0641H04L63/0861H04L67/10H04L67/12H04L67/22H04W12/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,916,010
App. No.
14/715,105
Granted
Mar 13, 2018
Kind
B2
Abstract

Systems and methods described herein are for transmitting a command to a remote system. A processing system determines the identity of the user based on the unique identifier and the biometric information. Thereafter, a sensor detects a gesture performed by the user. The sensor is configured to detect the gesture performed by the user when the user is located within the detectable range of the wireless antenna. The processing system determines an action associated with the detected gesture based on the identity of the user and sends a command to a remote computer system to cause it to perform the action associated with the detected gesture.

Claims (73)

1. A computer-implemented method for transmitting a command to a remote computer system, the computer-implemented method comprising:

detecting, via a first sensor, a unique identifier for a user device that is associated with a user, wherein the unique identifier is sent to the first sensor by the user device, the first sensor includes a wireless antenna, the detection of the unique identifier via the first sensor indicates that the user device is located within a detectable range of the wireless antenna, and both the user device and wireless antenna are located within a merchant store;

detecting, via a second sensor, biometric information for a plurality of customers located within the detectable range of the wireless antenna, wherein the second sensor includes a camera that is configured to detect the biometric information for each of the plurality of customers when the plurality of customers are located within the detectable range of the wireless antenna;

determining, using a processing system, an identity of the user based on the unique identifier and the detected biometric information, wherein at least a portion of the detected biometric information matches facial parameters of the user;

after the determining of the identity of the user, detecting, via the second sensor, a gesture performed by the user, wherein the gesture is directed to an item that is located within the merchant store, and the second sensor is configured to detect the gesture performed by the user when the user is located at one or more second locations within the detectable range of the wireless antenna;

identifying, using the processing system, an action associated with the detected gesture within a user-defined gesture table based on the identity of the user; and

sending, using the processing system, the command to the remote computer system, the command instructing the remote computer system to perform the action for the item, the action corresponding to the detected gesture from the user-defined gesture table.

2. The computer-implemented method of claim 1 , further comprising:

providing the biometric information, the unique identifier, and the gesture to a computer system, the computer system being connected to the first sensor and the second sensor, wherein the computer system sends the command to the remote computer system.

3. The computer-implemented method of claim 1 , wherein the detected biometric information includes an image of at least a portion of a face of the user, the computer-implemented method further comprising:

analyzing the image of the at least the portion of the face of the user using the processing system, wherein the analyzing of the image generates an output indicating a facial characteristic of the user; and

comparing the output with a set of previously stored reference signals, wherein the determining of the identity of the user is based on the comparison.

4. The computer-implemented method of claim 1 , wherein the unique identifier includes a media access control (MAC) address of the user device.

5. The computer-implemented method of claim 1 , further comprising:

detecting, via the first sensor, a second unique identifier for a second user device that is associated with a second user, the detection of the second unique identifier indicating that the second user device is located within the detectable range of the wireless antenna, wherein the second user is a person for whom biometric information is not detected via the second sensor;

transmitting a message to the second user device;

after the transmitting of the message to the second user device, determining one or more users within the detectable range of the wireless antenna that make a motion indicating a receipt of a message via a user device;

detecting second biometric information for the one or more users via the second sensor; and

determining the identity of the second user based on the second unique identifier and the second biometric information.

6. The computer-implemented method of claim 1 , wherein the remote computer system comprises a cloud computing system, the cloud computing system being configured to perform the action associated with the detected gesture.

7. The computer-implemented method of claim 1 , wherein the action associated with the detected gesture includes:

a posting of a message on a social media website;

an initiation of a financial transaction between the user and a third party;

a transmittal of information to the user; or

an action performed by a robot.

8. The computer-implemented method of claim 1 , wherein the user causes the action to be associated with the gesture by interacting with a website, the website including an interface that permits the associating of the action with the gesture.

9. The computer-implemented method of claim 1 , further comprising:

determining a candidate identity for the user based on the unique identifier for the user device, the candidate identity being associated with a previously-stored reference signal; and

after the determining of the candidate identity for the user, comparing the detected biometric information for the user with the previously-stored reference signal, wherein the identity of the user is determined based on the comparison.

10. The computer-implemented method of claim 1 , wherein the second sensor includes one or more cameras that collect a series of images depicting the gesture being performed by the user, the series of images being collected over a period of time, and wherein the computer-implemented method further comprises:

analyzing, using the processing system, the series of images to determine a trajectory of an object within one or more images of the series of images; and

comparing the trajectory of the object with one or more previously stored trajectories, each of the previously stored trajectories being associated with a gesture.

11. A computer-implemented system for transmitting a command to a remote computer system, the computer-implemented system comprising:

a memory; and

one or more processors disposed in communication with the memory and configured to issue processing instructions stored in the memory to:

detect, via a first sensor, a unique identifier for a user device that is associated with a user, wherein the unique identifier is sent to the first sensor by the user device, the first sensor includes a wireless antenna, the detection of the unique identifier via the first sensor indicates that the user device is located within a detectable range of the wireless antenna, and both the user device and wireless antenna are located within a merchant store;

detect, via a second sensor, biometric information for a plurality of customers located within the detectable range of the wireless antenna, wherein the second sensor includes a camera that is configured to detect the biometric information for each of the plurality of customers when the plurality of customers are located within the detectable range of the wireless antenna;

determine, using a processing system, an identity of the user based on the unique identifier and the detected biometric information, wherein at least a portion of the detected biometric information matches facial parameters of the user;

after the determining of the identity of the user, detecting, via the second sensor, a gesture performed by the user, wherein the gesture is directed to an item that is located within the merchant store, and the second sensor is configured to detect the gesture performed by the user when the user is located at one or more second locations within the detectable range of the wireless antenna;

identify, using the processing system, an action associated with the detected gesture within a user-defined gesture table based on the identity of the user; and

send, using the processing system, the command to the remote computer system, the command instructing the remote computer system to perform the action for the item, the action corresponding to the detected gesture from the user-defined gesture table.

12. The computer-implemented system of claim 11 , further comprising instruction to:

provide the biometric information, the unique identifier, and the gesture to a computer system, the computer system being connected to the first sensor and the second sensor, wherein the computer system sends the command to the remote computer system.

13. The computer-implemented system of claim 1 , wherein the detected biometric information includes an image of at least a portion of a face of the user, the computer-implemented system further comprising instructions to:

analyze the image of the at least the portion of the face of the user using the processing system, wherein the analyzing of the image generates an output indicating a facial characteristic of the user; and

compare the output with a set of previously stored reference signals, wherein the determining of the identity of the user is based on the comparison.

14. The computer-implemented system of claim 11 , wherein the unique identifier includes a media access control (MAC) address of the user device.

15. The computer-implemented system of claim 11 , further comprising instruction to:

detect, via the first sensor, a second unique identifier for a second user device that is associated with a second user, the detection of the second unique identifier indicating that the second user device is located within the detectable range of the wireless antenna, wherein the second user is a person for whom biometric information is not detected via the second sensor;

transmit a message to the second user device;

after the transmitting of the message to the second user device, determine one or more users within the detectable range of the wireless antenna that make a motion indicating a receipt of a message via a user device;

detect second biometric information for the one or more users via the second sensor; and

determine the identity of the second user based on the second unique identifier and the second biometric information.

16. The computer-implemented system of claim 11 , wherein the remote computer system comprises a cloud computing system, the cloud computing system being configured to perform the action associated with the detected gesture.

17. The computer-implemented system of claim 11 , wherein the action associated with the detected gesture includes:

a posting of a message on a social media website;

an initiation of a financial transaction between the user and a third party;

a transmittal of information to the user; or

an action performed by a robot.

18. The computer-implemented system of claim 11 , wherein the user causes the action to be associated with the gesture by interacting with a website, the website including an interface that permits the associating of the action with the gesture.

19. The computer-implemented system of claim 11 , further comprising instructions to:

determine a candidate identity for the user based on the unique identifier for the user device, the candidate identity being associated with a previously-stored reference signal; and

after the determining of the candidate identity for the user, compare the detected biometric information for the user with the previously-stored reference signal, wherein the identity of the user is determined based on the comparison.

20. The computer-implemented system of claim 11 , wherein the second sensor includes one or more cameras that collect a series of images depicting the gesture being performed by the user, the series of images being collected over a period of time, and wherein the computer-implemented system further comprises instructions to:

analyze, using the processing system, the series of images to determine a trajectory of an object within one or more images of the series of images; and

compare the trajectory of the object with one or more previously stored trajectories, each of the previously stored trajectories being associated with a gesture.

21. A processor-readable non-transitory medium storing processor-issuable instructions for transmitting a command to a remote computer system, said instructions being configured to:

detect, via a first sensor, a unique identifier for a user device that is associated with a user, wherein the unique identifier is sent to the first sensor by the user device, the first sensor includes a wireless antenna, the detection of the unique identifier via the first sensor indicates that the user device is located within a detectable range of the wireless antenna, and both the user device and wireless antenna are located within a merchant store;

detect, via a second sensor, biometric information for a plurality of customers located within the detectable range of the wireless antenna, wherein the second sensor includes a camera that is configured to detect the biometric information for each of the plurality of customers when the plurality of customers are within the detectable range of the wireless antenna;

determine, using a processing system, an identity of the user based on the unique identifier and the detected biometric information, wherein at least a portion of the detected biometric information matches facial parameters of the user;

after the determining of the identity of the user, detecting, via the second sensor, a gesture performed by the user, wherein the gesture is directed to an item that is located within the merchant store, and the second sensor is configured to detect the gesture performed by the user when the user is located at one or more second locations within the detectable range of the wireless antenna;

identify, using the processing system, an action associated with the detected gesture within a user-defined gesture table based on the identity of the user; and

send, using the processing system, the command to the remote computer system, the command instructing the remote computer system to perform the action for the item, the action corresponding to the detected gesture from the user-defined gesture table.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: FAITH, PATRICK
To: VISA INTERNATIONAL SERVICE ASSOCIATION
Reel/Frame 047377/0585 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE OF FIRST AND SECOND INVENTORS PREVIOUSLY RECORDED AT REEL: 044482 FRAME: 0505. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jan 16, 2018
From: HARRIS, THEODORE; EDINGTON, SCOTT; FAITH, PATRICK
To: VISA INTERNATIONAL SERVICE ASSOCIATION
Reel/Frame 045076/0384 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2017
From: HARRIS, THEODORE; EDINGTON, SCOTT; FAITH, PATRICK
To: VISA INTERNATIONAL SERVICE ASSOCIATION
Reel/Frame 044482/0505 →
Continuity (2)
Provisional Application 61994793 · May 16, 2014
Related Publication 20160109954A1 · Apr 21, 2016