Monitoring key-press delay and duration to determine need for assistance
View Patent ↗In a user-interactive system, such as an interactive voice response (IVR) system, the duration and/or force of key-presses by the user and/or the speed of response to prompts by the user are used to make inferences about the user, such as whether the user is impaired or is growing frustrated. The user interface is modified based on the inferences.
1. A method comprising:
determining a duration of actuating an actuator by a user;
determining if the duration is longer than a first time;
if the duration is longer than the first time, determining that the user is impaired;
in response to determining the user is impaired, modifying a user interface interfacing with the actuator to compensate for the impairment; and
in response to determining that the user is not impaired, forbearing from modifying the user interface.
2. The method of claim 1 wherein determining if the duration is long comprises:
determining, over time, durations of a plurality of actuations of actuators by a user;
comparing the determined durations to determine if the durations are getting longer over time; and
in response to determining that the durations are getting longer over time, modifying the user interface of the user.
3. The method of claim 1 wherein modifying the user interface of the user comprises: connecting the user to an agent.
4. The method of claim 1 wherein determining that the user is impaired comprises: interacting with the user to determine if the user is impaired.
5. The method of claim 1 wherein determining that a user is impaired comprises:
interacting with the user to determine if the user has a physical or a cognitive impairment
in response to determining that the user has a physical impairment, modifying the user interface in a first manner; and
in response to determining that the user has a cognitive impairment, modifying the user interface in a second manner.
6. The method of claim 1 further comprising:
determining whether the user is frustrated;
in response to determining that the user is frustrated, modifying the user interface in a first manner;
determining whether the user is impaired; and
in response to determining that the user is impaired, modifying the user interface in a second manner.
7. The method of claim 1 wherein
modifying comprises:
modifying the user interface in a first manner;
forbearing comprises:
in response to a short said duration, modifying the user interface in a second manner; and
in response to a normal said duration, forbearing from modifying the user interface.
8. The method of claim 1 wherein determining if the duration is longer than a first time comprises, determining a speed of response to a prompt by the user;
modifying comprises:
in response to a long said duration and a slow said speed of response, modifying the user interface; and
forbearing comprises:
in response to a short said duration and a fast said speed of response, forbearing from said modifying.
9. The method of claim 1 wherein determining if the duration is longer than a first time comprises:
determining intervals of time between successive said actuations; and
determining an interval of time between a prompt and a first said actuation;
modifying comprises:
in response to long said durations and long said intervals, modifying the user interface; and
forbearing comprises:
in response to short said durations and short said intervals, forbearing from said modifying.
10. The method of claim 1 wherein the first time is a historic average of the duration of actuating the actuator.
11. An apparatus comprising:
a user interface operable to interface with a user;
a device in communication with the user interface, the device comprising a processor and memory, the device operable to:
modify the user interface in response to a change in a duration of actuating of an actuator connected to the user interface; and
forbear from said modifying in response to no change in the duration of the actuation.
12. The apparatus of claim 11 wherein:
the device comprises an interactive voice response system; and
the actuator is included in a keyboard of a user terminal device.
13. The apparatus of claim 11 wherein:
the device comprises a wireless phone; and
the actuator is included in a dial pad of the phone.
14. The apparatus of claim 11 wherein:
the device comprises a computer; and
the actuator is included in a keyboard or a mouse of the computer.
15. The apparatus of claim 11 wherein:
the device comprises a personal digital assistant; and
the actuator is included in a keyboard or a touch-sensitive screen of the personal digital assistant.
16. The apparatus of claim 11 wherein:
the device comprises a burglar alarm system; and
the actuator is included in a keypad of the burglar alarm system.
17. The apparatus of claim 11 wherein:
the device comprises an electronic game; and
the actuator is a hand control of the game.
18. The apparatus of claim 11 wherein:
the device comprises a television; and
the actuator is included in a remote control of the television.
19. The apparatus of claim 11 wherein the device further comprises:
a key entry device having at least one pressable key;
a timing device for determining durations of pressing of the at least one key; and
a responsive device for selectively modifying the user interface in response to the determined durations.