IP Library Granted Patent US 9,595,171
Granted Patent B2
US 9,595,171 · App. 14/993,889 · Granted Mar 14, 2017

Methods and systems for augmentative and alternative communication

Inventors: Richard Hurtig (Philadelphia, PA); Benjamin Berkowitz (Iowa City, IA); Blake Earl Martinson (Charlotte, NC); Zihan Zhu (Iowa City, IA); Richard Rives Bird (Coralville, IA)
Assignee: University of Iowa Research Foundation
G08B5/222G06F3/011G06F3/013G06F3/017G06F3/0418G06F3/0487G06F3/04883G06F3/167H03K17/962G06F2203/038G06F2203/0381H03K2217/96003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,595,171
App. No.
14/993,889
Filed
Jan 12, 2016
Granted
Mar 14, 2017
Kind
B2
Art Unit
2683
USPC
340/4.11
Abstract

Methods and systems for augmentative and alternative communication are disclosed. An example method can comprise receiving a candidate input, classifying the candidate input as an intentional input, and generating a signal in response to the intentional input.

Claims (63)

1. A method for communication, comprising:

detecting, by a computing device, a connection with a sensor configured to detect only a single gesture, wherein the computing device is configured to connect with a plurality of sensors of different types;

determining, by the computing device, a type of the sensor;

determining, by the computing device, a filter based on the type of the sensor, wherein the filter is generated based on analysis of signals associated with the type of sensor and configured the computing device to classify gestures as intentional or unintentional based on a first timing threshold and a frequency characteristic;

receiving, by the computing device from the sensor, a signal representing a plurality of candidate inputs detected by the sensor;

classifying, by the computing device, the plurality of candidate inputs as one or more intentional inputs based on the first timing threshold and the frequency characteristic;

determining, by the computing device, timing information indicative of a time difference between receiving a first input signal of the one or more intentional inputs and receiving a second input signal of the one or more intentional inputs;

determining, by the computing device, that the one or more intentional inputs are relevant to a single command based on the timing information;

counting, by the computing device, a number of the one or more intentional inputs relevant to the single command;

selecting, by the computing device, a target device from a plurality of devices, based on the number of the one or more intentional inputs relevant to the single command, wherein each of the plurality of devices is associated with a respective number and a number of the target device matches the number of the one or more intentional outputs relevant to the single command; and

providing a signal to the selected target device in response to the intentional input.

2. The method of claim 1 , wherein the sensor comprises a touch sensor, a pressure sensor, a mechanical sensor, an optical reflectance sensor, an infrared reflectance sensor, a light sensor, a proximity detector, a capacitance sensor, an audio sensor, or a camera.

3. The method of claim 1 , wherein providing the signal to the selected target device in response to the intentional input comprises activating one or more of a nurse call switch, a computer, a television, a fan, a light, a telephone, and a medical device.

4. The method of claim 1 , wherein providing the signal to the selected target device in response to the intentional input comprises controlling one or more controlled devices.

5. The method of claim 1 , wherein the type of the sensor is determined based on a voltage level of a signal received from the sensor.

6. The method of claim 1 , wherein the type of the sensor is determined based on a code received from the sensor.

7. The method of claim 1 , further comprising determining an electrical resistance value of the connection with the sensor, wherein the type of the sensor is determined based on the electrical resistance value.

8. The method of claim 1 , further comprising:

receiving a second plurality of candidate inputs from the sensor;

classifying the second plurality of candidate inputs as one or more second intentional inputs; and

determining a command for controlling the target device based on the one or more second intentional inputs, wherein providing the signal to the selected target device comprises providing a signal indicative of the command to the selected target device in response to the intentional input.

9. The method of claim 8 , wherein the command comprises a command for an application on the target device.

10. The method of claim 8 , wherein the command is determined based on a number of the one or more second intentional inputs received during a time window.

11. The method of claim 8 , wherein the command is determined based on which target device is selected from among the plurality of devices.

12. The method of claim 1 , wherein the sensor comprises a single switch configured to provide signals based on a single gesture from a user.

13. A system, comprising:

a memory comprising computer-executable instructions; and

a processor functionally coupled to the memory and configured, by the computer-executable instructions, to perform at least the following actions,

detecting a connection with a sensor configured to detect only a single gesture, wherein the processor is configured to connect with a plurality of sensors of different types,

determining a type of the sensor,

determining a filter based on the type of the sensor, wherein the filter is generated based on analysis of signals associated with the type of sensor and configures the processor to classify gestures as intentional or unintentional based on a first timing threshold and a frequency characteristic,

receiving, from the sensor, a signal representing a plurality of candidate inputs detected by the sensor,

classifying the plurality of candidate inputs as one or more intentional inputs based on the first timing threshold and the frequency characteristic,

determining timing information indicative of a time difference between receiving a first input signal of the one or more intentional inputs and receiving a second input signal of the one or more intentional inputs,

determining that the one or more intentional inputs are relevant to a single command based on the timing information,

counting a number of the one or more intentional inputs relevant to the single command,

selecting a target device from a plurality of devices based on the number of the one or more intentional inputs relevant to the single command, wherein each of the plurality of devices is associated with a respective number and a number of the target device matches the number of the one or more intentional outputs relevant to the single command, and

providing a signal to the selected target device in response to the intentional input.

14. The system of claim 13 , wherein the sensor comprises a touch sensor, a pressure sensor, a mechanical sensor, an optical reflectance sensor, an infrared reflectance sensor, a light sensor, a proximity detector, a capacitance sensor, an audio sensor, or a camera.

15. The system of claim 13 , wherein providing the signal to the selected target device in response to the intentional input comprises activating one or more of a nurse call switch, a computer, a television, a fan, a light, a telephone, and a medical device.

16. The system of claim 13 , wherein providing the signal to the selected target device in response to the intentional input comprises controlling one or more controlled devices.

17. The system of claim 13 , wherein the type of the sensor is determined based on a voltage level of a signal received from the sensor.

18. The system of claim 13 , wherein the type of the sensor is determined based on a code received from the sensor.

19. The system of claim 13 , wherein the processor is further configured for determining an electrical resistance value of the connection with the sensor, wherein the type of the sensor is determined based on the electrical resistance value.

20. The system of claim 13 , wherein the processor is further configured for:

receiving a second plurality of candidate inputs from the sensor;

classifying the second plurality of candidate inputs as one or more second intentional inputs; and

determining a command for controlling the target device based on the one or more second intentional inputs, wherein providing the signal to the selected target device comprises providing a signal indicative of the command to the selected target device in response to the intentional input.

21. The system of claim 20 , wherein the command comprises a command for an application on the target device.

22. The system of claim 20 , wherein the command is determined based on a number of the one or more second intentional inputs received during a time window.

23. The system of claim 20 , wherein the command is determined based on which target device is selected from among the plurality of devices.

24. The system of claim 13 , wherein the sensor comprises a single switch configured to provide signals based on a single gesture from a user.

25. A non-transitory computer-readable medium comprising computer-executable instructions that when executed by a processor perform the method comprising:

detecting, by a computing device, a connection with a sensor configured to detect only a single gesture, wherein the computing device is configured to connect with a plurality of sensors of different types;

determining, by the computing device, a type of the sensor;

determining, by the computing device, a filter based on the type of the sensor, wherein the filter is generated based on analysis of signals associated with the type of sensor and configures the computing device to classify gestures as intentional or unintentional based on a first timing threshold and a frequency characteristic;

receiving, by he computing device from the sensor, a signal representing a plurality of candidate inputs detected by the sensor;

classifying, by the computing device, the plurality of candidate inputs as one or more intentional inputs based on the first timing threshold and the frequency characteristic;

determining, by the computing device, timing information indicative of a time difference between receiving a first input signal of the one or more intentional inputs and receiving a second input signal of the one or more intentional inputs;

determining, by the computing device, that the one or more intentional inputs are relevant to a single command based on the timing information;

counting, by the computing device, a number of the one or more intentional inputs relevant to the single command;

selecting, by the computing device, a target device from a plurality of devices, based on the number of the one or more intentional inputs relevant to the single command, wherein each of the plurality of devices is associated with a respective number and a number of the target device matches the number of the one or more intentional outputs relevant to the single command; and

providing a signal to the selected target device in response to the intentional input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2016
From: HURTIG, RICHARD; MARTINSON, BLAKE EARL; BERKOWITZ, BENJAMIN; ZHU, ZIHAN
To: UNIVERSITY OF IOWA RESEARCH FOUNDATION
Reel/Frame 040468/0920 →
Continuity (3)
Continuation In Part PCTUS2014046356 · Jul 11, 2014
Provisional Application 61845673 · Jul 12, 2013
Related Publication 20160125705A1 · May 5, 2016