IP Library Granted Patent US 10,121,388
Granted Patent B2
US 10,121,388 · App. 14/700,102 · Granted Nov 6, 2018

Methods, systems, and apparatuses to convey chorded input

Inventors: Caitlyn Seim (Atlanta, GA); Thad Eugene Starner (Atlanta, GA)
Assignee: Georgia Tech Research Corporation
G09B19/00G09B15/00G09B21/00G09B21/001G09B21/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,121,388
App. No.
14/700,102
Granted
Nov 6, 2018
Kind
B2
Abstract

Disclosed herein are methods, systems, computer readable media, and apparatuses for conveying chorded input to a user. Chorded input can be conveyed by one or more sequences of stimulation events, wherein each sequence represents a particular chorded input.

Claims (35)

1. A method of conveying a first and a second chorded input, the first chorded input comprising a first set of multiple actions to be undertaken simultaneously and the second chorded input comprising a second set of multiple actions to be undertaken simultaneously, the method comprising:

generating, by a processor in electrical communication with a plurality of actuators and an output device, a first stimulation sequence, the first stimulation sequence comprising instructions for sequentially activating, with a predetermined temporal offset between sequential activations, a first plurality of the plurality of actuators in a first sequential order, the predetermined temporal offset being selected by the processor;

according to the instructions of the first stimulation sequence, generating, by the processor, a first plurality of stimulation sequence signals configured to cause a first plurality of activations in which each of the first plurality of the plurality of actuators is activated in the first sequential order, wherein each of the first plurality of activations is a discrete stimulation event representing an action of the first set of multiple actions, the first plurality of activations conveying the first chorded input by sequentially representing each action of the first set of multiple actions to be undertaken simultaneously;

responsive to the first plurality of the plurality of actuators activating in the first sequential order, generating, by the processor, an output signal to cause a perceptible indication by the output device;

generating, by the processor, a second stimulation sequence, the second stimulation sequence comprising instructions for activating a second plurality of the plurality of actuators in a second sequential order; and

according to the instructions of the second stimulation sequence, generating, by the processor, a second plurality of stimulation sequence signals configured to cause a second plurality of activations in which each of a second plurality of the plurality of actuators is activated in the second sequential order, wherein each of the second plurality of activations is a discrete stimulation event representing an action of the second set of multiple actions, the second plurality of activations conveying the second chorded input by sequentially representing each action of the second set of multiple actions to be undertaken simultaneously.

2. The method of claim 1 , wherein a first activation and a second activation of the first plurality of activations are separated by a first predetermined offset such that the first activation begins at a first time and the second activation begins at a second time that is equal to the first time plus a duration of time equal to the first predetermined offset.

3. The method of claim 1 , wherein a first activation and a second activation of the second plurality of activations are separated by a second predetermined offset such that the first activation begins at a first time and the second activation begins at a second time that is equal to the first time plus a duration of time equal to the second predetermined offset.

4. The method of claim 1 , wherein the first and/or the second chorded input is conveyed via passive haptic learning such that each stimulation event comprises a haptic event to be experienced by a user.

5. The method of claim 1 , wherein each stimulation event is a vibrational stimulation, an audio stimulation, a tactile stimulation, or a combination thereof.

6. The method of claim 1 , wherein execution of the second stimulation sequence begins from 100 milliseconds to 1 second after the first plurality of activations ends.

7. The method of claim 1 , wherein the first and/or the second chorded input represents a word, a letter, a syllable, a code, a number, a symbol, a musical note, a musical chord, or a combination thereof.

8. The method of claim 1 , wherein each of the plurality of actuators is positioned on or within a wearable device configured to stimulate a portion of a device-wearer's body.

9. The method of claim 8 , wherein the wearable device comprises a glove, wherein the portion of the device-wearer's body comprises a left hand or a right hand, and wherein each of the actuators is configured to stimulate via vibrating a portion of the left hand or the right hand.

10. The method of claim 1 further comprising: before executing the first stimulation sequence, generating, by a processor, a signal to cause a parsing device to generate a parsing indication to a user.

11. The method of claim 10 , wherein the parsing indication represents a letter of the alphabet.

12. The method of claim 10 , wherein the parsing indication comprises a visual cue, an audible sound, a pause, a vibration, or a combination thereof.

13. The method of claim 12 , wherein the parsing indication comprises a visual cue, and wherein the device comprises a screen of a wearable headset configured for display of the visual cue.

14. The method of claim 2 , wherein the first predetermined time offset is from 5 milliseconds to 50 milliseconds.

15. The method of claim 1 , wherein each of the plurality of actuators comprise a vibration motor, a speaker, a bone-conduction device, or a combination thereof.

16. The method of claim 1 , wherein the perceptible indication comprises a visual cue, an audible sound, a pause, a vibration, or a combination thereof.

17. The method of claim 16 , wherein the perceptible indication comprises an audible sound, and wherein the output device comprises an audio output device configured to generate the audible sound.

18. A non-transitory computer-readable medium that stores instructions that, when executed by at least one processor, causes the at least one processor to perform a method of conveying a first and a second chorded input, the first chorded input comprising a first set of multiple actions to be undertaken simultaneously and the second chorded input comprising a second set of multiple actions to be undertaken simultaneously, the method comprising:

generating, by a processor in electrical communication with a plurality of actuators and an output device, a first stimulation sequence, the first stimulation sequence comprising instructions for sequentially activating, with a predetermined temporal offset between sequential activations, a first plurality of the plurality of actuators in a first sequential order, the predetermined temporal offset being selected by the processor;

according to the instructions of the first stimulation sequence, generating, by the processor, a first plurality of stimulation sequence signals configured to cause a first plurality of activations in which each of the first plurality of the plurality of actuators is activated in the first sequential order, wherein each of the first plurality of activations is a discrete stimulation event representing an action of the first set of multiple actions, the first plurality of activations conveying a first chorded input by sequentially representing each action of the first set of multiple actions to be undertaken simultaneously;

responsive to the plurality of actuators activating in the first sequential order, generating, by the processor, an output signal to cause a perceptible indication by the output device;

generating, by the processor, a second stimulation sequence, the second stimulation sequence comprising instructions for activating a second plurality of the plurality of actuators in a second sequential order; and

according to the instructions of the second stimulation sequence, generating, by the processor, a second plurality of stimulation sequence signals configured to cause a second plurality of activations in which each of a second plurality of the plurality of actuators is activated in the second sequential order, wherein each of the second plurality of activations is a discrete stimulation event representing an action of the second set of multiple actions, the second plurality of activations conveying the second chorded input by sequentially representing each action of the second set of multiple actions to be undertaken simultaneously.

19. A system for conveying a first and a second chorded input, the first chorded input comprising a first set of multiple actions to be undertaken simultaneously and the second chorded input comprising a second set of multiple actions to be undertaken simultaneously, the system comprising:

at least one memory operatively coupled to at least one processor and configured for storing data and instructions that, when executed by the at least one processor, cause the system to:

generate, by a processor in electrical communication with a plurality of actuators and an output device, a first stimulation sequence, the first stimulation sequence comprising instructions for sequentially activating, with a predetermined temporal offset between sequential activations, a first plurality of the plurality of actuators in a first sequential order, the predetermined temporal offset being selected by the processor;

according to the instructions of the first stimulation sequence, generate, by the processor, a first plurality of stimulation sequence signals configured to cause a first plurality of activations in which each of the first plurality of the plurality of actuators is activated in the first sequential order, wherein each of the first plurality of activations is a discrete stimulation event representing an action of the first set of multiple actions, the first plurality of activations conveying the first chorded input by sequentially representing each action of the first set of multiple actions to be undertaken simultaneously;

responsive to the plurality of actuators activating in the first sequential order, generate, by the processor, an output signal to cause a perceptible indication by the output device;

generate, by the processor, a second stimulation sequence, the second stimulation sequence comprising instructions for activating a second plurality of the plurality of actuators in a second sequential order; and

according to the instructions of the second stimulation sequence, generate, by the processor, a second plurality of stimulation sequence signals configured to cause a second plurality of activations in which each of a second plurality of the plurality of actuators is activated in the second sequential order, wherein each of the second plurality of activations is a discrete stimulation event representing an action of the second set of multiple actions, the second plurality of activations conveying the second chorded input by sequentially representing each action of the second set of multiple actions to be undertaken simultaneously.

Assignments (2)
CONFIRMATORY LICENSE Recorded Mar 16, 2018
From: GEORGIA INSTITUTE OF TECHNOLOGY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 045616/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2017
From: STARNER, THAD EUGENE; SEIM, CAITLYN
To: GEORGIA TECH RESEARCH CORPORATION
Reel/Frame 041201/0241 →
Continuity (2)
Provisional Application 61985519 · Apr 29, 2014
Related Publication 20150310762A1 · Oct 29, 2015
Cited By (2)
US 12,373,035 US 12,469,476