IP Library Granted Patent US 10,181,331
Granted Patent B2
US 10,181,331 · App. 15/795,054 · Granted Jan 15, 2019

Method and system for transforming language inputs into haptic outputs

Inventors: David Eagleman (Palo Alto, CA); Scott Novich (Palo Alto, CA)
Assignee: NEOSENSORY, INC.
G10L21/16G06F3/016G08B6/00G10L13/00G10L15/02G10L15/22G10L2015/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,181,331
App. No.
15/795,054
Granted
Jan 15, 2019
Kind
B2
Abstract

A method for transforming input information into outputs, preferably including: receiving input information; transforming the input information into a set of intermediary components; implementing a transformation model with the set of intermediary components, the transformation model operable to encode the set of intermediary components across a set of output parameters in a device domain associated with a device; and executing control signals operable to deliver outputs, based on the set of output parameters, to a user of the device.

Claims (41)

1. A method for providing information to a user, the method comprising:

establishing a physical interface between a user and a haptic output system comprising a plurality of haptic actuators defining a spatial distribution, each of the plurality of haptic actuators arranged at a nonzero offset from a skin surface of the user;

receiving a text input representative of communication in a language;

generating a speech component-based transcription based on the text input, wherein the speech component-based transcription comprises a series of speech components, the series of speech components comprising a set of phonemes and an English language plural morpheme;

determining a series of spatial representations in a device domain of the haptic output system, the series of spatial representations corresponding to the series of speech components; and

at the haptic output system, for each spatial representation of the series of spatial representations: providing a haptic output corresponding to the spatial representation, comprising, for each haptic actuator of the plurality:

mapping a respective location of the haptic actuator to a corresponding location within the spatial distribution;

based on a value of the spatial representation associated with the corresponding location, determining a respective actuation parameter; and

controlling the haptic actuator to actuate based on the respective actuation parameter.

2. The method of claim 1 , further comprising receiving a personal communication comprising the text input.

3. The method of claim 1 , wherein the text input is received via SMS.

4. The method of claim 1 , further comprising determining a set of speech components based on the language, wherein the set of speech components comprises each speech component of the series of speech components.

5. The method of claim 1 , wherein:

the plurality of haptic actuators substantially define a multidimensional array; and

the spatial representation is defined on a multidimensional space, wherein the multidimensional space and the multidimensional array have equal dimensionality.

6. The method of claim 1 , wherein the text input is received by a user device, the method further comprising transmitting the series of spatial representations from the user device to the haptic output system.

7. The method of claim 1 , wherein:

the haptic output system further comprises a wearable vest garment coupled to each haptic actuator of the plurality; and

the method comprises mechanically coupling the haptic output system to the user comprises clothing the user with the vest garment, wherein each of the haptic actuators is arranged at a nonzero offset from the skin surface of the user through a material of the vest.

8. The method of claim 1 , wherein:

the plurality of haptic actuators are mechanically coupled to a vehicle; and

the method comprises mechanically coupling the haptic output system to the user comprises supporting the user in a seat of the vehicle.

9. A method for providing information to a user, the method comprising:

at a client of a user device, receiving a personal communication associated with the user, the personal communication comprising a text representation;

generating a speech component-based transcription based on the text representation, wherein the speech component-based transcription comprises a series of speech components, the series of speech components comprising a set of phonemes and an English language plural morpheme;

determining a series of haptic outputs corresponding to the series of speech components;

at the client, wirelessly transmitting a dataset to a haptic output system coupled to the user, wherein the dataset comprises at least one of: the text representation, the series of speech components, and the series of haptic outputs; and

at the haptic output system, providing each haptic output of the series of haptic outputs to the user, wherein each of the series of haptic outputs is provided at a nonzero offset from a skin surface of the user.

10. The method of Claim 9 , wherein the text representation is received via a wireless communication technique.

11. The method of Claim 9 , wherein the text representation is received via a messaging client of the user device.

12. The method of Claim 9 , wherein the haptic output system comprises a plurality of haptic output devices.

13. The method of claim 12 , wherein, for each speech component of the series of speech components, determining the corresponding haptic output comprises, based on the speech component, selecting a haptic output device of the plurality of haptic output devices to actuate.

14. The method of claim 13 , wherein for each speech component of the series of speech components, determining the corresponding haptic output further comprises determining a time-dependent actuation pattern based on an emphasis of the speech component.

15. The method of Claim 9 , wherein the haptic output system comprises a wearable garment.

16. The method of claim 15 , wherein, while providing each haptic output to the user, the garment encircles a limb of the user.

17. The method of Claim 9 , wherein the haptic output system is mechanically coupled to a seat.

18. A method for providing information to a user, the method comprising:

receiving an information set for the user, the information set comprising audio data;

generating a speech component-based representation based on the information set, wherein the speech component-based representation comprises a series of speech components, wherein the series of speech components comprises a set of phonemes and an English language plural morpheme;

determining a series of haptic outputs corresponding to the series of speech components; and

at a haptic output system coupled to the user, the haptic output system comprising a set of vibration motors, providing each haptic output of the series of haptic outputs to the user, each of the series of haptic actuators is provided at a nonzero offset from a skin surface of the user.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2026
From: NEOSENSORY, INC.
To: ESSILOR INTERNATIONAL
Reel/Frame 074271/0953 →
RELEASE OF SECURITY INTEREST Recorded May 27, 2025
From: WTI FUND X, INC.
To: NEOSENSORY, INC.
Reel/Frame 071229/0943 →
SECURITY INTEREST Recorded Mar 14, 2024
From: NEOSENSORY, INC.
To: WTI FUND X, INC.
Reel/Frame 066779/0502 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2018
From: EAGLEMAN, DAVID; NOVICH, SCOTT
To: NEOSENSORY, INC.
Reel/Frame 044587/0468 →
Continuity (3)
Provisional Application 62460028 · Feb 16, 2017
Provisional Application 62486319 · Apr 17, 2017
Related Publication 20180233163A1 · Aug 16, 2018
Cited By (6)
US 12,193,840 US 12,318,220 US 12,318,221 US 12,396,680 US 12,543,000 US 12,702,357