Providing information to a user through somatosensory feedback
View Patent ↗A hearing device may provide hearing-to-touch sensory substitution as a therapeutic approach to deafness. Through use of signal processing on received signals, the hearing device may provide better accuracy with the hearing-to-touch sensory substitution by extending beyond the simple filtering of an incoming audio stream as found in previous tactile hearing aids. The signal processing may include low bitrate audio compression algorithms, such as linear predictive coding, mathematical transforms, such as Fourier transforms, and/or wavelet algorithms. The processed signals may activate tactile interface devices that provide touch sensation to a user. For example, the tactile interface devices may be vibrating devices attached to a vest, which is worn by the user. The vest may also provide other types of information to the user.
1. An apparatus, comprising:
an input device;
a processing module configured to control an array of tactile interface devices and coupled to the input device, wherein the processing module is configured to control the array of tactile interface devices by performing the steps of:
receiving samples of a data signal from the input device;
selecting a window of samples from the received samples of the data signal;
transforming the data samples of the window of samples into spatial patterns by transforming an N-dimensional signal of a first rate within the window of samples into a higher K-dimensional signal of a second slower rate, wherein the second rate corresponds to a rate capable of conveyance to a user through the array of tactile interface devices; and
generating control signals for operating the array of tactile interface devices by mapping the spatial patterns to one or more devices of the array of tactile interface devices.
2. The apparatus of claim 1 , wherein the processing module is configured to transform the data samples into special patterns by transforming the data samples from a time domain to a space domain, and wherein the processing module is further configured to compress the transformed data samples to reduce a dimensionality of the data samples.
3. The apparatus of claim 1 , wherein the tactile interface devices comprise at least one of eccentric rotating mass (ERM) motors, piezoelectric interfaces, and/or vibrating solenoids.
4. The apparatus of claim 1 , wherein the input device comprises at least one of a microphone, a network adapter, and a camera.
5. The apparatus of claim 1 , wherein the processing module comprises a smart phone, wherein the input devices comprises a microphone integrated with the smart phone, and wherein the data signal comprises an audio signal.
6. The apparatus of claim 1 , further comprising a tactile interface microcontroller coupled to the array of tactile interface devices, wherein the tactile interface microcontroller is configured to receive the generated control signals and activate individual tactile interface devices of the array of tactile interface devices.
7. The apparatus of claim 1 , wherein the processing module is configured to perform signal decomposition on the data samples.
8. The apparatus of claim 7 , wherein the processing module is configured to transform the data samples with a discrete cosine transform (DCT) to obtain a set of coefficients, and wherein the processing module is further configured to compress the transformed data samples by reducing the resulting set of coefficients to a smaller second set of coefficients, wherein each of the second set of coefficients corresponds to a device in the array of tactile interface devices or may map to a more complex tactile pattern that spans multiple devices in the array of tactile interface devices.
9. The apparatus of claim 8 , wherein the second set of coefficients are mapped to the array of tactile interface devices based on mapping data retrieved from a configuration file.
10. The apparatus of claim 1 , wherein the processing module is configured to perform feature extraction on the data samples.
11. The apparatus of claim 10 , wherein the processing module is configured to transform the data samples by deriving a digital finite impulse response (FIR) filter for one or more data samples, wherein the produced FIR filter for a data sample comprises coefficients that approximate the data sample, and wherein the processing module is configured to translate the predictive FIR coefficients for a data sample into a frequency-domain representation set of line spectral pairs (LSPs).
12. The apparatus of claim 11 , wherein the processing module is configured to generate control signals by quantizing each LSP from the set of LSPs based on a mapping from this set to the array of tactile interface devices.
13. A method, comprising:
receiving samples of a data signal, wherein the samples correspond to a window of time;
transforming the samples from a time domain to a space domain to reduce a data rate of the samples, wherein the transformed samples are represented to a set of coefficients;
compressing the set of coefficients representing the transformed samples to reduce a dimensionality of the transformed samples; and
generating control signals for operating an array of tactile interface devices by mapping the compressed samples to one or more devices of the array of tactile interface devices.
14. The method of claim 13 , wherein the step of receiving samples of a data signal comprises receiving audio samples of an audio signal.
15. The method of claim 13 , wherein the step of transforming the samples comprises performing signal decomposition on the data samples.
16. The method of claim 15 , wherein the step of transforming the samples comprises transforming the samples with a discrete cosine transform (DCT) to obtain a set of coefficients, and wherein the step of compressing the transformed samples comprises compressing the transformed samples by reducing the dimensionality of the resulting set of coefficients to a smaller second set of coefficients, wherein each of the second set of coefficients corresponds to one or more devices of the array of tactile interface devices.
17. The method of claim 16 , further comprising:
retrieving a configuration file comprising mapping data; and
mapping the second set of coefficients to the array of tactile interface devices based on the mapping data, wherein the generated control signals are based, at least in part, on the mapping of the first or second set of coefficients to the array of tactile interface devices.
18. The method of claim 13 , wherein the step of transforming the samples comprises transforming the samples using a digital filter.
19. The method of claim 18 , wherein the step of transforming the samples comprises transforming the samples by deriving a digital finite impulse response (FIR) filter for a set of one or more samples, wherein the produced FIR filter for a sample comprises coefficients that approximate the sample, and wherein the step of compressing the samples comprises converting the predicted FIR coefficients for a sample into a frequency-domain representation set of line spectral pairs (LSPs).
20. The method of claim 19 , wherein the step of generating control signals comprises quantizing each LSP from the set of LSPs based on a mapping from this set to the array of tactile interface devices.
21. A computer program product, comprising:
a non-transitory computer readable medium comprising code to perform the steps comprising:
receiving samples of a data signal;
transforming the samples from a time domain to a space domain to reduce a data rate of the samples;
compressing the transformed samples to reduce a dimensionality of the transformed samples; and
generating control signals for operating an array of tactile interface devices by mapping the compressed samples to individual devices of the array of tactile interface devices.
22. The computer program product of claim 21 , wherein the step of receiving samples of a data signal comprises receiving audio samples of an audio signal.
23. The computer program product of claim 21 , wherein the step of transforming the samples comprises performing signal decomposition on the data samples.
24. The computer program product of claim 23 , wherein the step of transforming the samples comprises transforming the samples with a discrete cosine transform (DCT) to obtain a resulting set of coefficients, and wherein the step of compressing the transformed samples comprises compressing the transformed samples by reducing the resulting set of coefficients to a smaller second set of coefficients, wherein each of the second set of coefficients corresponds to one or more devices of the array of tactile interface devices.
25. The computer program product of claim 24 , wherein the medium further comprises code to perform the steps of:
retrieving a configuration file comprising mapping data; and
mapping the second set of coefficients to the array of tactile interface devices based on the mapping data, wherein the generated control signals are based, at least in part, on the mapping of the first or second set of coefficients to the array of tactile interface devices.
26. The computer program product of claim 21 , wherein the step of transforming the samples using a digital filter.
27. The computer program product of claim 26 , wherein the step of transforming the samples comprises deriving a digital finite impulse response (FIR) filter for a set of one or more samples, wherein the produced FIR filter for a sample comprises coefficients that approximate the sample, and wherein the step of compressing the samples comprises converting the predicted FIR coefficients for a sample into a frequency-domain representation set of line spectral pairs (LSPs).
28. The computer program product of claim 26 , wherein the step of generating control signals comprises quantizing each LSP from the set of LSPs based on a mapping from this set to the array of tactile interface devices.