Haptic communication using dominant frequencies in speech signal
View Patent ↗Embodiments relate to performing haptic communication using frequency decomposition of speech where dominant frequencies of a speech is detected at a speech source and then sent to a signal generator to actuate actuators mapped to the dominant frequencies. The digitized version of the speech is segmented into a plurality of frames and then a predetermined number of dominant frequencies are detected from each frame. The dominant frequencies of frequencies are sent over to the signal generator so that the actuators corresponding to the dominant frequencies are activated for a time period corresponding to the frame.
1. A method, comprising:
generating a digitized version of a speech signal;
processing the digitized speech signal to generate processed speech signal by:
at least segmenting the digitized signal into frames, each of the frames having a predetermined length, and
performing spectral estimation on each of the frames to generate a frequency domain spectrum;
detecting dominant frequencies in the processed speech signal in each of the frames by at least determining a first dominant frequency at which a magnitude of the frequency domain spectrum is highest, to generate dominant frequency information; and
providing the detected dominant frequencies to generate actuator signals for activating cutaneous actuators on a receiving user's skin.
2. The method of claim 1 , wherein processing the digitized speech signal further comprises setting to zero the frequency domain spectrum below a first frequency point and beyond a second frequency point higher than the first frequency point.
3. The method of claim 1 , wherein processing the digitized speech signal further comprises:
detecting next dominant frequencies having respective magnitude of the frequency domain spectrum that are next highest after the first dominant frequency in each of the frames, and are separated from one or more prior dominant frequencies including the first dominant frequency by at least a predetermined frequency distance.
4. The method of claim 1 , wherein the spectral estimation is performed using Fast Fourier Transform (FFT).
5. The method of claim 1 , wherein each of the detected dominant frequencies is mapped to a respective one of the cutaneous actuators that are activated on the receiving user's skin.
6. The method of claim 1 , further comprising generating the actuator signals that activates cutaneous actuators mapped to the detected dominant frequencies for a period corresponding to each frame.
7. The method of claim 6 , wherein the period is longer or shorter than a length of the frame.
8. A haptic system comprising:
an analog-to-digital converter configured to generate a digitized version of a speech signal;
a frequency decomposition encoder configured to:
process the digitized speech signal to generated processed speech signal by (i) at least segmenting the digitized signal into frames, each of the frames having a predetermined length, and (ii) performing spectral estimation on each of the frames to generate a frequency domain spectrum, and
detect dominant frequencies in the processed speech signal in each of the frames by at least determining a first dominant frequency at which a magnitude of the frequency domain spectrum is highest, to generate dominant frequency information; and
a communication module configured to provide the detected dominant frequencies to generate actuator signals for activating cutaneous actuators on a receiving user's skin.
9. The haptic system of claim 8 wherein the frequency decomposition encoder is further configured to set to zero the frequency domain spectrum below a first frequency point and beyond a second frequency point higher than the first frequency point.
10. The haptic system of claim 8 wherein the frequency decomposition encoder is further configured to detect next dominant frequencies having respective magnitudes in the frequency domain spectrum that are next highest after the first dominant frequency in each of the frames, and are separated from one or more prior dominant frequencies including the first dominant frequency by at least a predetermined frequency distance.
11. The haptic system of claim 8 wherein the spectral estimation is performed using Fast Fourier Transform (FFT).
12. The haptic system of claim 8 wherein each of the detected dominant frequencies is mapped to a respective one of the cutaneous actuators that are activated on the receiving user's skin.
13. The haptic system of claim 8 wherein the actuator signals for activating cutaneous actuators mapped to the detected dominant frequencies for a period corresponding to each frame.
14. The haptic system of claim 13 , wherein the period is longer or shorter than a length of the frame.
15. A non-transitory computer-readable storage medium storing instructions, the instructions when executed by a processor cause the processor to:
generate a digitized version of a speech signal;
process the digitized speech signal to generate processed speech signal by (i) at least segmenting the digitized signal into frames, each of the frames having a predetermined length and (ii) performing spectral estimation on each of the frames to generate a frequency domain spectrum;
detect dominant frequencies in the processed speech signal in each of the frames by at least determining a first dominant frequency at which a magnitude of the frequency domain spectrum is highest, to generate dominant frequency information; and
provide the detected dominant frequencies to generate actuator signals for activating cutaneous actuators on a receiving user's skin.
16. The non-transitory computer-readable storage medium of claim 15 , wherein each of the detected dominant frequencies is mapped to a respective one of the cutaneous actuators that are activated on the receiving user's skin.
17. The non-transitory computer-readable storage medium of claim 16 , further storing instructions that cause the processor to generate the actuator signals that activates cutaneous actuators mapped to the detected dominant frequencies for a period corresponding to each frame.