Haptic feedback sensations based on audio output from computer devices
Triggering haptic sensations based on sound output from a computer device. A portion of sound data is stored that is output to a user as audio from an application program running on a computer. The portion of sound data is analyzed using intelligent heuristics to extract at least one sound feature from the sound data. The execution of at least one haptic effect is triggered based on the sound feature, where the haptic effect is commanded to the haptic feedback device approximately correlated to the output of the portion of sound to the user as audio. The haptic effect causes a haptic sensation to be output to the user. Different haptic effects can be associated with different sound features, frequency ranges, amplitudes, etc.
1. A method, comprising:
storing at least a portion of sound data in a memory buffer of a computer, wherein the sound data is to be analyzed by a processor to output a haptic effect from the analyzed sound data;
dividing at least a portion of the sound data into a plurality of frequency ranges, at least one of the frequency ranges associated with a periodic haptic effect;
analyzing each frequency range by the processor to determine one or more sound features corresponding to at least one of the frequency ranges; and
triggering execution of at least one haptic effect based on the determined one or more sound features.
2. The method of claim 1 wherein the portion of sound data is divided into a plurality of frequency ranges by applying a plurality of filters to the portion of sound data.
3. The method of claim 2 , the plurality of filters having at least:
a low-pass filter; and
a high-pass filter.
4. The method of claim 2 , the analyzing including separating the portion of sound data into a plurality of frequency components associated with a plurality of frequency ranges using a fast Fourier transform (FFT).
5. The method of claim 4 , wherein a number of outputs from the fast Fourier transform are grouped to provide sound features associated with each frequency range from the plurality of frequency ranges.
6. The method of claim 1 , wherein the at least one haptic effect was previously mapped to the at least one sound feature.
7. The method of claim 2 , further comprising:
computing an average of sound magnitudes in each frequency range, wherein the determined one or more sound features have a sound magnitude above a threshold value from the average.
8. A computer readable medium encoded with a computer program having code capable of being read by a processor, the code comprising:
code to store at least a portion of sound data in a memory buffer of a computer wherein the sound data is to be analyzed by a processor to output a haptic from the analyzed sound data;
code to divide at least a portion of sound data into a plurality of frequency ranges, at least one of the frequency ranges associated with a periodic haptic effect;
code to cause the processor to analyze each frequency range to determine one or more sound features corresponding to at least one of the frequency ranges; and
code to trigger execution of at least one haptic effect based on the determined one or more sound features.
9. The computer readable medium of claim 8 , wherein at least one haptic effect is associated with the at least one frequency component.
10. The computer readable medium of claim 8 wherein the portion of sound data is divided into a plurality of frequency ranges by applying a plurality of filters to the portion of sound data.
11. The computer medium readable of claim 10 , the code to analyze including code to separate the portion of sound data into a plurality of frequency components associated with a plurality of frequency ranges using a fast Fourier transform (FFT).
12. The computer readable medium of claim 8 , wherein the at least one haptic effect was previously mapped to the at least one sound feature.
13. The computer readable medium of claim 8 , the code further comprising:
code to compute an average of sound magnitudes in each frequency range, wherein the determined one or more sound features have a sound magnitude above a threshold value from the average.
14. An apparatus, comprising:
means for storing at least a portion sound data in a memory buffer of a computer, wherein the sound data is to be analyzed by a processor to output a haptic effect from the analyzed sound;
means for dividing at least a portion of sound data into a plurality of frequency ranges, at least one of the frequency ranges associated with a periodic haptic effect;
means for analyzing each frequency range to determine one or more sound features corresponding to at least one of the frequency ranges, wherein said means for analyzing is performed by the processor; and
means for triggering execution of at least one haptic effect based on the determined one or more sound features.
15. The apparatus of claim 14 , further comprising:
means for computing an average of sound magnitudes in each frequency range, wherein the determined one or more sound features have a sound magnitude above a threshold value from the average.