Haptic conversion system using segmenting and combining

1. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert an input into one or more haptic effects using segmenting and combining, the converting comprising:

receiving the input;

segmenting the input into input sub-signals, the segmenting comprising filtering the input using one or more filters, wherein each of the input sub-signals comprises a different frequency band that is output from a respective filter;

after the segmenting, prioritizing the input sub-signals based on an analysis parameter, wherein the prioritizing comprises determining for each of the input sub-signals, a value of a characteristic that is defined by the analysis parameter of the input sub-signal, and ordering the input sub-signals based on the determined values;

selecting a subset of the input sub-signals from the input sub-signals based on the prioritizing, wherein the subset is less than the input sub-signals;

calculating a haptic signal based on a combination of the selected subset of input sub-signals, the calculating the haptic signal including:

converting the subset of input sub-signals into haptic sub-signals wherein the converting includes multiplying an input sub-signal by a factor, and

summing the haptic sub-signals into the haptic signal and normalizing the haptic signal; and

generating the one or more haptic effects based on the haptic signal.

2. The computer-readable medium of claim 1 , wherein the one or more filters comprise at least one band-pass filter.

3. The computer-readable medium of claim 1 , wherein the receiving the input further comprises receiving a segment of an input signal.

4. The computer-readable medium of claim 3 , wherein the analysis parameter comprises a maximum magnitude value for each of the input sub-signals.

5. The computer-readable medium of claim 1 ,

wherein the characteristic comprises one of: a frequency, a duration, an envelope, a density, or a magnitude.

6. The computer-readable medium of claim 1 , the converting further comprising:

warping the haptic signal into a warped haptic signal, the warping based on a type of haptic output device that is configured to play the warped haptic signal;

wherein the generating the one or more haptic effects further comprises generating the one or more haptic effects based on the warped haptic signal.

7. The computer-readable medium of claim 1 , wherein the receiving the input further comprises:

receiving a multimedia file; and

extracting an input signal from the multimedia file.

8. The computer-readable medium of claim 1 , wherein the converting the subset of input sub-signals into haptic sub-signals further comprises at least one of:

multiplying an input sub-signal by a factor and a sine carrier waveform;

multiplying the input sub-signal by a factor; or

shifting frequency content from a first frequency band of the input sub-signal to a second frequency band of the input sub-signal.

9. The computer-readable medium of claim 8 wherein each of the input sub-signals is converted into a haptic sub-signal using a unique haptic conversion algorithm.

10. The computer-readable medium of claim 8 , wherein the shifting the frequency content from the first frequency band of the input sub-signal to the second frequency band of the input sub-signal further comprises performing a fast Fourier transform of the input sub-signal.

11. The computer-readable medium of claim 10 , wherein the shifting the frequency content from the first frequency band of the input sub-signal to the second frequency band of the input sub-signal further comprises at least one of:

averaging fast Fourier transform values for frequencies within the first frequency band of the input sub-signal, and assigning the average to a frequency within the second frequency band of the input sub-signal;

summing fast Fourier transform values for frequencies within the first frequency band of the input sub-signal, and assigning the sum to a frequency within the second frequency band of the input sub-signal;

selecting a fast Fourier transform value that has a highest absolute value from fast Fourier transform values for frequencies within the first frequency band of the input sub-signal, and assigning the selected fast Fourier transform value to a frequency within the second frequency band of the input sub-signal;

assigning a fast Fourier transform value for a frequency within the first frequency band of the input sub-signal to frequencies within the second frequency band of the input sub-signal; or

assigning a fast Fourier transform value for a frequency within the first frequency band of the input sub-signal to a lowest frequency within the second frequency band of the input sub-signal.

12. The computer-readable medium of claim 1 , wherein the summing of the haptic sub-signals into the haptic signal comprises at least one of:

segmenting the haptic signal into one or more time-windows, analyzing frequencies of the haptic sub-signals for each time-window, and selecting a haptic sub-signal from the haptic sub-signals as the haptic signal for each time-window, wherein the selected haptic sub-signal comprises a frequency of the frequencies; or

segmenting the input signal into one or more time windows, calculating a power spectrum density percentage contribution for each of the input sub-signals of the input sub-signals for each time window, and calculating a weighted combination of the corresponding haptic sub-signals as the haptic signal for each time-window, wherein a weight of each haptic sub-signal is based on the power spectrum density percentage contribution of each corresponding input sub-signal.

13. The computer-readable medium of claim 1 , the converting further comprising:

normalizing the haptic signal to 1 using its maximum absolute value.

14. The computer-readable medium of claim 1 , the converting further comprising:

cleaning one or more noisy vibrations from the haptic signal.

15. The computer-readable medium of claim 14 , wherein the cleaning the one or more noisy vibrations from the haptic signal further comprises:

selecting one or more sample haptic sub-signals from the haptic signal;

calculating a mean absolute value for each selected sample haptic sub-signal of the one or more selected sample haptic sub-signals;

comparing each mean absolute value with a threshold; and

removing a sample haptic sub-signal from the haptic signal when its corresponding mean absolute value is less than the threshold.

16. The computer-readable medium of claim 1 , wherein the generating the one or more haptic effects further comprising sending the haptic signal to a haptic output device to generate the one or more haptic effects.

17. The computer-readable medium of claim 16 , wherein the haptic output device comprises an actuator.

18. The computer-readable medium of claim 1 , wherein the input comprises one of an audio signal, a video signal, or an acceleration signal.

19. A computer-implemented method for converting an input into one or more haptic effects using segmenting and combining, the computer-implemented method comprising:

receiving the input;

segmenting by a processor the input into input sub-signals, the segmenting comprising filtering the input using one or more filters, wherein each of the input sub-signals comprises a different frequency band that is output from a respective filter;

after the segmenting, prioritizing by the processor the input sub-signals based on an analysis parameter, wherein the prioritizing comprises determining for each of the input sub-signals, a value of a characteristic that is defined by the analysis parameter of the input sub-signal, and ordering the input sub-signals based on the determined values;

selecting by the processor a subset of the input sub-signals from the input sub-signals based on the prioritizing, wherein the subset is less than the input sub-signals;

calculating a haptic signal based on a combination of the selected subset of input sub-signals, the calculating the haptic signal including:

converting the subset of input sub-signals into haptic sub-signals wherein the converting includes multiplying an input sub-signal by a factor, and

summing the haptic sub-signals into the haptic signal and normalizing the haptic signal; and

generating the one or more haptic effects based on the haptic signal.

20. The computer-implemented method of claim 19 ,

wherein the analysis parameter comprises a maximum magnitude value for each of the input sub-signals.

21. The computer-implemented method of claim 19 , wherein the receiving the input further comprises:

receiving a multimedia file; and

extracting an input signal from the multimedia file.

22. A system for converting an input into one or more haptic effects using segmenting and combining, the system comprising:

a memory configured to store a haptic conversion module; and

a processor configured to execute the haptic conversion module stored on the memory;

wherein the haptic conversion module is configured to receive the input;

wherein the haptic conversion module is further configured to segment the input into input sub-signals, the segmenting comprising filtering the input using one or more filters, wherein each of the input sub-signals comprises a different frequency band that is output from a respective filter;

wherein the haptic conversion module is further configured to, after the segmenting, prioritize the input sub-signals based on an analysis parameter, wherein the prioritize comprises determining for each of the input sub-signals, a value of a characteristic that is defined by the analysis parameter of the input sub-signal, and ordering the input sub-signals based on the determined values;

wherein the haptic conversion module is further configured to select a subset of the input sub-signals from the input sub-signals based on the prioritizing, wherein the subset is less than the input sub-signals;

wherein the haptic conversion module is further configured to calculate a haptic signal based on a combination of the selected subset of input sub-signals, the calculating the haptic signal including:

converting the subset of input sub-signals into haptic sub-signals wherein the converting includes multiplying an input sub-signal by a factor, and

summing the haptic sub-signals into the haptic signal and normalizing the haptic signal; and

wherein the haptic conversion module is further configured to generate the one or more haptic effects based on the haptic signal.

23. The system of claim 22 ,

wherein the analysis parameter comprises a maximum magnitude value for each of the input sub-signals.

24. The system of claim 22 ,

wherein the haptic conversion module is further configured to receive a multimedia file; and

wherein the haptic conversion module is further configured to extract an input signal from the multimedia file.

25. The computer-implemented method of claim 19 , wherein the generating the one or more haptic effects further comprises sending the haptic signal to a haptic output device.

26. The system of claim 22 , wherein the one or more haptic effects is generated by sending the haptic signal to a haptic output device.

27. The computer-implemented method of claim 21 , wherein the mixing the haptic sub-signals into the haptic signal comprises at least one of:

segmenting the haptic signal into one or more time-windows, analyzing frequencies of the haptic sub-signals for each time-window, and selecting a haptic sub-signal from the haptic sub-signals as the haptic signal for each time-window, wherein the selected haptic sub-signal comprises a frequency of the frequencies; or

segmenting the input signal into one or more time windows, calculating a power spectrum density percentage contribution for each of the input sub-signals of the input sub-signals for each time window, and calculating a weighted combination of the corresponding haptic sub-signals as the haptic signal for each time-window, wherein a weight of each haptic sub-signal is based on the power spectrum density percentage contribution of each corresponding input sub-signal.