SYSTEM AND METHOD FOR TRANSFORMING AUTHORED HAPTIC DATA TO FIT INTO HAPTIC BANDWIDTH
A computer implemented method and system of transforming an audio signal into a haptic data to fit into a haptic perceptual bandwidth of an electronic device having at least one actuator is disclosed. The method and system receives the audio signal; filters the audio signal into one or more frequency bands with each frequency band having a center frequency and time-amplitude values; authors the one or more frequency bands by modifying the time-amplitude values by changing, appending or deleting one or more time amplitude values to create an authored audio descriptor data; calculates an available bandwidth and the haptic perceptual bandwidth of the electronic device having at least one embedded actuator and fits the authored audio descriptor data into the haptic perceptual bandwidth of the electronic device to create a haptic data file.
1 . A computer implemented method of transforming an audio signal into haptic data to fit into a haptic perceptual bandwidth of an electronic device having at least one actuator, the method comprising:
receiving the audio signal;
filtering the audio signal into one or more frequency bands, wherein each of the one or more frequency bands has a center frequency;
authoring the one or more frequency bands at the center frequency to modify one or more time amplitude values to create an authored audio descriptor data;
calculating an available bandwidth and the haptic perceptual bandwidth of the electronic device having at least one actuator; and
fitting the authored audio descriptor data into the haptic perceptual bandwidth of the electronic device having at least one actuator to create a haptic data file.
2 . The computer implemented method of claim 1 , wherein the available bandwidth of the electronic device having at least one actuator is determined based on device specific information and actuator specific information.
3 . The computer implemented method of claim 2 , wherein the device specific information includes device mass, device type, and device operating characteristics.
4 . The computer implemented method of claim 2 , wherein the actuator specific information includes mass of actuator, type of actuator, and operating characteristics of the actuator.
5 . The computer implemented method of claim 1 , wherein the haptic perceptual bandwidth is determined based upon the available bandwidth and the available bandwidth is combined bandwidth of the electronic device having at least one actuator.
6 . The computer implemented method of claim 1 , wherein fitting the authored audio descriptor data into the haptic perceptual bandwidth includes determining if the center frequency of each of the one or more frequency bands can be accommodated within the haptic perceptual bandwidth and if so, passing the authored audio descriptor data to create the haptic data file.
7 . The computer implemented method of claim 1 , wherein fitting the authored audio descriptor data into the haptic perceptual bandwidth further comprises receiving frequency band ranking data for each of the one or more frequency bands, and, if the frequency band ranking data has been provided by a user, then fitting each of the one or more frequency bands into the haptic perceptual bandwidth based on the frequency band ranking data.
8 . An audio to haptic transformation system for transforming an audio signal into haptic data to fit into a haptic perceptual bandwidth of an electronic device comprising at least one actuator, the system comprising:
an audio analysis module configured to receive and filter the audio signal into one or more frequency bands, wherein each of the one or more frequency bands has a center frequency;
an authoring tool configured to author the one or more frequency bands at the center frequency to modulate one or more haptic data points to create authored audio descriptor data;
a transformation module to calculate an available bandwidth and the haptic perceptual bandwidth of the electronic device comprising at least one actuator, wherein the transformation module transforms the authored audio descriptor data to fit into the haptic perceptual bandwidth to create a haptic data file; and
a resynthesis module for parsing and executing the haptic data file in real time to provide an immersive haptic experience.
9 . The audio to haptic transformation system of claim 8 , wherein the transformation module calculates the available bandwidth of the electronic device comprising at least one actuator based on device specific information and actuator specific information.
10 . The audio to haptic transformation system of claim 9 , wherein the device specific information includes device mass, device type, and device operating characteristics.
11 . The audio to haptic transformation system of claim 9 , wherein the actuator specific information includes mass of actuator, type of actuator, and operating characteristics of the actuator.
12 . The audio to haptic transformation system of claim 8 , wherein the transformation module determines the haptic perceptual bandwidth based upon the available bandwidth and the available bandwidth is combined bandwidth of the electronic device having at least one actuator.
13 . The audio to haptic transformation system of claim 8 , wherein the transformation module further determines if all of the one or more frequency bands in the authored audio descriptor data can fit into the haptic perceptual bandwidth and if so, transforms the authored audio descriptor data to create the haptic data file.
14 . The audio to haptic transformation system of claim 8 , wherein the transformation module fits the authored audio descriptor data into the haptic perceptual bandwidth based on frequency band ranking data for each of the one or more frequency bands.
15 . The audio to haptic transformation system of claim 13 , wherein the transformation module further determines if all of the one or more frequency bands of the authored audio descriptor data cannot fit into the haptic perceptual bandwidth and if so, fits the one or more frequency bands of the authored audio descriptor data into the haptic perceptual bandwidth based on frequency band ranking.
16 . The audio to haptic transformation system of claim 14 , wherein the transformation module further determines if all of the one or more frequency bands of the authored audio descriptor data cannot be accommodated into the haptic perceptual bandwidth and if so, passes the center frequency of the one or more frequency bands according to frequency band ranking and discarding the one or more frequency bands of the authored audio descriptor data that do not fit into the haptic perceptual bandwidth.
17 . A computer readable medium having encoded instructions that, when executed by a processor, perform the following steps for transforming an audio signal into a haptic data to fit into a haptic perceptual bandwidth of an electronic device having at least one actuator:
receiving the audio signal;
filtering the audio signal into one or more frequency bands, wherein the one or more frequency bands has a center frequency;
authoring the one or more frequency bands at the center frequency to edit or append one or more haptic data points to create an authored audio descriptor data;
calculating an available bandwidth and the haptic perceptual bandwidth of the electronic device having at least one actuator;
transforming the authored audio descriptor data to fit into the haptic perceptual bandwidth to create a haptic data file; and
executing the haptic data file to provide an immersive haptic experience.
18 . The computer readable medium of claim 17 , wherein calculating the available bandwidth of the electronic device having at least one actuator is determined based on device specific information and actuator specific information.
19 . The computer readable medium of claim 18 , wherein the device specific information includes device mass, device type, and device operating characteristics.
20 . The computer readable medium of claim 18 , wherein the actuator specific information includes mass of actuator, type of actuator, and operating characteristics of the actuator.
21 . The computer readable medium of claim 17 , wherein the haptic perceptual bandwidth is determined based upon the available bandwidth of the electronic device having at least one actuator.
22 . The computer readable medium of claim 17 , wherein the encoded instructions, when executed by the processor, further perform the step of determining if the center frequency of all the one or more frequency bands can be accommodated within the haptic perceptual bandwidth and if so, transforming the one or more frequency bands to create the haptic data file.
23 . The computer readable medium of claim 17 , wherein the encoded instructions, when executed by the processor, further perform the step of determining if the authored audio descriptor data cannot fit into the haptic perceptual bandwidth at the center frequency of the one or more frequency bands and if so, fitting the center frequency of the one or more frequency, bands into the haptic perceptual bandwidth based on frequency band ranking and discarding the center frequency of the one or more frequency bands that cannot fit into the haptic perceptual bandwidth.