Device, method and computer program for analyzing an audio signal
A device for analyzing an audio signal to obtain an analysis representation of the audio signal includes a converter for converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model, and a calculator for calculating a neural activity pattern over time on the plurality of nerve fibers, which results based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is an analysis representation of the audio signal. The inventive device thus generates an especially suitable analysis representation of an audio signal in which masking effects occurring in the generation of action potentials on nerve fibers are considered. The inventive analysis representation is also suitable for an examination of the audio content and also for controlling cochlea implants.
1. A device for analyzing an audio signal to acquire an analysis representation of the audio signal, comprising:
a converter for converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model;
a calculator for calculating a neural activity pattern over time on the plurality of nerve fibers resulting based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is the analysis representation of the audio signal;
a coupler arranged to output the neural activity pattern to a plurality of nerve fibers of a human patient as electrical and/or chemical excitations; wherein
the converter for converting the audio signal includes:
a converter for converting the audio signal into a representation describing a movement of a basilar membrane in the ear model;
a converter for converting the representation describing the movement of a basilar membrane into a representation describing a deflection of a stereocilium of a hair cell coupled to the basilar membrane; and
a converter for converting the representation describing the deflection of the stereocilium into a representation describing the neurotransmitter vesicle occurrence;
the converter for converting the representation describing the movement of the basilar membrane into the representation describing the deflection of a stereocilium is implemented to describe the stereocilium by a model of a harmonic oscillator which comprises a spring return force and an attenuation based on a laminar flow resistance;
the model of the harmonic oscillator is implemented so that an excitation of the harmonic oscillator takes place by a second force component F stoch which describes a stochastic thermal force; and
the device for analyzing the audio signal comprises a hardware implementation, or the device for analyzing the audio signal is implemented using a computer.
2. A device for analyzing an audio signal to acquire an analysis representation of the audio signal, comprising:
a converter for converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model;
a calculator for calculating a neural activity pattern over time on the plurality of nerve fibers resulting based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is the analysis representation of the audio signal;
a coupler arranged to output the neural activity pattern to a plurality of nerve fibers of a human patient as electrical and/or chemical excitations; wherein
the converter for converting the audio signal includes:
a converter for converting the audio signal into a representation describing a movement of a basilar membrane in the ear model;
a converter for converting the representation describing the movement of a basilar membrane into a representation describing a deflection of a stereocilium of a hair cell coupled to the basilar membrane; and
a converter for converting the representation describing the deflection of the stereocilium into a representation describing the neurotransmitter vesicle occurrence;
the converter for converting the representation describing the movement of the basilar membrane into the representation describing the deflection of a stereocilium is implemented to describe the stereocilium by a model of a harmonic oscillator which comprises a spring return force and an attenuation based on a laminar flow resistance;
the model of the harmonic oscillator is described by a movement equation of the following form:
m{umlaut over (x)}=−Dx−K{dot over (x)}+F ext ( t )+ F stoch ( t )
wherein −Dx represents a spring return force;
wherein −Kż represents a laminar flow resistance;
wherein F ext represents an external force, which is proportional to a velocity v(t) of the basilar membrane; and
wherein F stoch represents a stochastic thermal force by an impact movement of atoms; and
the device for analyzing the audio signal comprises a hardware implementation, or the device for analyzing the audio signal is implemented using a computer.
3. A device for analyzing an audio signal to acquire an analysis representation of the audio signal, comprising:
a converter for converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model;
a calculator for calculating a neural activity pattern over time on the plurality of nerve fibers resulting based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is the analysis representation of the audio signal;
a coupler arranged to output the neural activity pattern to a plurality of nerve fibers of a human patient as electrical and/or chemical excitations; wherein
the converter for converting the audio signal includes:
a converter for converting the audio signal into a representation describing a movement of a basilar membrane in the ear model;
a converter for converting the representation describing the movement of a basilar membrane into a representation describing a deflection of a stereocilium of a hair cell coupled to the basilar membrane; and
a converter for converting the representation describing the deflection of the stereocilium into a representation describing the neurotransmitter vesicle occurrence;
the converter for converting the representation describing the movement of the basilar membrane into the representation describing the deflection of a stereocilium is implemented to describe the stereocilium by a model of a harmonic oscillator which comprises a spring return force and an attenuation based on a laminar flow resistance;
a spring constant D which describes a connection between the spring return force and the deflection of the stereocilium lies in a range between 1×10 −3 N/m and 6×10 −3 N/m; and
the device for analyzing the audio signal comprises a hardware implementation, or the device for analyzing the audio signal is implemented using a computer.
4. A method for analyzing an audio signal to acquire an analysis representation of the audio signal, comprising:
converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model;
calculating a neural activity pattern over time on the plurality of nerve fibers resulting based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is the analysis representation of the audio signal; and
outputting, by a coupler, the neural activity pattern to a plurality of nerve fibers of a human patient as electrical and/or chemical excitations; wherein
converting the audio signal includes converting the audio signal into a representation describing a movement of a basilar membrane in the ear model, converting the representation describing the movement of a basilar membrane into a representation describing a deflection of a stereocilium of a hair cell coupled to the basilar membrane, and converting the representation describing the deflection of the stereocilium into a representation describing the neurotransmitter vesicle occurrence;
converting the representation describing the movement of the basilar membrane into the representation describing the deflection of a stereocilium is implemented to describe the stereocilium by a model of a harmonic oscillator which comprises a spring return force and an attenuation based on a laminar flow resistance;
the model of the harmonic oscillator is implemented so that an excitation of the harmonic oscillator takes place by a second force component F stoch which describes a stochastic thermal force; and
the converting the audio signal and the calculating the neural activity pattern over time are performed by a hardware implementation or using a computer.
5. A method for analyzing an audio signal to acquire an analysis representation of the audio signal, comprising:
converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model;
calculating a neural activity pattern over time on the plurality of nerve fibers resulting based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is the analysis representation of the audio signal; and
outputting, by a coupler, the neural activity pattern to a plurality of nerve fibers of a human patient as electrical and/or chemical excitations; wherein
converting the audio signal includes converting the audio signal into a representation describing a movement of a basilar membrane in the ear model, converting the representation describing the movement of a basilar membrane into a representation describing a deflection of a stereocilium of a hair cell coupled to the basilar membrane, and converting the representation describing the deflection of the stereocilium into a representation describing the neurotransmitter vesicle occurrence;
converting the representation describing the movement of the basilar membrane into the representation describing the deflection of a stereocilium is implemented to describe the stereocilium by a model of a harmonic oscillator which comprises a spring return force and an attenuation based on a laminar flow resistance;
the model of the harmonic oscillator is described by a movement equation of the following form:
m{umlaut over (x)}=−Dx−K{dot over (x)}+F ext ( t )+ F stoch ( t )
wherein −Dx represents a spring return force;
wherein −Kż represents a laminar flow resistance;
wherein F ext represents an external force, which is proportional to a velocity v(t) of the basilar membrane; and
wherein F stoch represents a stochastic thermal force by an impact movement of atoms; and
the converting the audio signal and the calculating the neural activity pattern over time are performed by a hardware implementation or using a computer.
6. A method for analyzing an audio signal to acquire an analysis representation of the audio signal, comprising:
converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model;
calculating a neural activity pattern over time on the plurality of nerve fibers resulting based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is the analysis representation of the audio signal; and
outputting, by a coupler, the neural activity pattern to a plurality of nerve fibers of a human patient as electrical and/or chemical excitations; wherein
converting the audio signal includes converting the audio signal into a representation describing a movement of a basilar membrane in the ear model, converting the representation describing the movement of a basilar membrane into a representation describing a deflection of a stereocilium of a hair cell coupled to the basilar membrane, and converting the representation describing the deflection of the stereocilium into a representation describing the neurotransmitter vesicle occurrence;
converting the representation describing the movement of the basilar membrane into the representation describing the deflection of a stereocilium is implemented to describe the stereocilium by a model of a harmonic oscillator which comprises a spring return force and an attenuation based on a laminar flow resistance;
a spring constant D which describes a connection between the spring return force and the deflection of the stereocilium lies in a range between 1×10 −3 N/m and 6×10 −3 N/m; and
the converting the audio signal and the calculating the neural activity pattern over time are performed by a hardware implementation or using a computer.
7. A non-transitory computer-readable medium comprising a program code for performing a method according to claim 4 when the computer program runs on a computer.
8. A non-transitory computer-readable medium comprising a program code for performing a method according to claim 5 when the computer program runs on a computer.
9. A non-transitory computer-readable medium comprising a program code for performing a method according to claim 6 when the computer program runs on a computer.