Real-time voice timbre style transform

1. A method for transforming a voice of a speaker to a reference timbre, comprising:

receiving, during a real-time communication session, a first portion of a source signal of the voice of the speaker;

converting the first portion into a time-frequency domain to obtain a time-frequency signal;

obtaining frequency bin means of magnitudes over time of the time-frequency signal;

converting the frequency bin magnitude means into a Bark domain to obtain a source frequency response curve (SR), wherein SR(i) corresponds to magnitude mean of the i th frequency bin;

obtaining respective gains of frequency bins of the Bark domain with respect to a reference frequency response curve (Rf);

obtaining equalizer parameters using the respective gains of the frequency bins of the Bark domain;

transforming, into a transformed portion, the first portion to the reference timbre using the equalizer parameters; and

outputting the transformed portion such that the transformed portion is presented through a speaker.

2. The method of claim 1 , further comprising:

receiving a reference sample of the reference timbre;

converting the reference sample into the time-frequency domain to obtain a reference time-frequency signal;

obtaining reference frequency bin means of magnitudes (M j FFT ) over time of the reference time-frequency signal; and

converting the reference frequency bin means of magnitudes into the Bark domain to obtain the reference frequency response curve (Rf).

3. The method of claim 2 , wherein converting the reference frequency bin means of magnitudes (M j FFT ) into the Bark domain to obtain a reference frequency response curve (Rf) comprises:

using a formula M i Bark =Σ jϵB i β ij *M j FFT ,

wherein B i corresponds to FFT frequency bins in an ith Bark frequency band, and

wherein β ij corresponds to transform parameters of the Bark transform.

4. The method of claim 2 , wherein obtaining respective gains of frequency bins of the Bark domain comprises:

calculating a gain G b (k) of a k th frequency bin in the Bark domain using a ratio of the reference frequency bin magnitude mean of the k th frequency bin to the source frequency response curve (SR) of the k th frequency bin.

5. The method of claim 4 , wherein the G b (k) is calculated using a formula G b (k)=20*log(Rf(k)/SR(k)).

6. The method of claim 1 , wherein obtaining the equalizer parameters using the respective gains of the frequency bins of the Bark domain comprises:

normalizing the respective gains to obtain the equalizer parameters.

7. The method of claim 6 , wherein obtaining the equalizer parameters using the respective gains of the frequency bins of the Bark domain further comprises:

mapping the respective gains to respective center frequencies of the equalizer to obtain values for gains of the equalizer.

8. The method of claim 1 , further comprising:

receiving, from the speaker, the reference timbre.

9. The method of claim 1 , further comprising:

obtaining a second source frequency response curve for a second portion of the source signal;

in response to detecting a difference between the source frequency response curve and the second source frequency response curve exceeding a threshold,

obtaining new equalizer parameters, and

using the new equalizer parameters as the equalizer parameters; and

transforming the second portion of the source signal using the equalizer parameters.

10. An apparatus for transforming a voice of a speaker to a reference timbre, comprising:

a processor configured to:

receive, during a real-time communication session, a first portion of a source signal of the voice of the speaker;

convert the first portion into a time-frequency domain to obtain a time-frequency signal;

obtain frequency bin means of magnitudes over time of the time-frequency signal;

convert the frequency bin magnitude means into a Bark domain to obtain a source frequency response curve (SR), wherein SR(i) corresponds to magnitude mean of the i th frequency bin;

obtain respective gains of frequency bins of the Bark domain with respect to a reference frequency response curve (Rf);

obtain equalizer parameters using the respective gains of the frequency bins of the Bark domain;

transform, into a transformed portion, the first portion to the reference timbre using the equalizer parameters; and

output the transformed portion such that the transformed portion is presented through a speaker.

11. The apparatus of claim 10 , wherein the processor is further configured to:

receive a reference sample of the reference timbre;

convert the reference sample into the time-frequency domain to obtain a reference time-frequency signal;

obtain reference frequency bin means of magnitudes (M j FFT ) over time of the reference time-frequency signal; and

convert the reference frequency bin means of magnitudes into the Bark domain to obtain the reference frequency response curve (Rf).

12. The apparatus of claim 11 , wherein to convert the reference frequency bin means of magnitudes (M j FFT ) into the Bark domain to obtain a reference frequency response curve (Rf) comprises to:

use a formula M i Bark =Σ jϵB i β ij *M j FFT ,

wherein B i corresponds to FFT frequency bins in an ith Bark frequency band, and

wherein β ij corresponds to transform parameters of the Bark transform.

13. The apparatus of claim 11 , wherein to obtain respective gains of frequency bins of the Bark domain comprises to:

calculate a gain G b (k) of a k th frequency bin in the Bark domain using a ratio of the reference frequency bin magnitude mean of the k th frequency bin to the source frequency response curve (SR) of the k th frequency bin.

14. The apparatus of claim 13 , wherein the G b (k) is calculated using a formula G b (k)=20*log(Rf(k)/SR(k)).

15. The apparatus of claim 10 , wherein to obtain the equalizer parameters using the respective gains of the frequency bins of the Bark domain comprises to:

normalize the respective gains to obtain the equalizer parameters.

16. The apparatus of claim 15 , wherein to obtain the equalizer parameters using the respective gains of the frequency bins of the Bark domain further comprises to:

map the respective gains to respective center frequencies of the equalizer to obtain values for gains of the equalizer.

17. The apparatus of claim 10 , wherein the processor is further configured to:

receive, from the speaker, the reference timbre.

18. The apparatus of claim 10 , wherein the processor is further configured to:

obtain a second source frequency response curve for a second portion of the source signal;

in response to detecting a difference between the source frequency response curve and the second source frequency response curve exceeding a threshold,

obtain new equalizer parameters, and

use the new equalizer parameters as the equalizer parameters; and transform the second portion of the source signal using the equalizer parameters.

19. A non-transitory computer-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations comprising:

receiving, during a real-time communication session, a first portion of a source signal of the voice of the speaker;

converting the first portion into a time-frequency domain to obtain a time-frequency signal;

obtaining frequency bin means of magnitudes over time of the time-frequency signal;

converting the frequency bin magnitude means into a Bark domain to obtain a source frequency response curve (SR), wherein SR(i) corresponds to magnitude mean of the i th frequency bin;

obtaining respective gains of frequency bins of the Bark domain with respect to a reference frequency response curve (Rf);

obtaining equalizer parameters using the respective gains of the frequency bins of the Bark domain;

transforming, into a transformed portion, the first portion to the reference timbre using the equalizer parameters; and

outputting the transformed portion such that the transformed portion is presented through a speaker.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the operations further comprise:

obtaining a second source frequency response curve for a second portion of the source signal;

in response to detecting a difference between the source frequency response curve and the second source frequency response curve exceeding a threshold,

obtaining new equalizer parameters, and

using the new equalizer parameters as the equalizer parameters; and

transforming the second portion of the source signal using the equalizer parameters.