IP Library › Granted Patent US 10,993,049
Granted Patent B2
US 10,993,049 · App. 16/365,245 · Granted Apr 27, 2021

Systems and methods for modifying an audio signal using custom psychoacoustic models

Inventor: Nicholas R. Clark (Royston, GB)
Assignee: Mimi Hearing Technologies GmbH
H04R25/505G10K11/175H04R5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,993,049
App. No.
16/365,245
Granted
Apr 27, 2021
Kind
B2
Abstract

Systems and methods are provided for modifying an audio signal using custom psychoacoustic models. A user's hearing profile is first obtained. Subsequently, an audio processing function is parameterized so as to optimize the user's perceptually relevant information. The method for calculating the user's perceptually relevant information comprises first processing audio signal samples using the parameterized processing function and then transforming samples of the processed audio signals into the frequency domain. Next, masking and hearing thresholds are obtained from the user's hearing profile and applied to the transformed audio sample, wherein the user's perceived data is calculated. Once perceptually relevant information is optimized, the resulting parameters are transferred to the audio processing function and an output audio signal is processed.

Claims (54)

1. A method for processing an audio signal based on a processing function, the method comprising:

determining, at a processor, at least one parameter of the processing function based on an optimization of perceptually relevant information for the audio signal;

parameterizing the processing function with the at least one parameter; and

processing the audio signal by applying the processing function,

wherein calculation of the perceptually relevant information for the audio signal is based on an individual hearing profile for a given listener, the individual hearing profile comprising masking thresholds and hearing thresholds for the given listener.

2. The method according to claim 1 , wherein the hearing profile is derived from at least one of a suprathreshold test, a psychophysical tuning curve, a threshold test and an audiogram.

3. The method according to claim 1 , wherein the hearing profile is estimated from demographic information.

4. The method according to claim 1 , wherein the masking thresholds or hearing thresholds are applied to the audio signal in a frequency domain and the perceptually relevant information is calculated for information of the audio signal that is perceptually relevant.

5. The method according to claim 1 , wherein the determining of the at least one parameter comprises a sequential determination of subsets of the at least one parameter, each subset determined so as to optimize the perceptually relevant information for the audio signal.

6. The method according to claim 1 , wherein the processing function is an equalization processing function.

7. The method according to claim 1 , wherein the processing function operates on subband signals of the audio signal.

8. The method according to claim 7 , further comprising:

selecting a subset of the subbands so that a masking interaction between the selected subset of the subbands is minimized; and

determining at least one parameter for the selected subset of the subbands.

9. The method according to claim 8 , further comprising determining at least one parameter for an unselected subband based on at least one parameters of adjacent subbands.

10. The method according to claim 9 , wherein the at least one parameter for the unselected subband is determined based on an interpolation of the at least one parameter of the adjacent subbands.

11. The method according to claim 7 , wherein the at least one parameter is determined sequentially for each subband of the subband signals of the audio signal.

12. The method according to claim 7 , further comprising:

selecting a subset of adjacent subbands;

tying corresponding values of the at least one parameter for the selected subset of adjacent subbands; and

performing a joint determination of the tied corresponding values by minimizing the perceptually relevant information for the selected subset of adjacent subbands.

13. The method according to claim 12 , further comprising:

selecting a reduced subset of adjacent subbands from the selected subset of adjacent subbands;

tying corresponding values of at least one parameter for the reduced subset of subbands;

performing a joint determination of the tied corresponding values by minimizing the perceptually relevant information for the reduced subset of subbands;

repeating the previous steps until a single subband is selected; and

determining at least one parameter of the single subband.

14. The method according to claim 13 , further comprising:

selecting another subset of adjacent subbands;

repeating the previous steps of determining at least one parameter of another single subband by successively reducing the selected another subset of adjacent subbands; and

jointly processing of the at least one parameter determined for the another single subband derived from the subset of adjacent subbands and the another single subband derived from the another subset.

15. The method according to claim 14 , wherein the jointly processing of the at least one parameter for the another single subbands comprises at least one of:

jointly optimizing of the at least one parameter for the another single subbands;

smoothing of the at least one parameter for the another single subbands; and

applying constraints on a deviation of corresponding values of the at least one parameter for the another single subbands.

16. The method according claim 7 , wherein the audio processing function is a multiband compression of the audio signal and the at least one parameter of the processing function comprises at least one of a threshold, a ratio, and a gain.

17. The method according to claim 1 , further comprising:

splitting a sample of the audio signal into frequency components;

obtaining the masking thresholds from the hearing profile;

obtaining the hearing thresholds from the hearing profile;

applying the masking and hearing thresholds to the frequency components of the sample of the audio signal and disregarding imperceptible data of the audio signal;

quantizing the sample of the audio signal; and

encoding the sample of the audio signal.

18. The method according to claim 1 , wherein the perceptually relevant information is calculated by perceptual entropy.

19. An audio processing device comprising:

a processor; and

a memory storing instructions which when executed by the processor causes the processor to:

determine one or more parameters of the processing function based on an optimization of perceptually relevant information for the audio signal;

parameterize the processing function with the one or more parameters; and

process the audio signal by applying the processing function, wherein calculation of the perceptually relevant information for the audio signal is based on an individual hearing profile for a given listener, the individual hearing profile comprising masking thresholds and hearing thresholds for the given listener.

20. A non-transitory computer readable storage medium storing instructions which when executed by a processor of an audio processing device, causes the processor to:

determine one or more parameters of the processing function based on an optimization of perceptually relevant information for the audio signal;

parameterize the processing function with the one or more parameters; and

process the audio signal by applying the processing function, wherein calculation of the perceptually relevant information for the audio signal is based on an individual hearing profile for a given listener, the individual hearing profile comprising masking thresholds and hearing thresholds for the given listener.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 26, 2019
From: CLARK, NICHOLAS R.
To: MIMI HEARING TECHNOLOGIES GMBH
Reel/Frame 051122/0333 →
Priority Claims (1)
EP 18208020 · Nov 23, 2018 · regional
Continuity (5)
Continuation 16206376 · Nov 30, 2018
Provisional Application 62701350 · Jul 20, 2018
Provisional Application 62719919 · Aug 20, 2018
Provisional Application 62721417 · Aug 22, 2018
Related Publication 20200029158A1 · Jan 23, 2020