Dynamically preventing audio artifacts
The disclosure is directed to a process that can predict and prevent an audio artifact from occurring. The process can monitor the systems, processes, and execution threads on a larger system/device, such as a mobile or in-vehicle device. Using a learning algorithm, such as deep neural network (DNN), the information collected can generate a prediction of whether an audio artifact is likely to occur. The process can use a second learning algorithm, which also can be a DNN, to generate recommended system adjustments that can attempt to prevent the audio glitch from occurring. The recommendations can be for various systems and components on the device, such as changing the processing system frequency, the memory frequency, and the audio buffer size. After the audio artifact has been prevented, the system adjustments can be reversed fully or in steps to return the system to its state prior to the system adjustments.
1. A method comprising:
collecting one or more environment parameters of a system processing an audio portion, wherein the one or more environment parameters include a processing frequency of the system and a memory frequency of the system; and
determining a probability of an audio artifact occurring when outputting the audio portion based on the one or more environment parameters;
wherein adjusting at least one of the processing frequency or the memory frequency is performed to lower the probability of an audio artifact occurring when the probability is above a threshold, and wherein a size of an audio buffer of the system is adjusted in response to an increase to the processing frequency.
2. The method of claim 1 , wherein the system is a part of a mobile device, and the audio portion is a portion of streamed audio signal.
3. The method of claim 1 , wherein adjusting the memory frequency does not lower the probability of an audio artifact occurring.
4. The method of claim 1 , wherein said adjusting includes increasing the processing frequency until the processing frequency reaches a maximum processing frequency value.
5. The method of claim 1 , wherein said adjusting includes increasing the memory frequency until the memory frequency reaches a maximum memory frequency value.
6. The method of claim 1 , further comprising reversing an adjustment made during a prior audio check interval when the probability of an audio artifact occurring is not higher than the threshold.
7. The method of claim 6 , wherein the adjustment is reversed by a step value that is a fraction of the adjustment.
8. The method of claim 1 , further comprising using a deep neural network (DNN) to perform said determining.
9. The method of claim 1 , wherein said adjusting is executed using a DNN.
10. The method of claim 1 , wherein the probability of an audio artifact occurring is determined based further on: a number of threads being currently executed on the system, types of the threads, and priorities of the threads relative to an audio thread designated for processing the audio portion.
11. The method of claim 1 , wherein the processing frequency includes a frequency of at least one of: a CPU, a GPU, an audio system processor unit, a non-audio system processing unit, a communication channel, or a communication port.
12. A computer program product having a series of operating instructions stored on a non-transitory computer-readable medium that directs a data processing apparatus when executed thereby to perform audio artifact prevention operations on a system, the operations comprising:
collecting environment parameters of a system processing an audio portion, wherein the environment parameters include a processing frequency of the system and a memory frequency of the system;
determining a probability of an audio artifact occurring when outputting the audio portion based on the environment parameters; and
when the probability is higher than a threshold, lowering the probability by adjusting at least one of the processing frequency or the memory frequency, wherein a size of an audio buffer of the system is adjusted when the processing frequency is increased.
13. The computer program product of claim 12 , wherein the system is a part of a mobile device, and the audio portion is a portion of streamed audio signal.
14. The computer program product of claim 12 , wherein adjusting the memory frequency does not lower the probability of an audio artifact occurring.
15. The computer program product of claim 12 , wherein said adjusting includes increasing the processing frequency until the processing frequency reaches a maximum processing frequency value.
16. The computer program product of claim 12 , wherein said adjusting includes increasing the memory frequency until the memory frequency reaches a maximum memory frequency value.
17. The computer program product of claim 12 , further comprising reversing an adjustment made during a prior audio check interval when the probability of an audio artifact occurring is not higher than the threshold.
18. An audio system comprising:
a receiver that receives an audio portion; and
a processing unit that:
collects one or more environment parameters of the audio system, wherein the one or more environment parameters include a processing frequency of the system and a memory frequency of the system;
determines a probability of an audio artifact occurring when outputting the audio portion based on the one or more environment parameters; and
when the probability is higher than a threshold, lowers the probability by adjusting at least one of the processing frequency or the memory frequency, wherein a size of an audio buffer of the system is adjusted when the processing frequency is increased.
19. The audio system of claim 18 , wherein the processing unit uses a deep neural network (DNN) to determine the probability of an audio artifact occurring.
20. The audio system of claim 18 , wherein the processing unit uses a DNN to adjust at least one of the processing frequency or the memory frequency when the probability of an audio artifact occurring is higher than a threshold.
21. The audio system of claim 18 , wherein the probability of an audio artifact occurring is determined based further on: a number of threads being currently executed on the system, types of the threads, and priorities of the threads relative to an audio thread designated for processing the audio portion.
22. The audio system of claim 18 , wherein the processing frequency includes a frequency of at least one of: a CPU, a GPU, an audio system processor unit, a non-audio system processing unit, a communication channel, or a communication port.