Input/output mode control for audio processing
Systems and methods provide input and output mode control for audio processing on a user device. Audio processing may be configured by monitoring audio activity on a device having at least one microphone and a digital audio processing unit, collecting information from the monitoring of the activity, including an identification of at least one application utilizing audio processing, and determining a context for the audio processing, the context including at least one of a hardware, software, audio signal and/or environmental context. An audio signal processing configuration is determined based on the application and determined context, an associated audio signal processing mode is selected, and an optimized audio signal generated.
1. A method of audio signal processing performed by an audio playback device, comprising:
receiving a first audio signal from a first audio source and a second audio signal from a second audio source, wherein the second audio source is included in the audio playback device and the first audio source is separate from the audio playback device;
determining a plurality of first audio processing operations associated with the first audio signal based at least in part on a first audio application configured to transmit the first audio signal;
determining a plurality of second audio processing operations associated with the second audio signal based at least in part on a second audio application configured to transmit the second audio signal, wherein the plurality of second audio processing operations is different than the plurality of first audio processing operations;
determining a geospatial location of the audio playback device;
modifying the second audio signal based on the plurality of first audio processing operations and the plurality of second audio processing operations; and
modifying the first audio signal, concurrently with the second audio signal, based at least in part on the plurality of first audio processing operations and the determined geospatial location of the audio playback device, wherein modifying the first audio signal comprises filtering ambient sounds, including background noises, echoes, interference, or any combination thereof, from the received first audio signal responsive to determining that the audio playback device is located at a first location and maintaining the ambient sounds in the received first audio signal responsive to determining that the audio playback device is located at a second location different than the first location.
2. The method of claim 1 , wherein the second audio signal includes sound associated with movies, music, games, far-end speech of a voice over IP (VoIP) call, or a combination thereof.
3. The method of claim 1 , wherein the first audio signal includes speech associated with at least one speaker, and wherein the plurality of first audio processing operations comprises separating the speech associated with the at least one speaker from the second audio signal, speech associated with other speakers present with the at least one speaker, or a combination thereof.
4. The method of claim 1 , wherein the first audio source is an audio input source and the second audio source is a loudspeaker of the audio playback device.
5. The method of claim 1 , wherein the first audio application comprises a voice over IP (VoIP) application or an automatic speech recognition application.
6. The method of claim 1 , wherein the second audio application comprises a video application, a music application, a game application, a voice over IP (VoIP) application, or a combination thereof.
7. The method of claim 1 , wherein the plurality of first audio processing operations comprises detecting background noise in an environment associated with the first audio source.
8. The method of claim 7 , wherein the environment is further associated with the second audio source, and wherein the plurality of second audio processing operations comprises detecting the background noise in the environment.
9. A system comprising:
an audio playback device comprising hardware and software audio resources;
a non-transitory memory storing machine-readable instructions for audio processing; and
one or more hardware processors coupled to the non-transitory memory and operable to read instructions from the non-transitory memory to cause the system to perform operations comprising:
receiving a first audio signal from a first audio source and a second audio signal from a second audio source, wherein the second audio source is included in the audio playback device and the first audio source is separate from the audio playback device;
determining a plurality of first audio processing operations associated with the first audio signal based at least in part on a first audio application configured to transmit the first audio signal;
determining a plurality of second audio processing operations associated with the second audio signal based at least in part on a second audio application configured to transmit the second audio signal, wherein the plurality of second audio processing operations is different than the plurality of first audio processing operations;
determining a geospatial location of the audio playback device;
modifying the second audio signal based on the plurality of first audio processing operations and the plurality of second audio processing operations; and
modifying the first audio signal, concurrently with the second audio signal, based at least in part on the plurality of first audio processing operations and the determined geospatial location of the audio playback device, wherein modifying the first audio signal comprises filtering ambient sounds, including background noises, echoes, interference, or any combination thereof, from the received first audio signal responsive to determining that the audio playback device is located at a first location and maintaining the ambient sounds in the received first audio signal responsive to determining that the audio playback device is located at a second location different than the first location.
10. The system of claim 9 , wherein the second audio signal includes sound associated with movies, music, games, far-end speech of a voice over IP (VoIP) call, or a combination thereof.
11. The system of claim 9 , wherein the first audio signal includes speech associated with at least one speaker, and wherein the plurality of first audio processing operations comprises separating the speech associated with the at least one speaker from the second audio signal, speech associated with other speakers present with the at least one speaker, or a combination thereof.
12. The system of claim 9 , wherein the first audio application comprises a voice over IP (VoIP) application or an automatic speech recognition application.
13. The system of claim 9 , wherein the second audio application comprises a video application, a music application, a game application, a voice over IP (VoIP) application, or a combination thereof.