Multiplexing audio system and method
View Patent ↗A method and system for multiplexing audio signals into a single channel uses frequency division multiplexing. The frequency division multiplexing method herein is based on a frequency transform algorithm using FFT shifting that does not require a carrier signal for the modulation. In one embodiment, two input microphone audio signals are frequency shifted and the resulting single audio channel is directed over a standard input connection to a computing device, for instance, a smart phone using a wired TRRS connection. The TRRS analog input of the computing devices exhibits a high-pass characteristic, and the frequency shifting method enables the low frequency audio components of input audio signals to be received and processed by a software application on the smart phone. Other embodiments are disclosed.
1. A method for multiplexing audio signals into a single audio channel, the method comprising the steps of:
receiving a first audio signal over a first audio link;
receiving a second audio signal over a second audio link;
upward frequency shifting at least one of the first audio signal to a first bandwidth range and the second audio signal to a second bandwidth range to respectively produce at least one of a first frequency shifted signal and a second frequency shifted signal or a non-frequency shifted signal, the first frequency shifted signal, the second frequency shifted signal, and the non-frequency shifted signal are produced using a non-modulated signal;
summing at least one of the first frequency shifted signal or the second frequency shifted signal with one of a remainder of the first frequency shifted signal, the second frequency shifted signal or the non frequency shifted signal to produce a composite signal;
providing the composite signal over a single audio channel; and
extracting at least one audio signal from the composite signal over the single audio channel by:
receiving the composite signal over the single audio channel;
band filtering the composite signal for at least one independent audio channel to produce a filtered audio signal for the at least one independent audio channel;
downward frequency shifting the filtered audio signal in the at least one independent audio channel in an opposite direction to the upward frequency shifting previously applied on that audio channel to produce a baseband signal for the at least one independent audio channel; and
band filtering the baseband signal to generate a reconstructed audio signal.
2. The method of claim 1 , further comprising
determining a count of independently received audio signals;
allocating independent frequency channels within a channel bandwidth according to the count;
for each independent frequency channel, frequency shifting each of the independently received audio signals to an assigned independent frequency channel to produce a frequency shifted signal for each channel; and
summing the frequency shifted signals in each channel to produce the composite signal.
3. The method of claim 2 , further comprising
reassigning the count as the independently received audio signals are connected or disconnected; and
adjusting the allocating of the independent frequency channels within a channel bandwidth according to the count.
4. The method of claim 1 , wherein the frequency shifting for an audio signal is performed by:
applying a Fast Fourier Transform (FFT) to a block of audio samples in a bandwidth range for the audio signal;
shifting the FFT to produce a shifted FFT; and
applying an Inverse Fast Fourier Transform (IFFT) to the shifted FFT to produce a real-time domain signal, and
wherein the summing of frequency shifted signals adds the real-time domain signal generated from each bandwidth range to produce the composite signal.
5. The method of claim 1 , further comprising
receiving in connection with the composite signal, a data packet indicating a count and bandwidth;
allocating the independent audio channels according to the count and the bandwidth; and
performing the steps of said extracting for each independent audio channel to generate the reconstructed audio signal.
6. The method of claim 5 , further comprising:
reassigning the count as independently received audio signals are connected or disconnected; and
adjusting the allocating of the independent audio channels within a channel bandwidth according to the count.
7. The method of claim 1 , wherein the band filtering is one of low-pass, band-pass, band-stop, or high-pass filtering.
8. The method of claim 4 , further comprising applying a window to the block of audio samples prior to applying the FFT.
9. The method of claim 4 , further comprising circularly shifting coefficients of the FFT to produce the shifted FFT.
10. The method of claim 4 , further comprising up-sampling the audio signal prior to the FFT to increase a Nyquist frequency and corresponding frequency range for allocating channels.
11. The method of claim 4 , wherein the step of providing the composite signal over a single audio channel is performed by communicating the composite signal over a wireless data channel, that is one of Bluetooth or Wi-Fi.
12. The method of claim 1 , further comprising applying spectral expansion to the reconstructed audio signal to synthetically extend its audio spectrum to a substantially greater high frequency content than the received audio signal.
13. The method of claim 12 , wherein the spectral expansion includes:
creating a mapping matrix from an envelope comparative analysis of a reference wideband signal and a reference narrowband signal that predicts high frequency energy from a low frequency energy envelope; and
applying the mapping matrix to the reconstructed audio signal to synthetically extend its audio spectrum.
14. An audio controller for multiplexing audio signals into a single audio channel, comprising:
at least one microphone for receiving a first audio signal over a first audio link;
at least one audio path for receiving a second audio signal over a second audio link;
a processor communicatively coupled to the at least one microphone and the at least one audio path for:
upward frequency shifting at least one of the first audio signal to a first bandwidth range and the second audio signal to a second bandwidth range to respectively produce at least one of a first frequency shifted signal and a second frequency shifted signal or a non-frequency shifted signal, the first frequency shifted signal, the second frequency shifted signal, and the non-frequency shifted signal are produced using a non-modulated signal;
summing at least one of the first frequency shifted signal or the second frequency shifted signal with one of a remainder of the first frequency shifted signal, the second frequency shifted signal or the non frequency shifted signal to produce a composite signal;
a communication module communicatively coupled to the processor for providing the composite signal over a single audio channel;
a power port for receiving energy or hosting a battery to power the processor and electronics of the audio controller for performing a multiplexing of audio signals to provide the composite signal over a single audio channel; and
the processor further configured for:
receiving the composite signal over the single audio channel;
band-filtering the composite signal for at least one independent audio channel to produce a filtered audio signal;
downward frequency shifting the filtered audio signal in the independent audio channel in an opposite direction to an upward frequency shifting previously applied on that audio channel to produce a baseband signal for that independent audio channel; and
band-filtering the baseband signal to generate a reconstructed audio signal delivered to the ECR.
15. The audio controller of claim 14 , further including an earpiece comprising:
at least one ambient sound microphone (ASM) for receiving an ambient sound signal and generating at least one ASM signal; and
an Ear Canal Microphone (ECM) for receiving an ear-canal signal measured in the user's ear-canal and generating an ECM signal,
wherein the ASM and ECM are communicatively coupled to the processor for providing the first audio link.
16. The audio controller of claim 15 , further comprising:
an Ear Canal Receiver (ECR) for receiving an audio signal and generating a sound field in a user ear-canal,
wherein the ECR is communicatively coupled to the processor for providing an output audio responsive to the processor, and wherein
the reconstructed audio signal is delivered to the ECR.
17. The audio controller of claim 14 , wherein the processor
determines a count of independently received audio signals;
allocates independent frequency channels within a channel bandwidth according to the count;
for each independent frequency channel, frequency shifts each of the independently received audio signals to an assigned independent frequency channel to produce a frequency shifted signal for each channel; and
sums the frequency shifted signals in each channel to produce the composite signal.
18. The audio controller of claim 14 , wherein the processor
reassigns the count as the independently received audio signals are connected or disconnected; and
adjusts the allocating of the independent frequency channels within a channel bandwidth according to the count.
19. The audio controller of claim 14 , wherein the processor
applies a Fast Fourier Transform (FFT) to a block of audio samples in a bandwidth range for the audio signal;
shifts the FFT to produce a shifted FFT; and
applies an Inverse Fast Fourier Transform (IFFT) to the shifted FFT to produce a real-time domain signal, and
wherein the summing of frequency shifted signals adds the real-time domain signal generated from each bandwidth range to produce the composite signal.