Location based audio signal message processing
A system is described that includes a display configured to visually display a mixed visual signal and audio signal, which includes a camera, a first microphone, a second microphone, two speakers, memory, a processor, that displays a mixed visual signal and the speakers emit a mixed audio signal.
1 . A system:
a display configured to visually display a mixed visual signal;
a camera configured to generate a camera signal;
a first microphone configured to generate a first microphone signal, wherein the first microphone is oriented to pick up a user's voice;
a second microphone configured to generate a second microphone signal, wherein the second microphone is oriented to pick up ambient sound;
a first speaker;
a second speaker;
a memory configured to store instructions; and
a processor that executes the instructions to perform operations, the operations comprising:
receiving the first microphone signal;
receiving the second microphone signal;
receiving a stored virtual audio signal;
receiving a stored virtual visual signal;
receiving the camera signal;
mixing a portion of the camera signal with the stored virtual visual signal to form a mixed visual signal;
mixing the first microphone signal and the second microphone signal and the virtual audio signal to form a mixed audio signal;
sending the mixed audio signal to the first speaker and the second speaker; and
sending the mixed visual signal to the display.
2 . The system according to claim 1 , wherein the portion of the camera signal is configured to fit the display as if the user could look through the display to the view behind the display.
3 . The system according to claim 1 , wherein when mixing the first microphone signal and the second microphone signal and the virtual audio signal to form a mixed audio signal, the signals are time matched when mixed.
4 . The system according to claim 1 , wherein when mixing a portion of the camera signal with the stored virtual visual signal to form a mixed visual signal, the signals are time matched when mixed.
5 . The system according to claim 3 , wherein when mixing a portion of the camera signal with the stored virtual visual signal to form a mixed visual signal, the signals are time matched when mixed.
6 . The system according to claim 1 , the operations further comprising:
time matching the mixed audio signal with the mixed visual signal.
7 . The system according to claim 1 , wherein the operations further comprise:
analyzing the first microphone signal to detect the voice of a user.
8 . The system according to claim 1 , wherein the operations further comprise:
analyzing the mixed audio signal to detect the voice of a user.
9 . The system according to claim 1 , wherein the operations further comprise:
analyzing the second microphone signal to detect the voice of a person other than the user.
10 . The system according to claim 1 , wherein the operations further comprise:
analyzing the mixed audio signal to detect the voice of a person other than the user.
11 . The system according to claim 7 , wherein the operations further comprise:
analyzing the first microphone signal to detect a voice command if the voice of the user is detected.
12 . The system according to claim 8 , wherein the operations further comprise:
analyzing the first microphone signal to detect a voice command if the voice of the user is detected.
13 . The system according to claim 11 , wherein the operations further comprise:
performing an action in response to the voice command.
14 . The system according to claim 12 , wherein the operations further comprise:
performing an action in response to the voice command.
15 . The system according to claim 1 , wherein the system is a VR goggle.
16 . The system according to claim 1 , wherein the system is an AR goggle.
17 . The system according to claim 1 , wherein the first speaker is part of a left earphone.
18 . The system according to claim 1 , wherein the second speaker is part of a right earphone.