Method and system for in-game visualization based on audio analysis
A game headset receives a plurality of channels of game and/or chat audio during game play, monitors the plurality of channels, and detect one or more sounds on the channels during the monitoring. The game headset determines characteristics of the detected one or more sound and outputs one or more signals for generating a visual representation of the detected one or more sounds based on the determined characteristics. The game headset output the signals to a game console that provides the game play. The game console displays the visual representation during the game play based on the communicated visualization information. The one or more signals is a video stream of an in-game visualization. The game headset outputs the one or more signals to a second screen communication device that generates the visual representation during the game play based on the signals.
1. A method comprising:
receiving, by audio processing circuitry of a headset via a wired or wireless link to a gaming device, game audio of a game being played on the gaming device;
processing, by the audio processing circuitry, the game audio to detect one or more sound sources; and
generating, by visualization circuitry of the headset, a video signal that conveys a visual representation of the detected one or more sound sources.
2. The method of claim 1 , comprising transmitting, by a transmitter of the headset, the video signal to a peripheral device.
3. The method of claim 1 , comprising transmitting, by a transmitter of the headset, the video signal to the gaming device.
4. The method of claim 1 , wherein the processing of the game audio comprises accessing a gaming sounds database that stores audio signatures.
5. The method of claim 1 , wherein the visual representation comprises a plurality of markers corresponding to the one or more sound sources.
6. The method of claim 5 , wherein the plurality of markers conveys relative positions of the one or more sound sources.
7. The method of claim 6 , wherein the plurality of markers conveys speed and/or direction of movement of the sound sources.
8. The method of claim 6 comprising determining, by the audio processing circuitry during the processing of the game audio, which one or more of a plurality of audio channels are carrying sounds from each of the detected one or more sound sources.
9. The method of claim 8 , wherein the visual representation comprises a plurality of markers corresponding to the one or more sound sources.
10. A system comprising:
a headset comprising
audio processing circuitry operable to:
receive, via a wired or wireless link to a gaming device, game audio of a game being played on the gaming device; and
process the game audio to detect one or more sound sources; and
visualization circuitry operable to generate a video signal that conveys a visual representation of the detected one or more sound sources.
11. The system of claim 10 , wherein the headset comprises a transmitter operable to transmit the video signal to a peripheral device.
12. The system of claim 10 , wherein the headset comprises a transmitter operable to transmit the video signal to the gaming device.
13. The system of claim 10 , wherein, as part of the processing of the game audio, the audio processing circuitry is operable to access a gaming sounds database that stores audio signatures.
14. The system of claim 10 , wherein the visual representation comprises a plurality of markers corresponding to the one or more sound sources.
15. The system of claim 14 , wherein the plurality of markers conveys relative positions of the one or more sound sources.
16. The system of claim 14 , wherein the plurality of markers conveys speed and/or direction of movement of the sound sources.
17. The system of claim 14 wherein the audio processing circuitry is operable to, during the processing of the game audio, determine which one or more of a plurality of audio channels are carrying sounds from each of the detected one or more sound sources.
18. The system of claim 17 , wherein the visual representation comprises a plurality of markers corresponding to the one or more sound sources.