Method and system for in-game visualization based on audio analysis
View Patent ↗A game headset receives a plurality of channels of game and/or chat audio during game play, monitors the plurality of channels, and detect one or more sounds on the channels during the monitoring. The game headset determines characteristics of the detected one or more sound and outputs one or more signals for generating a visual representation of the detected one or more sounds based on the determined characteristics. The game headset output the signals to a game console that provides the game play. The game console displays the visual representation during the game play based on the communicated visualization information. The one or more signals is a video stream of an in-game visualization. The game headset outputs the one or more signals to a second screen communication device that generates the visual representation during the game play based on the signals.
1. A method, comprising:
in a game headset that receives a plurality of channels of game and/or chat audio during game play:
monitoring said plurality of channels;
detecting one or more sounds on one or more of said plurality of channels during said monitoring;
determining characteristics of said detected one or more sounds; and
outputting one or more signals for generating a visual representation of said detected one or more sounds based on said determined characteristics.
2. The method according to claim 1 , comprising outputting said one or more signals to a game console that provides said game play.
3. The method according to claim 2 , wherein said game console is operable to display said visual representation during said game play based on said outputted one or more signals.
4. The method according to claim 1 , wherein said one or more signals is a video stream of an in-game visualization.
5. The method according to claim 2 , comprising outputting said one or more signals to a second screen communication device, wherein said second screen communication device is operable to generate said visual representation during said game play based on said one or more signals.
6. The method according to claim 1 , wherein said determining said characteristics of said detected one or more sounds comprises determining one or more of: changes in which of said plurality of channels are carrying said detected one or more sounds, changes in intensity or loudness of said detected one or more sound, and changes in frequency of occurrence of said detected one or more sounds.
7. The method according to claim 1 , wherein said characteristics comprises one or more of: intensity or loudness of said detected one or more sounds, which of said plurality of channels are carrying said detected one or more sounds, and frequency of occurrence of said detected one or more sounds.
8. The method according to claim 1 , comprising performing signal analysis on said plurality of channels of game and/or chat audio during said game play for said determining of said characteristics of said one or more sounds.
9. The method according to claim 1 , wherein said visual representation of said detected one or more sounds comprises a graphical representation of a location of said detected one or more sounds, and a graphical representation of one or more of said determined characteristics of said detected one or more sounds.
10. The method according to claim 9 , wherein said graphical representation of one or more of said determined characteristics of said detected one or more sounds comprises one or more of: a static representation, an animated representation and a dynamic representation.
11. A system, comprising:
a game headset that receives a plurality of channels of game and/or chat audio during game play, said game headset is operable to:
monitor said plurality of channels;
detect one or more sounds on one or more of said plurality of channels during said monitoring;
determine characteristics of said detected one or more sounds; and
output one or more signals for generating a visual representation of said detected one or more sounds based on said determined characteristics.
12. The system according to claim 11 , wherein said game headset is operable to output said one or more signals to a game console that provides said game play.
13. The system according to claim 12 , wherein said game console is operable to display said visual representation during said game play based on said output one or more signals.
14. The system according to claim 11 , wherein said one or more signals is a video stream of an in-game visualization.
15. The system according to claim 12 , wherein said game headset is operable to output said one or more signals to a second screen communication device, wherein said second screen communication device is operable to generate said visual representation during said game play based on said one or more signals.
16. The system according to claim 11 , wherein said determining said characteristics of said detected one or more sounds comprises determining one or more of: changes in which of said plurality of channels are carrying said detected one or more sounds, changes in intensity or loudness of said detected one or more sound, and changes in frequency of occurrence of said detected one or more sounds.
17. The system according to claim 11 , wherein said characteristics comprises one or more of: intensity or loudness of said detected one or more sounds, which of said plurality of channels are carrying said detected one or more sounds, and frequency of occurrence of said detected one or more sounds.
18. The system according to claim 11 , wherein said game headset is operable to perform signal analysis on said plurality of channels of game and/or chat audio during said game play for said determining of said characteristics of said one or more sounds.
19. The system according to claim 11 , wherein:
said visual representation of said detected one or more sounds comprises a graphical representation of a location of said detected one or more sounds, and a graphical representation of one or more of said determined characteristics of said detected one or more sounds; and
said graphical representation of one or more of said determined characteristics of said detected one or more sounds comprises one or more of: a static representation, an animated representation and a dynamic representation.
20. A non-transitory computer readable medium having stored thereon, a computer program having at least one code section that is executable by a machine for causing the machine to perform steps comprising:
monitoring, in a game headset that receives a plurality of channels of game and/or chat audio during game play, said plurality of channels;
detecting one or more sounds on one or more of said plurality of channels during said monitoring;
determining characteristics of said detected one or more sounds; and
outputting one or more signals for generating a visual representation of said detected one or more sounds based on said determined characteristics.