IP Library Granted Patent US 12,397,229
Granted Patent B2
US 12,397,229 · App. 18/492,909 · Granted Aug 26, 2025

Audio mixing and equalization in gaming systems

Inventors: Jeffrey Nicholas Mahlmeister (Glenview, IL); Simon Duffy (Chicago, IL); Paul Allais (Saint André-lez-Lille, FR); Raphaël Greff (Lille, FR); Thomas J. Panfil (La Grange, IL); Cédric Demière (Saint-Amand-les-Eaux, FR); Battsengel Lopez (Copenhagen SV, DK); Vincenzo Giamundo (Lille, FR); Hong Cong Tuyen Pham (Croix, FR)
Assignee: GN Store Nord A/S
A63F13/424A63F13/213A63F13/215A63F13/54A63F13/79A63F13/533A63F13/537A63F13/87A63F2300/308A63F2300/5546A63F2300/572A63F2300/6072A63F2300/6081G06N3/02G06N3/08G10L15/16G10L15/26H04R3/12H04R5/033H04R5/04H04S7/302H04S7/308H04S2400/01H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,397,229
App. No.
18/492,909
Granted
Aug 26, 2025
Kind
B2
Abstract

A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Claims (74)

1. A method, comprising:

receiving, by a processing system including a processor, a plurality of audio streams including a game output audio stream of a gaming application, a gamer chat audio stream produced by a plurality of gamers participating in the gaming application, and a gamer microphone audio stream produced by one gamer of the plurality of gamers;

providing, by the processing system, on a display device of the one gamer, a graphical user interface for selection of audio processing settings by the one gamer, the graphical user interface including an audio stream selector configured for actuation by the one gamer to select for display, on the graphical user interface, one of a gaming audio control panel, a chat audio control panel and a microphone audio control panel;

receiving, by the processing system, from the graphical user interface, data defining the audio processing settings;

processing, by the processing system, the game output audio stream according to first audio processing settings of the audio processing settings, forming a processed game output audio stream;

processing, by the processing system, the gamer chat audio stream according to second audio processing settings of the audio processing settings, forming a processed gamer chat audio stream;

processing, by the processing system, the gamer microphone audio stream according to third audio processing settings of the audio processing settings, forming a processed gamer microphone audio stream;

providing, by the processing system, the processed game output audio stream and the processed gamer chat audio stream to audio equipment of the one gamer; and

providing, by the processing system, the processed gamer microphone audio stream to one or more gamers of the plurality of gamers.

2. The method of claim 1 , further comprising:

adjusting, by the processing system, a volume level of the processed game output audio stream according the first audio processing settings;

adjusting, by the processing system, a volume level of the processed gamer chat audio stream according to the second audio processing settings; and

providing the processed game output audio stream a game volume level and the processed gamer chat audio stream at a chat volume level to the audio equipment of the one gamer.

3. The method of claim 2 , wherein the providing a graphical user interface comprises:

providing, by the processing system, on a portion of the display device of the one gamer, a game parametric equalizer for the game output audio stream, wherein the providing the game parametric equalizer is responsive to actuation by the one gamer of the audio stream selector;

providing, by the processing system, on a portion of the display device of the one gamer, a chat parametric equalizer for the gamer chat audio stream, wherein the providing the chat parametric equalizer is responsive to actuation by the one gamer of the audio stream selector; and

receiving, by the processing system, gamer equalizer inputs at the game parametric equalizer and at the chat parametric equalizer from the one gamer to select respective gain values for respective frequency bands of the game parametric equalizer for the game output audio stream and to select respective game value for respective frequency bands of the chat parametric equalizer for the gamer chat audio stream.

4. The method of claim 3 , wherein the providing a graphical user interface comprises:

providing, by the processing system, on a portion of the display device of the one gamer, a microphone parametric equalizer for the gamer microphone audio stream, wherein the providing the microphone parametric equalizer is responsive to actuation by the one gamer of the audio stream selector.

5. The method of claim 3 , further comprising:

filtering, by the processing system, in a plurality of filters, the game output audio stream, wherein the filtering is according to the gamer equalizer inputs.

6. The method of claim 5 , further comprising:

receiving, by the processing system, gamer quality (Q) value inputs at the game parametric equalizer from the one gamer to select a Q value for the game parametric equalizer; and

adjusting, by the processing system, a frequency response of at least one filter of the plurality of filters according to the gamer Q value inputs.

7. The method of claim 1 , further comprising:

receiving, by the processing system, a gaming audio stream produced by the gaming application;

establishing, by the processing system, a game output virtual audio driver;

producing, by the game output virtual audio driver, the game output audio stream;

establishing, by the processing system, a gamer chat virtual audio driver;

producing, by the gamer chat virtual audio driver, the gamer chat audio stream;

establishing, by the processing system, a gamer microphone virtual audio driver; and

producing, by the gamer microphone virtual audio driver, the gamer microphone audio stream.

8. The method of claim 1 , further comprising:

receiving, by the processing system, a gamer profile of the one gamer, the gamer profile defining audio processing settings including the first audio processing settings, the second audio processing settings and the third audio processing settings of the one gamer.

9. The method of claim 1 , further comprising:

identifying, by the processing system, the gaming application; and

receiving, by the processing system, a game profile of the gaming application based on the identifying the gaming application, the game profile defining audio processing settings including the first audio processing settings, the second audio processing settings and the third audio processing settings of the one gamer for the gaming application.

10. The method of claim 9 , further comprising:

providing, by the processing system, on the graphical user interface, a mixer input for actuation by the one gamer to vary an audio volume of the processed game output audio stream and an audio volume of the processed gamer chat audio stream to audio equipment of the one gamer; and

receiving, by the processing system, from the graphical user interface, data defining the audio processing settings.

11. The method of claim 1 , wherein the processing the game output audio stream comprises:

forming, by the processing system, a virtual surround sound game audio; and

providing, by the processing system, the virtual surround sound game audio to the audio equipment of the one gamer.

12. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:

receiving, from a gaming application, gaming output information including a game output audio stream; and

receiving, at an audio processing module in data communication with the gaming application, the game output audio stream from the gaming application and producing a plurality of game audio streams;

providing, on a display device of a gamer, a graphical user interface configured to receive, from the gamer, gamer input including information about respective audio customizations for the plurality of game audio streams, the graphical user interface including an audio stream selector configured for actuation by the gamer to select a display of one of a gaming audio control panel, a chat audio control panel and a microphone audio control panel; and

applying, by the audio processing module, respective audio customizations to each respective game audio stream of the plurality of game audio streams, according to the gamer input.

13. The non-transitory machine-readable medium of claim 12 , wherein the operations further comprise:

receiving, at the graphical user interface on the display device of the gamer, an actuation of the audio stream selector to select adjustment of one of the gaming audio control panel, a chat audio control panel and a microphone audio control panel, forming a selected audio stream; and

receiving the gamer input defining the respective audio customizations for the selected audio stream.

14. The non-transitory machine-readable medium of claim 13 , wherein the operations further comprise:

providing a parametric equalizer on the graphical user interface; and

receiving gamer equalizer inputs at the parametric equalizer from the gamer to select respective gain values for respective frequency bands of the parametric equalizer for the selected audio stream.

15. The non-transitory machine-readable medium of claim 14 , wherein the operations further comprise:

establishing a plurality of filters, respective filters of the plurality of filters corresponding to the respective frequency bands of the parametric equalizer; and

filtering, in the plurality of filters, the selected audio stream, wherein the filtering is according to the gamer equalizer inputs.

16. The non-transitory machine-readable medium of claim 13 , wherein the operations further comprise:

identifying one or more audio output devices of the gamer; and

receiving, from the graphical user interface, information controlling a mapping of a respective game audio stream of the plurality of game audio streams to a selected audio output device of the one or more audio output devices.

17. A device, comprising

a processing system including a processor; and

a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:

receiving, from a gaming application, gaming output information including a game output audio stream, the game audio output stream including a plurality of game audio streams;

providing a graphical user interface configured for receipt of user manipulations of the graphical user interface, the user manipulations including actuation of an audio stream selector to select for display, on the graphical user interface, a respective gaming audio control panel of a plurality of gaming audio control panels, the plurality of gaming audio control panels for modifying the plurality of game audio streams, forming a selected gaming audio control panel;

receiving, at the graphical user interface, gamer input defining audio customizations for a selected game audio stream of the plurality of game audio streams;

communicating, by a virtual audio device in data communication with the gaming application, the plurality of game audio streams of the gaming application with one or more audio output devices of a gamer; and

applying, by an audio processing module in data communication with the virtual audio device, the audio customizations to the selected game audio stream, according to the gamer input.

18. The device of claim 17 , wherein the operations further comprise:

displaying, at the graphical user interface, a parametric equalizer interface, the parametric equalizer interface adapted to display a selected one parametric equalizer of a plurality of parametric equalizers, each respective parametric equalizer of the plurality of parametric equalizers corresponding to a respective game audio stream of the plurality of game audio streams, the selected one parametric equalizer being selected according to the actuation of the audio stream selector.

19. The device of claim 18 wherein the operations further comprise:

receiving, from the graphical user interface, information controlling a mapping of a respective game audio stream of the plurality of game audio streams to a selected audio output device of the one or more audio output devices.

20. The device of claim 18 wherein the operations further comprise:

receiving, from an operating system of the device, information controlling a mapping of a respective game audio stream of the plurality of game audio streams to a selected audio output device of the one or more audio output devices.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2025
From: STEELSERIES APS
To: GN STORE NORD A/S
Reel/Frame 071995/0038 →
NUNC PRO TUNC ASSIGNMENT Recorded Jan 23, 2025
From: STEELSERIES APS
To: GN STORE NORD A/S
Reel/Frame 069988/0950 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2023
From: MAHLMEISTER, JEFFREY NICHOLAS; DUFFY, SIMON; ALLAIS, PAUL; GREFF, RAPHAEL; PANFIL, THOMAS J.; DEMIERE, CEDRIC; LOPEZ, BATTSENGEL; GIAMUNDO, VINCENZO; PHAM, HONG CONG TUYEN
To: STEELSERIES APS
Reel/Frame 065401/0990 →
Continuity (3)
Continuation 17507889 · Oct 22, 2021
Provisional Application 63240004 · Sep 2, 2021
Related Publication 20240066400A1 · Feb 29, 2024
References Cited (51)
US 7479063B2 · Pryzby et al. · 2009 [cited by applicant]
US 8811629B1 · Kulavik · 2014 [cited by examiner]
US 9675871B1 · Jetter · 2017 [cited by examiner]
US 11011015B2 · Achmueller et al. · 2021 [cited by applicant]
US 20030044002A1 · Yeager et al. · 2003 [cited by applicant]
US 20030100359A1 · Loose et al. · 2003 [cited by applicant]
US 20050043090A1 · Pryzby et al. · 2005 [cited by applicant]
US 20050277469A1 · Pryzby et al. · 2005 [cited by applicant]
US 20080320545A1 · Schwartz · 2008 [cited by applicant]
US 20100040240A1 · Bonanno et al. · 2010 [cited by applicant]
US 20100100820A1 · Bryant et al. · 2010 [cited by applicant]
US 20100120533A1 · Bracken et al. · 2010 [cited by applicant]
US 20100261523A1 · Bonney et al. · 2010 [cited by applicant]
US 20120014553A1 · Bonanno · 2012 [cited by examiner]
US 20130331188A1 · Bonney et al. · 2013 [cited by applicant]
US 20140073429A1 · Meneses et al. · 2014 [cited by applicant]
US 20140153727A1 · Walsh et al. · 2014 [cited by applicant]
US 20150005073A1 · Cudak et al. · 2015 [cited by applicant]
US 20150106711A1 · Virolainen · 2015 [cited by applicant]
US 20150222239A1 · Zhang et al. · 2015 [cited by applicant]
US 20150302684A1 · Loose et al. · 2015 [cited by applicant]
US 20160303474A1 · Kuruba Buchannagari et al. · 2016 [cited by applicant]
US 20180193747A1 · Bracken et al. · 2018 [cited by applicant]
US 20180310115A1 · Romigh · 2018 [cited by applicant]
US 20180353855A1 · Niemeyer et al. · 2018 [cited by applicant]
US 20190308096A1 · Kuruba Buchannagari et al. · 2019 [cited by applicant]
US 20200043282A1 · Keilwert et al. · 2020 [cited by applicant]
US 20200097312A1 · Kotteri et al. · 2020 [cited by applicant]
US 20200242887A1 · Achmueller et al. · 2020 [cited by applicant]
US 20200353361A1 · Wang · 2020 [cited by applicant]
US 20220410004A1 · Van Welzen et al. · 2022 [cited by applicant]
US 20230060590A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230060642A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230063610A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230064627A1 · Souviraa-Labastie et al. · 2023 [cited by applicant]
US 20230066209A1 · Greff et al. · 2023 [cited by applicant]
US 20230067090A1 · Greff et al. · 2023 [cited by applicant]
US 20230068527A1 · Mahlmeister et al. · 2023 [cited by applicant]
International Preliminary Report on Patentability for PCT/2022/042292 mailed Mar. 14, 2024. [cited by applicant]
Int'l Search Report & Written Opinion for PCT/US2022/042292 mailed Jan. 25, 2023, 9 pages. [cited by applicant]
“PS5 3D Audio—Customize These Settingsto Get the Perfect Sound for Your PlayStation 5 Gaming Setup”, https://www.youtube.com/watch?v=SjCv3-WNHGw, Jan. 11, 2021, 1 pg. [cited by applicant]
“Teamspeak: 3D Sound—what is it?”, technical-tips, Nov. 11, 2020, technical-tips.com/blog/software/teamspeak-3d-sound—1201., Nov. 11, 2020, 2 pgs. [cited by applicant]
Hennequin, Romain , et al., “Spleeter: a fast and efficient music source separation tool with pre-trained models”, Journal of Open Source Software, 1 (5(50), 2154, Jun. 24, 2020, 4 pages. [cited by applicant]
Iwaya , “Individualization of head-related transfer functions with tournament-style listening test: Listening with other's ears”, Acoust. Sci. & Tech., vol. 27, No. 6, Nov. 2006, pp. 340-343., 5 pgs. [cited by applicant]
Lundqvist, Jonas , “In a real game situation, is HRTF-enhanced game audio preferable over regular stereo game audio?”, Luleå University of Technology | Bachelor thesis | Audio Technology |Department of Music and media |… [cited by applicant]
Mills, Matt , “What is HRTF: Listening to Positional Audio in Games”, https://itigic.com/hrtf-listening-to-positional-audio-in-games/, 7 pgs. [cited by applicant]
Moore-Coyler, Roland , “PS5 and 3D audio: Everything you need to know”, https://www.tomsguide.com/features/ps5-and-3d-audio-everything-you-need-to-know, Oct. 6, 2020, 17 pages. [cited by applicant]
Poirier-Quinot , et al., “Impact of HRTF individualization on player performance in a VR shooter game I”, Conference on Spatial Reproduction, Aug. 2018, 7 pgs. [cited by applicant]
Rothbucher , et al., “Integrating a H RTF-based Sound Synthesis System into Mumble”, MMSP, pp. 24-28., Oct. 1, 2010, 5 pgs. [cited by applicant]
Seeber , et al., “Subjective Selection of Non-Individual Head-Related Transfer Functions”, Proceedings of the 2003 International Conference on Auditory Display, Jul. 2003, 4 pgs. [cited by applicant]
Shukla , et al., “User selection of optimal HRTF sets via holistic comparative evaluation”, Conference on Audio for Virtual and Augmented Reality, Aug. 2018., 10 pages. [cited by applicant]