IP Library Granted Patent US 12,246,250
Granted Patent B2
US 12,246,250 · App. 18/329,638 · Granted Mar 11, 2025

Graphical user interface and parametric equalizer in gaming systems

Inventors: Jeffrey Nicholas Mahlmeister (Glenview, IL); Simon Duffy (Chicago, IL); Battsengel Lopez (Copenhagen, DK); Michael John Lelli (Chicago, IL); Damien Kevin Granger (Lille, FR)
Assignee: STEELSERIES ApS
A63F13/424A63F13/213A63F13/215A63F13/533A63F13/537A63F13/54A63F13/79G06N3/02G06N3/08G10L15/16G10L15/26H04R3/12H04R5/033H04R5/04H04S7/302H04S7/308A63F13/87A63F2300/308A63F2300/5546A63F2300/572A63F2300/6072A63F2300/6081H04S2400/01H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,246,250
App. No.
18/329,638
Granted
Mar 11, 2025
Kind
B2
Abstract

A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Claims (76)

1. A device, comprising:

a processing system including a processor; and

a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:

receiving a live game output audio stream of a gaming application currently being played by a plurality of gamers including a first gamer, wherein the receiving a live game output audio steam comprises receiving a plurality of audio input channels related to the gaming application;

providing a graphical user interface on a display device of the first gamer of the plurality of gamers, the graphical user interface configured for selection of one or more live audio processing settings by the first gamer for the live game output audio stream including one or more of the plurality of audio input channels to adjust audio during gameplay of the gaming application;

receiving data defining the one or more live audio processing settings; and

modifying the live game output audio stream of the gaming application according to the one or more live audio processing settings,

wherein the providing a graphical user interface comprises providing a frequency spectrum analyzer interface for selection by the first gamer of the one or more live audio processing settings for the live game output audio stream.

2. The device of claim 1 , wherein the receiving data defining the one or more live audio processing settings comprises:

receiving settings of a parametric equalizer for tailoring audio during gameplay so that the first gamer can better understand activities of other players in the gaming application.

3. The device of claim 1 , wherein the operations further comprise:

separating the live game output audio stream of the gaming application into the plurality of audio input channels, respective audio input channels of the plurality of audio input channels associated with respective audio sources of a plurality of audio sources related to the gaming application; and

routing the respective audio input channels of the plurality of audio input channels to respective audio output devices of a plurality of audio output devices.

4. The device of claim 3 , wherein the operations further comprise:

automatically detecting the plurality of audio sources;

automatically detecting the plurality of audio output devices; and

automatically routing each respective audio input channel from a respective audio source to a respective audio output device.

5. The device of claim 4 , wherein the operations further comprise:

pre-populating a routing matrix for controlling automatic routing of the plurality of audio input channels to the plurality of audio output devices.

6. The device of claim 5 , wherein the operations further comprise:

providing, on the graphical user interface on the display device of the first gamer, a user interface for selecting audio routing of the plurality of audio input channels;

receiving, from the user interface for selecting audio routing, gamer routing selection information; and

modifying the routing matrix according to the gamer routing selection information.

7. The device of claim 1 , wherein the operations further comprise:

separating the live game output audio stream of the gaming application into the plurality of audio input channels;

receiving respective live audio processing settings for respective audio input channels of the plurality of audio input channels; and

modifying each respective audio stream of the plurality of audio input channels according to the respective live audio processing settings.

8. The device of claim 7 , wherein the operations further comprise:

receiving, from the graphical user interface, data defining a filter type for a plurality of filters, each filter of the plurality of filters corresponding to a frequency band of a plurality of frequency bands;

establishing the plurality of filters; and

modifying the live game output audio stream of the gaming application according to the plurality of filters.

9. The device of claim 8 , wherein the operations further comprise:

receiving, from the graphical user interface, data defining a user-selectable center frequency and a gain for each respective frequency band for the plurality of the plurality of frequency bands.

10. A method, comprising:

receiving, by a processing system including a processor and a memory, a live game output audio stream of a gaming application played by a plurality of gamers including a first gamer, wherein the receiving a live game output audio steam comprises receiving a plurality of audio input channels related to the gaming application;

providing, by the processing system, a graphical user interface on a display device of the first gamer of the plurality of gamers, the graphical user interface configured for selection of one or more live audio processing settings by the first gamer for the live game output audio stream including one or more of the plurality of audio input channels to adjust audio during gameplay of the gaming application;

receiving, by the processing system, data defining the one or more live audio processing settings; and

modifying, by the processing system, the live game output audio stream according to the one or more live audio processing settings,

wherein the receiving data defining the one or more live audio processing settings comprises receiving settings of a parametric equalizer for tailoring audio during gameplay so that the first gamer can better understand activities of other players in the gaming application.

11. The method of claim 10 , wherein the providing a graphical user interface comprises:

providing a frequency spectrum analyzer interface for selection by the first gamer of the one or more live audio processing settings for the live game output audio stream.

12. The method of claim 10 , further comprising:

separating, by the processing system, the live game output audio stream of the gaming application into the plurality of audio input channels, respective audio input channels of the plurality of audio input channels associated with respective audio sources of a plurality of audio sources related to the gaming application; and

routing, by the processing system, the respective audio input channels of the plurality of audio input channels to respective audio output devices of a plurality of audio output devices.

13. The method of claim 12 , further comprising:

automatically detecting, by the processing system, the plurality of audio sources;

automatically detecting, by the processing system, the plurality of audio output devices; and

automatically routing, by the processing system, each respective audio input channel from a respective audio source to a respective audio output device.

14. The method of claim 13 , further comprising:

pre-populating, by the processing system, a routing matrix for controlling automatic routing of the plurality of audio input channels to the plurality of audio output devices.

15. The method of claim 14 , further comprising:

providing, by the processing system and on the graphical user interface on the display device of the first gamer, a user interface for selecting audio routing of the plurality of audio input channels;

receiving, by the processing system and from the user interface for selecting audio routing, gamer routing selection information; and

modifying, by the processing system, the routing matrix according to the gamer routing selection information.

16. The method of claim 10 , further comprising:

separating, by the processing system, the live game output audio stream of the gaming application into the plurality of audio input channels;

receiving, by the processing system, respective live audio processing settings for respective audio input channels of the plurality of audio input channels; and

modifying, by the processing system, each respective audio stream of the plurality of audio input channels according to the respective live audio processing settings.

17. The method of claim 16 , further comprising:

receiving, by the processing system and from the graphical user interface, data defining a filter type for a plurality of filters, each filter of the plurality of filters corresponding to a frequency band of a plurality of frequency bands;

establishing, by the processing system, the plurality of filters; and

modifying, by the processing system, the live game output audio stream of the gaming application according to the plurality of filters.

18. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:

receiving a live game output audio stream of a gaming application currently being played by a first gamer, wherein the receiving a live game output audio steam comprises receiving a plurality of audio input channels related to the gaming application;

providing a user interface, the user interface configured for selection of one or more live audio processing settings for the live game output audio stream including one or more of the plurality of audio input channels to adjust audio during gameplay of the gaming application;

receiving data defining the one or more live audio processing settings; and

modifying the live game output audio stream of the gaming application according to the one or more live audio processing settings,

wherein the providing a user interface comprises providing a frequency spectrum analyzer interface for selection by the first gamer of the one or more live audio processing settings for the live game output audio stream.

19. The non-transitory machine-readable medium of claim 18 , wherein the operations further comprise:

separating the live game output audio stream of the gaming application into the plurality of audio input channels;

receiving respective selections of the live audio processing settings for respective audio input channels of the plurality of audio input channels; and

modifying, by the processing system, each respective audio stream of the plurality of audio input channels according to the respective selections of the live audio processing settings.

20. The non-transitory machine-readable medium of claim 19 , wherein the operations further comprise:

receiving, from the user interface, data defining a filter type for a plurality of filters, each filter of the plurality of filters corresponding to a frequency band of a plurality of frequency bands;

establishing the plurality of filters; and

modifying, by the processing system, the live game output audio stream of the gaming application according to the plurality of filters.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 23, 2025
From: STEELSERIES APS
To: GN STORE NORD A/S
Reel/Frame 069988/0950 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2023
From: MAHLMEISTER, JEFFREY NICHOLAS; DUFFY, SIMON; LOPEZ, BATTSENGEL; LELLI, MICHAEL JOHN; GRANGER, DAMIEN KEVIN
To: STEELSERIES APS
Reel/Frame 064209/0526 →
Continuity (3)
Continuation 17507941 · Oct 22, 2021
Provisional Application 63240004 · Sep 2, 2021
Related Publication 20230364508A1 · Nov 16, 2023
References Cited (53)
US 7479063B2 · Pryzby · 2009 [cited by examiner]
US 8811629B1 · Kulavik et al. · 2014 [cited by applicant]
US 9675871B1 · Jetter · 2017 [cited by examiner]
US 11011015B2 · Achmueller · 2021 [cited by examiner]
US 20030100359A1 · Loose · 2003 [cited by examiner]
US 20050043090A1 · Pryzby · 2005 [cited by examiner]
US 20050277469A1 · Pryzby · 2005 [cited by examiner]
US 20080320545A1 · Schwartz · 2008 [cited by examiner]
US 20100040240A1 · Bonanno et al. · 2010 [cited by applicant]
US 20100100820A1 · Bryant et al. · 2010 [cited by applicant]
US 20100120533A1 · Bracken et al. · 2010 [cited by applicant]
US 20100261523A1 · Bonney · 2010 [cited by examiner]
US 20120014553A1 · Bonanno · 2012 [cited by applicant]
US 20130331188A1 · Bonney · 2013 [cited by examiner]
US 20140073429A1 · Meneses et al. · 2014 [cited by applicant]
US 20140153727A1 · Walsh et al. · 2014 [cited by applicant]
US 20150005073A1 · Cudak et al. · 2015 [cited by applicant]
US 20150106711A1 · Virolainen · 2015 [cited by examiner]
US 20150222239A1 · Zhang et al. · 2015 [cited by applicant]
US 20150302684A1 · Loose · 2015 [cited by examiner]
US 20160303474A1 · Kuruba Buchannagari et al. · 2016 [cited by applicant]
US 20170046906A1 · Hilbert · 2017 [cited by examiner]
US 20180193747A1 · Bracken et al. · 2018 [cited by applicant]
US 20180310115A1 · Romigh · 2018 [cited by applicant]
US 20180353855A1 · Niemeyer et al. · 2018 [cited by applicant]
US 20190308096A1 · Kuruba Buchannagari et al. · 2019 [cited by applicant]
US 20200043282A1 · Keilwert · 2020 [cited by examiner]
US 20200097312A1 · Kotteri · 2020 [cited by examiner]
US 20200242887A1 · Achmueller · 2020 [cited by examiner]
US 20200353361A1 · Wang · 2020 [cited by applicant]
US 20220203232A1 · Wiggeshoff · 2022 [cited by examiner]
US 20220410004A1 · Van Welzen et al. · 2022 [cited by applicant]
US 20230060590A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230060642A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230063610A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230064627A1 · Souviraa-Labastie et al. · 2023 [cited by applicant]
US 20230066209A1 · Greff et al. · 2023 [cited by applicant]
US 20230067090A1 · Greff et al. · 2023 [cited by applicant]
US 20230068527A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230330527A1 · Mahlmeister et al. · 2023 [cited by applicant]
International Preliminary Report on Patentability for PCT/2022/042292 mailed Mar. 14, 2024. [cited by applicant]
Int'l Search Report & Written Opinion for PCT/US2022/042292 mailed Jan. 25, 2023, 9 pages. [cited by applicant]
“PS5 3D Audio—Customize These Settings to Get the Perfect Sound for Your PlayStation 5 Gaming Setup”, https://www.youtube.com/watch?v=SjCv3-WNHGw, Jan. 11, 2021, 1 pg. [cited by applicant]
“Teamspeak: 3D Sound—what is it?”, technical-tips, Nov. 11, 2020, technical-tips.com/blog/software/teamspeak-3d-sound-1201., Nov. 11, 2020, 2 pgs. [cited by applicant]
Hennequin, Romain , et al., “Spleeter: a fast and efficient music source separation tool with pre-trained models”, Journal of Open Source Software, 1 (5(50), 2154, Jun. 24, 2020, 4 pages. [cited by applicant]
Iwaya , “Individualization of head-related transfer functions with tournament-style listening test: Listening with other's ears”, Acoust. Sci. & Tech., vol. 27, No. 6, Nov. 2006, pp. 340-343., 5 pgs. [cited by applicant]
Lundqvist, Jonas , “In a real game situation, is HRTF-enhanced game audio preferable over regular stereo game audio?”, Luleå University of Technology | Bachelor thesis | Audio Technology |Department of Music and media |… [cited by applicant]
Mills, Matt , “What is HRTF: Listening to Positional Audio in Games”, https://itigic.com/hrtf-listening-to-positional-audio-in-games/, 7 pgs. [cited by applicant]
Moore-Coyler, Roland , “PS5 and 3D audio: Everything you need to know”, https://www.tomsguide.com/features/ps5-and-3d-audio-everything-you-need-to-know, Oct. 6, 2020, 17 pages. [cited by applicant]
Poirier-Quinot , et al., “Impact of HRTF individualization on player performance in a VR shooter game I”, Conference on Spatial Reproduction, Aug. 2018, 7 pgs. [cited by applicant]
Rothbucher , et al., “Integrating a H RTF-based Sound Synthesis System into Mumble”, MMSP, pp. 24-28., Oct. 1, 2010, 5 pgs. [cited by applicant]
Seeber , et al., “Subjective Selection of Non-Individual Head-Related Transfer Functions”, Proceedings of the 2003 International Conference on Auditory Display, Jul. 2003, 4 pgs. [cited by applicant]
Shukla , et al., “User selection of optimal HRTF sets via holistic comparative evaluation”, Conference on Audio for Virtual and Augmented Reality, Aug. 2018., 10 pages. [cited by applicant]