IP Library Granted Patent US 12,377,347
Granted Patent B2
US 12,377,347 · App. 18/522,396 · Granted Aug 5, 2025

Selecting head related transfer function profiles for audio streams in gaming systems

Inventors: Raphaël Greff (Lille, FR); Vincenzo Giamundo (Lille, FR); Timothée Pourbaix (Lille, FR)
Assignee: STEELSERIES ApS
A63F13/424A63F13/213A63F13/215A63F13/54A63F13/79A63F13/533A63F13/537A63F13/87A63F2300/308A63F2300/5546A63F2300/572A63F2300/6072A63F2300/6081G06N3/02G06N3/08G10L15/16G10L15/26H04R3/12H04R5/033H04R5/04H04S7/302H04S7/308H04S2400/01H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,377,347
App. No.
18/522,396
Granted
Aug 5, 2025
Kind
B2
Abstract

A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Claims (55)

1. A device, comprising

a gaming application that produces a game output audio stream;

a chat audio application that produces one or more chat audio streams from one or more other devices;

an audio processing module in data communication with the gaming application and the chat audio application, the audio processing module including a head-related transfer function (HRTF) module in data communication with the gaming application, the HRTF module operative to receive the game output audio stream from the gaming application and to apply a personalized HRTF to the game output audio stream to produce a game surround sound audio stream, wherein the HRTF module is further operative to receive a plurality of chat audio streams from the chat audio application and apply one of different chat HRTFs to each of the plurality of chat audio streams to produce a plurality of chat surround sound audio streams, wherein each of the different chat HRTFs have a particular direction that follows an avatar of a respective player in a visual game space of the respective chat audio stream associated with the respective player, wherein separate HRTFs are selected by a user of the device and applied to each of the different chat HRTFs respectively, and wherein the HRTF module is further operative to combine the game surround sound audio stream and the chat surround sound audio streams to produce a surround sound audio stream; and

a speaker system coupled with the HRTF module and operative to receive the surround sound audio stream and produce surround sound audio for the user of the device.

2. The device of claim 1 , wherein the audio processing module enables the user to position each of the plurality of chat audio streams to appear to come from separate directions around the user.

3. The device of claim 1 , wherein the speaker system comprises a headset worn by the user of the device.

4. The device of claim 1 , wherein the device comprises a laptop computer system and wherein the speaker system comprises a right speaker and a left speaker built into the laptop computer system for providing audio to the user of the device.

5. The device of claim 1 , further comprising: a graphical user interface module operative to provide instructions to the user to guide the user through a HRTF selection procedure to identify the personalized HRTF, the different chat HRTFs, and to receive input from the user identifying the personalized HRTF and the different chat HRTFs.

6. The device of claim 5 , wherein the graphical user interface module is further operative to present one or more audio test files to a plurality of standardized HRTFs and receive from the user an indication of the personalized HRTF.

7. The device of claim 6 , wherein the graphical user interface module is further operative to present a series of A/B tests to the user, each A/B test of the series of A/B tests using a first HRTF and a second HRTF of the plurality of standardized HRTFs, the graphical user interface module operative to receive from the user an indication of the personalized HRTF from each A/B test of the series of A/B tests.

8. The device of claim 1 , wherein the different chat HRTFs arrange audio from each of the plurality of chat audio streams in a circle around an audio space of the user.

9. The device of claim 1 , further comprising: a graphical user interface module operative to receive user inputs from the user of the device to control the HRTF module.

10. The device of claim 1 , wherein the audio processing module enables the user to position a chat audio stream of the user to appear to come from a selected direction as heard by any other player.

11. A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:

receiving a game output audio stream from a gaming system;

applying a personalized head-related transfer function (HRTF) to the game audio output stream to produce a game surround sound audio stream;

receiving a plurality of chat audio streams from players operating one or more respective other gaming systems;

applying one of different chat HRTFs to each of the plurality of chat audio streams to produce a plurality of chat surround sound audio streams, wherein each of the different chat HRTFs have a particular direction that follows an avatar of a player in a visual game space of the respective chat audio stream associated with the player, wherein separate HRTFs are selected by a user of the gaming system and applied to each of the different chat HRTFs respectively;

combining the game surround sound audio stream and the plurality of chat surround sound audio streams to produce a surround sound audio stream;

and

providing the surround sound audio stream to audio equipment of the user of the gaming system.

12. The non-transitory, machine-readable medium of claim 11 , wherein the operations further comprise:

providing a first listening test of a first standard head-related transfer function;

providing a second listening test of a second standard head-related transfer function; and

receiving a selection of the personalized head-related transfer function among first standard head-related transfer function and the second standard head-related transfer function based on preference of the user for the first listening test or the second listening test.

13. The non-transitory, machine-readable medium of claim 11 , wherein the operations further comprise:

selecting a first head-related transfer function;

selecting a second head-related transfer function;

performing listening tests of the first head-related transfer function and the second head-related transfer function;

receiving a second selection of a new head-related transfer function among the first head-related transfer function and the second head-related transfer function; and

selecting the new preferred head-related transfer function as the personalized HRTF.

14. The non-transitory, machine-readable medium of claim 11 , wherein the receiving the game output audio stream from the gaming system comprises:

receiving user input defining respective audio customizations for the game output audio stream and the plurality of chat audio streams;

applying the respective audio customizations to the game output audio stream and the plurality of chat audio streams, according to the user input, producing a customized game audio stream and a customized chat audio stream; and

applying the personalized head-related transfer function to the customized game audio stream to create the surround sound audio stream.

15. The non-transitory, machine-readable medium of claim 11 , wherein the operations further comprise:

providing a graphical user interface operative to provide instructions to the user to guide the user through a head-related transfer function selection procedure to identify the personalized head-related transfer function and to receive input from the user selecting the personalized head-related transfer function.

16. The non-transitory, machine-readable medium of claim 15 , wherein the operations further comprise:

presenting, on the graphical user interface, a series of A/B tests to the user, each A/B test of the series of A/B tests using a first head-related transfer function and a second head-related transfer function of a plurality of standardized head-related transfer functions; and

receiving, through the graphical user interface from the user an indication of a personalized head-related transfer function for each A/B test of the series of A/B tests.

17. The non-transitory, machine-readable medium of claim 11 , wherein the providing the surround sound audio stream to the audio equipment of the user comprises providing the surround sound audio stream to a headset worn by the user.

18. A method, comprising:

receiving, by a processing system including a processor, a game output audio stream from a gaming system;

applying, by the processing system, a personalized head-related transfer function (HRTF) to the game audio output stream to produce a game surround sound audio stream;

receiving, by the processing system, a plurality of chat audio streams from respective other gaming systems operated by players;

applying, by the processing system, one of different chat HRTFs to each of the plurality of chat audio streams to produce chat surround sound audio streams, wherein each of the different chat HRTFs has a particular direction that follows an avatar of a player in a visual game space of the respective chat audio stream associated with the player, and wherein separate HRTFs are selected by a user of the gaming system and applied to each of the different chat HRTFs respectively;

combining, by the processing system, the game surround sound audio stream and the chat surround sound audio streams to produce a surround sound audio stream;

and

providing, by the processing system, the surround sound audio stream to audio equipment of the user of the gaming system.

19. The method of claim 18 , further comprising providing, by the processing system, a graphical user interface module operative to receive user inputs from the user to control the different chat head-related transfer functions.

20. The method of claim 18 , comprising:

receiving, by the processing system, user input defining respective audio customizations for the game surround sound audio stream and the chat surround sound audio streams;

applying, by the processing system, the respective audio customizations to the game surround sound audio stream and the chat surround sound audio streams, according to the user input, producing a customized game audio stream and a customized chat audio stream; and

combining, by the processing system, the customized game audio stream and the customized chat audio stream to produce the surround sound audio stream.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 23, 2025
From: STEELSERIES APS
To: GN STORE NORD A/S
Reel/Frame 069988/0950 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2023
From: GREFF, RAPHAËL; GIAMUNDO, VINCENZO; POURBAIX, TIMOTHÉE
To: STEELSERIES APS
Reel/Frame 065784/0171 →
Continuity (3)
Continuation 17508014 · Oct 22, 2021
Provisional Application 63240004 · Sep 2, 2021
Related Publication 20240091638A1 · Mar 21, 2024
References Cited (53)
US 7479063B2 · Pryzby et al. · 2009 [cited by applicant]
US 8811629B1 · Kulavik et al. · 2014 [cited by applicant]
US 9675871B1 · Jetter et al. · 2017 [cited by applicant]
US 11011015B2 · Achmueller et al. · 2021 [cited by applicant]
US 20030044002A1 · Yeager et al. · 2003 [cited by applicant]
US 20030100359A1 · Loose et al. · 2003 [cited by applicant]
US 20050043090A1 · Pryzby et al. · 2005 [cited by applicant]
US 20050277469A1 · Pryzby et al. · 2005 [cited by applicant]
US 20080320545A1 · Schwartz · 2008 [cited by applicant]
US 20100040240A1 · Bonanno et al. · 2010 [cited by applicant]
US 20100100820A1 · Bryant et al. · 2010 [cited by applicant]
US 20100120533A1 · Bracken et al. · 2010 [cited by applicant]
US 20100261523A1 · Bonney et al. · 2010 [cited by applicant]
US 20120014553A1 · Bonanno · 2012 [cited by applicant]
US 20130331188A1 · Bonney et al. · 2013 [cited by applicant]
US 20140073429A1 · Meneses et al. · 2014 [cited by applicant]
US 20140153727A1 · Walsh et al. · 2014 [cited by applicant]
US 20150005073A1 · Cudak et al. · 2015 [cited by applicant]
US 20150106711A1 · Virolainen · 2015 [cited by applicant]
US 20150222239A1 · Zhang et al. · 2015 [cited by applicant]
US 20150302684A1 · Loose et al. · 2015 [cited by applicant]
US 20160303474A1 · Kuruba Buchannagari et al. · 2016 [cited by applicant]
US 20180193747A1 · Bracken et al. · 2018 [cited by applicant]
US 20180310115A1 · Romigh · 2018 [cited by applicant]
US 20180353855A1 · Niemeyer et al. · 2018 [cited by applicant]
US 20190308096A1 · Kuruba Buchannagari et al. · 2019 [cited by applicant]
US 20200043282A1 · Keilwert et al. · 2020 [cited by applicant]
US 20200097312A1 · Kotteri et al. · 2020 [cited by applicant]
US 20200228911A1 · Baszucki · 2020 [cited by examiner]
US 20200242887A1 · Achmueller et al. · 2020 [cited by applicant]
US 20200353361A1 · Wang · 2020 [cited by applicant]
US 20220410004A1 · Van Welzen et al. · 2022 [cited by applicant]
US 20230060590A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230060642A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230063610A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230064627A1 · Souviraa-Labastie et al. · 2023 [cited by applicant]
US 20230066209A1 · Greff et al. · 2023 [cited by applicant]
US 20230067090A1 · Greff et al. · 2023 [cited by applicant]
US 20230068527A1 · Mahlmeister et al. · 2023 [cited by applicant]
US 20230330527A1 · Mahlmeister et al. · 2023 [cited by applicant]
Int'l Search Report & Written Opinion for PCT/US2022/042292 mailed Jan. 25, 2023, 9 pages. [cited by applicant]
“PS5 3D Audio—Customize These Settings To Get The Perfect Sound For Your PlayStation 5 Gaming Setup”, https://www.youtube.com/watch?v=SjCv3-WNHGw, Jan. 11, 2021, 1 pg. [cited by applicant]
“Teamspeak: 3D Sound—what is it?”, technical-tips, Nov. 11, 2020, technical-tips.com/blog/software/teamspeak-3d-sound—1201., Nov. 11, 2020, 2 pgs. [cited by applicant]
Hennequin, Romain , et al., “Spleeter: a fast and efficient music source separation tool with pre-trained models”, Journal of Open Source Software, 1 (5(50), 2154, Jun. 24, 2020, 4 pages. [cited by applicant]
Iwaya , “Individualization of head-related transfer functions with tournament-style listening test: Listening with other's ears”, Acoust. Sci. & Tech., vol. 27, No. 6, Nov. 2006, pp. 340-343., 5 pgs. [cited by applicant]
Lundqvist, Jonas , “In a real game situation, is HRTF-enhanced game audio preferable over regular stereo game audio?”, Luleå University of Technology | Bachelor thesis | Audio Technology | Department of Music and media … [cited by applicant]
Mills, Matt , “What is HRTF: Listening to Positional Audio in Games”, https://itigic.com/hrtf-listening-to-positional-audio-in-games/, 7 pgs. [cited by applicant]
Moore-Coyler, Roland , “PS5 and 3D audio: Everything you need to know”, https://www.tomsguide.com/features/ps5-and-3d-audio-everything-you-need-to-know, Oct. 6, 2020, 17 pages. [cited by applicant]
Poirier-Quinot , et al., “Impact of HRTF individualization on player performance in a VR shooter game I”, Conference on Spatial Reproduction, Aug. 2018, 7 pgs. [cited by applicant]
Rothbucher , et al., “Integrating a H RTF-based Sound Synthesis System into Mumble”, MMSP, pp. 24-28., Oct. 1, 2010, 5 pgs. [cited by applicant]
Seeber , et al., “Subjective Selection of Non-Individual Head-Related Transfer Functions”, Proceedings of the 2003 International Conference on Auditory Display, Jul. 2003, 4 pgs. [cited by applicant]
Shukla, et al., “User selection of optimal HRTF sets via holistic comparative evaluation”, Conference on Audio for Virtual and Augmented Reality, Aug. 2018., 10 pages. [cited by applicant]
International Preliminary Report on Patentability for PCT/2022/042292 mailed Mar. 14, 2024, 8 pages. [cited by applicant]