IP Library › Granted Patent US 12,407,997
Granted Patent B2
US 12,407,997 · App. 18/246,938 · Granted Sep 2, 2025

Audio personalisation method and system

Inventors: Marina Villanueva Barreiro (London, GB); Calum Armstrong (London, GB); Danjeli Schembri (London, GB)
Assignee: Sony Interactive Entertainment Inc.
H04S7/303H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,997
App. No.
18/246,938
Granted
Sep 2, 2025
Kind
B2
Abstract

An audio personalisation method for a first user includes: testing a first user on a calibration test, the calibration test comprising requiring a user to match a test sound to a test location, either by controlling the position of the presented sound or controlling the position of the presented location, for a sequence of test matches, each test sound being presented at a position using a default head related transfer function ‘HRTF’, receiving an estimate of each matching location from the first user, and calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and comparing at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals; identifying a reference individual with the closest match of compared location estimation errors to those of the first user; and using an HRTF, previously obtained for the identified reference individual, for the first user.

Claims (69)

1. An audio personalisation method for a first user, comprising the steps of:

testing the first user on a calibration test, the calibration test comprising:

requiring a tested individual to match a test sound to a test location, either by controlling a position of the test sound or controlling the position of the test location, for a sequence of test matches,

each test sound being presented at a specified position using a default head related transfer function ‘HRTF’,

receiving an estimate of each matching location from the first user, and

calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and

comparing at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals;

identifying a reference individual with the closest match of compared location estimation errors to those of the first user; and

using an HRTF, previously obtained for the identified reference individual, for the first user.

2. An audio personalisation method for reference individuals, comprising the steps of:

obtaining respective head related transfer functions ‘HRTFs’ for a corpus of reference individuals;

testing respective reference individuals on a calibration test, the calibration test comprising:

requiring a reference individual to match a test sound to a test location, either by controlling a position of the test sound or controlling the position of the test location, for a sequence of test matches,

each test sound being presented at a specified position using a default head related transfer function ‘HRTF’,

receiving an estimate of each matching location from the reference individual, and

calculating a respective error for each estimate, to generate a sequence of location estimate errors for the respective tested reference individual; and

associating the sequence of location estimate errors for the reference individual with their respective obtained HRTF.

3. An audio personalisation method according to claim 1 , in which

if a predetermined number of reference individuals are added to the corpus, for whom an HRTF and associated sequence of location estimate errors are available, then

comparing at least some of the location estimate errors for the first user with the estimate errors of the same location for at least a subset of the corpus of additional reference individuals; and

if an additional reference individual has a closer match of compared location estimation errors to those of the first user than the currently identified reference individual, then

using the HRTF obtained for that additional reference user for the first user.

4. An audio personalisation method according to claim 1 , in which the subset of the corpus is selected responsive to demographic details of the first user and the reference individuals.

5. An audio personalisation method according to claim 1 , in which the respective locations comprise at least a subset of locations selected due to having at least a threshold variance in location estimation errors for a subset of reference individuals.

6. An audio personalisation method according to claim 1 , in which respective sounds used in the calibration test comprise one or more of:

i. narrowband sounds;

ii. broadband sounds;

iii. impulse sounds;

iv. tones;

v. chirps; and

vi. speech.

7. An audio personalisation method according to claim 1 , in which for a calibration test: respective locations are selected from a set of predetermined locations in a predetermined series of subsets.

8. An audio personalisation method according to claim 7 , in which a subset comprising locations on a horizontal centreline and a subset comprising locations on a vertical centreline are included within first N subsets in the predetermined series of subsets, where N is between 2 and 5.

9. An audio personalisation method according to claim 7 , in which

the steps of comparing at least some of the location estimate errors for the first user with the corresponding estimate errors for at least a subset of the corpus of reference individuals,

identifying a reference individual with the closest match of compared location estimation errors to those of the first user, and

using the HRTF obtained for the identified reference user for the first user,

are performed after a predetermined number of subsets has been completed within the predetermined series of subsets.

10. An audio personalisation method according to claim 9 , in which if the first user subsequently takes the calibration test using a predetermined number of subsequent subsets of the predetermined series of subsets, the steps of comparing, identifying and using are performed again.

11. An audio personalisation method according to claim 1 , in which for a calibration test: respective locations are selected randomly from at least a subset of predetermined locations.

12. An audio personalisation method according to claim 1 , in which if a first reference individual is identified as the best match for users by a threshold amount more than other reference individuals, then an additional reference individual is selected having morphological similarities to the first reference individual within a predetermined tolerance.

13. An audio personalisation method according to claim 1 , in which if no single reference individual has a match of compared location estimation errors to those of the first user within a predetermined threshold level of matches, the method comprises

blending the HRTFs of closest M matching reference individuals to generate a blended HRTF, where M is a value of two or more; and

using the blended HRTF for the first user.

14. A non-transitory, computer-readable storage medium containing a computer program comprising computer executable instructions, which when executed by a computer system, cause the computer system to perform an audio personalisation method for a first user, comprising the steps of:

testing the first user on a calibration test, the calibration test comprising:

requiring a tested individual to match a test sound to a test location, either by controlling a position of the test sound or controlling the position of the test location, for a sequence of test matches,

each test sound being presented at a specified position using a default head related transfer function ‘HRTF’,

receiving an estimate of each matching location from the first user, and

calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and

comparing at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals;

identifying a reference individual with the closest match of compared location estimation errors to those of the first user; and

using an HRTF, previously obtained for the identified reference individual, for the first user.

15. An audio personalisation system for a first user, comprising

a testing processor configured to test the first user on a calibration test, the calibration test comprising:

requiring a tested individual to match a test sound to a test location, either by controlling a position of the test sound or controlling the position of the test location, for a sequence of test matches, each test sound being presented at a specified position using a default head related transfer function ‘HRTF’,

receiving an estimate of each matching location from the first user, and

calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and

a comparison processor configured to cause a comparison at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals;

the comparison processor being configured to identify a reference individual with the closest match of compared location estimation errors to those of the first user; and

an HRTF processor configured to use an HRTF, previously obtained for the identified reference individual, for the first user.

16. An audio personalisation system for reference individuals, comprising

storage configured to store respective head related transfer functions ‘HRTFs’ for a corpus of reference individuals,

a testing processor configured to testing respective reference individuals on a calibration test, the calibration test comprising:

requiring a reference individual to match a test sound to a test location, either by controlling position of the test sound or controlling the position of the test location,

for a sequence of test matches, each test sound being presented at a specified position using a default head related transfer function ‘HRTF’,

receiving an estimate of each matching location from the reference individual, and

calculating a respective error for each estimate, to generate a sequence of location estimate errors for the respective tested reference individual; and

an association processor configured to associating the sequence of location estimate errors for the reference individual with their respective obtained HRTF.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2023
From: SCHEMBRI, DANJELI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 063186/0739 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2023
From: BARREIRO, MARINA VILLANUEVA; ARMSTRONG, CALUM; SCHEMBRI, DANJELI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 063129/0392 →
Priority Claims (1)
GB 2015595 · Oct 1, 2020 · national
Continuity (1)
Related Publication 20230413005A1 · Dec 21, 2023
References Cited (11)
US 10070239B2 · Romigh · 2018 [cited by examiner]
US 11245999B2 · Kim · 2022 [cited by applicant]
US 20180310115A1 · Romigh · 2018 [cited by applicant]
US 20210176577A1 · Kim · 2021 [cited by applicant]
CN 108540925A · 2018 [cited by applicant]
KR 20190034487A · 2019 [cited by applicant]
WO 2019059558A1 · 2019 [cited by applicant]
WO WO2021045869A1 · 2021 [cited by examiner]
Combined Search and Examination Report for corresponding GB Application No. GB2015595.8, 6 pages, dated Mar. 25, 2021. [cited by applicant]
International Search Report and Written Opinion for corresponding PCT Application No. PCT/GB2021/052387, 20 pages, dated Jan. 4, 2022. [cited by applicant]
Frantisek Rund, et al., “Alternatives to HRTF measurement,” Telecommunications and Signal Processing, 2012 35th International Conference on IEEE, pp. 648-652, dated Jul. 3, 2012. [cited by applicant]