Out-of-head localization processing apparatus and filter selection method
An out-of-head localization processing apparatus according to the embodiments includes a filter selection unit configured to select a preset filter, an out-of-head localization processing unit configured to perform out-of-head localization processing using the preset filter selected, headphones configured to output, to a user, a signal of a test sound source, an input unit configured to accept a user input, a sensor unit, a three-dimensional coordinate calculation unit configured to calculate three-dimensional coordinates of a localized position of a sound image based on a detection signal from the sensor unit, and an evaluation unit configured to evaluate, based on the three-dimensional coordinates of each of the preset filters, a filter optimal for the user from the plurality of preset filters.
1. An out-of-head localization processing apparatus comprising:
headphones configured to output a signal to a user;
a sensor configured to generate a detection signal indicating position information;
a memory configured to store a plurality of preset filters and instructions;
at least one processor operably coupled to the memory, headphones, and sensor, the at least one processor configured to execute the instructions to:
reproduce a test sound source;
select, from the plurality of preset filters, a preset filter to be used for out-of-head localization processing;
perform the out-of-head localization processing on a signal of the test sound source using the preset filter selected by the filter selection unit;
output, to the user via the headphones, the signal that has been subjected to the out-of-head localization processing by the out-of-head localization processing unit;
accept a user input for determining a localized position of a sound image in the out-of-head localization processing;
receive the detection signal from the sensor, the detection signal indicating position information of the localized position pointed to by the user;
calculate three-dimensional coordinates of the localized position based on the detection signal from the sensor; and
evaluate, based on the three-dimensional coordinates of the localized position of each of the preset filters, a filter optimal for the user from the plurality of preset filters.
2. The out-of-head localization processing apparatus according to claim 1 , wherein
the sensor is configured to detect a marker worn by the user on a finger, and
the at least one processor is further configured to calculate the three-dimensional coordinates of the localized position based on the position information of the marker.
3. The out-of-head localization processing apparatus according to claim 1 , wherein the sensor is placed on the headphones.
4. The out-of-head localization processing apparatus according to claim 3 , wherein
the headphones comprise:
left and right housings; and
a head band connecting the left and right housings, and
the sensor comprises a plurality of sensors placed on the left and right housings or the head band.
5. The out-of-head localization processing apparatus according to claim 1 , wherein
the sensor worn by the user on a finger is configured to detect a marker placed on the headphones, and
the at least one processor is further configured to calculate the three-dimensional coordinates of the localized position based on the position information of the marker.
6. The out-of-head localization processing apparatus according to claim 1 , wherein
the at least one processor is further configured to calculate a distance between the user and the localized position using the three-dimensional coordinates of the localized position of each of the preset filters, and
the optimal filter is evaluated based on the distance between the user and the localized position of each of the preset filters.
7. The out-of-head localization processing apparatus according to claim 1 , wherein
the at least one processor is further configured to calculate a distance between a virtual speaker and the localized position using the three-dimensional coordinates of the localized position of each of the preset filters and preset three-dimensional coordinates of the virtual speaker, and
the optimal filter is evaluated based on the distance between the virtual speaker and the localized position of each of the preset filters.
8. A filter selection method comprising:
selecting, from a plurality of preset filters stored in a memory, a preset filter to be used for out-of-head localization processing;
outputting a signal of a test sound source that has been subjected to the out-of-head localization processing using the selected preset filter;
accepting a user input for determining a localized position of a sound image in the out-of-head localization processing, the localized position being pointed to by the user;
acquiring, by a sensor, position information of the localized position pointed to by the user;
calculating three-dimensional coordinates of the localized position based on the position information; and
selecting, based on the three-dimensional coordinates of the localized position of each of the preset filters, an optimal filter from the plurality of preset filters.
9. The filter selection method according to claim 8 , wherein
the sensor is configured to detect a marker worn by the user on a finger,
the three-dimensional coordinates of the localized position are calculated based on the position information of the marker.
10. The filter selection method according to claim 8 , wherein the sensor is placed on the headphones.
11. The filter selection method according to claim 10 , wherein
the headphones comprise:
left and right housings; and
a head band connecting the left and right housings, and
the sensor comprises a plurality of sensors placed on the left and right housings or the head band.
12. The filter selection method according to claim 8 , wherein
the sensor worn by on the user's finger detects the marker placed on the headphones, and
the three-dimensional coordinates of the localized position are calculated based on the position information of the marker.
13. The filter selection method according to claim 8 , wherein
a distance between the user and the localized position is calculated using the three-dimensional coordinates of the localized position of each of the preset filters, and
the optimal filter is evaluated based on the distance between the user and the localized position of each of the preset filters.
14. The filter selection method according to claim 8 , wherein
a distance between a virtual speaker and the localized position is calculated using the three-dimensional coordinates of the localized position of each of the preset filters and preset three-dimensional coordinates of the virtual speaker, and
the optimal filter is evaluated based on the distance between the virtual speaker and the localized position of each of the preset filters.
15. A filter selection apparatus comprising:
headphones configured to output a signal to a user;
a sensor configured to generate a detection signal indicating position information;
a memory configured to store a plurality of preset filters and instructions;
at least one processor operably coupled to the memory, headphones, and sensor, the at least one processor configured to execute the instructions stored in the memory to:
reproduce a test sound source;
select, from the plurality of preset filters, a preset filter to be used for out-of-head localization processing;
perform the out-of-head localization processing on a signal of the test sound source using the preset filter selected by the filter selection unit;
output, to the user via the headphones, the signal that has been subjected to the out-of-head localization processing by the out-of-head localization processing unit;
accept a user input for determining a localized position of a sound image in the out-of-head localization processing;
receive the detection signal from the sensor, the detection signal indicating position information of the localized position pointed to by the user;
calculate three-dimensional coordinates of the localized position based on the detection signal from the sensor; and
evaluate, based on the three-dimensional coordinates of the localized position of each of the preset filters, a filter optimal for the user from the plurality of preset filters.