Information processing device, information processing method, and information processing program
An information processing device ( 100 ) according to the present disclosure includes: an acquisition unit ( 141 ) configured to acquire a first image including a content image of an ear of a user; and a calculation unit ( 142 ) configured to calculate, based on the first image acquired by the acquisition unit ( 141 ), a head-related transfer function corresponding to the user by using a learned model having learned to output a head-related transfer function corresponding to an ear when an image including a content image of the ear is input.
1. An information processing device comprising:
circuitry configured to:
acquire a first image including a content image of an ear of a user;
acquire a first ear parameter from the first image by using a learned model having learned a relation between a second image including a content image of the ear and a second ear parameter; and
acquire a head-related transfer function based on input of the first ear parameter acquired by the first image by using a learned model having learned a relation between the second ear parameter and the head-related transfer function, wherein the circuitry is configured to acquire the first ear parameter of the ear included in the first image using an ear parameter estimation model having learned to output an ear parameter corresponding to an ear when an image including a content image of the ear is input.
2. The information processing device according to claim 1 ,
wherein the first ear parameter comprises a variable representing a characteristic of the ear included in the first image.
3. The information processing device according to claim 1 , wherein the ear parameter estimation model is generated by learning a relation between an image including a content image of the ear and an ear parameter of the ear.
4. The information processing device according to claim 3 , wherein the ear parameter estimation model is generated by learning a relation between the ear parameter and an ear image obtained by rendering three-dimensional data of the ear generated based on the ear parameter.
5. The information processing device according to claim 4 , wherein the ear parameter estimation model is generated by learning the relation between a plurality of ear images obtained by changing a camera angle in rendering.
6. The information processing device according to claim 5 , wherein the circuitry is configured to perform acoustic simulation for three-dimensional data obtained by synthesizing three-dimensional data of the ear generated based on the ear parameter and three-dimensional data of a head, and to generate a learned model by learning a relation between a head-related transfer function obtained through the acoustic simulation and the ear parameter.
7. An information processing method by which a computer performs:
acquiring a first image including a content image of an ear of a user;
acquiring a first ear parameter from the first image by using a learned model having learned a relation between a second image including a content image of the ear and a second ear parameter; and
acquiring a head-related transfer function based on input of the first ear parameter acquired by the first image by using a learned model having learned a relation between the second ear parameter and the head-related transfer function, wherein acquiring the first ear parameter of the ear included in the first image includes using an ear parameter estimation model having learned to output an ear parameter corresponding to an ear when an image including a content image of the ear is input.
8. The information processing method according to claim 7 , wherein the first ear parameter comprises a variable representing a characteristic of the ear included in the first image.
9. The information processing method according to claim 7 , wherein the ear parameter estimation model is generated by learning a relation between an image including a content image of the ear and an ear parameter of the ear.
10. The information processing method according to claim 9 , wherein the ear parameter estimation model is generated by learning a relation between the ear parameter and an ear image obtained by rendering three-dimensional data of the ear generated based on the ear parameter.
11. The information processing method according to claim 10 , wherein the ear parameter estimation model is generated by learning the relation between a plurality of ear images obtained by changing a camera angle in rendering.
12. The information processing method according to claim 11 , further comprising performing acoustic simulation for three-dimensional data obtained by synthesizing three-dimensional data of the ear generated based on the ear parameter and three-dimensional data of a head, and generating a learned model by learning a relation between a head-related transfer function obtained through the acoustic simulation and the ear parameter.
13. A non-transitory computer-readable storage medium encoded with executable instructions that, when executed by at least one processor, cause the at least one processor to perform:
acquiring a first image including a content image of an ear of a user;
acquiring a first ear parameter from the first image by using a learned model having learned a relation between a second image including a content image of the ear and a second ear parameter; and
acquiring a head-related transfer function based on input of the first ear parameter acquired by the first image by using a learned model having learned a relation between the second ear parameter and the head-related transfer function, wherein acquiring the first ear parameter of the ear included in the first image includes using an ear parameter estimation model having learned to output an ear parameter corresponding to an ear when an image including a content image of the ear is input.
14. The non-transitory computer-readable storage medium according to claim 13 , wherein the first ear parameter comprises a variable representing a characteristic of the ear included in the first image.
15. The non-transitory computer-readable storage medium according to claim 13 , wherein the ear parameter estimation model is generated by learning a relation between an image including a content image of the ear and an ear parameter of the ear.