Information processing device and information processing method
Provided is an information processing device that controls and presents sound information in an appropriate form to a user who acts in an environment on the basis of situation recognition including recognition of the environment and recognition of the actions of the user. The information processing device includes: a sensor that detects an object; an open ear style earpiece that is worn on an ear of a listener, and includes an acoustics generation unit, and a sound guide portion that transmits a sound generated by the acoustics generation unit into an earhole; and a processing unit that processes sound information of a sound source, the sound information being generated by the acoustics generation unit, the processing unit acquiring the sound information of the sound source corresponding to the object detected by the sensor, and a process of localizing a sound image of the acquired sound source while varying a position of the sound image in accordance with a position in a three-dimensional acoustic space, the position in the three-dimensional acoustic space corresponding to a position of the detected object.
1. An information processing device, comprising:
a sensor that detects an object;
an open ear style earpiece that is worn on an ear of a listener;
an acoustics generation unit;
a sound guide portion that transmits a sound generated by the acoustics generation unit into an earhole; and
a processing unit configured to:
process sound information of a sound source, the sound information being generated by the acoustics generation unit,
acquire the sound information of the sound source corresponding to the object detected by the sensor, and
localize a sound image of the acquired sound source while varying a position of the localized sound image relative to a position of the detected object so that the listener can distinguish between real ambient sound and virtual sound.
2. The information processing device according to claim 1 , wherein
the sound source generates a virtual sound, and
the processing unit executes, with respect to a sound image of the sound source that generates the virtual sound, the process of localizing the sound image of the sound source while varying the position of the sound image.
3. The information processing device according to claim 2 , wherein
the virtual sound that is processed by the processing unit has characteristics that are distinguishable from characteristics of a sound that reaches an eardrum through an opening portion of the open ear style earpiece.
4. The information processing device according to claim 1 , wherein
the sensor has detection areas in accordance with sensing modes.
5. The information processing device according to claim 4 , wherein
the sensing modes include
a normal mode in which the sensor performs the detection in a normal detection area of the sensor, and
a white-cane mode in which the sensor performs the detection in a detection area smaller than the normal detection area in the normal mode.
6. The information processing device according to claim 5 , wherein
in the white-cane mode, the processing unit executes the process of localizing the sound image of the sound source while varying the position of the sound image when the sensor detects the object in a region in a predetermined range around the listener.
7. The information processing device according to claim 5 , further comprising
an LED having a function to emit light beams in a plurality of colors, wherein
in the white-cane mode, the LED emits a light beam in a predetermined one of the plurality of colors.
8. An information processing device, comprising:
a sensor that detects an object;
an open ear style earpiece that is worn on an ear of a listener;
an acoustics generation unit;
a sound guide portion that transmits a sound generated by the acoustics generation unit into an earhole; and
a processing unit configured to:
process sound information of a sound source, the sound information being generated by the acoustics generation unit,
acquire the sound information of the sound source corresponding to information that relates to the object detected by the sensor and that are provided by an information providing unit, and
localize a sound image of the acquired sound source while selecting a type of the sound information, while controlling an amount of the sound information and while varying a position of the localized sound source relative to a position of the detected object.
9. The information processing device according to claim 8 , wherein
the type of the sound information is voice data or sound-source data.
10. The information processing device according to claim 9 , wherein
the processing unit controls the amount of the sound information in accordance with how frequently the sound of the sound-source data is generated.
11. The information processing device according to claim 9 , wherein,
in a case where the type of the sound information is the voice data, the sound information includes
a character ID, and
information about characteristics of a voice to be specified by the character ID.
12. The information processing device according to claim 9 , wherein
in a case where the type of the sound information is the sound-source data, the sound information includes at least one of
a frequency,
a duration,
time-series data of sound-pressure sample values, or
a sound ID.
13. The information processing device according to claim 8 , wherein
the information providing unit
acquires, from a database, information to be specified from the object, and
provides the information to be specified from the object.
14. The information processing device according to claim 8 , wherein
the information providing unit
communicates with software than runs on a server device connected to Internet, and
acquires and provides information that the server has specified from the object.
15. The information processing device according to claim 8 , wherein
the processing unit comprises a personal agent.
16. The information processing device according to claim 15 , wherein
the personal agent provides a function of artificial intelligence.
17. The information processing device according to claim 16 , wherein
the function of the artificial intelligence is a calculation for learning or estimation (inference).
18. The information processing device according to claim 8 , further comprising
a neural-network processing unit.
19. The information processing device according to claim 18 , wherein
the neural-network processing unit executes a process of a function of artificial intelligence.
20. The information processing device according to claim 8 , wherein
the processing unit further executes a process by the information providing unit under control by a personal agent.
21. The information processing device according to claim 20 , further comprising
a memory that stores the information that relate to the object, wherein
the information providing unit
reads out and provides the information that relates to the object from the memory.
22. The information processing device according to claim 20 , further comprising
a communication unit, wherein
the information providing unit
queries a server device connected via the communication unit about the information that relates to the object, and
receives and provides the information that relates to the object from the server device.
23. The information processing device according to claim 20 , further comprising:
a communication unit; and
a microphone, wherein
the information providing unit
queries a server device connected via the communication unit about the information that relates to the object by transmitting a voice of the listener, the voice being acquired via the microphone, and
receives and provides the information that relates to the object from the server device.
24. The information processing device according to claim 23 , wherein
the information providing unit further receives, from the server device, relevant information corresponding to the voice, and
the processing unit
acquires the sound information of the sound source, the sound information being included in the relevant information, and
executes the process of localizing the sound image of the sound source.
25. An information processing device, comprising:
an open ear style earpiece;
an acoustics generation unit that is arranged in a rear of an ear of a listener;
a sound guide portion that has a structure folded back from a rear of an auricle of the ear to a front of the auricle of the ear via a vicinity of an earlobe, and that transmits a sound generated by the acoustics generation unit into an earhole;
a sensor that acquires external information; and
a processor, the information processing device being operated under a state in which any of a plurality of modes has been selected, the processor configured to
reproduce an external three-dimensional space on a basis of the external information acquired via the sensor,
generate virtual-sound information for causing the acoustics generation unit to generate the sound in accordance with the mode selected from the plurality of modes, and
localize a sound image of a sound source that varies in position over time in the three-dimensional space and vary a position of the localized sound image relative to a position of a detected object.
26. An information processing method, comprising:
detecting an object by a sensor of an information processing device;
acquiring sound information of a sound source corresponding to the detected object;
localizing a sound image of the acquired sound source while varying a position of the localized sound image relative to a position of the detected object so that the listener can distinguish between real ambient sound and virtual sound; and
outputting a sound of the sound image from the information processing device comprising:
an open ear style earpiece,
an acoustics generation unit, and
a sound guide portion that transmits a sound generated by the acoustics generation unit into an earhole.
27. An information processing method, comprising:
detecting an object by a sensor of an information processing device;
acquiring sound information of a sound source corresponding to information that is provided in relation to the detected object;
localizing a sound image of the acquired sound source while selecting a type of the sound information, while controlling an amount of the sound information and while varying a position of the localized sound source relative to a position of the detected object; and
outputting a sound of the sound image from the information processing device comprising:
an open ear style earpiece,
an acoustics generation unit, and
a sound guide portion that transmits a sound generated by the acoustics generation unit into an earhole.