Ear-mount able listening device with voice direction discovery for rotational correction of microphone array outputs
Techniques described herein include generating first audio signals representative of sounds emanating from an environment and captured with an array of microphones disposed within an ear-mountable listing device. A rotational position of the array of microphones is determined. A rotational correction is applied to the first audio signals to generate a second audio signal. The rotational correction is based at least in part upon the determined rotational position. A speaker of the ear-mountable listening device is driven with the second audio signal to output audio into an ear.
1. An ear-mountable listening device, comprising:
an array of microphones configured to capture sounds emanating from an environment and output first audio signals representative of the sounds, wherein the array of microphones has a rotational position that is variable relative to an ear of a user when the ear-mountable listening device is mounted to the ear or is variable while the ear-mountable listening device is worn in the ear;
a speaker arranged to emit audio into the ear in response to a second audio signal; and
electronics coupled to the array of microphones and the speaker, the electronics including logic that when executed by the electronics causes the ear-mountable listening device to perform operations including:
discovering a direction of incidence of a voice of the user upon the array of microphones mounted to the ear of the user; and
applying a rotational correction to the first audio signals to generate the second audio signal that drives the speaker, wherein the rotational correction is based at least in part upon the direction of incidence of the voice.
2. The ear-mountable listening device of claim 1 , wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
determining a rotational position of the array of microphones relative to a mouth of the user based upon the direction of incidence of the voice; and
applying an ear-to-mouth angular offset to the rotational position to determine the rotational correction.
3. The ear-mountable listening device of claim 2 , wherein the ear-to-mouth angular offset is a customized value calibrated on a per user basis.
4. The ear-mountable listening device of claim 3 , wherein the ear-to-mouth angular offset is based upon at least one of a profile picture of the user or execution of an initial voice direction discover routine.
5. The ear-mountable listening device of claim 1 , further comprising:
an internal microphone coupled to the electronics and oriented within the ear-mountable listening device to focus on the voice emanating via an ear canal when the ear-mountable listening device is worn,
wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
monitoring the internal microphone for the voice; and
commencing discovering the direction of incidence after the voice exceeds a threshold level as measured by the internal microphone.
6. The ear-mountable listening device of claim 1 , wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
monitoring an inertial monitoring unit (IMU) of the ear-mountable listening device; and
commencing discovering the direction of incidence of the voice when a motion or an orientation of the ear-mountable listening device falls within one or more prescribed ranges.
7. The ear-mountable listening device of claim 1 , wherein discovering the direction of the voice comprises one or more of:
comparing relative times of arrival of sounds across the array of microphones;
comparing sound amplitudes across the array of microphones; or
beamforming the microphone array to identify the direction of incidence.
8. The ear-mountable listening device of claim 1 , wherein the array of microphones is disposed within a rotatable component of the ear-mountable listening device, the rotatable component rotatable to provide a user interface for controlling at least one user selectable function of the ear-mountable listening device.
9. The ear-mountable listening device of claim 1 , wherein the rotational correction applied to the first audio signals comprises a rotational transformation applied by the electronics to the first audio signals that preserves spaciousness of the sounds emanating from the environment such that the user can localize the sounds based upon the audio output from the speaker despite rotation of the array of microphones.
10. The ear-mountable listening device of claim 1 , wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
reasserting a head related transfer function (HRTF) of the user with the audio output from the speaker despite rotation of the array of microphones.
11. The ear-mountable listening device of claim 1 , wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
determining the rotational correction based at least in part upon a direction indication output from an inertial measurement unit (IMU) of the ear-mountable listening device that changes with rotation of the rotational position of the array of microphones.
12. A method of operation of an ear-mountable listening device, the method comprising:
generating first audio signals representative of sounds emanating from an environment and captured with an array of microphones of the ear-mountable listening device mounted to an ear;
determining a rotational position of the array of microphones, wherein determining the rotational position of the array of microphones comprises:
discovering a direction of incidence of a voice of a user upon the array of microphones while the ear-mountable listening device is worn in the ear of the user; and
applying an ear-to-mouth angular offset to the direction of incidence;
applying a rotational correction to the first audio signals to generate a second audio signal, wherein the rotational correction is based at least in part upon the rotational position; and
driving a speaker of the ear-mountable listening device with the second audio signal to output audio into the ear.
13. The method of claim 12 , further comprising:
sensing a rotational change of the array of microphones; and
revising the rotational correction applied to the first audio signals based upon the rotational change.
14. The method of claim 13 , further comprising:
adjusting a user function of the ear-mountable listening device in response to the rotational change.
15. The method of claim 14 , wherein adjusting the user function in response to the rotational change comprises:
adjusting a volume of the speaker in response to the rotational change of the array of microphones, wherein the array of microphones is disposed within a rotatable component of the ear-mountable listening device.
16. The method of claim 12 , wherein the ear-to-mouth angular offset is determined based upon at least one of a profile picture of the user or execution of an initial voice direction discover routine.
17. The method of claim 12 , further comprising:
monitoring an internal microphone of the ear-mountable listening device for the voice, wherein the internal microphone is positioned and oriented within the ear-mountable listening device to focus on the voice emanating via an ear canal of the user when the ear-mountable listening device is worn in the ear; and
commencing discovering the direction of incidence after the voice exceeds a threshold level as measured by the internal microphone.
18. The method of claim 17 , wherein discovering the direction of the voice comprises one or more of:
comparing relative times of arrival of sounds across the array of microphones;
comparing sound amplitudes across the array of microphones; or
beamforming the microphone array to identify the direction of incidence.
19. The method of claim 12 , wherein the rotational correction applied to the first audio signals comprises a rotational transformation applied by electronics of the ear-mountable listening device to the first audio signals that preserves spaciousness of the sounds emanating from the environment such that the user can localize the sounds based upon the audio output from the speaker despite rotation of the array of microphones.