Detecting user's eye movement using sensors in hearing instruments
A set of one or more processing circuits obtains eye movement-related eardrum oscillation (EMREO)-related measurements from one or more EMREO sensors of a hearing instrument. The EMREO sensors are located in an ear canal of a user of the hearing instrument and are configured to detect environmental signals of EMREOs of an eardrum of the user of the hearing instrument. The one or more processing circuits may perform an action based on the EMREO-related measurements.
1. A method comprising:
obtaining, by a set of one or more processing circuits, eye movement-related eardrum oscillation (EMREO)-related measurements from one or more EMREO sensors of a hearing instrument, wherein the EMREO sensors are located in an ear canal of a user of the hearing instrument and are configured to detect environmental signals of EMREOs of an eardrum of the user of the hearing instrument and generate the EMREO-related measurements based on the detected environmental signals;
determining, by the one or more processing circuits, based on the EMREO-related measurements, potential modifications to left-ear and right-ear audio signals;
determining, by the one or more processing circuits, that the user has moved their head; and
applying, by the one or more processing circuits, the potential modifications to the left-ear and right-ear audio signals in response to determining that the user has moved their head.
2. The method of claim 1 , wherein determining the potential modifications to the left-ear and right-ear audio signals comprises determining a delay between the left-ear and right-ear audio signals.
3. The method of claim 1 , wherein determining the potential modifications to the left-ear and right-ear audio signals comprises determining a relative intensity of the left-ear and right-ear audio signals.
4. The method of claim 1 , wherein applying the potential modifications to the left-ear and right-ear audio signals comprises applying a head-related transform function.
5. The method of claim 1 , wherein applying the potential modifications to the left-ear and right-ear audio signals comprise steering or selecting a microphone beamformer.
6. The method of claim 1 , wherein the one or more EMREO sensors include a microphone positioned at a medial tip of the hearing instrument and configured to detect changes in air pressure within the ear canal caused by EMREOs.
7. The method of claim 1 , wherein at least one of:
the EMREO sensors include a vertical-cavity surface-emitting laser (VCSEL) positioned to shine a coherent beam onto the eardrum; and obtaining the EMREO-related measurements comprises applying, by the one or more processing circuits, optical feedback interferometry based on reflected light of the coherent beam to determine a position of the eardrum,
the EMREO sensors include a time of flight (ToF) sensor configured to emit infrared light toward the eardrum and configured to determine a distance to the eardrum based on a travel time of the infrared light to the eardrum and back to the ToF sensor, and obtaining the EMREO-related measurements comprises determining, by the one or more processing circuits, the position of the eardrum based on the travel time,
the EMREO sensors include a structured light sensor configured to emit structured light toward the eardrum, and obtaining the EMREO-related measurements comprises determining, by the one or more processing circuits, the position of the eardrum based on a pattern of light detected by the structured light sensor,
the EMREO sensors include a vibration sensor in contact with skin of the ear canal, and obtaining the EMREO-related measurements comprises obtaining, by the one or more processing circuits, measurements of surface waves in the skin of the ear canal caused by the EMREOs of the eardrum, or
the EMREO sensors include a vibration sensor attached to the eardrum or an ossicular chain of the user, and obtaining the EMREO-related measurements comprises obtaining, by the one or more processing circuits, measurements of vibrations from the vibration sensor.
8. The method of claim 1 , wherein the hearing instrument is a left hearing instrument of the user, and the method further comprises:
receiving the left-ear audio signal from a microphone of the left hearing instrument; and
receiving the right-ear audio signal from a microphone of a right hearing instrument of the user.
9. A system comprising:
one or more eye movement-related eardrum oscillation (EMREO) sensors located in an ear canal of a user of a hearing instrument, wherein the EMREO sensors are configured to detect environmental signals of EMREOs of an eardrum of the user and generate the EMREO-related measurements based on the detected environmental signals; and
one or more processing circuits configured to:
determine, based on the EMREO-related measurements, potential modifications to left-ear and right-ear audio signals;
determining that the user has moved their head; and
apply the potential modifications to the left-ear and right-ear audio signals in response to determining that the user has moved their head.
10. The system of claim 9 , wherein the one or more processing circuits are configured to, as part of determining the potential modifications to the left-ear and right-ear audio signals, determine a delay between the left-ear and right-ear audio signals.
11. The system of claim 9 , wherein the one or more processing circuits are configured to, as part of determining the potential modifications to the left-ear and right-ear audio signals, determine a relative intensity of the left-ear and right-ear audio signals.
12. The system of claim 9 , wherein the one or more processing circuits are configured to, as part of applying the potential modifications to the left-ear and right-ear audio signals, apply a head-related transform function.
13. The system of claim 9 , wherein the one or more processing circuits are configured to, as part of applying the potential modifications to the left-ear and right-ear audio signals, steer or select a microphone beamformer.
14. The system of claim 9 , wherein the system comprises the hearing instrument and the hearing instrument comprises at least one of the EMREO sensors or the one or more processing circuits.
15. The system of claim 9 , wherein:
the system comprises a computing system and the hearing instrument, and
the computing system comprises the one or more processing circuits.
16. The system of claim 9 , wherein the one or more EMREO sensors include a microphone positioned at a medial tip of the hearing instrument configured to detect changes in air pressure within the ear canal caused by EMREOs.
17. The system of claim 9 , wherein at least one of:
the EMREO sensors include a vertical-cavity surface-emitting laser (VCSEL) positioned to shine a coherent beam onto the eardrum, and the one or more processing circuits are configured such that, as part of obtaining the EMREO-related measurements, the one or more processing circuits apply optical feedback interferometry based on reflected light of the coherent beam to determine a position of the eardrum,
the EMREO sensors include a time of flight (ToF) sensor configured to emit infrared light toward the eardrum and configured to determine a distance to the eardrum based on a travel time of the infrared light to the eardrum and back to the ToF sensor, and the one or more processing circuits are configured such that, as part of obtaining the EMREO-related measurements, the one or more processing circuits determine the position of the eardrum based on the travel time,
the EMREO sensors include a structured light sensor configured to emit structured light toward the eardrum, and the one or more processing circuits are configured such that, as part of obtaining the EMREO-related measurements, the one or more processing circuits determine the position of the eardrum based on a pattern of light detected by the structured light sensor,
the EMREO sensors include a vibration sensor in contact with skin of the ear canal, the one or more processing circuits are configured such that, as part of obtaining the EMREO-related measurements, the one or more processing circuits obtain measurements of surface waves in the skin of the ear canal caused by the EMREOs of the eardrum, or
the EMREO sensors include a vibration sensor attached to the eardrum or an ossicular chain of the user, and the one or more processing circuits are configured such that, as part of obtaining the EMREO-related measurements, the one or more processing circuits obtain measurements of vibrations from the vibration sensor.
18. The system of claim 9 , wherein:
the hearing instrument is a left hearing instrument of the user, and the one or more processing circuits are further configured to:
receive the left-ear audio signal from a microphone of the left hearing instrument; and
receive the right-ear audio signal from a microphone of a right hearing instrument of the user.