IN-EAR MOTION SENSORS FOR AR/VR APPLICATIONS AND DEVICES
An in-ear device for immersive reality applications is provided. The device includes an in-ear fixture configured to fit in an ear canal of a user, a motion sensor mounted on the in-ear fixture and configured to provide a motion signal indicative of an inner body motion or a bulk body motion of the user, a speaker coupled to provide an audio signal to the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a health condition of the user based on the motion signal. A method for using the above device, a memory and a processor for storing and executing instructions to perform the method are also provided.
1 . A device, comprising:
an in-ear fixture configured to seal an ear canal of a user;
a motion sensor mounted on the in-ear fixture and configured to provide a motion signal indicative of an inner body motion or a bulk body motion of the user;
a speaker coupled to provide an audio signal to the user; and
a processor that is coupled to an augmented reality headset, the processor configured to identify a health condition of the user based on the motion signal.
2 . The device of claim 1 , wherein the motion sensor is a contact microphone and the motion signal is transmitted through a body of the user into a contact point between the motion sensor and the ear canal of the user.
3 . The device of claim 1 , wherein the motion sensor is an inertial motion unit and the motion signal is indicative of a bulk body motion of the user including one of a sneeze, a cough, a fall, and a step.
4 . The device of claim 1 , wherein the motion sensor is a micro-electronic moving system.
5 . The device of claim 1 , wherein the motion signal is indicative of an inner body motion of the user including one of a heart rate or a respiratory rate.
6 . The device of claim 1 , further comprising an electrode mounted on the in-ear fixture, the electrode configured to receive a signal indicative of a cardiovascular activity of the user.
7 . The device of claim 1 , further comprising an electrode mounted on the in-ear fixture, the electrode configured to receive a signal indicative of a neural activity of the user.
8 . The device of claim 1 , wherein the processor is configured to synchronize a waveform with the motion signal and a waveform with an electronic signal to determine a vital sign of the user.
9 . The device of claim 1 , wherein the processor is configured to determine a heart rate of the user from the motion signal.
10 . The device of claim 1 , wherein the processor is configured to remove one of a noise component or an interference from the audio signal to the user based on the motion signal.
11 . A computer-implemented method, comprising:
receiving, from a motion sensor in an in-ear device, a motion signal indicative of an inner body motion or a bulk body motion of a user of the in-ear device;
forming a waveform with the motion signal; and
identifying a health condition of the user based on the waveform.
12 . The computer-implemented method of claim 11 , further comprising receiving, from a second motion sensor in a second in-ear device, a second motion signal indicative of the inner body motion or the bulk body motion, and wherein forming the waveform comprises removing at least one of a noise component or an interference from the motion signal with the second motion signal.
13 . The computer-implemented method of claim 11 , wherein the motion signal is indicative of an inner body motion and identifying a health condition of the user comprises determining at least one of a heart rate and a breathing rate of the user.
14 . The computer-implemented method of claim 11 , wherein the motion signal is indicative of a bulk body motion of the user and identifying a health condition of the user comprises at least one of detecting a fall of the user, a cough of the user, a sneeze of the user, or determining a step count for the user.
15 . The computer-implemented method of claim 11 , further comprising identifying a systolic heart pulse and a diastolic heart pulse from the waveform, wherein identifying a health condition of the user based on the waveform comprises identifying features in the systolic heart pulse and the diastolic heart pulse.
16 . The computer-implemented method of claim 11 , further comprising identifying a systolic heart pulse and a diastolic heart pulse from the waveform, wherein identifying a health condition of the user based on the waveform comprises determining a blood pressure of the user based on an amplitude of the diastolic heart pulse and on an amplitude of the systolic heart pulse.
17 . The computer-implemented method of claim 11 , further comprising identifying a systolic heart pulse and a diastolic heart pulse from the waveform, wherein identifying a health condition of the user based on the waveform comprises determining a blood pressure of the user based on a time delay of the diastolic heart pulse relative to the systolic heart pulse.
18 . The computer-implemented method of claim 11 , further comprising filtering, with the waveform, one of a noise component and an interference from an audio signal to a speaker mounted in the in-ear device, and providing, with the speaker, the audio signal to the user.
19 . The computer-implemented method of claim 11 , further comprising: receiving, from an electrode, an electronic signal indicative of a cardiovascular activity of the user, identifying a correlation of the electronic signal with the waveform, and determining one of a heart rate, a breathing rate, or a blood pressure of the user based on the correlation or a deep neural network algorithm.
20 . The computer-implemented method of claim 11 , wherein identifying a health condition of the user further comprises performing a spectral analysis on the waveform to identify a p-wave, a QRS-complex, and a T-wave complex in an electro-cardiogram.