IP Library Granted Patent US 12,495,980
Granted Patent B2
US 12,495,980 · App. 18/602,888 · Granted Dec 16, 2025

Detecting heart rate variability using a hearable

Inventors: Xiaoran Fan (Irvine, CA); Trausti Thormundsson (Irvine, CA); Richard Edwin Howard (Highland Park, NJ)
Assignee: Google LLC
A61B5/02405A61B5/38A61B5/6817A61B2560/0223A61B2562/0204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,495,980
App. No.
18/602,888
Granted
Dec 16, 2025
Kind
B2
Abstract

Techniques and apparatuses are described that perform heart rate variability detection using a hearable. A hearable, such as an earbud, is capable of performing a novel physiological monitoring process termed herein audioplethysmography, which is an active acoustic method capable of sensing subtle physiologically-related changes observable at a user's outer and middle ear. Instead of relying on other auxiliary sensors, such as optical or electrical sensors, audioplethysmography involves transmitting and receiving acoustic signals to monitor a user's biometrics, including heart rate variability and/or blood pressure. In addition to being relatively unobtrusive, some hearables can be configured to support audioplethysmography without the need for additional hardware. As such, the size, cost, and power usage of the hearable can help make health monitoring accessible to a larger group of people and improve the user experience with hearables.

Claims (58)

1 . A method comprising:

transmitting a first acoustic transmit signal that propagates within at least a portion of an ear canal of a person, the first acoustic transmit signal having multiple frequencies;

receiving an acoustic receive signal, the acoustic receive signal representing a version of the first acoustic transmit signal with one or more characteristics modified due to the propagation within the ear canal;

selecting a subset of the multiple frequencies based on the one or more modified characteristics of the acoustic receive signal; and

transmitting a second acoustic transmit signal that propagates within at least the portion of the ear canal of the person, the second acoustic transmit signal having the subset of the multiple frequencies.

2 . The method of claim 1 , wherein a quantity of the subset of the multiple frequencies is less than a quantity of the multiple frequencies.

3 . The method of claim 1 , wherein the transmitting of the second acoustic transmit signal comprises transmitting the second acoustic transmit signal having a higher amplitude at each frequency within the subset of the multiple frequencies compared to an amplitude of the first acoustic transmit signal at each of the multiple frequencies.

4 . The method of claim 1 , wherein the transmitting of the second acoustic transmit signal comprises transmitting the second acoustic transmit signal having a longer duration at each frequency within the subset of the multiple frequencies compared to a duration of the first acoustic transmit signal at each of the multiple frequencies.

5 . The method of claim 1 , wherein the selecting the subset of the multiple frequencies comprises:

determining at least one frequency of the multiple frequencies is associated with an amplitude of the acoustic receive signal having a peak-to-average ratio that is above a threshold; and

determining at least one other frequency of the multiple frequencies is associated with a phase of the acoustic receive signal having another peak-to-average ratio that is above the threshold.

6 . A device comprising:

at least one transducer configured to:

transmit a first acoustic transmit signal that propagates within at least a portion of an ear canal of a person, the first acoustic transmit signal having multiple frequencies;

receive an acoustic receive signal, the acoustic receive signal representing a version of the first acoustic transmit signal with one or more characteristics modified due to the propagation within the ear canal; and

transmit a second acoustic transmit signal that propagates within at least the portion of the ear canal of the person, the second acoustic transmit signal having a subset of the multiple frequencies;

and

at least one processor configured to:

select, prior to the transmission of the second acoustic transmit signal, the subset of the multiple frequencies based on the one or more modified characteristics of the acoustic receive signal.

7 . The device of claim 6 , further comprising:

a speaker; and

an active-noise-cancellation circuit comprising a feedback microphone,

wherein the at least one transducer comprises the speaker and the feedback microphone.

8 . The device of claim 6 , wherein:

the at least one transducer comprises a speaker and a microphone;

the speaker is configured to be positioned proximate to a first ear of the person; and

the microphone is configured to be positioned proximate to a second ear of the person.

9 . The device of claim 6 , further comprising:

two hearables positioned proximate to different ears of the person, the two hearables each comprising the at least one transducer and the at least one processor,

wherein the two hearables are configured to transmit acoustic signals having different sets of tones.

10 . The device of claim 6 , wherein the device comprises at least one earbud.

11 . The device of claim 6 , wherein a quantity of the subset of the multiple frequencies is less than a quantity of the multiple frequencies.

12 . The device of claim 6 , wherein the at least one transducer is further configured to transmit the second acoustic transmit signal such that the second acoustic transmit signal has a higher amplitude at each frequency within the subset of the multiple frequencies compared to an amplitude of the first acoustic transmit signal at each of the multiple frequencies.

13 . The device of claim 6 , wherein the at least one transducer is further configured to transmit the second acoustic transmit signal such that the second acoustic transmit signal has a longer duration at each frequency within the subset of the multiple frequencies compared to a duration of the first acoustic transmit signal at each of the multiple frequencies.

14 . The device of claim 6 , wherein the at least one processor is further configured to:

determine that at least one frequency of the multiple frequencies is associated with an amplitude of the acoustic receive signal having a peak-to-average ratio that is above a threshold;

determine at least one other frequency of the multiple frequencies is associated with a phase of the acoustic receive signal having another peak-to-average ratio that is above the threshold; and

select the subset of the multiple frequencies such that the subset of the multiple frequencies comprises the at least one frequency and the at least one other frequency.

15 . The method of claim 1 , further comprising:

receiving a second acoustic receive signal that represents a version of the second acoustic transmit signal with one or more characteristics modified due to the propagation within the ear canal; and

determining a heart rate variability of the person based on the one or more modified characteristics of the second acoustic receive signal, wherein:

the determining of the heart rate variability of the person comprises:

generating a down-converted signal based on the second acoustic receive signal by mixing a digital version of the second acoustic receive signal with a digital version of the second acoustic transmit signal using an in-phase and quadrature mixer;

generating a filtered signal based on the down-converted signal by passing the down-converted signal through a low-pass filter; and

measuring the heart rate variability based on peaks within at least one of an amplitude or a phase of the filtered signal.

16 . The method of claim 15 , further comprising:

determining a blood pressure of the person based on the one or more modified characteristics of the second acoustic receive signal.

17 . The method of claim 16 , wherein the determining of the blood pressure of the person comprises:

detecting occurrences of a dicrotic notch within at least one of an amplitude or a phase of a version of the acoustic receive signal; and

measuring the blood pressure of the person based on the occurrences of the dicrotic notch.

18 . The method of claim 1 , wherein the first acoustic transmit signal and the second acoustic transmit signal each comprise an ultrasound signal having frequencies between approximately twenty kilohertz and two megahertz.

19 . The method of claim 1 , further comprising:

transmitting audible content during at least a portion of time that the first acoustic transmit signal and the second acoustic transmit signal are transmitted.

20 . A non-transitory computer-readable storage medium comprising instructions that, when executed by a processor, cause a hearable to:

transmit a first acoustic transmit signal that propagates within at least a portion of an ear canal of a person, the first acoustic transmit signal having multiple frequencies;

receive an acoustic receive signal, the acoustic receive signal representing a version of the first acoustic transmit signal with one or more characteristics modified due to the propagation within the ear canal;

select a subset of the multiple frequencies based on the one or more modified characteristics of the acoustic receive signal; and

transmit a second acoustic transmit signal that propagates within at least the portion of the ear canal of the person, the second acoustic transmit signal having the subset of the multiple frequencies.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2024
From: FAN, XIAORAN; THORMUNDSSON, TRAUSTI; HOWARD, RICHARD EDWIN
To: GOOGLE LLC
Reel/Frame 066826/0353 →
Continuity (2)
Continuation PCTUS2023064242 · Mar 13, 2023
Related Publication 20240307022A1 · Sep 19, 2024
References Cited (99)
US 5105822A · Stevens et al. · 1992 [cited by applicant]
US 7354380B2 · Volpe · 2008 [cited by applicant]
US 10873798B1 · Jackson et al. · 2020 [cited by applicant]
US 11402902B2 · Parshionikar · 2022 [cited by applicant]
US 20040196992A1 · Ryan · 2004 [cited by applicant]
US 20090097689A1 · Prest et al. · 2009 [cited by applicant]
US 20100125218A1 · Haartsen et al. · 2010 [cited by applicant]
US 20100189269A1 · Haartsen et al. · 2010 [cited by applicant]
US 20140051940A1 · Messerschmidt · 2014 [cited by applicant]
US 20190022348A1 · Read et al. · 2019 [cited by applicant]
US 20190294769A1 · Lesso · 2019 [cited by applicant]
US 20200186910A1 · Kemmerer et al. · 2020 [cited by applicant]
US 20200187795A1 · Yokoi et al. · 2020 [cited by applicant]
US 20210186426A1 · Raju et al. · 2021 [cited by applicant]
US 20210275056A1 · Mcmahon et al. · 2021 [cited by applicant]
US 20210281943A1 · Lehnert · 2021 [cited by applicant]
US 20220087570A1 · Lesso et al. · 2022 [cited by applicant]
US 20220183659A1 · Margalit · 2022 [cited by applicant]
US 20220386959A1 · Georgiou et al. · 2022 [cited by applicant]
US 20230096953A1 · Kuster · 2023 [cited by examiner]
US 20250318800A1 · Fan et al. · 2025 [cited by applicant]
WO 2010054863 · 2010 [cited by applicant]
WO 2015076916 · 2015 [cited by applicant]
WO 2016150947 · 2016 [cited by applicant]
WO 2019018750 · 2019 [cited by applicant]
WO 2019152212 · 2019 [cited by applicant]
WO 2019226739A1 · 2019 [cited by applicant]
WO 2020082387A1 · 2020 [cited by applicant]
WO 2020130535A1 · 2020 [cited by applicant]
WO 2021123720 · 2021 [cited by applicant]
WO 2022019442A1 · 2022 [cited by applicant]
WO 2023240224 · 2023 [cited by applicant]
WO 2023240233 · 2023 [cited by applicant]
WO 2023240240 · 2023 [cited by applicant]
WO 2024191491A1 · 2024 [cited by applicant]
WO 2024192250A1 · 2024 [cited by applicant]
WO 2024192386A1 · 2024 [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/068198, Dec. 10, 2024, 6 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/068181, Dec. 10, 2024, 7 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/068208, Dec. 20, 2024, 7 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2024/020238, Oct. 2, 2024, 21 pages. [cited by applicant]
“A Research Space for Earable Computing”, Retrieved at: https://www.esense.io/—on May 10, 2022, 16 pages. [cited by applicant]
“Air—Speed of Sound vs. Temperature”, Retrieved at: https://www.engineeringtoolbox.com/air-speed-sound-d_603.html—on May 10, 2022, 14 pages. [cited by applicant]
“Cardioid XLR Lav Microphone”, Retrieved at: https://www.movophoto.com/products/lv4-c-xlr-phantom-power-lav-cardioid-mic—on May 10, 2022, 3 pages. [cited by applicant]
“Finger Pulse Oximeter, (SpO2) Blood Oxygen Saturation Monitor with Pulse Rate Measurements and Pulse Bar Graph, Digital Reading LED Display”, Retrieved at: https://santamedical.com/collections/oximeters/products/finger… [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/068198, Aug. 31, 2023, 10 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/068208, Aug. 31, 2023, 11 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/068181, Sep. 4, 2023, 11 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/064242, Nov. 3, 2023, 21 pages. [cited by applicant]
“Invitation to Pay Additional Fees and Partial Search Report”, Application No. PCT/US2023/064242, Sep. 20, 2023, 13 pages. [cited by applicant]
“Speed of Sound in Gases”, Retrieved at: https://www.betamachinery.com/knowledge-center/speed-of-sound-in-gases-list—on May 10, 2022, 4 pages. [cited by applicant]
“What is Carbon Dioxide?”, Retrieved at: https://www.co2meter.com/blogs/news/10709101-what-is-carbon-dioxide, Dec. 9, 2013, 6 pages. [cited by applicant]
Amesaka, et al., “Facial Expression Recognition Using Ear Canal Transfer Function”, Sep. 19, 2019, 9 pages. [cited by applicant]
Appelhans, et al., “Heart Rate Variability as an Index of Regulated Emotional Responding”, Sep. 2006, pp. 229-240. [cited by applicant]
Bui, et al., “eBP: A Wearable System For Frequent and Comfortable Blood Pressure Monitoring From User's Ear”, Oct. 2019, 17 pages. [cited by applicant]
Butkow, et al., “Motion-resilient Heart Rate Monitoring with In-ear Microphones”, Aug. 2021, 14 pages. [cited by applicant]
Chamary, JV, “You'll Be Surprised How Often You Actually Touch Your Face”, https://www.forbes.com/sites/jvchamary/2020/07/30/coronavirus-face-touching/?sh=442158ae375f, Jul. 30, 2020, 6 pages. [cited by applicant]
Fan, et al., “Enabling Low-Cost Full Surface Tactile Skin for Human Robot Interaction”, Apr. 2022, pp. 1800-1807. [cited by applicant]
Fan, et al., “HeadFi: Bringing Intelligence to All Headphones”, Oct. 2021, 14 pages. [cited by applicant]
Geisler, et al., “The impact of heart rate variability on subjective well-being is mediated by emotion regulation”, Nov. 2010, pp. 723-728. [cited by applicant]
He, et al., “An Ear-worn Continuous Ballistocardiogram (BCG) Sensor for Cardiovascular Monitoring”, Apr. 2015, 15 pages. [cited by applicant]
Lane, et al., “Neural correlates of heart rate variability during emotion”, Jan. 2009, pp. 213-222. [cited by applicant]
Laskowski, Edwardr. , “What's a normal resting heart rate?”, Oct. 2, 2020, 4 pages. [cited by applicant]
Lofqvist, et al., “Speed of Sound Measurements in Gas-Mixtures at Varying Composition Using an Ultrasonic Gas Flow Meter with Silicon Based Transducers”, Jan. 1, 2003, 6 pages. [cited by applicant]
Ma, et al., “OESense: Employing Occlusion Effect for In-ear Human Sensing”, Jun. 16, 2021, 13 pages. [cited by applicant]
Martin, et al., “In-Ear Audio Wearable: Measurement of Heart and Breathing Rates for Health and Safety Monitoring”, Jun. 2018, pp. 1256-1263. [cited by applicant]
Moller, et al., “Transfer Characteristics of Headphones Measured on Human Ears”, Apr. 1995, 16 pages. [cited by applicant]
Nguyen, et al., “A Lightweight And Inexpensive In-ear Sensing System For Automatic Whole-night Sleep Stage Monitoring”, Nov. 2016, 15 pages. [cited by applicant]
Poh, et al., “Cardiovascular monitoring using earphones and a mobile device”, Dec. 2012, 9 pages. [cited by applicant]
Poh, et al., “Heartphones: Sensor Earphones and Mobile Application for Non-obtrusive Health Monitoring”, Sep. 2009, pp. 153-154. [cited by applicant]
Rahman, et al., “How Frequently Do We Touch Facial T-Zone: A Systematic Review”, https://www.annalsofglobalhealth.org/articles/10.5334/aogh.2956/, Jul. 6, 2020, 9 pages. [cited by applicant]
Roddiger, et al., “Towards Respiration Rate Monitoring Using an In-Ear Headphone Inertial Measurement Unit”, Sep. 2019, 7 pages. [cited by applicant]
Rupavatharam, et al., “Towards In-Ear Inertial Jaw Clenching Detection”, Sep. 2019, pp. 54-55. [cited by applicant]
Schafer, Ronaldw. , “What is a Savitzky-Golay Filter”, Jul. 2011, 7 pages. [cited by applicant]
Shilko, et al., “Calculation of Pulse Wave Parameters with Account of Blood Vessel Deformation”, Jan. 2001, pp. 88-94. [cited by applicant]
Sissons, Claire, “What to know about patulous eustachian tube”, Jun. 12, 2020, 10 pages. [cited by applicant]
Stein, Phyllisk. , “Heart rate variability: a measure of cardiac autonomic tone”, May 1994, pp. 1376-1381. [cited by applicant]
Vogel, et al., “In-Ear Vital Signs Monitoring Using a Novel Microoptic Reflective Sensor”, Nov. 2009, pp. 882-889. [cited by applicant]
Wallburg, Kris, “Control Your AirPods with a Wink or Smile”, https://www.macworld.com/article/675759/patent-control-your-airpods-with-a-wink-or-smile.html, Dec. 2, 2020, 4 pages. [cited by applicant]
Winokur, et al., “A Wearable Vital Signs Monitor at the Ear for Continuous Heart Rate and Pulse Transit Time Measurements”, Apr. 15, 2015, 14 pages. [cited by applicant]
Winokur, et al., “A Wearable Vital Signs Monitor at the Ear for Continuous Heart Rate and Pulse Transit Time Measurements”, Sep. 2012, pp. 2724-2727. [cited by applicant]
Wong, George, “Speed of Sound in Standard Air”, Jan. 28, 1986, 8 pages. [cited by applicant]
Zhao, et al., “Emotion Recognition using Wireless Signals”, Oct. 2016, 14 pages. [cited by applicant]
“Extended European Search Report”, Application No. 24163311.4, Jun. 18, 2024, 11 pages. [cited by applicant]
“Extended European Search Report”, EP Application No. 24162019.4, Jun. 18, 2024, 11 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2024/019953, Jul. 4, 2024, 13 pages. [cited by applicant]
“Invitation to Pay Additional Fees and Partial Search Report”, Application No. PCT/US2024/020238, Jul. 11, 2024, 11 pages. [cited by applicant]
“Two AirPods Max Patents reveal the addition of a new processor and sensors designed to Detect Heart Pathologies”, Retrieved at: https://www.patentlyapple.com/2024/03/two-airpods-max-patents-reveal-the-addition-of-a-new… [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/086447, Apr. 12, 2024, 14 pages. [cited by applicant]
Jin, et al., “EarCommand “Hearing” Your Silent Speech Commands In Ear”, Jul. 7, 2022, 28 pages. [cited by applicant]
Nguyen, et al., “A Scalable and Domain Adaptive Respiratory Symptoms Detection Framework using Earables”, Dec. 2021, 6 pages. [cited by applicant]
Roddiger, et al., “Sensing with Earables”, Sep. 7, 2022, 57 pages. [cited by applicant]
Zhang, et al., “Coughtrigger: Earbuds IMU Based Cough Detection Activator using an Energy-efficient Sensitivity-prioritized Time Series Classifier”, May 2022, 5 pages. [cited by applicant]
Zhang, et al., “EarCough: Enabling Continuous Subject Cough Event Detection on Hearables”, Mar. 18, 2023, 6 pages. [cited by applicant]
“Foreign Office Action”, EP Application No. 23738398.9, May 21, 2025, 9 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/086447, Sep. 10, 2025, 10 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2024/020238, Sep. 10, 2025, 16 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2024/019953, Sep. 10, 2025, 9 pages. [cited by applicant]
“Restriction Requirement”, U.S. Appl. No. 18/556,853, filed Oct. 30, 2025, 8 pages. [cited by applicant]
Cited By (1)
US 12,629,037