IP Library Granted Patent US 12,629,037
Granted Patent B2
US 12,629,037 · App. 18/556,843 · Granted May 19, 2026

Audioplethysmography calibration

Inventors: Xiaoran Fan (Irvine, CA); Trausti Thormundsson (Irvine, CA)
Assignee: Google LLC
A61B5/0205A61B5/6817A61B5/7225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,629,037
App. No.
18/556,843
Granted
May 19, 2026
Kind
B2
Abstract

Techniques and apparatuses are described that perform audioplethysmography calibration. Provided according to one or more preferred embodiments is a hearable, such as an earbud, that is capable of performing a novel physiological monitoring process termed herein audioplethysmography, an active acoustic method capable of sensing subtle physiologically-related changes observable at a user's outer and middle ear. The hearable can utilize audioplethysmography to monitor a user's biometrics, recognize facial behaviors, and/or sense an environment using acoustic signals. The techniques for audioplethysmography calibration enable the hearable to dynamically select frequencies that improve the performance of audioplethysmography. With audioplethysmography calibration, the hearable may utilize different frequencies for different ears and these frequencies may change over time.

Claims (67)

1 . A method comprising:

performing a calibration process that identifies, from a set of multiple frequencies, at least one acoustic frequency suitable for audioplethysmography using at least one speaker and at least one microphone, the performing of the calibration process comprising:

transmitting a first acoustic transmit signal having the set of multiple frequencies, the first acoustic transmit signal propagating within at least a portion of an ear canal of a user;

receiving a first acoustic receive signal, the first acoustic receive signal representing a version of the first acoustic transmit signal that has one or more waveform characteristics modified based on the propagation within the ear canal; and

selecting the at least one acoustic frequency from the set of multiple frequencies based on the one or more waveform characteristics; and

performing, using the at least one acoustic frequency selected by the calibration process, the audioplethysmography at an ear of the user.

2 . The method of claim 1 , further comprising:

detecting whether an ear canal of the user is at least partially sealed by a device comprising the at least one speaker and/or the at least one microphone; and

responsive to the detecting, initiating the performing of the calibration process.

3 . The method of claim 1 , wherein:

the performing of the calibration process comprises performing a first calibration process at a first ear using a first speaker of the at least one speaker and a first microphone of the at least one microphone;

the using the at least one acoustic frequency comprises using the at least one acoustic frequency for performing the audioplethysmography at the first ear; and

the method further comprises:

performing, at a second ear of the user, a second calibration process that identifies at least one second acoustic frequency suitable for the audioplethysmography using a second speaker of the at least one speaker and a second microphone of the at least one microphone; and

using the at least one second acoustic frequency for performing the audioplethysmography at the second ear.

4 . The method of claim 1 , further comprising:

transmitting audible content during at least a portion of time that the calibration process is performed or during at least a portion of time that the audioplethysmography is performed.

5 . The method of claim 1 , wherein the at least one frequency comprises two or more frequencies from the set of multiple frequencies.

6 . The method of claim 1 , wherein the selecting the at least one acoustic frequency comprises:

demodulating the first acoustic receive signal by mixing a digital version of the first acoustic receive signal with a digital version of the first acoustic transmit signal to generate a first mixed signal;

passing the first mixed signal through a low-pass filter to generate a first filtered signal;

determining a second derivative of the first filtered signal;

identifying zero-crossing frequencies associated with the second derivative of the first filtered signal; and

selecting the at least one acoustic frequency from the zero-crossing frequencies.

7 . The method of claim 1 , wherein the transmitting of the first acoustic transmit signal comprises transmitting the first acoustic transmit signal having a bandwidth of at least four kilohertz.

8 . The method of claim 1 , wherein the first acoustic transmit signal comprises at least one of the following:

an ultrasound signal having frequencies between approximately twenty kilohertz and two megahertz; or

an audible signal having frequencies between approximately twenty hertz and twenty kilohertz.

9 . The method of claim 1 , wherein the performing of the audioplethysmography comprises:

transmitting a second acoustic transmit signal having the at least one acoustic frequency, the second acoustic transmit signal propagating within at least a portion of an ear canal of the user;

receiving a second acoustic receive signal, the second acoustic receive signal representing a version of the second acoustic transmit signal that has one or more waveform characteristics modified based on the propagation within the ear canal; and

determining at least one physiological metric of the user based on the one or more modified waveform characteristics of the second acoustic receive signal.

10 . The method of claim 9 , wherein the determining of the at least one physiological metric of the user comprises:

demodulating the second acoustic receive signal by mixing a digital version of the second acoustic receive signal with a digital version of the second acoustic transmit signal to generate a second mixed signal;

passing the second mixed signal through a low-pass filter to generate a second filtered signal;

generating an autocorrelation of the second filtered signal; and

determining a period of the autocorrelation of the second filtered signal to determine the at least one physiological metric.

11 . The method of claim 9 , wherein the at least one physiological metric comprises at least one of the following:

a heart rate of the user; or

a respiration rate of the user.

12 . A device comprising:

at least one speaker;

at least one microphone; and

at least one processor, the device configured to:

perform, using the at least one speaker, the at least one microphone, and the at least one processor, a calibration process that identifies, from a set of multiple frequencies, at least one acoustic frequency suitable for audioplethysmography, the device is further configured to perform the following as part of the calibration process:

transmit, using the at least one speaker, a first acoustic transmit signal having the set of multiple frequencies, the first acoustic transmit signal propagating within at least a portion of an ear canal of a user;

receive, using the at least one microphone, a first acoustic receive signal, the first acoustic receive signal representing a version of the first acoustic transmit signal that has one or more waveform characteristics modified based on the propagation within the ear canal; and

select, using the at least one processor, the at least one acoustic frequency from the set of multiple frequencies based on the one or more waveform characteristics; and

perform, using the at least one speaker and the at least one microphone, the audioplethysmography at an ear of the user using the at least one acoustic frequency selected by the calibration process.

13 . The device of claim 12 , further comprising:

an active-noise-cancellation circuit comprising the at least one microphone.

14 . The device of claim 13 , wherein the at least one speaker and the at least one microphone are configured to be positioned proximate to one ear of a user.

15 . The device of claim 12 , wherein:

the at least one speaker is configured to be positioned proximate to a first ear of a user; and

the at least one microphone is configured to be positioned proximate to a second ear.

16 . The device of claim 12 , wherein at least one of the at least one speaker or the least one microphone is part of at least one transducer of the device.

17 . The device of claim 12 , wherein the device is configured to at least partially seal one or more ears of a user.

18 . The device of claim 12 , wherein the device comprises:

at least one earbud; or

headphones.

19 . The device of claim 12 , wherein the at least one frequency comprises two or more frequencies from the set of multiple frequencies.

20 . The device of claim 12 , wherein the device is further configured to:

demodulate the first acoustic receive signal by mixing a digital version of the first acoustic receive signal with a digital version of the first acoustic transmit signal to generate a first mixed signal;

pass the first mixed signal through a low-pass filter to generate a first filtered signal;

determine, using the at least one processor, a second derivative of the first filtered signal;

identify, using the at least one processor, zero-crossing frequencies associated with the second derivative of the first filtered signal; and

select, using the at least one processor, the at least one acoustic frequency from the zero-crossing frequencies.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2023
From: FAN, XIAORAN; THORMUNDSSON, TRAUSTI
To: GOOGLE LLC
Reel/Frame 065343/0695 →
Continuity (2)
Provisional Application 63366219 · Jun 10, 2022
Related Publication 20250082210A1 · Mar 13, 2025
References Cited (116)
US 5105822A · Stevens · 1992 [cited by examiner]
US 7354380B2 · Volpe · 2008 [cited by applicant]
US 10873798B1 · Jackson et al. · 2020 [cited by applicant]
US 11402902B2 · Parshionikar · 2022 [cited by applicant]
US 12042328B2 · Arakawa · 2024 [cited by examiner]
US 12495980B2 · Fan et al. · 2025 [cited by applicant]
US 20040196992A1 · Ryan · 2004 [cited by applicant]
US 20090097689A1 · Prest et al. · 2009 [cited by applicant]
US 20100125218A1 · Haartsen et al. · 2010 [cited by applicant]
US 20100189269A1 · Haartsen et al. · 2010 [cited by applicant]
US 20140051940A1 · Messerschmidt · 2014 [cited by examiner]
US 20190022348A1 · Read et al. · 2019 [cited by applicant]
US 20190294769A1 · Lesso · 2019 [cited by applicant]
US 20200186910A1 · Kemmerer et al. · 2020 [cited by applicant]
US 20200187795A1 · Yokoi et al. · 2020 [cited by applicant]
US 20200196977A1 · Martin et al. · 2020 [cited by applicant]
US 20210186426A1 · Raju et al. · 2021 [cited by applicant]
US 20210275056A1 · Mcmahon et al. · 2021 [cited by applicant]
US 20210281943A1 · Lehnert · 2021 [cited by applicant]
US 20220087570A1 · Lesso et al. · 2022 [cited by applicant]
US 20220183659A1 · Margalit · 2022 [cited by applicant]
US 20220386959A1 · Georgiou et al. · 2022 [cited by applicant]
US 20230096953A1 · Kuster et al. · 2023 [cited by applicant]
US 20240307022A1 · Fan · 2024 [cited by examiner]
US 20240312478A1 · Fan · 2024 [cited by examiner]
US 20250082300A1 · Fan · 2025 [cited by examiner]
US 20250213142A1 · Amihood · 2025 [cited by examiner]
US 20250278240A1 · Amihood · 2025 [cited by examiner]
US 20250318800A1 · Fan · 2025 [cited by examiner]
JP 2018500949A · 2018 [cited by applicant]
JP 2022056790A · 2022 [cited by applicant]
WO 2010054863 · 2010 [cited by applicant]
WO 2015076916 · 2015 [cited by applicant]
WO 2016150947 · 2016 [cited by applicant]
WO 2019018750 · 2019 [cited by applicant]
WO 2019152212 · 2019 [cited by applicant]
WO 2019226739A1 · 2019 [cited by applicant]
WO 2020082387A1 · 2020 [cited by applicant]
WO 2020130535A1 · 2020 [cited by applicant]
WO 2020174680A1 · 2020 [cited by applicant]
WO 2021123720 · 2021 [cited by applicant]
WO WO2021123720A1 · 2021 [cited by examiner]
WO 2022019442A1 · 2022 [cited by applicant]
WO 2023240224 · 2023 [cited by applicant]
WO 2023240233 · 2023 [cited by applicant]
WO 2024191456A1 · 2024 [cited by applicant]
WO 2024191491A1 · 2024 [cited by applicant]
WO 2024192250A1 · 2024 [cited by applicant]
WO 2024192386A1 · 2024 [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/064242, Nov. 3, 2023, 21 pages. [cited by applicant]
Amesaka, et al., “Facial Expression Recognition Using Ear Canal Transfer Function”, Sep. 19, 2019, 9 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/068198, Dec. 10, 2024, 6 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/068181, Dec. 10, 2024, 7 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/068208, Dec. 10, 2024, 7 pages. [cited by applicant]
“Extended European Search Report”, Application No. 24163311.4, Jun. 18, 2024, 11 pages. [cited by applicant]
“Extended European Search Report”, EP Application No. 24162019.4, Jun. 18, 2024, 11 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2024/019953, Jul. 4, 2024, 13 pages. [cited by applicant]
“Invitation to Pay Additional Fees and Partial Search Report”, Application No. PCT/US2024/020238, Jul. 11, 2024, 11 pages. [cited by applicant]
“Two AirPods Max Patents reveal the addition of a new processor and sensors designed to Detect Heart Pathologies”, Retrieved at: https://www.patentlyapple.com/2024/03/two-airpods-max-patents-reveal-the-addition-of-a-new… [cited by applicant]
“A Research Space for Earable Computing”, Retrieved at: https://www.esense.io/—on May 10, 2022, 16 pages. [cited by applicant]
“Air—Speed of Sound vs. Temperature”, Retrieved at: https://www.engineeringtoolbox.com/air-speed-sound-d_603. html—on May 10, 2022, 14 pages. [cited by applicant]
“Cardioid XLR Lav Microphone”, Retrieved at: https://www.movophoto.com/products/lv4-c-xlr-phantom-power-lav-cardioid-mic—on May 10, 2022, 3 pages. [cited by applicant]
“Finger Pulse Oximeter, (SpO2) Blood Oxygen Saturation Monitor with Pulse Rate Measurements and Pulse Bar Graph, Digital Reading LED Display”, Retrieved at: https://santamedical.com/collections/oximeters/products/finger… [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/068198, Aug. 31, 2023, 10 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/068208, Aug. 31, 2023, 11 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/068181, Sep. 4, 2023, 11 pages. [cited by applicant]
“Invitation to Pay Additional Fees and Partial Search Report”, Application No. PCT/US2023/064242, Sep. 20, 2023, 13 pages. [cited by applicant]
“Speed of Sound in Gases”, Retrieved at: https://www.betamachinery.com/knowledge-center/speed-of-sound-in-gases-list—on May 10, 2022, 4 pages. [cited by applicant]
“What is Carbon Dioxide?”, Retrieved at: https://www.co2meter.com/blogs/news/10709101-what-is-carbon-dioxide, Dec. 9, 2013, 6 pages. [cited by applicant]
Appelhans, et al., “Heart Rate Variability as an Index of Regulated Emotional Responding”, Sep. 2006, pp. 229-240. [cited by applicant]
Bui, et al., “eBP: A Wearable System For Frequent and Comfortable Blood Pressure Monitoring From User's Ear”, Oct. 2019, 17 pages. [cited by applicant]
Butkow, et al., “Motion-resilient Heart Rate Monitoring with In-ear Microphones”, Aug. 2021, 14 pages. [cited by applicant]
Chamary, JV, “You'll Be Surprised How Often You Actually Touch Your Face”, https://www.forbes.com/sites/jvchamary/2020/07/30/coronavirus-face-touching/?sh=442158ae375f, Jul. 30, 2020, 6 pages. [cited by applicant]
Fan, et al., “Enabling Low-Cost Full Surface Tactile Skin for Human Robot Interaction”, Apr. 2022, pp. 1800-1807. [cited by applicant]
Fan, et al., “HeadFi: Bringing Intelligence to All Headphones”, Oct. 2021, 14 pages. [cited by applicant]
Geisler, et al., “The impact of heart rate variability on subjective well-being is mediated by emotion regulation”, Nov. 2010, pp. 723-728. [cited by applicant]
He, et al., “An Ear-worn Continuous Ballistocardiogram (BCG) Sensor for Cardiovascular Monitoring”, Apr. 2015, 15 pages. [cited by applicant]
Lane, et al., “Neural correlates of heart rate variability during emotion”, Jan. 2009, pp. 213-222. [cited by applicant]
Laskowski, Edwardr. , “What's a normal resting heart rate?”, Oct. 2, 2020, 4 pages. [cited by applicant]
Lofqvist, et al., “Speed of Sound Measurements in Gas-Mixtures at Varying Composition Using an Ultrasonic Gas Flow Meter with Silicon Based Transducers”, Jan. 1, 2003, 6 pages. [cited by applicant]
Ma, et al., “OESense: Employing Occlusion Effect for In-ear Human Sensing”, Jun. 16, 2021, 13 pages. [cited by applicant]
Martin, et al., “In-Ear Audio Wearable: Measurement of Heart and Breathing Rates for Health and Safety Monitoring”, Jun. 2018, pp. 1256-1263. [cited by applicant]
Moller, et al., “Transfer Characteristics of Headphones Measured on Human Ears”, Apr. 1995, 16 pages. [cited by applicant]
Nguyen, et al., “A Lightweight And Inexpensive In-ear Sensing System For Automatic Whole-night Sleep Stage Monitoring”, Nov. 2016, 15 pages. [cited by applicant]
Poh, et al., “Cardiovascular monitoring using earphones and a mobile device”, Dec. 2012, 9 pages. [cited by applicant]
Poh, et al., “Heartphones: Sensor Earphones and Mobile Application for Non-obtrusive Health Monitoring”, Sep. 2009, pp. 153-154. [cited by applicant]
Rahman, et al., “How Frequently Do We Touch Facial T-Zone: A Systematic Review”, https://www.annalsofglobalhealth.org/articles/10.5334/aogh.2956/, Jul. 6, 2020, 9 pages. [cited by applicant]
Roddiger, et al., “Towards Respiration Rate Monitoring Using an In-Ear Headphone Inertial Measurement Unit”, Sep. 2019, 7 pages. [cited by applicant]
Rupavatharam, et al., “Towards In-Ear Inertial Jaw Clenching Detection”, Sep. 2019, pp. 54-55. [cited by applicant]
Schafer, Ronaldw. , “What is a Savitzky-Golay Filter”, Jul. 2011, 7 pages. [cited by applicant]
Shilko, et al., “Calculation of Pulse Wave Parameters with Account of Blood Vessel Deformation”, Jan. 2001, pp. 88-94. [cited by applicant]
Sissons, Claire, “What to know about patulous eustachian tube”, Jun. 12, 2020, 10 pages. [cited by applicant]
Stein, Phyllisk. , “Heart rate variability: a measure of cardiac autonomic tone”, May 1994, pp. 1376-1381. [cited by applicant]
Vogel, et al., “In-Ear Vital Signs Monitoring Using a Novel Microoptic Reflective Sensor”, Nov. 2009, pp. 882-889. [cited by applicant]
Wallburg, Kris, “Control Your AirPods with a Wink or Smile”, https://www.macworld.com/article/675759/patent-control-your-airpods-with-a-wink-or-smile.html, Dec. 2, 2020, 4 pages. [cited by applicant]
Winokur, et al., “A Wearable Vital Signs Monitor at the Ear for Continuous Heart Rate and Pulse Transit Time Measurements”, Apr. 15, 2015, 14 pages. [cited by applicant]
Winokur, et al., “A Wearable Vital Signs Monitor at the Ear for Continuous Heart Rate and Pulse Transit Time Measurements”, Sep. 2012, pp. 2724-2727. [cited by applicant]
Wong, George, “Speed of Sound in Standard Air”, Jan. 28, 1986, 8 pages. [cited by applicant]
Zhao, et al., “Emotion Recognition using Wireless Signals”, Oct. 2016, 14 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2023/086447, Apr. 12, 2024, 14 pages. [cited by applicant]
Jin, et al., “EarCommand “Hearing” Your Silent Speech Commands In Ear”, Jul. 7, 2022, 28 pages. [cited by applicant]
Nguyen, et al., “A Scalable and Domain Adaptive Respiratory Symptoms Detection Framework using Earables”, Dec. 2021, 6 pages. [cited by applicant]
Roddiger, et al., “Sensing with Earables”, Sep. 7, 2022, 57 pages. [cited by applicant]
Zhang, et al., “Coughtrigger: Earbuds IMU Based Cough Detection Activator using an Energy-efficient Sensitivity-prioritized Time Series Classifier”, May 2022, 5 pages. [cited by applicant]
Zhang, et al., “EarCough: Enabling Continuous Subject Cough Event Detection on Hearables”, Mar. 18, 2023, 6 pages. [cited by applicant]
“Foreign Office Action”, EP Application No. 24162019.4, Apr. 8, 2025, 6 pages. [cited by applicant]
“Foreign Office Action”, EP Application No. 23738398.9, May 21, 2025, 9 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2023/086447, Sep. 10, 2025, 10 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2024/020238, Sep. 10, 2025, 16 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2024/019953, Sep. 10, 2025, 9 pages. [cited by applicant]
“Notice of Allowance”, U.S. Appl. No. 18/602,888, Oct. 15, 2025, 17 pages. [cited by applicant]
“Restriction Requirement”, U.S. Appl. No. 18/602,888, Aug. 7, 2025, 6 pages. [cited by applicant]
“Restriction Requirement”, U.S. Appl. No. 18/556,853, Oct. 30, 2025, 8 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2024/020238, Oct. 2, 2024, 21 pages. [cited by applicant]
“Foreign Office Action”, JP Application No. 2024-571923, Nov. 25, 2025, 13 pages. [cited by applicant]
“Foreign Office Action”, EP Application No. 23739040.6, Mar. 2, 2026, 5 pages. [cited by applicant]