IP Library › Granted Patent US 12,239,421
Granted Patent B2
US 12,239,421 · App. 18/310,215 · Granted Mar 4, 2025

Sensor device

Inventors: Christian Holz (Seattle, WA); Eyal Ofek (Redmond, WA); Michael J. Sinclair (Kirkland, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
A61B5/02028A61B5/0017A61B5/0024A61B5/0093A61B5/02007A61B5/02125A61B5/02416A61B5/0261A61B5/14551A61B5/489A61B5/6813A61B5/6844A61B5/7221A61B5/0077A61B5/021A61B5/02108A61B5/02427A61B5/02438A61B5/1075A61B5/1076A61B5/1079A61B5/1455A61B5/14552A61B5/6803A61B5/681A61B5/6822A61B5/6824A61B5/6828A61B5/6898A61B5/7207A61B2562/046A61B2576/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,239,421
App. No.
18/310,215
Granted
Mar 4, 2025
Kind
B2
Abstract

A sensor device is described herein. The sensor device includes a multi-dimensional optical sensor and processing circuitry, wherein the multi-dimensional optical sensor generates images and the processing circuitry is configured to output data that is indicative of hemodynamics of a user based upon the images. The sensor device is non-invasive, and is able to be incorporated into wearable devices, thereby allowing for continuous output of the data that is indicative of the hemodynamics of the user.

Claims (50)

1. A smartwatch that is wearable on a wrist of a user, the smartwatch comprising:

a display;

a sensor that is configured to generate images that are indicative of blood pressure of the user when the smartwatch is worn on the wrist of the user; and

a processor that is in communication with the display and the sensor, where the processor obtains the images that are indicative of the blood pressure of the user and causes an alert to be presented on the display based upon the data, wherein processor causes the alert to be presented on the display based upon an identified direction of an artery or vein of the user in the images, and further where the alert indicates that the user has hypertension or is at risk for hypertension.

2. The smartwatch of claim 1 , wherein the images have M×N pixels, where both M and N are greater than one.

3. The smartwatch of claim 2 , wherein the sensor comprises an array of illuminators that emit light in a non-visible spectrum and an array of detectors that detect light in the non-visible spectrum, wherein the images generated by the sensor are based upon light emitted by the illuminators and light detected by the detectors.

4. The smartwatch of claim 2 , wherein the sensor comprises an array of light emitting diodes (LEDs), wherein a first set of LEDs in the array are configured to emit light and a second set of LEDs in the array are operated as photodiodes and are configured to detect light, wherein the images are generated by the sensor based upon light emitted by the first set of LEDs and light detected by the second set of LEDs.

5. The smartwatch of claim 1 , wherein the sensor comprises:

a multi-dimensional optical sensor that is positionable proximate to a surface of skin of the user and external to the wrist of the user, wherein the multi-dimensional optical sensor comprises an array of photodiodes and is configured to generate the images;

where the processor is configured to:

receive the images generated by the multi-dimensional optical sensor;

validate, based upon the images, that the images include a region that corresponds to the artery or vein of the user; and

responsive to validating that the images include the region that corresponds to the artery or the vein of the user, cause the alert to be presented on the display based upon the images received from the multi-dimensional optical sensor.

6. The smartwatch of claim 1 , wherein the processor is configured to compute and output values for at least one of the following based upon the images generated by the sensor:

pulse transmit time;

arterial stiffness;

arterial blood oxygenation; or

tissue blood oxygenation.

7. The smartwatch of claim 1 , wherein the data that is indicative of the blood pressure of the patient is one of arterial pulse wave velocity or pulse transit time.

8. The smartwatch of claim 1 , wherein the sensor is a complementary metal oxide semiconductor (CMOS) sensor.

9. The smartwatch of claim 1 , wherein the processor verifies types of tissue captured in the images, and further wherein processor obtains the data based upon the types of tissue captured in the images.

10. The smartwatch of claim 1 , wherein the sensor is a charge coupled device (CCD) sensor.

11. A method performed by a smartwatch when the smartwatch is worn by a user on a wrist of the user, the method comprising:

generating, by a sensor device in the smartwatch, images of an artery or vein of the user;

obtaining, by a processor of the smartwatch, data that is indicative of blood pressure of the user based upon the images of the artery or vein generated by the sensor device, wherein obtaining the data comprises:

identifying a direction of the artery or the vein of the user in the images, wherein the data is obtained based upon the identified direction of the artery or the vein of the user in the images;

generating an alarm based upon the data that is indicative of the blood pressure of the user, where the alarm indicates that the user has hypertension or is at risk for hypertension; and

displaying the alarm on a display of the smartwatch for presentment to the user.

12. The method of claim 11 , wherein the data that is indicative of the blood pressure of the patient is one of arterial pulse wave velocity or pulse transit time of the patient.

13. The method of claim 11 , wherein the processor is further configured to compute a value for at least one of the following based upon the images of the artery or vein generated by the sensor device:

pulse transit time;

arterial stiffness;

arterial blood oxygenation; or

tissue blood oxygenation.

14. The method of claim 11 , wherein the sensor device is a multi-dimensional optical sensor such that the images generated by the sensor device have M×N pixels, where both M and N are greater than one.

15. The method of claim 11 , wherein generating the images of the artery or vein of the user comprises:

emitting, by an illuminator of the sensor device, infrared light towards the wrist of the user to illuminate the artery or vein, wherein the images are infrared images.

16. The method of claim 11 , wherein generating the images of the artery or vein of the user comprises:

emitting, by an illuminator of the sensor device, visible light towards the wrist of the user to illuminate the artery or vein, wherein the images are generated based upon the artery or vein being illuminated by the visible light.

17. The method of claim 11 , wherein generating the images of the artery or vein of the user comprises generating the images through use of an array of devices, wherein the array of devices comprises both illuminators and photodetectors.

18. A smartwatch comprising:

a sensor device that generates multi-dimensional images of an artery or vein of a user while the smartwatch is worn on a wrist of the user;

a processor that is in communication with the sensor device, where the processor obtains data that is indicative of blood pressure of the user based upon the multi-dimensional images of the artery or vein generated by the sensor device, where the processor determines a direction of the artery or vein of the user in the images, and further where the processor generates an alert based upon the determined direction of the artery or vein of the user in the images, the alert that indicates that the user has hypertension or is at risk of hypertension; and

a display that is in communication with the processor, where the processor causes the alert to be presented on the display to inform the user that the user has hypertension or is at risk of hypertension.

19. The smartwatch of claim 18 , wherein the data that is indicative of the blood pressure of the patient is one of arterial pulse wave velocity or pulse transit time of the patient.

20. The smartwatch of claim 18 , wherein the processor is further configured to compute a value for at least one of the following based upon the multi-dimensional images of the artery or vein generated by the sensor device:

pulse transit time;

arterial stiffness;

arterial blood oxygenation; or

tissue blood oxygenation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2023
From: HOLZ, CHRISTIAN; OFEK, EYAL; SINCLAIR, MICHAEL J.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 063752/0250 →
Continuity (3)
Continuation 17104824 · Nov 25, 2020
Continuation 15871733 · Jan 15, 2018
Related Publication 20230263403A1 · Aug 24, 2023
References Cited (123)
US 6349227B1 · Numada · 2002 [cited by applicant]
US 7530949B2 · Al Ali et al. · 2009 [cited by applicant]
US 7972266B2 · Gobeyn et al. · 2011 [cited by applicant]
US 8909311B2 · Ho et al. · 2014 [cited by applicant]
US 9060683B2 · Tran · 2015 [cited by applicant]
US 9414780B2 · Rhoads · 2016 [cited by applicant]
US 9770197B2 · Bresch et al. · 2017 [cited by applicant]
US 9826940B1 · Lengerich · 2017 [cited by applicant]
US 9968282B2 · Makkapati et al. · 2018 [cited by applicant]
US 10052035B2 · Martin et al. · 2018 [cited by applicant]
US 10209794B2 · Wang et al. · 2019 [cited by applicant]
US 10568527B2 · Yoon · 2020 [cited by examiner]
US 10682180B2 · Taylor · 2020 [cited by applicant]
US 10874305B2 · Holz et al. · 2020 [cited by applicant]
US 20050010119A1 · Palti et al. · 2005 [cited by applicant]
US 20080292151A1 · Kurtz et al. · 2008 [cited by applicant]
US 20090203998A1 · Klinghult et al. · 2009 [cited by applicant]
US 20090306524A1 · Muhlsteff et al. · 2009 [cited by applicant]
US 20100204588A1 · Kim et al. · 2010 [cited by applicant]
US 20100246651A1 · Baheti et al. · 2010 [cited by applicant]
US 20110066381A1 · Garudadri et al. · 2011 [cited by applicant]
US 20110124978A1 · Williams · 2011 [cited by applicant]
US 20120215114A1 · Gratton et al. · 2012 [cited by applicant]
US 20130120106A1 · Cauwels et al. · 2013 [cited by applicant]
US 20130197322A1 · Tran · 2013 [cited by applicant]
US 20140012142A1 · Mestha et al. · 2014 [cited by applicant]
US 20140148663A1 · Bresch et al. · 2014 [cited by applicant]
US 20140168167A1 · Chou · 2014 [cited by applicant]
US 20140221849A1 · Farringdon et al. · 2014 [cited by applicant]
US 20140336478A1 · Segman · 2014 [cited by applicant]
US 20150018660A1 · Thomson et al. · 2015 [cited by applicant]
US 20150018676A1 · Barak · 2015 [cited by applicant]
US 20150119725A1 · Martin et al. · 2015 [cited by applicant]
US 20150216484A1 · Kasahara et al. · 2015 [cited by applicant]
US 20150297119A1 · Makkapati et al. · 2015 [cited by applicant]
US 20150335293A1 · Christman et al. · 2015 [cited by applicant]
US 20160015282A1 · Kim · 2016 [cited by examiner]
US 20160034042A1 · Joo · 2016 [cited by applicant]
US 20160098834A1 · Eguchi · 2016 [cited by examiner]
US 20160360974A1 · Lange · 2016 [cited by applicant]
US 20170035359A1 · Qiu et al. · 2017 [cited by applicant]
US 20170065184A1 · Barak · 2017 [cited by examiner]
US 20170079591A1 · Gruhlke et al. · 2017 [cited by applicant]
US 20170143249A1 · Davis et al. · 2017 [cited by applicant]
US 20170156651A1 · Arias · 2017 [cited by examiner]
US 20170340209A1 · Klaassen · 2017 [cited by examiner]
US 20180042496A1 · Lachhman et al. · 2018 [cited by applicant]
US 20180055369A1 · Burns et al. · 2018 [cited by applicant]
US 20180055428A1 · Toya · 2018 [cited by examiner]
US 20180110450A1 · Lamego et al. · 2018 [cited by applicant]
US 20180146926A1 · Ishikawa · 2018 [cited by examiner]
US 20180146931A1 · Abe · 2018 [cited by examiner]
US 20180216340A1 · Debuff · 2018 [cited by applicant]
US 20180333088A1 · Holz · 2018 [cited by examiner]
US 20180344262A1 · Oka · 2018 [cited by examiner]
US 20180372714A1 · Chen et al. · 2018 [cited by applicant]
US 20190008392A1 · Wang et al. · 2019 [cited by applicant]
US 20190069842A1 · Rothberg · 2019 [cited by examiner]
US 20190216340A1 · Holz · 2019 [cited by examiner]
US 20200129077A1 · Rogers et al. · 2020 [cited by applicant]
US 20200305798A1 · Ishikawa et al. · 2020 [cited by applicant]
US 20210100459A1 · Holz et al. · 2021 [cited by applicant]
AU 2014200060B2 · 2014 [cited by applicant]
CN 105476643A · 2016 [cited by applicant]
F. Conti, D. Palossi, R. Andri, M. Magno and L. Benini, “Accelerated Visual Context Classification on a Low-Power Smartwatch,” in IEEE Transactions on Human-Machine Systems, vol. 47, No. 1, pp. 19-30, Feb. 2017, doi: 10… [cited by examiner]
H. Liu, Y. Wang and L. Wang, “A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging,” 2012 Annual International Conference of the IEEE Engineering in Medicine and… [cited by examiner]
Tamura, T., Maeda, Y., Sekine, M., & Yoshida, M. (2014). Wearable photoplethysmographic sensors—past and present. Electronics, 3(2), 282-302. (Year: 2014). [cited by examiner]
P. Zurek, O. Krejcar, M. Penhaker, M. Cerny and R. Frischer, “Continuous Noninvasive Blood Pressure Measurement by Near Infra Red CCD Camera and Pulse Transmit Time Systems,” 2010 Second International Conference on Comp… [cited by examiner]
O'Toole, et al., “Absorbance Based Light Emitting Diode Optical Sensors and Sensing Devices”, In Sensors, vol. 8, 2008, pp. 2453-2479. [cited by applicant]
Lee, et al., “Development of a Wristwatch-Type PPG Array Sensor Module”, In 2011 IEEE International Conference on Consumer Electronics, May 5, 2022, pp. 168-171. [cited by applicant]
Castaneda, et al., “A Review on Wearable Photoplethysmography Sensors and Their Potential Future Applications in Health Care”, In International Journal of Biosensors and Bioelectronics, vol. 4, No. 4, 2018, pp. 195-202. [cited by applicant]
Tamura, et al., “Wearable Photoplethysmography Sensors—Past and Present”, In Electronics, vol. 3, 2014, pp. 282-302. [cited by applicant]
“Adaptive blood pressure estimation from wearable PPG sensors using peripheral artery pulse wave velocity measurements and multi-channel blind identification of local arterial dynamics”, In Proceedings of 28th Annual In… [cited by applicant]
“Simband: A digital health device”, Retrieved From << https://www.simband.io/>>, Retrieved On: Nov. 10, 2017, 1 Page. [cited by applicant]
“Pulse Oximetry Capturing Technique”, Application as Filed in U.S. Appl. No. 15/597,514, filed May 17, 2017, 26 Pages. [cited by applicant]
Chandrasekaran, et al., “Cuffless differential blood pressure estimation using smart phones”, In Journal of IEEE Transactions on Biomedical Engineering, vol. 60, No. 4, Apr. 2013, pp. 1080-1089. [cited by applicant]
Constant, et al., “Pulse-Glasses: An unobtrusive, wearable HR monitor with Internet-of-Things functionality”, In Proceedings of IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN), … [cited by applicant]
Holz, et al., “Glabella: Continuously Sensing Blood Pressure Behavior using an Unobtrusive Wearable Device”, In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, Issue 3, Sep. 1, 2… [cited by applicant]
Liu, et al., “Toward a Smartphone Application for Estimation of Pulse Transit Time”, In Journal of Sensors, vol. 15, Oct. 27, 2015, pp. 27303-27321. [cited by applicant]
“Head-Mounted Device For Capturing Pulse Data”, Application as Filed in U.S. Appl. No. 15/624,602, filed Jun. 15, 2017, 24 Pages. [cited by applicant]
Payne, et al., “Pulse transit time measured from the ECG: an unreliable marker of beat-to-beat blood pressure”, In Journal of Applied Physiology, vol. 100, Issue 1, Jan. 2006, pp. 136-141. [cited by applicant]
Ramakrishna, et al., “Toward ubiquitous blood pressure monitoring via pulse transit time: theory and practice”, In Journal of IEEE Transactions on Biomedical Engineering, vol. 62, Issue 8, Aug. 2015, pp. 1879-1901. [cited by applicant]
Gesche, et al., “Continuous blood pressure measurement by using the pulse transit time: comparison to a cuff-based method”, In Journal of European Journal of Applied Physiology, vol. 112, No. 1, Jan. 1, 2012, 7 Pages. [cited by applicant]
Deakin, et al., “Accuracy of the advanced trauma life support guidelines for predicting systolic blood pressure using carotid, femoral, and radial pulses: observational study”, In Proceedings of BMJ, vol. 321, Sep. 16, … [cited by applicant]
Thomas, et al., “BioWatch: A wrist watch based signal acquisition system for physiological signals including blood pressure”, In Proceedings of 36th Annual International Conference of the IEEE Engineering in Medicine an… [cited by applicant]
Vappou, et al., “Pulse wave ultrasound manometry (PWUM): Measuring central blood pressure non-invasively”, In Proceedings of IEEE International Ultrasonics Symposium, Oct. 18, 2011, pp. 2122-2125. [cited by applicant]
Winokur, et al., “A Wearable Vital Signs Monitor at the Ear for Continuous Heart Rate and Pulse Transit Time Measurements”, In Proceedings of IEEE Annual International Conference of the Engineering in Medicine and Biolo… [cited by applicant]
Withings, et al., “Body Cardio Scale”, Retrieved From <<https://www.withings.com/US/en/products/body-cardio>>, Retrieved On: Nov. 10, 2017, 8 Pages. [cited by applicant]
Worthing, Tyler Richard, “Using Ultrasound to Measure Arterial Diameter for the Development of a Wearable Blood Pressure Monitoring Device”, In Master's thesis of University of British Columbia, Oct. 2016, 114 Pages. [cited by applicant]
“Cardiio uses iPhone camera sensor to get your heart rate on the go”, Retrieved From: https://gigaom.com/2012/08/09/Cardiio-uses-iphone-camera-sensor-to-get-your-heart-rate-on-the-go/, Aug. 9, 2012, 9 Pages. [cited by applicant]
“Pulse Oximeter—Heart Rate and Oxygen Monitor App”, Retrieved From: https:/itunes.apple.com/us/app/pulse-oximeter-heart-rate-and-oxygen-monitor-app/id775632066?mt=8, Mar. 3, 2017, 4 Pages. [cited by applicant]
“Non Final Office Action Issued in U.S. Appl. No. 15/597,514”, Mailed Date: Mar. 18, 2019, 14 Pages. [cited by applicant]
Freitas, Ubiratan S., “Remote Camera-based Pulse Oximetry”, In Proceedings of the Sixth International Conference on eHealth, Telemedicine, and Social Medicine, Mar. 1, 2014, pp. 59-63. [cited by applicant]
Gastel, et al., “New principle for measuring arterial blood oxygenation, enabling motion-robust remote monitoring”, In Journal of Scientific Reports, vol. 6, Dec. 7, 2016, pp. 1-16. [cited by applicant]
Gregoski, et al., “Development and Validation of a Smartphone Heart Rate Acquisition Application for Health Promotion and Wellness Telehealth Applications”, In International Journal of Telemedicine and Applications, Jan… [cited by applicant]
Guazzi, et al., “Non-contact measurement of oxygen saturation with an RGB camera”, In Journal of Biomedical Optic Express, vol. 6, No. 9, Aug. 11, 2015, pp. 3320-3338. [cited by applicant]
Ovadia, Blechman, et al., “The Feasibility of Flat, Portable and Wireless Device for Non-Invasive Peripheral Oxygenation Measurement over the Entire Body”, In Journal of Biomedical Science and Engineering, vol. 9, Mar. … [cited by applicant]
Vashist, et al., “Commercial Smartphone-Based Devices and Smart Applications for Personalized Healthcare Monitoring and Management”, In Journal of Diagostics, vol. 4, Issue 3, Sep. 1, 2014, 22 Pages. [cited by applicant]
Wang, et al., “HemaApp: Noninvasive Blood Screening of Hemoglobin using Smartphone Cameras”, In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, Sep. 12, 2016, pp. 593-604. [cited by applicant]
“Final Office Action Issued in U.S. Appl. No. 15/597,514”, Mailed Date: Jul. 18, 2019, 14 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US2019/012586”, Mailed Date: Jul. 18, 2019, 22 Pages. [cited by applicant]
“Restriction Requirement for U.S. Appl. No. 15/871,733”, Mailed Date: Sep. 6, 2019, 6 Pages. [cited by applicant]
“Reply to Restriction Requirement for U.S. Appl. No. 15/871,733”, Filed Date: Nov. 6, 2019, 2 Pages. [cited by applicant]
Majumder, et al. “Wearable Sensors for Remote Health Monitoring”, In Sensors 2017, vol. 17, No. 130, 2017, pp. 1-45. [cited by applicant]
Fu, et al., “System design for wearable blood oxygen saturation and pulse measurement device”, In Procedia Manufacturing, 2015, pp. 1187-1194. [cited by applicant]
Meyer, Francois G., “Signal Data Mining from Wearable Systems”, Nov. 2010, pp. 123-146. [cited by applicant]
“Non-Final Office Action for U.S. Appl. No. 15/871,733”, Mailed Date: Jan. 17, 2020, 14 Pages. [cited by applicant]
“Non Final Office Action Issued in U.S. Appl. No. 15/597,514”, Mailed Date: Feb. 19, 2020, 15 Pages. [cited by applicant]
“Reply to Non-Final Office Action for U.S. Appl. No. 15/871,733”, Filed Date: Apr. 16, 2020, 18 Pages. [cited by applicant]
“Final Office Action Issued in U.S. Appl. No. 15/597,514”, Mailed Date: Jun. 12, 2020, 17 Pages. [cited by applicant]
“Notice of Allowance and Fees Due for U.S. Appl. No. 15/871,733”, Mailed Date: Aug. 19, 2020, 9 Pages. [cited by applicant]
“Non Final Office Action Issued in U.S. Appl. No. 15/597,514”, Mailed Date: Nov. 10, 2020, 15 Pages. [cited by applicant]
“Amendment After Notice of Allowance and Fees Due for U.S. Appl. No. 15/871,733”, Filed Date: Nov. 17, 2020, 7 Pages. [cited by applicant]
“Notice of Allowability for U.S. Appl. No. 15/871,733”, Mailed Date: Dec. 7, 2020, 7 Pages. [cited by applicant]
“Office Action Issued in Indian Patent Application No. 202017029453”, Mailed Date: Apr. 26, 2022, 6 Pages. [cited by applicant]
“First Office Action Issued in Chinese Patent Application No. 201980008198.9”, Mailed Date: Nov. 3, 2022, 10 Pages. [cited by applicant]
“Office Action for U.S. Appl. No. 17/104,824”, Mailed Date: May 11, 2022, 16 pages. [cited by applicant]
“Response to the Office Action for U.S. Appl. No. 17/104,824”, Filed Date: Nov. 10, 2022, 11 pages. [cited by applicant]
“Notice of Allowance and Fees Due for U.S. Appl. No. 17/104,824”, Mailed Date: Feb. 1, 2023, 10 pages. [cited by applicant]
“Office Action Issued in Chinese Patent Application No. 201980008198.9”, Mailed Date: Aug. 9, 2023, 26 Pages. [cited by applicant]
“Second Office Action Issued in Chinese Patent Application No. 201980008198.9”, Mailed Date: Jun. 1, 2023, 29 Pages. [cited by applicant]
Notice of Allowance Received for Mexican Application No. MX/a/2020/007458, mailed on Aug. 29, 2024, 5 pages. [cited by applicant]
Office Action Received for Mexican Application No. MX/a/2020/007458, mailed on May 16, 2024, 5 pages (English Translation Provided). [cited by applicant]