IP Library Granted Patent US 12,201,443
Granted Patent B2
US 12,201,443 · App. 17/549,293 · Granted Jan 21, 2025

Determining a sleep state of a user

Inventors: Dimitrios Mavroeidis (Utrecht, NL); Ulf Grossekathoefer (Eindhoven, NL); Aki Sakari Härmä (Eindhoven, NL)
Assignee: KONINKLIJKE PHILIPS N.V.
A61B5/4812A61B5/38A61B5/4809A61B5/7221A61B5/7267
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,201,443
App. No.
17/549,293
Granted
Jan 21, 2025
Kind
B2
Abstract

According to an embodiment of an aspect, there is provided a computer-implemented method for determining a sleep state of a user. The method comprising receiving (S 11 ) a physiological signal from a physiological signal detector used by the user. The method further comprising determining (S 12 ), based on the received physiological signal, the sleep state of the user. The method further comprising calculating (S 13 ) a reliability value associated with the determination. The reliability value being calculated based on a comparison of the received physiological signal with historic physiological signals of the same sleep state as the determined sleep state. There is further provided a device ( 20 ) and computer-readable medium ( 30 ). In accordance with the present disclosure, the sleep state of a user may be determined with greater accuracy when compared with past methods.

Claims (24)

1. A computer-implemented method for determining a sleep state of a user in a system that includes one or more physiological sensors comprising one or more of a polysomnogram (PSG) sensor, an electroencephalogram (EEG) sensor, or an electrocardiogram (ECG) sensor, one or more peripheral devices comprising one or more of an inertia sensor, a temperature sensor, a strain sensor or a skin conductance sensor, and a processor configured to implement a deep neural network having a plurality of layers comprising convolutional layers or recurrent layers, an output layer, and a detection model developed for detection of conditions or sources of signal detection in signals generated by the one or more physiological sensors that employs a time-varying vector-valued sensor uncertainty function, the method comprising:

receiving one or more physiological signals from the one or more physiological sensors used by the user;

determining the sleep state of the user based on the received one or more physiological signals and without data from the one or more peripheral sensors using the deep neural network, wherein the output layer generates the determined sleep state using a softmax function;

calculating a reliability value indicative of a reliability of the determination of the sleep state using the deep neural network based on the received one or more physiological signals and without an output from the one or more peripheral sensors, the reliability value being calculated based on a comparison of the received one or more physiological signals with one or more historic physiological signals each associated with a historic user and a historic sleep state previously determined for the historic user that is the same as the determined sleep state, wherein the output layer generates the reliability value using the softmax function and a Bayesian deep leaning method;

responsive to determining that the reliability value is lower than a first threshold value, preventing output of the sleep state determination;

responsive to determining that the reliability value is greater than a second threshold value that is greater than the first threshold value, outputting the sleep state determination; and

responsive to determining that the first reliability value is greater than or equal to the first threshold value and less than the second threshold value, requesting and receiving data from the one or more peripheral devices, determining an updated sleep state of the user and an updated reliability value for the updated sleep state using the detection model and the time-varying vector-valued sensor uncertainty function of the deep neural network based on the received one or more physiological signals and the received data from the one or more peripheral devices, and outputting the updated sleep state determination only if the updated reliability value is greater than the second threshold value.

2. The method according to claim 1 , further comprising storing determination results for the sleep state determination or the updated sleep state determination and training the neural network using the stored determination results.

3. The method according to claim 1 , further comprising causing auditory stimulation of the user based on the sleep state determination.

4. A system for determining a sleep state of a user, comprising:

one or more physiological sensors comprising one or more of a polysomnogram (PSG) sensor, an electroencephalogram (EEG) sensor, or an electrocardiogram (ECG) sensor;

one or more peripheral devices comprising one or more of an inertia sensor, a temperature sensor, a strain sensor or a skin conductance sensor; and

a processor configured to implement a deep neural network having a plurality of layers comprising convolutional layers or recurrent layers, an output layer, and a detection model developed for detection of conditions or sources of signal detection in signals generated by the one or more physiological sensors that employs a time-varying vector-valued sensor uncertainty function, the processor being further configured to:

receive one or more physiological signals from the one or more physiological sensors used by the user;

determine the sleep state of the user based on the received one or more physiological signals and without data from the one or more peripheral sensors using the deep neural network, wherein the output layer generates the determined sleep state using a softmax function;

calculate a reliability value indicative of a reliability of the determination of the sleep state using the deep neural network based on the received one or more physiological signals and without an output from the one or more peripheral sensors, the reliability value being calculated based on a comparison of the received one or more physiological signals with one or more historic physiological signals each associated with a historic user and a historic sleep state previously determined for the historic user that is the same as the determined sleep state, wherein the output layer generates the reliability value using the softmax function and a Bayesian deep leaning method;

determine whether the reliability value is lower than a first threshold value;

responsive to determining that the reliability value is lower than the first threshold value, prevent output of the sleep state determination;

determine whether the reliability value is greater than a second threshold value that is greater than the first threshold value;

responsive to determining that the reliability value is greater than a second threshold value, output the sleep state determination; and

determine whether the first reliability value is greater than or equal to the first threshold value and less than the second threshold value;

responsive to determining that the first reliability value is greater than or equal to the first threshold value and less than the second threshold value, request and receive data from the one or more peripheral devices, determine an updated sleep state of the user and an updated reliability value for the updated sleep state using the detection model and the time-varying vector-valued sensor uncertainty function of the deep neural network based on the received one or more physiological signals and the received data from the one or more peripheral devices, and output the updated sleep state determination only if the updated reliability value is greater than the second threshold value.

5. The system according to claim 4 , wherein the processor is adapted to store determination results for the sleep state determination or the updated sleep state determination and train the neural network using the stored determination results.

6. A non-transitory computer-readable medium storing a program which, when executed on a computer, is configured to cause the computer to perform a method according to claim 1 in a system according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2022
From: MAVROEIDIS, DIMITRIOS; HARMA, AKI SAKARI; GROSSEKATHOEFER, ULF
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 059658/0761 →
Priority Claims (1)
EP 20213750 · Dec 14, 2020 · regional
Continuity (1)
Related Publication 20220183620A1 · Jun 16, 2022
References Cited (21)
US 20060070451A1 · Walsh · 2006 [cited by examiner]
US 20080033304A1 · Dalal · 2008 [cited by examiner]
US 20100076333A9 · Burton · 2010 [cited by examiner]
US 20140276242A1 · Chen · 2014 [cited by examiner]
US 20150190086A1 · Chan · 2015 [cited by examiner]
US 20160058298A1 · Koch · 2016 [cited by examiner]
US 20170259428A1 · Assad · 2017 [cited by examiner]
US 20170278195A1 · Washio · 2017 [cited by applicant]
US 20190110755A1 · Capodilupo · 2019 [cited by examiner]
US 20190282152A1 · Ouwerkerk · 2019 [cited by examiner]
US 20200205704A1 · Bhavaraju · 2020 [cited by applicant]
WO 2002100267A1 · 2002 [cited by applicant]
WO 2015006364A2 · 2015 [cited by applicant]
WO WO2022074626A1 · 2022 [cited by examiner]
H.-V. V Ngo, A. Miedema, I. Faude, T. Martinetz, M. Molle, and J. Bom, “Driving Sleep Slow Oscillations by Auditory Closed-Loop Stimulation-A Self-Limiting Process,” J. Neurosci., vol. 35, No. 17, pp. 6630-6638, 2015. [cited by applicant]
M. Bellesi, B. Riedner, G. Garcia-Molina, C. Cirelli, and G. Tononi, “Enhancement of sleep slow waves: underlying mechanisms and practical consequences,” Front. Syst. Neurosci., vol. 8, No. October, pp. 1-17, Oct. 2014. [cited by applicant]
N. A. Papalambros, G. Santostasi, R. G. Malkani, R. Braun, S. Weintraub, K. A. Paller, and P. C. Zee, “Acoustic enhancement of sleep slow oscillations and concomitant memory improvement in older adults,” Front. Hum. Neu… [cited by applicant]
M. M. Leminen, J. Virkkala, E. Saure, T. Paajanen, P. C. Zee, and G. Santostasi, “Enhanced Memory Consolidation via Automatic Sound Stimulation During Non-REM Sleep,” Sleep, vol. 40, No. 3, pp. 1-10, 2017. [cited by applicant]
B. Riedner, B. K. Hulse, F. Ferrarelli, S. Sarasso, and G. Tononi, “Enhancing sleep slow waves with natural stimuli,” Medicamundi, vol. 45, No. 2, pp. 82-88, 2010. [cited by applicant]
H. H. Jasper, “The ten-twenty electrode system of the international federation,” Electroencephalogr. Clin. Neurophysiol., vol. 10, No. 1, pp. 371-375, 1958. [cited by applicant]
Liang, S. et al., “Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks”, https://arxiv.org/abs/1706.02690, Aug. 2020. [cited by applicant]