IP Library Granted Patent US 12,542,213
Granted Patent B2
US 12,542,213 · App. 17/432,912 · Granted Feb 3, 2026

Determining a relative cognitive capability of a subject

Inventors: Irina Fedulova (Moscow, RU); Vladimir Groza (Moscow, RU)
Assignee: KONINKLIJKE PHILIPS N.V.
G16H50/20G06F18/256G06V20/597G06V40/174G16H40/63G16H50/30G06V10/80G06V40/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,542,213
App. No.
17/432,912
Granted
Feb 3, 2026
Kind
B2
Abstract

A method and system for determining an indicator for a subject that is responsive to changes in a relative cognitive capability of that subject. At least two separate machine-learning algorithms are used to generate a respective number of intermediate indicators based on one or more outputs of one or more sensors monitoring the subject. The intermediate indicators are subsequently processed to thereby generate an indicator of a relative cognitive capability of the subject.

Claims (46)

1 . A method of generating an output indicator of a relative cognitive capability of a monitored subject carrying out an intellectual task of reading a medical image through a computing system, the method comprising:

sensing with at least one sensorobtaining at least one physiological signal of a subject, wherein the at least sensor includes at least one of a pulse oximeter, a blood pressure cuff, electroencephalogram and an electrocardiogram, the at least one physiological signal includes a numerical measure of a pulse rate, a blood pressure, a brain activity and a heart rate in response to the intellectual task, and the at least one sensor generates at least one output indicative of the at least one sensed physiological signal;

processing the at least one output using a first machine-learning algorithm, to thereby generate a first intermediate indicator of either a factor able to impair a subject's relative cognitive capability or a characteristic affected by impairments to a subject's relative cognitive capability based on the numerical measure of the at least one physiological signal, wherein the first intermediate indicator includes a first numerical measure of at least one of a distraction level, an attention level, an emotional level and a fatigue level of the subject;

processing the at least one output using a second, different machine-learning algorithm, to thereby generate a second, different intermediate indicator of either a factor able to impair a subject's relative cognitive capability or a characteristic affected by impairments to a-the subject's relative cognitive capability based on the numerical measure of the at least one physiological signal, wherein the second intermediate indicator includes a second numerical measure of the at least one of the distraction level, the attention level, the emotional level and the fatigue level of the subject; and

processing the first and second intermediate indicators to thereby generate an output indicator of the subject's relative cognitive capability;

detecting information entered into an input interface of the computing system during an event of the intellectual task may be inaccurate based on the at least one output of the at least one sensor;

preventing the computing device from saving the entered information; and

preventing the input interface of the computing device from receiving further user input.

2 . The method of claim 1 , wherein the step of processing the first and second intermediate indicators comprises processing the first and second intermediate indicators, using a third, different machine-learning algorithm, to generate an output indicator of a level of the subject's relative cognitive capability.

3 . The method of claim 1 , wherein the at least one sensor comprises at least two sensors, and the at least one output comprises at least one output from each sensor.

4 . The method of claim 1 , wherein the processing includes determining a weighted sum of the first and second intermediate indicators and passing the weighted sum through a sigmoid function.

5 . The method of claim 1 , wherein the first and second machine-learning algorithms are trained independently from one another.

6 . The method of claim 1 , wherein at least one of the first and second machine-learning algorithms includes one or more layers, each layer including a plurality of neurons, each neuron configured to perform an operation on input data to produce a numerical output, wherein an output of each of the one or more layers is an input of a subsequent layer, and a final layer provides at least one of the first and second intermediate indicators.

7 . The method of claim 1 , further comprising:

processing the output indicator to determine whether the relative cognitive capability of the subject is below a predetermined threshold; and

in response to determining that the relative cognitive capability of the subject is below the predetermined threshold, generating an alert.

8 . The method of claim 7 , wherein the step of generating an alert comprises generating a user perceptible output via a user interface.

9 . TheA method of claim 1 , further comprising:

changing a flag of the input user interface of the computing system in response to the detecting.

10 . The method of claim 1 , further comprising:

changing a state of the input user interface of the computing system in response to the detecting.

11 . The method of claim 1 , wherein the monitored subject is a clinician, and the intellectual task includes diagnosing subjects, wherein the first intermediate indicator or the second intermediate indicator is a measure in response to an intellectual task related to assessing the medical images.

12 . A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

sense with at least one sensor at least one physiological signal of a subject, wherein the at least one sensor includes at least one of a pulse oximeter, a blood pressure cuff, electroencephalogram and an electrocardiogram, the at least one physiological signal includes a numerical measure of a pulse rate, a blood pressure, a brain activity and a heart rate in response to the intellectual task, and the at least one sensor generates at least one output indicative of the at least one sensed physiological signal;

process, with an application specific integrated circuit (ASIC), the at least one output and generate a first intermediate indicator of either a factor able to impair a subject's relative cognitive capability or a characteristic affected by impairments to a subject's relative cognitive capability based on the numerical measure of the at least one physiological signal, wherein the first intermediate indicator includes a first numerical measure of at least one of a distraction level, an attention level, an emotional level and a fatigue level of the subject;

process, with the ASIC, the at least one output using a second, different machine-learning algorithm, and generate a second, different intermediate indicator of either a factor able to impair a subject's relative cognitive capability or a characteristic affected by impairments to the subject's relative cognitive capability based on the numerical measure of the at least one physiological signal, wherein the second intermediate indicator includes a second numerical measure of the at least one of the distraction level, the attention level, the emotional level and the fatigue level of the subject; and

process, with the ASIC, the first and second intermediate indicators and generate an output indicator of the subject's relative cognitive capability based on a combination of the first and second intermediate indicators;

detect, with one or more processors, information entered into an input interface of the computing system during an event of the intellectual task may be inaccurate based on the at least one output of the at least one sensor, prevent the computing device from saving the entered information, and prevent the input interface of the computing device from receiving further user input.

13 . The non-transitory computer readable medium of claim 12 , wherein at least one of the first and second intermediate indicators indicate a change to a predetermined baseline level.

14 . The non-transitory computer readable medium of claim 12 , wherein at least one of the first and second intermediate indicators indicate a difference from a predetermined normal level.

15 . A system for determining a relative cognitive capability of a monitored subject carrying out an intellectual task of reading a medical image, the system comprising:

at least one sensor configured to sense at least one physiological signal of a subject, wherein the at least one sensor includes at least one of a pulse oximeter, a blood pressure cuff, electroencephalogram and an electrocardiogram, the at least one physiological signal includes a numerical measure of a pulse rate, a blood pressure, a brain activity and a heart rate in response to the intellectual task, and the at least one sensor generates at least one output indicative of the at least one sensed physiological signal;

a neural network including at least one machine-learning algorithm, each of the at least one machine-learning algorithms including one or more layers, each of the one or more layers including a plurality of neurons, each of the plurality of neurons configured to perform an operation on input data to produce a numerical output, wherein an output of each of the one or more layers is an input of a subsequent layer, and a final layer provides at least one of a first intermediate indicator and a second intermediate indicator,

wherein a first machine-learning algorithm is configured to process the at least one output and generate the first intermediate indicator of either a factor able to impair a subject's relative cognitive capability or a characteristic affected by impairments to a subject's relative cognitive capability based on the numerical measure of the at least one physiological signal, wherein the first intermediate indicator includes a first numerical measure of at least one of a distraction level, an attention level, an emotional level and a fatigue level of the subject;

wherein the second machine-learning algorithm is configured to process the at least one output using a second, different machine-learning algorithm, and generate the second intermediate indicator of either a factor able to impair a subject's relative cognitive capability or a characteristic affected by impairments to the subject's relative cognitive capability based on the numerical measure of the at least one physiological signal, wherein the second intermediate indicator includes a second numerical measure of the at least one of the distraction level, the attention level, the emotional level and the fatigue level of the subject, and

one or more processors configured to generate an output indicator of the subject's relative cognitive capability based on a combination of the first and second intermediate indicators.

16 . The system of claim 15 , further comprising:

an input user interface adapted to receive a user input representing an outcome of an intellectual task performed by the subject; and

at least one of the one or more processors adapted to flag the user input provided by the subject based on the output indicator.

17 . The system of claim 15 , further comprising:

an input user interface adapted to receive a user input representing an outcome of an intellectual task performed by a-the subject; and

at least one of the one or more processor configured to determine whether a relative cognitive capability of the subject is below a predetermined threshold,; and, in response to determining that the relative cognitive capability of the subject is below the predetermined threshold, prevent the subject from providing a user input.

18 . The system of claim 15 , wherein at least one of the one or more processors is further configured to change a flag on an input user interface in response to determining the subject's cognitive capability is impaired.

19 . The system of claim 15 , wherein at least one of the one or more processors is further configured to change a state of an input user interface of the computing system to prevent entry of a user input corresponding to the reading of the medical image in response to determining the subject's cognitive capability is impaired.

20 . The method of claim 15 , further comprising:

an application specific integrated circuit (ASIC) including the neural network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2021
From: FEDULOVA, IRINA; GROZA, VLADIMIR
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 057247/0674 →
Priority Claims (1)
RU RU2019105162 · Feb 25, 2019 · national
Continuity (1)
Related Publication 20220189181A1 · Jun 16, 2022
References Cited (41)
US 10538259B2 · Molne · 2020 [cited by examiner]
US 10765380B2 · Everman · 2020 [cited by examiner]
US 10783801B1 · Beaubien · 2020 [cited by examiner]
US 10877444B1 · Roach · 2020 [cited by examiner]
US 11093904B2 · Humble · 2021 [cited by examiner]
US 11122998B2 · Martucci · 2021 [cited by examiner]
US 11141088B2 · Liu · 2021 [cited by examiner]
US 11249544B2 · Sicconi · 2022 [cited by examiner]
US 11298062B2 · Ellison · 2022 [cited by examiner]
US 11715564B2 · Mellem · 2023 [cited by examiner]
US 20150223743A1 · Pathangay · 2015 [cited by examiner]
US 20160090097A1 · Grube et al. · 2016 [cited by applicant]
US 20160262680A1 · Martucci · 2016 [cited by examiner]
US 20160267405A1 · Reiner · 2016 [cited by examiner]
US 20180102047A1 · Wilson · 2018 [cited by applicant]
US 20180199877A1 · Kukawka · 2018 [cited by examiner]
US 20180220948A1 · Kojima · 2018 [cited by applicant]
US 20190019068A1 · Zhu et al. · 2019 [cited by applicant]
US 20190045020A1 · Ein-Gil · 2019 [cited by applicant]
US 20190216392A1 · Bower · 2019 [cited by examiner]
US 20200008725A1 · Bach · 2020 [cited by examiner]
US 20200342979A1 · Sadowsky · 2020 [cited by examiner]
US 20210106290A1 · Groleau · 2021 [cited by examiner]
US 20220095975A1 · Aluf · 2022 [cited by examiner]
US 20220230522A1 · Myers · 2022 [cited by examiner]
US 20230280828A1 · Fung · 2023 [cited by examiner]
JP 2003373620A · 2005 [cited by applicant]
JP 2010128649A · 2010 [cited by applicant]
WO 2015193806A1 · 2016 [cited by applicant]
WO 2017191227A1 · 2017 [cited by applicant]
WO 2018168121A1 · 2018 [cited by applicant]
Healey, J. A. et al. “Detecting stress during real-world driving tasks using physiological sensors” IEEE Transactions on Intelligent Transportation Systems, 6(2), pp. 156-166 (2005). (Year: 2005). [cited by examiner]
Benezeth et al: “Remote Heart Rate Variability for Emotional State Monitoring”; IEEE International Conference on Biomedical and Health Informatics, 2018, Las Vegas, NV, 5 Page Document. [cited by applicant]
De Naurois et al: “Detection and Prediction of Driver Drowsiness Using Artificial Neural Network Models”; Accident Analysis and Prevention, Elsevier Ltd, 2017, 10 Page Document. [cited by applicant]
PCT/EP2020/054722 ISR & Written Opinion, May 14, 2020, 14 Page Document. [cited by applicant]
Joshi et al: “A Brief Review of Facial Expressions Recognition System”; Asian Journal of Convergence in Technology, vol. 1V, Issue I, 2015, 4 Page Document. [cited by applicant]
Ko: “A Brief Review of Facial Emotion Recognition Based on Visual Information”; Sensors, 2018, 20 Page Document. [cited by applicant]
Krupinski: “Fatigue in Radiology: What is Its Impact and What Can Be Done?” Radiology Business Journal, Feb. 2017, 9 Page Article. [cited by applicant]
Philips: Licensing:Vital Signs Camera, 4 Page Document, 2018. [cited by applicant]
Salman et al: “Artificial Intelligence in Bio-Medical Domain: An Overview of AI Based Innovations in Medical”; International Journal of Advanced Computer Science and Applications, vol. 8, No. 8, 2017, pp. 319-327. [cited by applicant]
Solaz et al: “Drowsiness Detection Based on the Analysis of Breathing Rate Obtained From Real-Time Image Recognition”; Transportation Research Procedia 14 (2016), pp. 3867-3876. [cited by applicant]