IP Library Granted Patent US 12,708,292
Granted Patent B1
US 12,708,292 · App. 18/067,554 · Granted Aug 18, 2026

State assessment system and methods of use

Inventors: Olivia Fox Cotton (Centerville, OH); Lisa Lucia (West Roxbury, MA); Jordan Coker (Auburn, AL)
Assignee: Aptima, Inc.
A61B5/14546A61B5/1455A61B2503/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,708,292
App. No.
18/067,554
Granted
Aug 18, 2026
Kind
B1
Abstract

A state assessment system is provided to determine a state of a subject with an analytics subsystem based on data from a physiological sensor. In some embodiments, the physiological sensor is a fNIRS sensor and the analytics subsystem is configured to determine a hemoglobin measure from the physiological data, determine a neural activation measure from the hemoglobin measure and determine the state of the subject based on a physiology/state model and the neural activation measure. In some embodiments, the physiology/state model is trained by monitoring the subject with the fNIRS sensor and performing a Continuous Performance Test (CPT) to determine attention data and performing an n-back task to determine workload data. In some embodiment, the state of the subject is an objective measure of one of a vigilance measure, a response inhibition measure, a resilience measure and a workload measure.

Claims (63)

1 . A state assessment system configured to determine a state of a subject,

the state assessment system comprising:

a physiological sensor comprising an fNIRS sensor configured to communicate a physiological data of a subject;

an additional sensor configured to communicate a cardiac data of the subject;

an analytics subsystem configured to determine a state of the subject from the physiological data and the cardiac data;

the fNIRS sensor comprises:

one or more LED, and

one or more photodetector; and

the analytics subsystem comprises:

a hemoglobin estimation module configured to determine a hemoglobin measure from the physiological data of the subject,

a neurocognitive measure module configured to determine a neural activation measure from the hemoglobin measure,

a heart rate measure module configured to determine a heart rate measure from the cardiac data of the subject,

a physiology/state model configured to define a relationship between the neural activation measure and a cognitive state measure, and

a cognitive state measure module configured to determine the state of the subject based on the cognitive state measure and the heart rate measure.

2 . The state assessment system of claim 1 wherein the state of the subject comprises an objective measure of a workload measure.

3 . The state assessment system of claim 1 wherein the state of the subject comprises an objective measure of one of the group of objective measures consisting of:

a vigilance measure;

a response inhibition measure; and

a resilience measure.

4 . The state assessment system of claim 2 wherein an attention measure and the workload measure are used to define a preparedness measure.

5 . A method of training a physiology/state model for use to determine a state of a subject based on a physiological data of the subject, the method comprising:

defining a state of the subject as an attention measure and a workload measure;

defining the physiological data as a neural activation of the subject;

placing a sensor on the subject to measure the neural activation of the subject;

defining an objective relationship of the attention measure to the neural activation of the subject over a time period by performing a Continuous Performance Test (CPT) on the subject and measuring the neural activation of the subject over the time period; and

defining an objective relationship of the workload measure to the neural activation of the subject over a second time period by performing an n-back task on the subject and measuring the neural activation of the subject over the second time period.

6 . The method of claim 5 wherein the objective relationship of the attention measure to the neural activation of the subject over the time period and the objective relationship of the workload measure to the neural activation of the subject over a second time period are defined by a machine learning algorithm.

7 . The method of claim 5 wherein the attention measure comprises a vigilance measure and a response inhibition measure.

8 . The method of claim 5 wherein the n-back task comprises one or more NASA Task Load Index task.

9 . The method of claim 5 further comprising;

placing a second sensor on the subject to measure the a heartrate measure of the subject; and

the physiological data further comprises the heartrate measure of the subject.

10 . The method of claim 5 further comprising:

placing a second sensor on the subject to measure a respiration measure; and

the physiological data further comprises the respiration measure of the subject.

11 . The method of claim 5 further comprising:

placing a second sensor on the subject to measure a hydration measure the subject; and

wherein the physiological data further comprises the hydration measure of the subject.

12 . The method of claim 5 further comprising:

placing a second sensor on the subject to measure a blood oxygen saturation measure of the subject; and

wherein the physiological data further comprises the blood oxygen saturation measure of the subject.

13 . The method of claim 5 wherein the physiological data further comprises at least one selected from the group of measures consisting of:

a heartrate measure of the subject;

a hydration measure the subject;

a hydration measure the subject; and

a blood oxygen saturation measure of the subject.

14 . A state assessment system configured to determine a state of a subject, the state assessment system comprising:

a physiological sensor comprising an fNIRS sensor configured to communicate a physiological data of a subject;

an additional sensor configured to communicate a cardiac data of the subject;

an analytics subsystem configured to determine a state of the subject from the physiological data and the cardiac data;

the fNIRS sensor comprises:

one or more LED, and

one or more photodetector; and

the analytics subsystem comprises:

a hemoglobin estimation module configured to determine a hemoglobin measure from the physiological data of the subject,

a neurocognitive measure module configured to determine a neural activation measure from the hemoglobin measure,

a heart rate measure module configured to determine a heart rate measure from the cardiac data of the subject,

a physiology/state model configured to define a relationship between the neural activation measure and a cognitive state measure,

a cognitive state measure module configured to determine the state of the subject based on the cognitive state measure and the heart rate measure, and

the state of the subject comprises an objective measure of one of the group of objective measures consisting of:

a vigilance measure,

a response inhibition measure, and

a resilience measure.

Assignments (2)
CONFIRMATORY LICENSE Recorded Dec 23, 2024
From: APTIMA, INC.
To: UNITED STATES GOVERNMENT
Reel/Frame 069755/0205 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2023
From: FOX COTTON, OLIVIA; LUCIA, LISA; COKER, JORDAN
To: APTIMA, INC.
Reel/Frame 062256/0685 →
Continuity (1)
Provisional Application 63290573 · Dec 16, 2021
References Cited (37)
US 9848812B1 · Harrivel et al. · 2017 [cited by applicant]
US 20180042484A1 · Bracken · 2018 [cited by examiner]
Al-Shargie et al., Mental Stress Assessment Using Simultaneous Measurement of EEG and fNIRS. Biomedical Optics Express, Oct. 2016, vol. 7(10), pp. 3882-3898. [cited by applicant]
Al-Shargie, Stress Detection and Reduction Based on Simultaneous Measurement of EEG and fNIRS Signals. Frontiers in Human Neuroscience, Jan. 2019, vol. 13, 2 page Abstract. [cited by applicant]
Baker et al., Modified Beer-Lambert Law for Blood Flow. Biomedical Optics Express, Nov. 2014, vol. 5(11), pp. 4053-4075. [cited by applicant]
Brennan et al., Coordinating Cognition: The Costs and Benefits of Shared Gaze During Collaborative Search. Cognition, Mar. 2008, vol. 106(3), pp. 1465-1477. [cited by applicant]
Carter et al., Target predictability, Sustained Attention, and Response Inhibition. Brain and Cognition, Jun. 2013, vol. 82(1), pp. 35-42. [cited by applicant]
Causse et al., Influences of Age, Mental Workload, and Flight Experience on Cognitive Performance and Prefrontal Activity in Private Pilots: a fNIRS Study. Scientific Reports, May 2019, vol. 9(1), pp. 1-12. [cited by applicant]
Cummings et al., Task Versus Vehicle-Based Control Paradigms in Multiple Unmanned Vehicle Supervision by a Single Operator. IEEEE Transactions on Human-Machine Systems, Jun. 2014, vol. 44(3), pp. 353-361. [cited by applicant]
DeCostanza et al., Team Measurement: Unobtrusive Strategies for Intelligent Tutoring Systems. in Building Intelligent Tutoring Systems for Teams, vol. 19, Sep. 2018, pp. 101-130. [cited by applicant]
DeHais et al., Monitoring Pilot's Cognitive Fatigue with Engagement Features in Simulated and Actual Flight Conditions Using a Hybrid fNIRS-EEG Passive BCI. IEEE Conference on Systems, Man, and Cybernetics Society (SMC … [cited by applicant]
Dieleman et al., Short-term Mechanisms Influencing Volumetric Brain Dynamics. NeuroImage, 2017, vol. 16, pp. 507-513. [cited by applicant]
Durkee et al., System Decision Framework for Augmenting Human Performance Using Real-Time Workload Classifiers. 2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decis… [cited by applicant]
Durkee et al., Real-Time Workload Assessment as a Foundation for Human Performance Augmentation. in Foundations of Augmented Cognition. AC/HCII 2013, LNAI 8027, 2013, pp. 279-288. [cited by applicant]
Eskicioglu et al., Brain asymmetry in directing attention during dichotic listening test: An fNIRS study. Laterality: Asymmetries of Body, Brain and Cognition, Jul. 2019, vol. 24(4), pp. 377-392, DOI: 10.1080/1357650X.2… [cited by applicant]
Fischer et al, Linguistic Correlates of Team Performance: Toward a Tool for Monitoring Team Functioning During Space Missions. Aviation, Space, and Environmental Medicine, May 2007, vol. 73(5), Section II, pp. B86-B95. [cited by applicant]
Frederick-Recascino et al., Monitoring Automated Displays: Effects of and Solutions for Boredom. Computer Science, Oct. 2001, 20th Digital Avionics Systems Conference (20th DASC), vol. 1, Oct. 14-18, 2001, Daytona Beach… [cited by applicant]
Fusaroli et al., A Heart for Interaction: Shared Physiological Dynamics and Behavioral Coordination in a Collective, Creative Construction Task. Journal of Experimental Psychology: Human Perception and Performance, 2016… [cited by applicant]
Gabbard et al., Utilizing functional near-infrared spectroscopy for prediction of cognitive workload in noisy work environments. Neurophotonics, Oct.-Dec. 2017, vol. 4(4), 041406, 10 pages. [cited by applicant]
Geeseman et al., Functional Near-Infrared Spectroscopy (fNIRS) in an Aerospace Environment: Challenges and Considerations. Aerospace Medicine and Human Performance, Oct. 2020, vol. 91(10), pp. 833-835. [cited by applicant]
Gidlof et al., Using Eye Tracking to Trace a Cognitive Process: Gaze Behaviour During Decision Making in a Natural Environment. Journal of Eye Movement Research, 2013, vol. 6(1), pp. 1-14. [cited by applicant]
Hasson et al., Intersubject Synchronization of Cortical Activity During Natural Vision. Science, Mar. 2004, vol. 303 (5664), pp. 1634-1640. [cited by applicant]
Heilbronner et al., Caffeine Differentially Alters Cortical Hemodynamic Activity During Working Memory: A Near Infrared Spectroscopy Study. BMC Research Notes, 2015, vol. 8:520, 7 pages. DOI 10.1186/s13104-015-1491-3. [cited by applicant]
Khan et al., Drowsiness Detection During a Driving Task Using fNIRS. Chapter 13 in Neuroergonomics, 2019, pp. 79-85. [cited by applicant]
McKendrick et al., Mobile Neuroergonomics: Action, Interfaces, Cognitive Load, and Selective Attention. Chapter 18 In Neuroergonomics: The Brain at Work and in Everyday Life. 2019, pp. 111-116. [cited by applicant]
Nihashi et al., Monitoring of Fatigue in Radiologists During Prolonged Image Interpretation Using fNIRS. Japanese Journal of Radiology, 2019, vol. 37(6), pp. 437-448. [cited by applicant]
Pappada et al., Establishing an Instrumented Environment for Simulation-based Training of Healthcare Providers: An Initial Proof of Concept. International Journal of Academic Medicine, Jun. 2016, pp. 32-40. [cited by applicant]
Pappada et al., Developing Neurocognitive Workload Management Technologies for Multitasking, Power Point Presentation on US Navy Panel: Human Factors Challenges in UAS—Cognitive Workload, Situational Awareness, Decision… [cited by applicant]
Parasuraman et al., Putting the Brain to Work: Neuroergonomics Past, Present, and Future. Human Factors, Jun. 2008, vol. 50(3), pp. 468-474. [cited by applicant]
Richardson et al., Looking to Understand: The Coupling Between Speakers' and Listeners' Eye Movements and its Relationship to Discourse Comprehension. Cognitive Science, 2005, vol. 29, pp. 39-54. [cited by applicant]
Sestito et al., Investigating Neural Sensorimotor Mechanisms Underlying Flight Expertise in Pilots: Preliminary Data from an EEG Study. Frontiers in Human Neuroscience, Dec. 2018, vol. 12, Art. 489, 13 pages. [cited by applicant]
Stewart et al. Eye Movements in Strategic Choice. Journal of Behavioral Decision Making, 2016, vol. 29, pp. 137-156. [cited by applicant]
Strang et al., Physio-Behavioral Coupling in a Cooperative Team Task: Contributors and Relations. Journal of Experimental Psychology: Human Perception and Performance, Jun. 2013, vol. 40(1), pp. 145-158, 16 pages. [cited by applicant]
Tekleab et al., A Longitudinal Study of Team Conflict, Conflict Management, Cohesion, and Team Effectiveness. Group & Organization Management, Apr. 2009, vol. 34(2), pp. 170-205. [cited by applicant]
Thayer, On the Importance of Inhibition: Central and Peripheral Manifestations of Nonlinear Inhibitory Processes in Neural Systems. Dose-Response. Jan.-Mar. 2006, vol. 4, pp. 2-21. [cited by applicant]
United States Air Force Aircraft Accident Investigation Board Report, F-16CM, T/N 94-0043, 77th Fighter Squadron, 20th Fighter Wing, Shaw Air Force Base, South Carolina. Jun. 30, 2020, Report issued Oct. 18, 2020, 49 pa… [cited by applicant]
Williams et al., Resting Cardiac Vagal Tone Predicts Intra-Individual Reaction Time Variability during an Attention Task in a Sample of Young and Healthy Adults. Psychophysiology, Oct. 2016, vol. 53(12), pp. 1843-1851, … [cited by applicant]