IP Library Granted Patent US 12,663,863
Granted Patent B2
US 12,663,863 · App. 18/432,937 · Granted Jun 23, 2026

Systems and methods for determining the coupling response of a non-linear variant system

Inventors: Ekansh Gupta (Atlanta, GA); Raghupathy Sivakumar (Atlanta, GA); Cheng-Yeh Chen (Atlanta, GA)
Assignee: Georgia Tech Research Corporation
G06F3/015B25J13/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,663,863
App. No.
18/432,937
Filed
Feb 5, 2024
Granted
Jun 23, 2026
Kind
B2
Examiner
XIE, KWIN
Art Unit
2626
USPC
345/156
Abstract

An exemplary system and method are disclosed that can detect unobserved and unobservable signals in a subject, or system, using an auxiliary, secondary signal measured from the subject while the unobserved and unobservable signals are known to be present. In particular, the exemplary system and method can used to measure observed signals, e.g., in a nonlinear time-variant system (NLTV system) such as the brain, to measure the unobserved or unobservable signal of interest via response coupling that employs a test instrument configured to facilitate interactions between the primary and the auxiliary signal.

Claims (38)

1 . A system comprising:

a processor; and

a memory having instructions stored thereon, wherein execution of the instructions by the processor causes the processor to:

receive measurements of an observed signal that is a physiological response evoked by presentation of a stimulus;

determine, via response coupling that employs a test instrument configured to select a property of the observed signal to amplify an unobserved signal and facilitate interactions between the observed signal and the unobserved signal, a probability value of a presence or non-presence of the unobserved signal via a trained classifier, wherein: (i) the unobserved signal is associated with a non-linear time-variant system, (ii) the observed signal and the unobserved signal are concurrently measured and originate from different sources such that the unobserved signal is not a component of the stimulus, and (iii) the trained classifier was trained based on training data comprising a plurality of measured unobserved signals acquired when a corresponding observed signal is present;

in response to determining a probability value indicating the presence of the unobserved signal, determine one or more inferred properties of the unobserved signal based on one or more observed signal properties; and

control a computing system or perform a diagnostic operation based, at least in part, on the one or more inferred properties.

2 . The system of claim 1 , wherein the observed signal is acquired via a brain-computer interface (BCI).

3 . The system of claim 1 , wherein the instructions to determine the probability value of a presence or non-presence of an unobserved signal comprises:

instructions to generate (i) a first band signal having frequency range from a first frequency to a second frequency of the observed signal, (ii) a second band signal having frequency range from the second frequency to a third frequency of the observed signal, (iii) a third band signal having frequency range from the third frequency to a fourth frequency of the observed signal; and

instructions to provide the first band signal, the second band signal, the third band signal, and a source signal of the first band signal, the second band signal, the third band signal to the trained classifier.

4 . The system of claim 1 , wherein the instructions to determine the probability value of a presence or non-presence of an unobserved signal comprises:

instructions to generate a probability density distribution curve from a difference between a first window of signal frequency of the observed signal and a second window of signal frequency of the observed signal, wherein the first window and the second window have different frequencies, and

instructions to determine the probability value of the presence or non-presence of the unobserved signal via a Bayesian classifier.

5 . A method comprising:

receiving, by a processor, measurements of an observed signal that is a physiological response evoked by presentation of a stimulus;

determining, by the processor via response coupling, that employs a test instrument configured to select a property of the observed signal to amplify an unobserved signal and facilitate interactions between the observed signal and the unobserved signal, a probability value of a presence or non-presence of the unobserved signal via a trained classifier, wherein: (i) the unobserved signal is associated with a non-linear time-variant system, (ii) the observed signal and the unobserved signal are concurrently measured and originate from different sources such that the unobserved signal is not a component of the stimulus, and (iii) the trained classifier was trained based on training data comprising a plurality of measured unobserved signals acquired when a corresponding observed signal is present;

in response to determining, by the processor, a probability value indicating the presence of the unobserved signal, determining one or more inferred properties of the unobserved signal based on one or more observed signal properties; and

controlling, by the processor, a computing system or performing a diagnostic operation based, at least in part, on the one or more inferred properties.

6 . The method of claim 5 , wherein the measurements of the observed signal are acquired as a physiological response to a stimulus.

7 . The method of claim 5 , wherein the observed signal comprises an offset-onset SSVEP signal or a pattern reversal SSVEP.

8 . The method of claim 5 , wherein the observed signal is acquired via a brain-computer interface (BCI).

9 . The method of claim 5 , wherein the observed signal was acquired while a display is contemporaneously presenting an observable error in movement or action of a graphical element.

10 . The method of claim 5 , wherein the probability value of the presence of the unobserved signal, or a value derived therefrom, is employed as a human-in-the-loop input signal for an AI training system.

11 . The method of claim 10 , wherein the AI training system is configured to generate a trained AI system for control of a robot.

12 . The method of claim 10 , wherein the AI training system is configured to generate a trained AI system for control of a computing task.

13 . The method of claim 5 , wherein determining the probability value of a presence or non-presence of an unobserved signal comprises:

generating a probability density distribution curve from a difference between a first window of signal frequency of the observed signal and a second window of signal frequency of the observed signal, wherein the first window and the second window have different frequencies, and

determining the probability value of the presence or non-presence of the unobserved signal via a Bayesian classifier.

14 . The method of claim 13 , wherein the probability value of presence or non- presence of the unobserved signal is a composite score from two or more scores, including a score from the Bayesian classifier.

15 . A non-transitory computer-readable medium having instructions stored thereon, wherein execution of the instructions by a processor causes the processor to:

receive measurements of an observed signal that is a physiological response evoked by presentation of a stimulus;

determine, via response coupling that employs a test instrument configured to select a property of the observed signal to amplify an unobserved signal and facilitate interactions between the observed signal and the unobserved signal, a probability value of a presence or non-presence of the unobserved signal via a trained classifier, wherein: (i) the unobserved signal is associated with a non-linear time-variant system, (ii) the observed signal and the unobserved signal are concurrently measured and originate from different sources such that the unobserved signal is not a component of the stimulus, and (iii) the trained classifier was trained based on training data comprising a plurality of measured unobserved signals acquired when a corresponding observed signal is present;

in response to determining a probability value indicating the presence of the unobserved signal, determining one or more inferred properties of the unobserved signal based on one or more observed signal properties; and

control a computing system or perform a diagnostic operation based, at least in part, on the one or more inferred properties.

16 . The non-transitory computer-readable medium of claim 15 , wherein the observed signal is acquired via a brain-computer interface (BCI).

17 . The non-transitory computer-readable medium of claim 15 , wherein the observed signal has a simultaneous combined response in a subject with the unobserved signal.

18 . The non-transitory computer-readable medium of claim 15 , wherein the probability value of the presence of the unobserved signal, or a value derived therefrom, is employed as a human-in-the-loop control signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: GUPTA, EKANSH; SIVAKUMAR, RAGHUPATHY; CHEN, CHENG-YEH
To: GEORGIA TECH RESEARCH CORPORATION
Reel/Frame 071398/0234 →
Continuity (2)
Provisional Application 63483143 · Feb 3, 2023
Related Publication 20240264670A1 · Aug 8, 2024
References Cited (65)
US 11402907B2 · Baba · 2022 [cited by examiner]
US 20190107888A1 · Sereshkeh · 2019 [cited by examiner]
US 20220051586A1 · Stankevich · 2022 [cited by examiner]
US 20220155867A1 · Connor · 2022 [cited by examiner]
US 20230010664A1 · Zhang · 2023 [cited by examiner]
US 20230032492A1 · Kouider · 2023 [cited by examiner]
US 20240366157A1 · Moses · 2024 [cited by examiner]
CA 3134153A1 · 2020 [cited by examiner]
CA 3214642A1 · 2022 [cited by examiner]
WO WO2020086959A1 · 2020 [cited by examiner]
WO WO2022251472A1 · 2022 [cited by examiner]
Wolpaw, et al., “An EEG-based Brain-computer Interface for Cursor Control”, Electroencephalography and Clinical Neurophysiology, vol. 78, Issuse 3, pp. 252-259, Mar. 1991. [cited by applicant]
Xu , et al., “A Hybrid BCI Speller Paradigm Combining P300 Potential and the SSVEP Blocking Feature”, Journal of Neural Engineering, vol. 10, 14 pages, 2013. [cited by applicant]
Xu , et al., “Accelerating Reinforcement Learning Using Eeg-based Implicit Human Feedback”, Neurocomputing, vol. 460, 14 pages, Oct. 14, 2021. [cited by applicant]
Zobaer , et al., “K-Complexes, Spindles, and ERPs as Impulse Responses: Unification via Neural Field Theory”, Biological Cybernetics, vol. 111, pp. 149-164, 2017. [cited by applicant]
“Brain Computer Interface Market Size, Share & Trends Analysis Report By Product (Invasive, Non-invasive), By Application (Healthcare, Communication & Control), By End Use, By Region, And Segment Forecasts, 2024-2030”, … [cited by applicant]
“Brain Computer Interface Market Size, Share, and Trends 2024 to 2033”, Https://www.precedenceresearch.com/brain-computer-interface-market, 20 pages, 2021. [cited by applicant]
“Brain Computer Interface Market Size, Share, Competitive Landscape and Trend Analysis Report, by Component, Type and Application : Global Opportunity Analysis and Industry Forecast, 2021-2030”, https://www.alliedmarket… [cited by applicant]
Arvaneh, et al., “Spatially Sparsed Common Spatial Pattern to Improve Bci Performance”, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing—Proceedings, pp. 2412-2415, 2011. [cited by applicant]
Barachant, et al., “Classification of Covariance Matrices using a Riemannian-based Kernel for BCI Applications”, Neurocomputing, vol. 112, 12 pages, May 5, 2013. [cited by applicant]
Chauveau, et al., “Effects of Skull Thickness, Anisotropy, and Inhomogeneity on Forward EEG/ERP Computations Using a Spherical Three-Dimensional Resistor Mesh Model”, Human Brain Mapping, vol. 21, pp. 86-97, 2004. [cited by applicant]
Coles, et al., “A Psychophysiological Investigation of the Continuous Flow Model of Human Information Processing”, Journal of Experimental Psychology: Human Perception and Performance, vol. 11, No. 5, pp. 529-553, Oct. … [cited by applicant]
Davila, et al., “Subspace Averaging of Steady-State Visual Evoked Potentials”, IEEE Transactions on Biomedical Engineering, vol. 47, Issue 6, pp. 720-728, 2000. [cited by applicant]
Dowsett, et al., “Mobile Steady-state Evoked Potential Recording: Dissociable Neural Effects of Real-world Navigation and Visual Stimulation”, Journal of Neuroscience Methods, vol. 332, 26 pages, 2020. [cited by applicant]
Duan, et al., “Quadcopter Flight Control Using a Non-invasive Multi-modal Brain Computer Interface”, Frontiers in Neurorobotics, vol. 13, Article 23, 11 pages, May 31, 2019. [cited by applicant]
Falkenstein, et al., “Effects of Crossmodal Divided Attention on Late Erp Components. Li. Error Processing in Choice Reaction Tasks”, Electroencephalography and Clinical Neurophysiology, vol. 78, Issue 6, pp. 447-455, J… [cited by applicant]
Falkenstein, et al., “Erp Components on Reaction Errors and Their Functional Significance: a Tutorial”, Biological Psychology, vol. 51, pp. 87-107, 2000. [cited by applicant]
Farwell, et al., “Talking Off the Top of Your Head: Toward a Mental Prosthesis Utilizing Event-related Brain Potentials”, Electroencephalography and Clinical Neurophysiology, vol. 70, pp. 510-523, 1988. [cited by applicant]
Fazli, et al., “Enhanced Performance by a Hybrid NIRS-EEG Brain Computer Interface”, NeuroImage, vol. 59, Issue 1, pp. 519-529, 2012. [cited by applicant]
Fidêncio, et al., “Error-related Potentials in Reinforcement Learning-based Brain-machine Interfaces”, Frontiers in Human Neuroscience, vol. 16, Article 806517, 21 pages, Jun. 2022. [cited by applicant]
Gandhi, et al., “Quantum Neural Network-Based EEG Filtering for a Brain-Computer Interface”, IEEE Transactions on Neural Networks and Learning Systems, vol. 25, No. 2, pp. 278-288, Feb. 2014. [cited by applicant]
Garrett, et al., “Moment-to-moment Brain Signal Variability: A Next Frontier in Human Brain Mapping?”, Neuroscience & Biobehavioral Reviews, vol. 37, No. 4, 29 pages, May 2013. [cited by applicant]
Gehring, et al., “A Neural System for error Detection and Compensation”, Psychological Science, vol. 4, No. 6, pp. 385-390, Nov. 1993. [cited by applicant]
Gerven, et al., “The Brain-computer Interface Cycle”, Journal of Neural Engineering, vol. 6, 11 pages, 2009. [cited by applicant]
Gibson, et al., “EEG Variability: Task-driven or Subject-driven Signal of Interest?”, NeuroImage, vol. 252, May 15, 17 pages, 2022. [cited by applicant]
Gomez, et al., “Correcting Robot Mistakes in Real Time using EEG Signals”, 2017 IEEE international conference on robotics and automation (ICRA), 9 pages, 2017. [cited by applicant]
Gupta, et al., “Blink to Get in: Biometric Authentication for Mobile Devices Using Eeg Signals”, ICC 2020—2020 IEEE International Conference on Communications (ICC), 6 pages, 2020. [cited by applicant]
Jiang, et al., “A Brain-computer Interface for Single-trial Detection of Gait Initiation from Movement Related Cortical Potentials”, Clinical Neurophysiology, vol. 126, 6 pages, 2015. [cited by applicant]
Kawala-Sterniuk, et al., “Summary of over Fifty Years with Brain-Computer Interfaces—A Review”, Brain Sciences, vol. 11, No. 43, 41 pages, 2021. [cited by applicant]
Klimesch, Wolfgang., “EEG Alpha and Theta Oscillations Reflect Cognitive and Memory Performance: A Review and Analysis”, Brain Research Reviews, vol. 29, pp. 169-195, 1999. [cited by applicant]
Lawhern, et al., “EEGNet: a Compact Convolutional Neural Network for EEG-based Brain-computer Interfaces”, Journal of Neural Engineering, vol. 15, pp. 1-17, 2018. [cited by applicant]
Lei, et al., “Common Spatial Pattern Ensemble Classifier and Its Application in Brain-computer Interface”, Journal of Electronic Science and Technology of China, vol. 7, No. 1, pp. 17-21, Mar. 2009. [cited by applicant]
Leistritz, et al., “Time-Variant Modeling of Brain Processes”, Proceedings of the IEEE, vol. 104, Issue 2, pp. 262-281, Feb. 2016. [cited by applicant]
Lopez-Gordo, et al., “Use of Phase in Brain-Computer Interfaces based on Steady-State Visual Evoked Potentials”, Neural Processing Letters, vol. 32, 9 pages, 2010. [cited by applicant]
Madore , et al., “Multicosts of Multitasking”, Cerebrum, the Dana Forum on Brain Science, 8 pages, Apr. 2019. [cited by applicant]
Margaux, et al., “Objective and Subjective Evaluation of Online Error Correction During P300-Based Spelling”, Advances in Human-Computer Interaction, vol. 2012, Article ID 578295, 13 pages, 2012. [cited by applicant]
Miltner, et al., “Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a “Generic” Neural System for Error Detection”, Journal of Cognitive Neuroscience, vol. 9, No. 6, pp.… [cited by applicant]
Moisala, et al., “Brain Activity During Divided and Selective Attention to Auditory and Visual Sentence Comprehension Tasks”, Frontiers in Human Neuroscience, vol. 1, Article 86, 15 pages, Feb. 19, 2015. [cited by applicant]
Mouli, et al., “Toward a Reliable PWM-based Light-emitting Diode Visual Stimulus for Improved SSVEP Response with Minimal Visual Fatigue”, The Journal of Engineering, vol. 2017, Issue. 2, pp. 7-12, 2017. [cited by applicant]
Nijboer, et al., “Single-task fMRI Overlap Predicts Concurrent Multitasking Interference”, NeuroImage, vol. 100, pp. 60-74, 2014. [cited by applicant]
Nijhol, Anton., “Bci for Games: a ‘state of the art’ Survey”, Lecture Notes in Computer Science, pp. 225-228, 2008. [cited by applicant]
Norcia, et al., “The Steady-state Visual Evoked Potential in Vision Research: A Review”, Journal of Vision, vol. 15, Issue 6, 46 pages, May 2015. [cited by applicant]
Notbohm, et al., “Modification of Brain Oscillations via Rhythmic Light Stimulation Provides Evidence for Entrainme. nt but not for Superposition of Event-Related Responses”, Frontiers in Human Neuroscience, vol. 10, Ar… [cited by applicant]
Pires, et al., “Error-Related Potentials: Challenges and Applications”, Frontiers in Human Neuroscience, vol. 16, 2 pages, Jul. 19, 2022. [cited by applicant]
Ramele, et al., “Eeg Waveform Analysis of P300 Erp With Applications to Brain Computer Interfaces”, Brain Sciences, vol. 8, No. 199, 24 pages, 2018. [cited by applicant]
Raza, et al., “Covariate Shift Estimation Based Adaptive Ensemble Learning for Handling Non-stationarity in Motor Imagery Related EEG-based Brain-computer Interface”, Neurocomputing, vol. 343, pp. 154-166, May 28, 2019. [cited by applicant]
Renard, et al., “OpenViBE: An Open-Source Software Platform to Design, Test and Use Brain-Computer Interfaces in Real and Virtual Environments”, Presence: teleoperators and virtual environments, vol. 19, No. 1, 44 pages… [cited by applicant]
Rennie, et al., “Unified Neurophysical Model of EEG Spectra and Evoked Potentials”, Biological Cybernetics, vol. 86, pp. 457-471, 2002. [cited by applicant]
Rivet, et al., “xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain-computer Interface”, IEEE Transactions on Biomedical Engineering, vol. 56, No. 8, 10 pages, 2009. [cited by applicant]
Saha, et al., “Progress in Brain Computer Interface: Challenges and Opportunities”, Frontiers in Systems Neuroscience, vol. 15, Article 578875, 20 pages, Feb. 2021. [cited by applicant]
Schirrmeister, et al., “Deep Learning with Convolutional Neural Networks for EEG Decoding and Visualization”, Human Brain Mapping, vol. 38, pp. 5391-5420, 2017. [cited by applicant]
Trueman, et al., “Choice Reaction Time and Learning”, Springer, pp. 534-537, 2012. [cited by applicant]
Tweel, et al., “Human Visual Responses to Sinusoidally Modulated Light”, Electroencephalography and Clinical Neurophysiology, vol. 18, Issue 6, pp. 587-598, May 1965. [cited by applicant]
Vourvopoulos, et al., “Effects of a Brain-Computer Interface With Virtual Reality (VR) Neurofeedback: A Pilot Study in Chronic Stroke Patients”, Frontiers in Human Neuroscience, vol. 13, Article 210, 17 pages, Jun. 19, … [cited by applicant]
Wang, et al., “Lead Selection for SSVEP-based brain-computer Interface”, n The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 2, pp. 4507-4510, Sep. 1-5, 2004. [cited by applicant]