IP Library › Granted Patent US 12,190,246
Granted Patent B2
US 12,190,246 · App. 16/952,523 · Granted Jan 7, 2025

Apparatus and method for distinguishing neural waveforms

Inventors: Do Sik Hwang (Seoul, KR); Jun Sik Eom (Seoul, KR); Han Byol Jang (Seoul, KR); Se Won Kim (Seoul, KR); In Yong Park (Seoul, KR)
Assignee: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
G06N3/084G06F18/213G06F18/23G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,246
App. No.
16/952,523
Granted
Jan 7, 2025
Kind
B2
Abstract

A neural waveform distinguishment apparatus includes: a neural waveform obtainment unit that obtains multiple neural waveforms in a pre-designated manner from neural signals sensed by way of at least one electrode; a preprocessing unit that obtains multiple gradient waveforms by calculating pointwise slopes in each of the neural waveforms; a feature extraction unit comprising an encoder ensemble composed of multiple encoders, which have a pattern estimation method learned beforehand and include different numbers of hidden layers, where the feature extraction unit obtains multiple codes as multiple features extracted by the encoders respectively from the gradient waveforms and concatenates the codes extracted by the encoders respectively to extract a feature ensemble for each of the gradient waveforms; and a clustering unit that distinguishes the neural waveforms corresponding respectively to the gradient waveforms by clustering the feature ensembles extracted respectively in correspondence to the gradient waveforms according to a pre-designated clustering technique.

Claims (35)

1. An electronic device for representing neural waveforms by providing a multi-dimensional grouping of clustered feature ensembles comprising:

a processor including a central processing unit capable of executing a computer program,

a display, and

a memory connected to the processor,

wherein the memory stores program instructions for providing a multi-dimensional grouping of clustered feature ensembles that, when executed, cause the processor to

obtain a plurality of neural waveforms from neural signals sensed by at least one electrode;

calculate pointwise slopes in each of the plurality of neural waveforms to obtain a plurality of gradient waveforms;

extract a plurality of features from the plurality of gradient waveforms using an encoder ensemble including a plurality of encoders executing a pre-learned pattern estimation method, each of the plurality of encoders using a different number of hidden layers to extract the plurality of features from the same plurality of gradient waveforms;

extract a plurality of codes for each of the plurality of gradient waveforms by concatenating the plurality of extracted features, respectively;

extract a plurality of feature ensembles for each of the plurality of gradient waveforms by concatenating the plurality of extracted codes, respectively; and

cluster the plurality of feature ensembles to distinguish the plurality of neural waveforms corresponding each of the plurality of gradient waveforms,

wherein the encoder ensemble includes a plurality of decoders that correspond respectively to the plurality of encoders, each of the decoders configured to receive a code extracted from the gradient waveforms by a corresponding encoder and to recover the gradient waveforms inputted to the corresponding encoder according to a learned pattern recovery method,

wherein learning by the plurality of encoders is performed as an error, calculated from differences between the gradient waveforms and recovered waveforms recovered by the decoders, that is back-propagated by way of the decoders, and

wherein the clustered feature ensembles distinguishing the plurality of neural waveforms are displayed on the display,

wherein the different number of hidden layers is set for each of the plurality of encoders so that each of the plurality of encoders outputs different features for the same plurality of gradient waveforms,

wherein the same plurality of gradient waveforms is input to each of the plurality of encoders.

2. The electronic device of claim 1 , wherein the learning by each of the plurality of encoders is performed in the same manner using the same gradient waveforms.

3. The electronic device of claim 1 , wherein the plurality of feature ensembles are clustered into at least one clustered feature ensemble according to a density-based spatial clustering of applications applying a noise (DBSCAN) technique.

4. The electronic device of claim 1 ,

wherein the neural signals are obtained by sampling raw-level neural signals in analog form sensed by the at least one electrode and converting the raw-level neural signals into digital neural signals, extracting the digital neural signals with intensities at or above a pre-designated threshold intensity, and aligning the digital neural signals with intensities at or above a pre-designated threshold intensity in a pre-designated manner.

5. A method for distinguishing neural waveforms, the method comprising:

providing a processor including a central processing unit capable of executing a computer program, a display, and a memory connected to the processor, wherein the memory stores program instructions for providing a multi-dimensional grouping of clustered feature ensembles, including instructions for

obtaining a plurality of neural waveforms in a pre-designated manner from neural signals sensed by way of at least one electrode;

obtaining a plurality of gradient waveforms by calculating pointwise slopes in each of the plurality of neural waveforms;

obtaining a plurality of codes using an encoder ensemble, the encoder ensemble composed of a plurality of encoders having a previously learned pattern estimation method and each having different numbers of hidden layers, the plurality of codes obtained as a plurality of features extracted by the plurality of encoders from the same plurality of gradient waveforms;

extracting a feature ensemble for each of the plurality of gradient waveforms by concatenating the plurality of codes extracted by the plurality of encoders, respectively;

distinguishing the plurality of neural waveforms corresponding respectively to the plurality of gradient waveforms by clustering a plurality of feature ensembles extracted respectively in correspondence to the plurality of gradient waveforms according to a pre-designated clustering technique; and

displaying the clustered plurality of feature ensembles that distinguish the plurality of neural waveforms on a display,

wherein the encoder ensemble includes a plurality of decoders that correspond respectively to the plurality of encoders, each of the decoders configured to receive a code extracted from the gradient waveforms by a corresponding encoder and to recover the gradient waveforms inputted to the corresponding encoder according to a learned pattern recovery method, and

wherein learning by the plurality of encoders is performed as an error, calculated from differences between the gradient waveforms and recovered waveforms recovered by the decoders, that is back-propagated by way of the decoders,

wherein the different number of hidden layers is set for each of the plurality of encoders so that each of the plurality of encoders outputs different features for the same plurality of gradient waveforms,

wherein the same plurality of gradient waveforms is input of each of the plurality of encoders.

6. The method of claim 5 , wherein the distinguishing the plurality of neural waveforms comprises clustering the plurality of feature ensembles into at least one cluster according to a density-based spatial clustering of applications with a noise (DBSCAN) technique.

7. The method of claim 5 , wherein the obtaining of the plurality of neural waveforms comprises sampling raw-level neural signals of an analog form sensed by way of the at least one electrode and converting the raw-level neural signals into a digital form; and

obtaining the plurality of neural waveforms by extracting neural signals having intensities of a pre-designated threshold intensity or greater from among the neural signals and aligning the extracted neural signals in a pre-designated manner.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2020
From: HWANG, DO SIK; EOM, JUN SIK; JANG, HAN BYOL; KIM, SE WON; PARK, IN YONG
To: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
Reel/Frame 054418/0667 →
Priority Claims (1)
KR 10-2019-0150209 · Nov 21, 2019 · national
Continuity (1)
Related Publication 20210158154A1 · May 27, 2021
References Cited (16)
US 5047930A · Martens · 1991 [cited by examiner]
US 11589829B2 · Khosousi · 2023 [cited by examiner]
US 20120245481A1 · Blanco · 2012 [cited by examiner]
US 20210117705A1 · Liu · 2021 [cited by examiner]
KR 1020150085007A · 2015 [cited by applicant]
Leung, Howan, et al. “Wavelet-denoising of electroencephalogram and the absolute slope method: a new tool to improve electroencephalographic localization and lateralization.” clinical neurophysiology 120.7 (2009): 1273-… [cited by examiner]
Yin, Zhong, Mengyuan Zhao, Yongxiong Wang, Jingdong Yang, and Jianhua Zhang. “Recognition of emotions using multimodal physiological signals and an ensemble deep learning model.” Computer methods and programs in biomedi… [cited by examiner]
Jordan, Jeremy. “Introduction to autoencoders.” (2018): 1-17. (Year: 2018). [cited by examiner]
Oyelade, Jelili, et al. “Data clustering: Algorithms and its applications.” 2019 19th International Conference on Computational Science and Its Applications (ICCSA). IEEE, 2019. (Year: 2019). [cited by examiner]
Mehmood, Raja Majid, Ruoyu Du, and Hyo Jong Lee. “Optimal feature selection and deep learning ensembles method for emotion recognition from human brain EEG sensors.” Ieee Access 5 (2017): 14797-14806. (Year: 2017). [cited by examiner]
Yang, Shuo, et al. “Assessing cognitive mental workload via EEG signals and an ensemble deep learning classifier based on denoising autoencoders.” Computers in biology and medicine 109 (2019): 159-170. (Year: 2019). [cited by examiner]
R. Quian Quiroga, and Z. Nadasdy, and Y. Ben-Shaul, “Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering.” Neural Computation, 16 (8). pp. 1661-1687. (2004). [cited by applicant]
H. F. Jelinek, et al. “Classification of pathology in diabetic eye disease.” (2005). [cited by applicant]
Junkai Yi, et al “A novel text clustering approach using deep-learning vocabulary network.” Mathematical Problems in Engineering (2017). [cited by applicant]
Ghulam Muhammad, et al “Automatic seizure detection in a mobile multimedia framework.” IEEE Access vol. 6, pp. 45372-45383(2018). [cited by applicant]
Daniel Valencia, Amir Alimohammad “An efficient hardware architecture for template matching-based spike sorting.” IEEE transactions on biomedical circuits and systems, vol. 13(3), pp. 481-492(Mar. 2019). [cited by applicant]