IP Library Granted Patent US 12,499,973
Granted Patent B2
US 12,499,973 · App. 17/890,843 · Granted Dec 16, 2025

Sequence-based anomaly detection with hierarchical spiking neural networks

Inventors: Stephen Joseph Verzi (Albuquerque, NM); Craig Michael Vineyard (Cedar Crest, NM); James Bradley Aimone (Keller, TX)
Assignee: National Technology & Engineering Solutions of Sandia, LLC
G16B30/00G06N3/049G06N3/08G16B40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,499,973
App. No.
17/890,843
Granted
Dec 16, 2025
Kind
B2
Abstract

Anomaly detection for streaming data is provided. A spiking neural network receives inputs of streaming data, wherein each input is contained within a number of neighborhoods and converts the inputs into phase-coded spikes. A median value of each input is calculated for each size neighborhood containing the input, and an absolute difference of each input from its median value is calculated for each size neighborhood. From the absolute differences, a median absolute difference (MAD) value of each input is calculated for each size neighborhood. It is determined whether the MAD value for any size neighborhood exceeds a respective threshold. If the MAD value exceeds its threshold, an anomaly indication is output for the input. If none of the MAD values for the neighborhoods exceeds its threshold, a normal indication is output for the input.

Claims (58)

1 . A computer-implemented method of anomaly detection for streaming data, the method comprising:

using a number of processors to implement a spiking neural network that performs the steps of:

receiving inputs of streaming data, wherein each input is contained within a number of neighborhoods, wherein the neighborhoods comprise a number of increasingly larger symmetrical numbers of inputs preceding and following the input;

converting the inputs into phase-coded spikes;

calculating, from the phase-coded spikes, a median value of each input for each size neighborhood containing the input;

calculating an absolute difference of each input from its median value for each size neighborhood containing the input;

calculating, from the absolute differences, a median absolute difference (MAD) value of each input for each size neighborhood containing the input;

determining for each input whether the MAD value for any size neighborhood containing the input exceeds a respective threshold, wherein;

responsive to a determination that the MAD value of one or more neighborhoods exceeds its threshold, outputting an anomaly indication for the input; and

responsive to a determination that none of the MAD values for the neighborhoods exceeds its threshold, outputting a normal indication for the input.

2 . The method of claim 1 , further comprising normalizing the MAD values.

3 . The method of claim 1 , further comprising routing the determination of whether the MAD value for any size neighborhood exceeds a respective threshold back as input for computing the median value of each input for each neighborhood.

4 . The method of claim 1 , wherein phase-coding represents a neuron spiking delay for a specified length of time to allow processing the inputs in ascending order.

5 . The method of claim 1 , wherein the streaming data comprises one of:

sequential data; or

time-series data.

6 . The method of claim 1 , wherein the inputs comprise a DNA sequence.

7 . The method of claim 6 , wherein detection of an anomaly indicates a DNA edit.

8 . The method of claim 1 , wherein the spiking neural network comprises leaky integrate-and-fire neurons.

9 . A system for anomaly detection for streaming data, the system comprising:

a storage device configured to store program instructions; and

one or more processors operably connected to the storage device and configured to execute the program instructions to implement a spiking neural network that causes the system to:

receive inputs of streaming data, wherein each input is contained within a number of neighborhoods, wherein the neighborhoods comprise a number of increasingly larger symmetrical numbers of inputs preceding and following the input;

convert the inputs into phase-coded spikes;

calculate, from the phase-coded spikes, a median value of each input for each size neighborhood containing the input;

calculate an absolute difference of each input from its median value for each size neighborhood containing the input;

calculate, from the absolute differences, a median absolute difference (MAD) value of each input for each size neighborhood containing the input;

determine for each input whether the MAD value for any size neighborhood containing the input exceeds a respective threshold, wherein;

responsive to a determination that the MAD value of one or more neighborhoods exceeds its threshold, output an anomaly indication for the input; and

responsive to a determination that none of the MAD values for the neighborhoods exceeds its threshold, output a normal indication for the input.

10 . The system of claim 9 , wherein the spiking neural network normalizes the MAD values.

11 . The system of claim 9 , wherein the spiking neural network further routes the determination of whether the MAD value for any size neighborhood exceeds a respective threshold back as input for computing the median value of each input for each neighborhood.

12 . The system of claim 9 , wherein phase-coding represents a neuron spiking delay for a specified length of time to allow processing the inputs in ascending order.

13 . The system of claim 9 , wherein the streaming data comprises one of:

sequential data; or

time-series data.

14 . The system of claim 9 , wherein the inputs comprise a DNA sequence.

15 . The system of claim 14 , wherein detection of an anomaly indicates a DNA edit.

16 . The system of claim 9 , wherein the spiking neural network comprises leaky integrate-and-fire neurons.

17 . A computer program product for anomaly detection for streaming data, the computer program product comprising:

a computer-readable storage medium having program instructions embodied thereon to implement a spiking neural network that performs the steps of:

receiving inputs of streaming data, wherein each input is contained within a number of neighborhoods, wherein the neighborhoods comprise a number of increasingly larger symmetrical numbers of inputs preceding and following the input;

converting the inputs into phase-coded spikes;

calculating, from the phase-coded spikes, a median value of each input for each size neighborhood containing the input;

calculating an absolute difference of each input from its median value for each size neighborhood containing the input;

calculating, from the absolute differences, a median absolute difference (MAD) value of each input for each size neighborhood containing the input;

determining for each input whether the MAD value for any size neighborhood containing the input exceeds a respective threshold, wherein;

responsive to a determination that the MAD value of one or more neighborhoods exceeds its threshold, outputting an anomaly indication for the input; and

responsive to a determination that none of the MAD values for the neighborhoods exceeds its threshold, outputting a normal indication for the input.

18 . The computer program product of claim 17 , further comprising instructions for normalizing the MAD values.

19 . The computer program product of claim 17 , further comprising instructions for routing the determination of whether the MAD value for any size neighborhood exceeds a respective threshold back as input for computing the median value of each input for each neighborhood.

20 . The computer program product of claim 17 , wherein phase-coding represents a neuron spiking delay for a specified length of time to allow processing the inputs in ascending order.

21 . The computer program product of claim 17 , wherein the streaming data comprises one of:

sequential data; or

time-series data.

22 . The computer program product of claim 17 , wherein the inputs comprise a DNA sequence.

23 . The computer program product of claim 22 , wherein detection of an anomaly indicates a DNA edit.

24 . The computer program product of claim 17 , wherein the spiking neural network comprises leaky integrate-and-fire neurons.

Assignments (3)
CONFIRMATORY LICENSE Recorded Jan 22, 2026
From: NATIONAL TECHNOLOGY & ENGINEERING SOLUTIONS OF SANDIA, LLC
To: NNSA
Reel/Frame 073543/0301 →
CONFIRMATORY LICENSE Recorded Sep 20, 2022
From: NATIONAL TECHNOLOGY & ENGINEERING SOLUTIONS OF SANDIA, LLC
To: U.S. DEPARTMENT OF ENERGY
Reel/Frame 061146/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2022
From: VERZI, STEPHEN JOSEPH; VINEYARD, CRAIG MICHAEL; AIMONE, JAMES BRADLEY
To: NATIONAL TECHNOLOGY & ENGINEERING SOLUTIONS OF SANDIA, LLC
Reel/Frame 061028/0038 →
Continuity (2)
Continuation In Part 16436744 · Jun 10, 2019
Related Publication 20220406408A1 · Dec 22, 2022
References Cited (26)
US 10268836B2 · Ukil · 2019 [cited by examiner]
US 11169514B2 · Song et al. · 2021 [cited by applicant]
CN 105205114A · 2015 [cited by applicant]
WO 2017199233A1 · 2017 [cited by applicant]
WO 2019125419A1 · 2019 [cited by applicant]
Horiuchi et al. “Fast Median Filter with Various Kernel Sizes”, SPIE, Mar. 2019, pp. 6. [cited by examiner]
Houdrouge “Scalable Nearest Neighbour Algorithms for High Dimensional Data”, Ecole Polytechnique—INF 513—M1 Project, 2018, pp. 15. [cited by examiner]
Izakian et al. “Anomaly Detection in Time Series Data using a Fuzzy C-Means Clustering”, IEEE, 2013, pp. 2513-2518. [cited by examiner]
Van Overbeek et al., DNA Repair Profiling Reveals Nonrandom Outcomes at Cas9-Mediated Breaks, Molecular Cell, vol. 63, No. 4, Aug. 18, 2016, pp. 633-646/ https://www.cell.com/action/showPdf?pii=S1097-2765%2816%2930325-2. [cited by applicant]
Allen et al., “Predicting the mutations generated by repair of Cas9-induced double-strand breaks,” Nature Biotechnology, vol. 37, Nov. 27, 2018, pp. 64-72. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6949135/. [cited by applicant]
Chuai et al., “DeepCRISPR: optimized CRISPR guide RNA design by deep learning,” Genome Biology, vol. 19, No. 80, Jun. 26, 2018, 18 pages. https://genomebiology.biomedcentral.com/track/pdf/10.1186/s13059-018-1459-4.pdf. [cited by applicant]
Chakrabarti et al., “Target-Specific Precision of CRISPR-Mediated Genome Editing,” Molecular Cell, vol. 73, No. 4, Feb. 21, 2019, pp. 699-713. https://www.cell.com/action/showPdf?pii=S1097-2765%2818%2931001-3. [cited by applicant]
Chen et al., “Massively parallel profiling and predictive modeling of the outcomes of CRISPR/Cas9-mediated double-strand break repair,” Nucleic Acids Research, vol. 47, No. 15, Jun. 5, 2019, pp. 7989-8003. 7989-8003. [cited by applicant]
Arbab et al., “Determinants of Base Editing Outcomes from Target Library Analysis and Machine Learning,” Cell, vol. 182, No. 2, Jul. 23, 2020, pp. 463-480. https://www.cell.com/action/showPdf?pii=S0092-8674%2820%2930632… [cited by applicant]
Kamiya et al., “A rapid method for detection of mutations induced by CRISPR/Cas9-based genome editing in common wheat,” Plant Biotechnology (Tokyo), vol. 37, No. 2, Jun. 25, 2020, pp. 247-251. https://www.ncbi.nlm.nih.g… [cited by applicant]
Liang et al., “Genome-wide detection of CRISPR editing in vivo using GUIDE-tag,” Nature Communications, vol. 13, No. 437, Jan. 21, 2022, 14 pages. https://www.nature.com/articles/s41467-022-28135-9.pdf. [cited by applicant]
Maciag et al., “Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural Networks,” Neural Networks, vol. 139, Jul. 2021, pp. 118-139. https://www.sciencedirect.com/science/article/pii/S08936080… [cited by applicant]
Demertzis et al., “Gryphon: a semi-supervised anomaly detection system based on one-class evolving spiking neural network,” Neural Computing & Applications, vol. 32, Issue 9, Jul. 27, 2019, pp. 4303-4314. https://doi.or… [cited by applicant]
Ahmad et al., “Unsupervised real-time anomaly detection for streaming data,” Neurocomputing, vol. 262, Nov. 1, 2017, pp. 134-147. https://www.sciencedirect.com/science/article/pii/S0925231217309864?via%3Dihub. [cited by applicant]
Chen and Qiu, “Real-time Anomaly Detection for Streaming Data using Burst Code on a Neurosynaptic Processor,” Design, Automation & Test in Europe Conference & Exhibition, 2017, pp. 205-207. http://hydrogen.syr.edu/˜qqiu… [cited by applicant]
Bäßler et al., “Unsupervised anomaly detection in multivariate time series with online evolving spiking neural networks,” Machine Learning, vol. 111, Mar. 10, 2022, pp. 1377-1408. https://link.springer.com/content/pdf/1… [cited by applicant]
Stratton et al., “A Spiking Neural Network Based Auto-encoder for Anomaly Detection in Streaming Data,” 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Dec. 1-4, 2020, Canberra, Australia, pp. 1981-1988. [cited by applicant]
Yusob et al., “Anomaly Detection in Time Series Data Using Spiking Neural Network,” Advanced Science Letters, vol. 24, No. 10, Oct. 10, 2018, pp. 7572-7576. https://doi.org/10.1166/asl.2018.12980. [cited by applicant]
Verzi et al, “Neural-Inspired Anomaly Detection,” Springer Proceedings in Complexity. Springer, Champp., 2018, DOI: 10.1007/978-3-319-96661-8_21, pp. 202-209. [cited by applicant]
Chen and Wu, “Adaptive Impulse Detection Using Center-Weighted Medial Filters,” IEEE Signal Processing Letter, vol. 4, No. 1, 2001, 3 pages. [cited by applicant]
Demertzis and Iliadis, “A Hybrid Network Anomaly and Intrusion Detection Approach Based on Evolving Spiking Neural Network Classification,” 5th Conference on e-Democracy, Athens, Greece, Communications in Computer and I… [cited by applicant]