IP Library Granted Patent US 12,488,265
Granted Patent B2
US 12,488,265 · App. 17/386,965 · Granted Dec 2, 2025

Optimizing a prognostic-surveillance system to achieve a user-selectable functional objective

Inventors: Menglin Liu (San Mateo, CA); Richard P. Sonderegger (Dorchester, MA); Kenneth P. Baclawski (Waltham, MA); Dieter Gawlick (Palo Alto, CA); Anna Chystiakova (Palo Alto, CA); Guang C. Wang (San Diego, CA); Zhen Hua Liu (San Mateo, CA); Hariharan Balasubramanian (Redmond, WA); Kenny C. Gross (Escondido, CA)
Assignee: Oracle International Corporation
G06N7/06G06F18/21326G06F18/2193G06N5/04G06F18/214G06N7/01G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,488,265
App. No.
17/386,965
Granted
Dec 2, 2025
Kind
B2
Abstract

The disclosed embodiments relate to a system that optimizes a prognostic-surveillance system to achieve a user-selectable functional objective. During operation, the system allows a user to select a functional objective to be optimized from a set of functional objectives for the prognostic-surveillance system. Next, the system optimizes the selected functional objective by performing Monte Carlo simulations, which vary operational parameters for the prognostic-surveillance system while the prognostic-surveillance system operates on synthesized signals, to determine optimal values for the operational parameters that optimize the selected functional objective.

Claims (68)

1 . A method for optimizing a prognostic-surveillance system to achieve a user-selectable functional objective, comprising:

receiving a selection of a functional objective to be optimized, wherein the functional objective to be optimized is selected from a set of functional objectives configured for the prognostic-surveillance system, wherein the functional objective comprises a quality of information objective; and

optimizing the selected functional objective, wherein the optimizing the selected functional objective comprises:

performing Monte Carlo simulations using a synthetic data pump,

wherein the synthetic data pump generates time-series signals that vary operational parameters for the prognostic-surveillance system in response to defects in a monitored asset,

wherein the Monte Carlo simulations vary the operational parameters for the prognostic-surveillance system while the prognostic-surveillance system operates on synthesized signals;

determining optimal values for the operational parameters that optimize the selected functional objective; and

determining, based on the Monte Carlo simulations, a quality of sensors, and based on the quality of the sensors, adjusting a sampling rate.

2 . The method of claim 1 , wherein the set of functional objectives for the prognostic-surveillance system comprises:

fast anomaly detection, which can be evaluated in terms of an average sample number (ASN) for a detection decision;

high prognostic accuracy, which can be evaluated in terms of false alarm probabilities (FAPs) and missed alarm probabilities (MAPs); and

low compute cost, which can be evaluated in terms of required computational operations and memory usage.

3 . The method of claim 1 , wherein the prognostic-surveillance system uses an inferential model while detecting incipient anomalies, and wherein the operational parameters include one or more of the following:

a number of signals in the inferential model;

a number of samples for each signal;

signal-to-noise ratios for the signals; and

a number of training vectors for the inferential model.

4 . The method of claim 3 , wherein the prognostic-surveillance system uses a sequential probability ratio test (SPRT) while detecting incipient anomalies, and wherein the operational parameters include one or more of the following SPRT parameters:

a desired false alarm probability parameter α;

a desired missed alarm probability parameter β;

a variance parameter V; and

a sensitivity parameter M.

5 . The method of claim 1 , wherein unselected functional objectives in the set of functional objectives become subordinate objectives and/or constraints while performing the Monte Carlo simulations.

6 . The method of claim 1 , wherein the method uses a stochastic gradient-descent technique to optimize the selected functional objective while performing the Monte Carlo simulations.

7 . The method of claim 1 , wherein the method further comprises performing digital filtering operations on signals received by the prognostic-surveillance system to reduce signal-to-noise ratios of the signals.

8 . The method of claim 1 , wherein the method further comprises performing intelligent data preprocessing operations on signals received by the prognostic-surveillance system to improve signal quality.

9 . The method of claim 1 , wherein the method further comprises configuring the prognostic-surveillance system to use the optimal values for the operational parameters during subsequent prognostic-surveillance operations.

10 . The method according to claim 1 , wherein the prognostic-surveillance system determines subordinate objectives based on the received functional objective to be optimized.

11 . The method according to claim 1 , wherein the Monte Carlo simulations are performed for a user in a single instance.

12 . A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for optimizing a prognostic-surveillance system to achieve a user-selectable functional objective, the method comprising:

receiving a selection of a functional objective to be optimized, wherein the functional objective to be optimized is selected from a set of functional objectives configured for the prognostic-surveillance system, wherein the functional objective comprises a quality of information objective; and

optimizing the selected functional objective, wherein the optimizing the selected functional objective comprises:

performing Monte Carlo simulations using a synthetic data pump,

wherein the synthetic data pump generates time-series signals that vary operational parameters for the prognostic-surveillance system in response to defects in a monitored asset,

wherein the Monte Carlo simulations vary the operational parameters for the prognostic-surveillance system while the prognostic-surveillance system operates on synthesized signals;

determining optimal values for the operational parameters that optimize the selected functional objective; and

determining, based on the Monte Carlo simulations, a quality of sensors, and based on the quality of the sensors, adjusting a sampling rate.

13 . The non-transitory computer-readable storage medium of claim 12 , wherein the set of functional objectives for the prognostic-surveillance system comprises:

fast anomaly detection, which can be evaluated in terms of an average sample number (ASN) for a detection decision;

high prognostic accuracy, which can be evaluated in terms of false alarm probabilities (FAPs) and missed alarm probabilities (MAPs); and

low compute cost, which can be evaluated in terms of required computational operations and memory usage.

14 . The non-transitory computer-readable storage medium of claim 12 , wherein the prognostic-surveillance system uses an inferential model while detecting incipient anomalies, and wherein the operational parameters include one or more of the following:

a number of signals in the inferential model;

a number of samples for each signal;

signal-to-noise ratios for the signals; and

a number of training vectors for the inferential model.

15 . The non-transitory computer-readable storage medium of claim 14 , wherein the prognostic-surveillance system uses a sequential probability ratio test (SPRT) while detecting incipient anomalies, and wherein the operational parameters include one or more of the following SPRT parameters:

a desired false alarm probability parameter α;

a desired missed alarm probability parameter β;

a variance parameter V; and

a sensitivity parameter M.

16 . The non-transitory computer-readable storage medium of claim 12 , wherein unselected functional objectives in the set of functional objectives become subordinate objectives and/or constraints while performing the Monte Carlo simulations.

17 . The non-transitory computer-readable storage medium of claim 12 , wherein the method further comprises performing digital filtering operations on signals received by the prognostic-surveillance system to reduce signal-to-noise ratios of the signals.

18 . The non-transitory computer-readable storage medium of claim 12 , wherein the method further comprises performing intelligent data preprocessing operations on signals received by the prognostic-surveillance system to improve signal quality.

19 . A system that optimizes a prognostic-surveillance system to achieve a user-selectable functional objective, comprising:

a computing system with one or more processors and one or more associated memories; and

an optimization processor that executes on the computing system, wherein during operation, the optimization processor:

receives a selection of a functional objective to be optimized, wherein the functional objective to be optimized is selected from a set of functional objectives configured for the prognostic-surveillance system, wherein the functional objective comprises a quality of information objective, and

optimizes the selected functional objective, wherein the optimizing the selected functional objective comprises:

performing Monte Carlo simulations using a synthetic data pump,

wherein the synthetic data pump generates time-series signals that vary operational parameters for the prognostic-surveillance system in response to defects in a monitored asset,

wherein the Monte Carlo simulations vary the operational parameters for the prognostic-surveillance system while the prognostic-surveillance system operates on synthesized signals;

determining optimal values for the operational parameters that optimize the selected functional objective; and

determining, based on the Monte Carlo simulations, a quality of sensors, and based on the quality of the sensors, adjusting a sampling rate.

20 . The system of claim 19 , wherein the set of functional objectives for the prognostic-surveillance system comprises:

fast anomaly detection, which can be evaluated in terms of an average sample number (ASN) for a detection decision;

high prognostic accuracy, which can be evaluated in terms of false alarm probabilities (FAPs) and missed alarm probabilities (MAPs); and

low compute cost, which can be evaluated in terms of required computational operations and memory usage.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA PREVIOUSLY RECORDED AT REEL: 057205 FRAME: 0760. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 22, 2021
From: LIU, MENGLIN; SONDEREGGER, RICHARD P.; BACLAWSKI, KENNETH P.; GAWLICK, DIETER; CHYSTIAKOVA, ANNA; WANG, GUANG C.; LIU, ZHEN HUA; BALASUBRAMANIAN, HARIHARAN; GROSS, KENNY C.
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 057673/0436 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2021
From: LIU, MENGLIN; SONDEREGGER, RICHARD P.; BACLAWSKI, KENNETH P.; GAWLICK, DIETER; CHYSTIAKOVA, ANNA; WANG, GUANG C.; LIU, ZHEN HUA; BALASUBRAMANIAN, HARIHARAN; GROSS, KENNY C.
To: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
Reel/Frame 057205/0760 →
Continuity (1)
Related Publication 20230035541A1 · Feb 2, 2023
References Cited (35)
US 10964130B1 · Dixit · 2021 [cited by examiner]
US 11130422B1 · Goldfarb · 2021 [cited by examiner]
US 11983854B2 · Isik · 2024 [cited by examiner]
US 20180341876A1 · Ghosh · 2018 [cited by examiner]
US 20200184351A1 · Wang · 2020 [cited by examiner]
US 20200218801A1 · Gross · 2020 [cited by examiner]
US 20200242483A1 · Shashikant Rao · 2020 [cited by examiner]
US 20200410090A1 · Baker · 2020 [cited by examiner]
US 20210326759A1 · Ardel · 2021 [cited by examiner]
US 20210349157A1 · Srinivasan · 2021 [cited by examiner]
US 20210382447A1 · Stano · 2021 [cited by examiner]
US 20210382473A1 · Stano · 2021 [cited by examiner]
US 20220261657A1 · Puzanov · 2022 [cited by examiner]
US 20220335574A1 · Tang · 2022 [cited by examiner]
US 20220357734A1 · Amakawa · 2022 [cited by examiner]
US 20220390514A1 · Winston · 2022 [cited by examiner]
US 20220398446A1 · Xie · 2022 [cited by examiner]
Sharma et Atkins, “Prognostics-Informed Battery Reconfiguration in a Multi-Battery Small UAS Energy System” Mar. 2, 2021, arXiv:2103.01883v1, pp. 1-10. (Year: 2021). [cited by examiner]
More et al., “SimML Framework: Monte Carlo Simulation of Statistical Machine Learning Algorithms for IoT Prognostic Applications” 2016, pp. 174-179. (Year: 2016). [cited by examiner]
Jin et al., Are Ensemble Classifiers Powerful Enough for the Detection and Diagnosis of Intermediate-Severity Faults? Jul. 8, 2020, arXiv: 2007.03167v2, pp. 1-12. (Year: 2020). [cited by examiner]
Zhao et al., “Streaming Variational Monte Carlo” Feb. 29, 2020, arXiv: 1906.01549v3, pp. 1-12. (Year: 2020). [cited by examiner]
Gross et Wang, “AI Decision Support Prognostics for IoT Asset Health Monitoring, Failure Prediction, Time to Failure” 2019, pp. 244-248. (Year: 2019). [cited by examiner]
Wang et al., “Neural Architecture Search using Deep Neural Networks and Monte Carlo Tree Search” Nov. 21, 2019, arXiv:1805.07440v5, pp. 1-13. (Year: 2019). [cited by examiner]
Wei et al., “Remaining useful life prediction of lithium-ion batteries based on Monte Carlo Dropout and gated recurrent unit” May 18, 2021, pp. 2862-2871. (Year: 2021). [cited by examiner]
Thin et al., “Monte Carlo Variational Auto-Encoders” Jun. 30, 2021, arXiv: 2106.15921v1, pp. 1-18. (Year: 2021). [cited by examiner]
Que et al., “Remaining Useful Life Prediction for Bearings based on a Gated Recurrent Unit” Feb. 26, 2021, pp. 1-11. (Year: 2021). [cited by examiner]
Jin et al., “Using Ensemble Classifiers to Detect Incipient Anomalies” Aug. 20, 2020, arXiv: 2008.08710v1, pp. 1-25. (Year: 2020). [cited by examiner]
Huang et al., “Bayesian Neural Network Based Method of Remaining Useful Life Prediction and Uncertainty Quantification for Aircraft Engine” 2020, pp. 1-8. (Year: 2020). [cited by examiner]
Ebihara et al., “Sequential Density Ratio Estimation for Simultaneous Optimization of Speed and Accuracy” Feb. 6, 2021, arXiv: 2006.05587v3, pp. 1-63. (Year: 2021). [cited by examiner]
Chen et al., “Monte Carlo Filtering Objectives: A New Family of Variational Objectives to Learn Generative Model and Neural Adaptive Proposal for Time Series” May 20, 2021, arXiv: 2105.09801v1, pp. 1-23. (Year: 2021). [cited by examiner]
Carrazza et al., “MadFlow: automating Monte Carlo simulation on GPU for particle physics processes” Jun. 18, 2021, arXiv: 2106.10279v1, pp. 1-7. (Year: 2021). [cited by examiner]
Martin et al., “The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction” Dec. 15, 2020, arXiv: 2007.08620v2, pp. 1-21. (Year: 2020). [cited by examiner]
Silva et al., “Surrogate Monte Carlo” Feb. 10, 2021, arXiv: 2102.08186v1, pp. 1-6. (Year: 2021). [cited by examiner]
Davies et al., “The Application of Time Series Modelling and Monte Carlo Simulation: Forecasting Volatile Inventory Requirements” 2014, pp. 1-17. (Year: 2014). [cited by examiner]
Chopin et Papaspiliopoulos, “An Introduction to Sequential Monte Carlo” Oct. 2020, Springer, pp. i-390. (Year: 2020). [cited by examiner]