IP Library Granted Patent US 12,299,564
Granted Patent B2
US 12,299,564 · App. 17/133,285 · Granted May 13, 2025

Pattern discovery, prediction and causal effect estimation in treatment discontinuation

Inventors: Celia Cintas (Nairobi, KE); Victor Abayomi Akinwande (Karen, KE); Aisha Walcott (Nairobi, KE); Ramya Raghavendra (New York, NY); Komminist Weldemariam (Ottawa, CA)
Assignee: International Business Machines Corporation
G06N3/08G06F18/2132G06F18/217G06F18/40G06N3/044G16H20/00G16H50/20G16H50/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,299,564
App. No.
17/133,285
Granted
May 13, 2025
Kind
B2
Abstract

With a trained, computerized discontinuation predictor machine learning component (MLC), predict, based on an input time series, a time when a subject will discontinue a course of medical treatment; with a trained, computerized pattern behavior extractor MLC, extract from said input time series the top k discriminatory sequences via discriminatory sub-sequence mining (said top k discriminatory sequences differentiate between first and second classes of interest to provide a hypothesis for downstream analysis of a cause of discontinuing said course of treatment). With a trained, causal effect estimator computerized MLC, determine a reason why said subject will discontinue said course of medical treatment, based on said top k discriminatory sequences and additional data; and with a computerized user interface, provide said time and said reason why to a responsible party to initiate an intervention.

Claims (49)

1. A method comprising:

with a trained, computerized discontinuation predictor machine learning component, predicting, based on an input time series, a time when a subject will discontinue a course of medical treatment;

with a trained, computerized pattern behavior extractor machine learning component, extracting from said input time series a top k discriminatory sequences via discriminatory sub-sequence mining by comparing two or more subgroups and performing mining in search of patterns that appear unequally in the two or more subgroups, wherein said top k discriminatory sequences differentiate between first and second classes of interest to provide a hypothesis for downstream analysis of a cause of discontinuing said course of medical treatment;

with a trained, causal effect estimator computerized machine learning component, determining a reason why said subject will discontinue said course of medical treatment, based on said top k discriminatory sequences and additional data;

with a computerized user interface, providing said time when said subject will discontinue said course of medical treatment and said reason why said subject will discontinue said course of medical treatment to a responsible party to initiate an intervention; and

initiating said intervention to maintain said course of medical treatment.

2. The method of claim 1 , further comprising carrying out said intervention.

3. The method of claim 2 , wherein said intervention comprises counseling said subject and continuing to administer said course of medical treatment to said subject.

4. The method of claim 2 , wherein said intervention comprises counseling said subject, ceasing said course of medical treatment to said subject, and administering an alternative course of medical treatment to said subject which is not subject to said reason.

5. The method of claim 1 , wherein said computerized discontinuation predictor machine learning component comprises a recurrent neural network, and wherein said predicting, based on said input time series, when said subject will discontinue said course of medical treatment comprises applying said recurrent neural network.

6. The method of claim 5 , wherein said recurrent neural network comprises a long short-term memory, and wherein applying said recurrent neural network comprises applying said long short-term memory.

7. The method of claim 6 , wherein applying said long short-term memory comprises processing an input sequence of treatment episodes by recursively applying a transition function to an internal hidden state vector, including computing an activation of said hidden state vector at a given time step based on a current one of said treatment episodes and a hidden state for a time step previous to said given time step.

8. The method of claim 1 , wherein:

said input time series include a collection of sequences for continuing said course of medical treatment and a collection of sequences for discontinuing said course of medical treatment, and

said discriminatory sub-sequence mining comprises determining a support left value and a support right value based on said input collections of sequences, and

said top k discriminatory sequences are extracted based on said support left value and said support right value.

9. The method of claim 8 , further comprising pruning to eliminate from said top k discriminatory sequences those patterns that are obtained by augmenting an existing pattern, where said existing pattern is at least one of shorter and more general than a corresponding one of said augmented patterns, and has a higher confidence of predicting a class than said corresponding one of said augmented patterns.

10. The method of claim 8 , wherein providing said time and said reason with said computerized user interface comprises displaying a combination of:

a bar plot to show coverage of said collection of sequences for continuing said course of medical treatment and said collection of sequences for discontinuing said course of medical treatment; and

a shaded scatter plot to show said top k discriminatory sequences.

11. The method of claim 1 , wherein determining said reason why said subject will discontinue said course of medical treatment comprises determining a treatment effect by subtracting an outcome for an untreated group from an outcome for a treated group, and removing confounders by inverse probability weighting.

12. A computer program product comprising one or more computer readable storage media having stored thereon:

first program instructions executable by a computer system to cause the computer system to predict, based on an input time series, a time when a subject will discontinue a course of medical treatment;

second program instructions executable by the computer system to cause the computer system to extract from said input time series a top k discriminatory sequences via discriminatory sub-sequence mining by comparing two or more subgroups and performing mining in search of patterns that appear unequally in the two or more subgroups, wherein said top k discriminatory sequences differentiate between first and second classes of interest to provide a hypothesis for downstream analysis of a cause of discontinuing said course of medical treatment;

third program instructions executable by the computer system to cause the computer system to determine a reason why said subject will discontinue said course of medical treatment, based on said top k discriminatory sequences and additional data;

fourth program instructions executable by the computer system to cause the computer system to provide said time when said subject will discontinue said course of medical treatment and said reason why said subject will discontinue said course of medical treatment to a responsible party to initiate an intervention; and

fifth program instructions executable by the computer system to cause the computer system initiate said intervention to maintain said course of medical treatment.

13. A system comprising:

a memory;

a non-transitory computer readable medium comprising computer executable instructions; and

at least one processor, coupled to said memory and said non-transitory computer readable medium, and operative to execute said instructions to:

instantiate a trained, computerized discontinuation predictor machine learning component, a trained, computerized pattern behavior extractor machine learning component, a trained, causal effect estimator computerized machine learning component, and a computerized user interface;

with said trained, computerized discontinuation predictor machine learning component, predict, based on an input time series, a time when a subject will discontinue a course of medical treatment;

with said trained, computerized pattern behavior extractor machine learning component, extract from said input time series a top k discriminatory sequences via discriminatory sub-sequence mining by comparing two or more subgroups and performing mining in search of patterns that appear unequally in the two or more subgroups, wherein said top k discriminatory sequences differentiate between first and second classes of interest to provide a hypothesis for downstream analysis of a cause of discontinuing said course of medical treatment;

with said trained, causal effect estimator computerized machine learning component, determine a reason why said subject will discontinue said course of medical treatment, based on said top k discriminatory sequences and additional data;

with said computerized user interface, provide said time when said subject will discontinue said course of medical treatment and said reason why said subject will discontinue said course of medical treatment to a responsible party to initiate an intervention; and

initiating said intervention to maintain said course of medical treatment.

14. The system of claim 13 , wherein said computerized discontinuation predictor machine learning component comprises a recurrent neural network, applied to predict, based on said input time series, when said subject will discontinue said course of medical treatment.

15. The system of claim 14 , wherein said recurrent neural network comprises a long short-term memory.

16. The system of claim 15 , wherein said long short-term memory is applied by processing an input sequence of treatment episodes by recursively applying a transition function to an internal hidden state vector, including computing an activation of said hidden state vector at a given time step based on a current one of said treatment episodes and a hidden state for a time step previous to said given time step.

17. The system of claim 13 , wherein:

said input time series include a collection of sequences for continuing said course of medical treatment and a collection of sequences for discontinuing said course of medical treatment, and

said discriminatory sub-sequence mining comprises determining a support left value and a support right value based on said input collections of sequences, and

said top k discriminatory sequences are extracted based on said support left value and said support right value.

18. The system of claim 17 , wherein said trained, computerized pattern behavior extractor machine learning component is further operative to prune to eliminate from said top k discriminatory sequences those patterns that are obtained by augmenting an existing pattern, where said existing pattern is at least one of shorter and more general than a corresponding one of said augmented patterns, and has a higher confidence of predicting a class than said corresponding one of said augmented patterns.

19. The system of claim 17 , wherein said computerized user interface provides said time and said reason by displaying a combination of:

a bar plot to show coverage of said collection of sequences for continuing said course of medical treatment and said collection of sequences for discontinuing said course of medical treatment; and

a shaded graph plot to show said top k discriminatory sequences.

20. The system of claim 13 , wherein said trained, causal effect estimator computerized machine learning component is operative to determine said reason why said subject will discontinue said course of medical treatment by determining a treatment effect by subtracting an outcome for an untreated group from an outcome for a treated group, and removing confounders by inverse probability weighting.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2020
From: CINTAS, CELIA; AKINWANDE, VICTOR ABAYOMI; WALCOTT, AISHA; RAGHAVENDRA, RAMYA; WELDEMARIAM, KOMMINIST
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 054743/0817 →
Continuity (1)
Related Publication 20220198265A1 · Jun 23, 2022
References Cited (39)
US 8543215B2 · Hatlestad · 2013 [cited by applicant]
US 11631484B1 · Hanina · 2023 [cited by examiner]
US 20040210117A1 · Ueno · 2004 [cited by examiner]
US 20130006671A1 · Hufford · 2013 [cited by examiner]
US 20140310016A1 · Kenney · 2014 [cited by applicant]
US 20170277835A1 · Bell · 2017 [cited by applicant]
US 20210241137A1 · Jain · 2021 [cited by examiner]
CA 2789885A1 · 2014 [cited by applicant]
CN 204520641 · 2015 [cited by applicant]
Maharajan et al., “A Tutorial Markov Analysis of Effective Human Tutorial Sessions,” Proceedings of the 5th Workshop on Natural Language Processing Techniques for Education Applications, pp. 30-34 Melbourne, Australia, … [cited by examiner]
Abhar, Orhan, “Rule Mining and Sequential Pattern Based Predictive Modeling with EMR Data” (2019) Theses and Dissertations—Computer Science 85 (Year: 2019). [cited by examiner]
Fournier-Viger, Philippe, and Vincent S. Tseng, “Mining top-k sequential rules,” International Conference on Advanced Data Mining and Applications, Berlin, Heidelberg: Springer Berlin Heidelberg, 2011 (Year: 2011). [cited by examiner]
Brownlee, Jason, “4 Types of Classification Tasks in Machine Learning” (Apr. 8, 2020) (Year: 2020). [cited by examiner]
Faraone, Stephen V., “Interpreting Estimates of Treatment Effects” (Dec. 2008) P&T 2008 vol. 33, No. 12 (Year: 2008). [cited by examiner]
Azuike et al., Predictors of discontinuation of contraceptive use among Nigerian women: Results of 2013 Nigeria Demographic and Health Surveys, Journal of Scientific Research and Studies vol. 4 (7), pp. 171-176, Jul. 20… [cited by applicant]
Bradley et al., “Levels, Trends, and Reasons for Contraceptive Discontinuation”, US Aid From the Amercian People, DHS Analytical Studies 20, ICF Macro, Calverton, Maryland, USA, Sep. 2009, 109 pages. [cited by applicant]
Emam et al., “Predicting the Long-Term Outcomes of Biologics in Psoriasis Patients Using Machine Learning”, Submitted on Aug. 25, 2019, arXiv:1908.09251, pp. 1-14. [cited by applicant]
Wang et al., “Contraceptive Discontinuation, Failure, and Switching in Cambodia”, Further Analysis of the 2014 Cambodia Demographic and Health Survey, DHS Further Analysis Reports No. 105, ICF, Rockville, Maryland, USA,… [cited by applicant]
IBM Releases SQL-Native Time Series Processing in Cloud. Downloaded from https://www.ibm.com/blog/announcement/ibm-releases-sql-native-time-series-processing-in-cloud/ Nov. 26, 2020. pp. 6. [cited by applicant]
Horvitz-Thompson estimator. Downloaded from https://en.wikipedia. org/wiki/Horvitz%E2%80%93Thompson_estimator Nov. 26, 2020. pp. 2. [cited by applicant]
Rosenbaum, Paul R, Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score. The American Statistician vol. 39, No. 1 (Feb. 1985), pp. 33-38 (6 pages). [cited by applicant]
The DHS Program—Calendar Tutorial. pp. 2. [cited by applicant]
Gesesew HA, Ward P, Hajito KW, Feyissa GT, Mohammadi L, Mwanri L. Discontinuation from antiretroviral therapy: a continuing challenge among adults in HIV care in Ethiopia: a systematic review and meta-analysis. PloS one… [cited by applicant]
Ann K Blanc, Sian L Curtis, and Trevor N Croft. Monitoring contraceptive continuation: links to fertility outcomes and quality of care. Studies in family planning, 33(2):127-140, 2002. [cited by applicant]
Sian L Curtis, Ian Diamond, and John W McDonald. Birth interval and family effects on postneonatal mortality in brazil. Demography, 30(1):33-43, 1993. [cited by applicant]
Annet Nanvubya, Julius Ssempiira, Juliet Mpendo, Ali Ssetaala, Annet Nalutaaya, Mathias Wambuzi, Paul Kitandwe, Bernard S Bagaya, Sabrina Welsh, Stephen Asiimwe, et al. Use of modern family planning methods in fishing c… [cited by applicant]
Kerry L. D. MacQuarrie, Christina Juan, Courtney Allen, Sally Zweimueller, and Alison Gemmill. Women's contraceptive profiles throughout the life course in burundi and nepal. Technical report, DHS Analytical Studies No.… [cited by applicant]
Jian Pei et al,. Mining Sequential Patterns by Pattern-Growth: The PrefixSpan Approach. IEEE Transactions on Knowledge and Data Engineering, vol. 16, No. 10, Oct. 2004. pp. 17. [cited by applicant]
Mohammed J Zaki. Spade: An efficient algorithm for mining frequent sequences. Machine learning, 42(1-2):31-60, 2001. [cited by applicant]
Miguel A Hern'an and James M Robins. Estimating causal effects from epidemiological data. Journal of Epidemiology & Community Health, 60(7):578-586, 2006. [cited by applicant]
Paul R Rosenbaum and Donald B Rubin. The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1):41-55, 1983. [cited by applicant]
David W Scott. Multivariate density estimation: theory, practice, and visualization. John Wiley & Sons, 2015. [cited by applicant]
Susan Athey and Guido Imbens. Recursive partitioning for heterogeneous causal effects. Proceedings of the National Academy of Sciences, 113(27):7353-7360, 2016. [cited by applicant]
Mshai Shimoni, Ehud Karavani, Sivan Ravid, Peter Bak, Tan Hung Ng, Sharon Hensley Alford, Denise Meade, and Yaara Goldschmidt. An evaluation toolkit to guide model selection and cohort definition in causal inference. ar… [cited by applicant]
Richard K Crump, V Joseph Hotz, Guido W Imbens, and Oscar A Mitnik. Dealing with limited overlap in estimation of average treatment effects. Biometrika, 96(1):187-199, 2009. [cited by applicant]
Fredrik D Johansson, Dennis Wei, Michael Oberst, Tian Gao, Gabriel Brat, David Sontag, and Kush R Varshney. Characterization of overlap in observational studies. arXiv preprint arXiv:1907.04138, 2019. [cited by applicant]
Ehud Karavani, Peter Bak, and Yishai Shimoni. A discriminative approach for finding and characterizing positivity violations using decision trees. arXiv preprint arXiv:1907.08127, 2019. [cited by applicant]
Johns Hopkins Bloomberg School of Public Health. PMA: Performance Monitoring for Action. https://www.pmadata.org/, 2019. [cited by applicant]
Finale Doshi-Velez and Been Kim. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608, 2017. [cited by applicant]