IP Library Granted Patent US 12,405,844
Granted Patent B2
US 12,405,844 · App. 18/050,694 · Granted Sep 2, 2025

Systems and methods for synthetic database query generation

Inventors: Jeremy Goodsitt (Champaign, IL); Austin Walters (Savoy, IL); Vincent Pham (Champaign, IL); Fardin Abdi Taghi Abad (Champaign, IL)
Assignee: Capital One Services, LLC
G06F9/541G06F8/71G06F9/54G06F9/547G06F11/3608G06F11/3628G06F11/3636G06F16/2237G06F16/2264G06F16/2423G06F16/24568G06F16/248G06F16/254G06F16/258G06F16/283G06F16/285G06F16/288G06F16/335G06F16/90332G06F16/90335G06F16/9038G06F16/906G06F16/93G06F17/15G06F17/16G06F17/18G06F18/2115G06F18/213G06F18/214G06F18/2148G06F18/217G06F18/2193G06F18/22G06F18/23G06F18/24G06F18/2411G06F18/2415G06F18/285G06F18/40G06F21/552G06F21/60G06F21/6245G06F21/6254G06F30/20G06F40/117G06F40/166G06F40/20G06N3/04G06N3/044G06N3/045G06N3/06G06N3/08G06N3/088G06N3/094G06N5/00G06N5/02G06N5/04G06N7/00G06N7/01G06N20/00G06Q10/04G06T7/194G06T7/246G06T7/248G06T7/254G06T11/001G06V10/768G06V10/993G06V30/194G06V30/1985H04L63/1416H04L63/1491H04L67/306H04L67/34H04N21/23412H04N21/8153G06T2207/10016G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,405,844
App. No.
18/050,694
Granted
Sep 2, 2025
Kind
B2
Abstract

A system for returning synthetic database query results. The system may include a memory unit for storing instructions, and a processor configured to execute the instructions to perform operations comprising: receiving a query input by a user at a user interface; determining, based on natural language processing, a type of the query input; determining, based on the received query input and a database language interpreter, an output data format; returning, based on a generation model and the output data format, a result of the query input; providing, to a plurality of training models and based on the determined query type, the query input and the result; and training the training models, based on the query input and the result.

Claims (40)

1. A system for generating synthetic results based on a query input, comprising:

one or more processors and memories storing instructions that, when executed by the one or more processors, cause operations comprising:

in response to a user interaction, with a user interface, involving a query input, inputting the query input into a natural language processing model to derive a type of the query input;

routing, via a network, based on the type of the query input, the query input to a trained model of a plurality of models, wherein the trained model is trained to generate synthetic values for a selected subclass within a class and not for other subclasses within the class; and

based on the routing of the query input to the trained model, inputting the query input to the trained model to generate a subclass-specific synthetic dataset that satisfies a statistical similarity criterion associated with both the synthetic dataset and a reference dataset, wherein the statistical similarity criterion is one or more of a statistical correlation score between the synthetic dataset and the reference dataset, a data similarity score between the synthetic dataset and the reference dataset, or a data quality score for the synthetic dataset.

2. The system of claim 1 , the operations further comprising:

returning, via a network, based on the subclass-specific synthetic dataset, one or more synthetic query results.

3. The system of claim 1 , the operations further comprising:

retrieving, from a network database, a data record comprising one or more record portions and one or more sensitive record portions; and

returning, via a network, based on the data record and the subclass-specific synthetic dataset, one or more synthetic query results comprising (i) the one or more record portions without the one or more sensitive record portions and (ii) one or more synthetic data portions of the subclass-specific synthetic dataset in lieu of the one or more sensitive record portions.

4. The system of claim 1 , wherein routing the query input to the trained model comprises inputting one or more query portions of the query input to a classifier model to determine the selected subclass and, based on the selected subclass and the type of the query input, routing the query input to the trained model.

5. The system of claim 1 , wherein the statistical similarity criterion comprises a statistical correlation score between the synthetic dataset and the reference dataset.

6. The system of claim 1 , wherein the trained model comprises a neural network, recurrent neural network, generative adversarial network, kernel density estimator, or random value generator.

7. A method comprising:

executing, via one or more processors, operations comprising:

based on a user interaction, with a user interface, involving a query input, inputting the query input into a natural language processing model to derive a type of the query input;

routing, via a network, based on the type of the query input, the query input to a trained model that is trained to generate synthetic values for a selected subclass within a class and not for other subclasses within the class; and

based on the routing of the query input to the trained model, inputting the query input to the trained model to generate a subclass-specific synthetic dataset that satisfies a statistical similarity criterion associated with both the synthetic dataset and a reference dataset, wherein the statistical similarity criterion comprises one or more of a statistical correlation score between the synthetic dataset and the reference dataset, a data similarity score between the synthetic dataset and the reference dataset, or a data quality score for the synthetic dataset.

8. The method of claim 7 , the operations further comprising:

returning, via a network, based on the subclass-specific synthetic dataset, one or more synthetic query results.

9. The method of claim 7 , the operations further comprising:

retrieving, from a network database, a data record comprising one or more record portions and one or more sensitive record portions; and

returning, via a network, based on the data record and the subclass-specific synthetic dataset, one or more synthetic query results comprising (i) the one or more record portions without the one or more sensitive record portions and (ii) one or more synthetic data portions of the subclass-specific synthetic dataset in lieu of the one or more sensitive record portions.

10. The method of claim 7 , the operations wherein routing the query input to the trained model comprises inputting one or more query portions of the query input to a classifier model to determine the selected subclass and, based on the selected subclass and the type of the query input, routing the query input to the trained model.

11. The method of claim 7 , wherein the statistical similarity criterion comprises a statistical correlation score between the synthetic dataset and the reference dataset.

12. The method of claim 7 , wherein the statistical similarity criterion comprises a data similarity score between the synthetic dataset and the reference dataset.

13. The method of claim 7 , wherein the trained model comprises a neural network, recurrent neural network, generative adversarial network, kernel density estimator, or random value generator.

14. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause operations comprising:

based on a user interaction, with a user interface, involving a query input, inputting the query input into a natural language processing model to derive a type of the query input;

routing, via a network, based on the type of the query input, the query input to a trained model that is trained to generate synthetic values for a selected subclass within a class and not for other subclasses within the class; and

based on the routing of the query input to the trained model, inputting the query input to the trained model to generate a subclass-specific synthetic dataset that satisfies a statistical similarity criterion associated with both the synthetic dataset and a reference dataset, wherein the statistical similarity criterion comprises one or more of a statistical correlation score between the synthetic dataset and the reference dataset, a data similarity score between the synthetic dataset and the reference dataset, or a data quality score for the synthetic dataset.

15. The one or more non-transitory computer-readable media of claim 14 , the operations further comprising:

returning, via a network, based on the subclass-specific synthetic dataset, one or more synthetic query results.

16. The one or more non-transitory computer-readable media of claim 14 , the operations further comprising:

retrieving, from a network database, a data record comprising one or more record portions and one or more sensitive record portions; and

returning, via a network, based on the data record and the subclass-specific synthetic dataset, one or more synthetic query results comprising (i) the one or more record portions without the one or more sensitive record portions and (ii) one or more synthetic data portions of the subclass-specific synthetic dataset in lieu of the one or more sensitive record portions.

17. The one or more non-transitory computer-readable media of claim 14 , the operations wherein routing the query input to the trained model comprises inputting one or more query portions of the query input to a classifier model to determine the selected subclass and, based on the selected subclass and the type of the query input, routing the query input to the trained model.

18. The one or more non-transitory computer-readable media of claim 14 , wherein the statistical similarity criterion comprises a statistical correlation score between the synthetic dataset and the reference dataset.

19. The one or more non-transitory computer-readable media of claim 14 , wherein the statistical similarity criterion comprises a data similarity score between the synthetic dataset and the reference dataset.

20. The one or more non-transitory computer-readable media of claim 14 , wherein the trained model comprises a neural network, recurrent neural network, generative adversarial network, kernel density estimator, or random value generator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2022
From: GOODSITT, JEREMY; WALTERS, AUSTIN; PHAM, VINCENT; ABDI TAGHI ABAD, FARDIN
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 061582/0943 →
Continuity (3)
Continuation 16298463 · Mar 11, 2019
Provisional Application 62694968 · Jul 6, 2018
Related Publication 20230073695A1 · Mar 9, 2023
References Cited (148)
US 5911139A · Jain et al. · 1999 [cited by applicant]
US 5974549A · Golan · 1999 [cited by applicant]
US 6137912A · Kostrzewski et al. · 2000 [cited by applicant]
US 6269351B1 · Black · 2001 [cited by applicant]
US 6456990B1 · Hofmann et al. · 2002 [cited by applicant]
US 7788191B2 · Jebara · 2010 [cited by applicant]
US 7953682B2 · Smith et al. · 2011 [cited by applicant]
US 8375014B1 · Brocato et al. · 2013 [cited by applicant]
US 8375032B2 · Birdwell et al. · 2013 [cited by applicant]
US 8392418B2 · Birdwell et al. · 2013 [cited by applicant]
US 8484215B2 · Anderson · 2013 [cited by applicant]
US 8548951B2 · Solmer et al. · 2013 [cited by applicant]
US 8706659B1 · Mann et al. · 2014 [cited by applicant]
US 8782744B1 · Fuller et al. · 2014 [cited by applicant]
US 8990236B2 · Mizrahy et al. · 2015 [cited by applicant]
US 9171146B2 · Vipat et al. · 2015 [cited by applicant]
US 9274935B1 · Lachwani et al. · 2016 [cited by applicant]
US 9462013B1 · Boss et al. · 2016 [cited by applicant]
US 9497202B1 · Calo et al. · 2016 [cited by applicant]
US 9608809B1 · Ghetti et al. · 2017 [cited by applicant]
US 9678999B1 · Gibas et al. · 2017 [cited by applicant]
US 9716842B1 · Worley et al. · 2017 [cited by applicant]
US 9754190B1 · Guttmann · 2017 [cited by applicant]
US 9886247B2 · Laredo et al. · 2018 [cited by applicant]
US 9912698B1 · Thioux et al. · 2018 [cited by applicant]
US 9954893B1 · Zhao et al. · 2018 [cited by applicant]
US 10122969B1 · Lim et al. · 2018 [cited by applicant]
US 10212428B2 · Trepte · 2019 [cited by applicant]
US 10282907B2 · Miller et al. · 2019 [cited by applicant]
US 10453220B1 · Mihal et al. · 2019 [cited by applicant]
US 10740335B1 · Juveneton · 2020 [cited by examiner]
US 20020103793A1 · Koller et al. · 2002 [cited by applicant]
US 20030003861A1 · Kagemoto et al. · 2003 [cited by applicant]
US 20030074368A1 · Schuetze et al. · 2003 [cited by applicant]
US 20060031622A1 · Jardine · 2006 [cited by applicant]
US 20070169017A1 · Coward · 2007 [cited by applicant]
US 20070271287A1 · Acharya et al. · 2007 [cited by applicant]
US 20080168339A1 · Hudson et al. · 2008 [cited by applicant]
US 20080270363A1 · Hunt et al. · 2008 [cited by applicant]
US 20080288889A1 · Hunt et al. · 2008 [cited by applicant]
US 20090018996A1 · Hunt et al. · 2009 [cited by applicant]
US 20090055331A1 · Stewart · 2009 [cited by applicant]
US 20090055477A1 · Flesher et al. · 2009 [cited by applicant]
US 20090110070A1 · Takahashi et al. · 2009 [cited by applicant]
US 20090254971A1 · Herz et al. · 2009 [cited by applicant]
US 20100251340A1 · Martin et al. · 2010 [cited by applicant]
US 20100254627A1 · Tehrani et al. · 2010 [cited by applicant]
US 20100332210A1 · Birdwell et al. · 2010 [cited by applicant]
US 20100332474A1 · Birdwell et al. · 2010 [cited by applicant]
US 20110179011A1 · Cardno et al. · 2011 [cited by applicant]
US 20120174224A1 · Thomas et al. · 2012 [cited by applicant]
US 20120284213A1 · Lin et al. · 2012 [cited by applicant]
US 20130117830A1 · Erickson et al. · 2013 [cited by applicant]
US 20130124526A1 · Birdwell et al. · 2013 [cited by applicant]
US 20130159309A1 · Birdwell et al. · 2013 [cited by applicant]
US 20130159310A1 · Birdwell et al. · 2013 [cited by applicant]
US 20130167192A1 · Hickman et al. · 2013 [cited by applicant]
US 20140053061A1 · Chasen et al. · 2014 [cited by applicant]
US 20140195466A1 · Phillipps et al. · 2014 [cited by applicant]
US 20140201126A1 · Zadeh et al. · 2014 [cited by applicant]
US 20140278339A1 · Aliferis et al. · 2014 [cited by applicant]
US 20140324760A1 · Marwah et al. · 2014 [cited by applicant]
US 20140325662A1 · Foster et al. · 2014 [cited by applicant]
US 20140365549A1 · Jenkins · 2014 [cited by applicant]
US 20150032761A1 · Pasternack · 2015 [cited by applicant]
US 20150058388A1 · Smigelski · 2015 [cited by applicant]
US 20150066793A1 · Brown · 2015 [cited by applicant]
US 20150100537A1 · Grieves et al. · 2015 [cited by applicant]
US 20150220734A1 · Nalluri et al. · 2015 [cited by applicant]
US 20150241873A1 · Goldenberg et al. · 2015 [cited by applicant]
US 20150309987A1 · Epstein et al. · 2015 [cited by applicant]
US 20160019271A1 · Ma et al. · 2016 [cited by applicant]
US 20160057107A1 · Call et al. · 2016 [cited by applicant]
US 20160092476A1 · Stojanovic et al. · 2016 [cited by applicant]
US 20160092557A1 · Stojanovic et al. · 2016 [cited by applicant]
US 20160110657A1 · Gibiansky et al. · 2016 [cited by applicant]
US 20160110810A1 · Ashok et al. · 2016 [cited by applicant]
US 20160119377A1 · Goldberg et al. · 2016 [cited by applicant]
US 20160132787A1 · Drevo et al. · 2016 [cited by applicant]
US 20160162688A1 · Call et al. · 2016 [cited by applicant]
US 20160197803A1 · Talbot et al. · 2016 [cited by applicant]
US 20160308900A1 · Sadika et al. · 2016 [cited by applicant]
US 20160371601A1 · Grove et al. · 2016 [cited by applicant]
US 20170011105A1 · Shet et al. · 2017 [cited by applicant]
US 20170039271A1 · Bishop · 2017 [cited by examiner]
US 20170083990A1 · Hou et al. · 2017 [cited by applicant]
US 20170147930A1 · Bellala et al. · 2017 [cited by applicant]
US 20170220336A1 · Chen et al. · 2017 [cited by applicant]
US 20170236183A1 · Klein et al. · 2017 [cited by applicant]
US 20170249432A1 · Grantcharov · 2017 [cited by applicant]
US 20170331858A1 · Clark, III et al. · 2017 [cited by applicant]
US 20170359570A1 · Holzer et al. · 2017 [cited by applicant]
US 20180018590A1 · Szeto et al. · 2018 [cited by applicant]
US 20180108149A1 · Levinshtein · 2018 [cited by applicant]
US 20180115706A1 · Kang et al. · 2018 [cited by applicant]
US 20180150548A1 · Shah et al. · 2018 [cited by applicant]
US 20180165475A1 · Veeramachaneni et al. · 2018 [cited by applicant]
US 20180165728A1 · McDonald et al. · 2018 [cited by applicant]
US 20180173730A1 · Copenhaver et al. · 2018 [cited by applicant]
US 20180173958A1 · Hu et al. · 2018 [cited by applicant]
US 20180181802A1 · Chen et al. · 2018 [cited by applicant]
US 20180198602A1 · Duffy et al. · 2018 [cited by applicant]
US 20180199066A1 · Ross · 2018 [cited by applicant]
US 20180204111A1 · Zadeh et al. · 2018 [cited by applicant]
US 20180240041A1 · Koch et al. · 2018 [cited by applicant]
US 20180247078A1 · Newman · 2018 [cited by examiner]
US 20180248827A1 · Scharber et al. · 2018 [cited by applicant]
US 20180253894A1 · Krishnan et al. · 2018 [cited by applicant]
US 20180260474A1 · Surdeanu et al. · 2018 [cited by applicant]
US 20180260704A1 · Sun et al. · 2018 [cited by applicant]
US 20180268286A1 · Dasgupta · 2018 [cited by applicant]
US 20180307978A1 · Ar et al. · 2018 [cited by applicant]
US 20180336463A1 · Bloom · 2018 [cited by applicant]
US 20180367484A1 · Rodriguez et al. · 2018 [cited by applicant]
US 20190005657A1 · Gao et al. · 2019 [cited by applicant]
US 20190026956A1 · Gausebeck et al. · 2019 [cited by applicant]
US 20190034833A1 · Ding et al. · 2019 [cited by applicant]
US 20190042290A1 · Bailey et al. · 2019 [cited by applicant]
US 20190051051A1 · Kaufman et al. · 2019 [cited by applicant]
US 20190057509A1 · Lv et al. · 2019 [cited by applicant]
US 20190090834A1 · Pauly · 2019 [cited by applicant]
US 20190147371A1 · Deo et al. · 2019 [cited by applicant]
US 20190196600A1 · Rothberg et al. · 2019 [cited by applicant]
US 20190220653A1 · Wang et al. · 2019 [cited by applicant]
Park et al., Data Synthesis based on Generative Adversarial Networks, vol. 11 No. 10, Jul. 2018. (Year: 2018). [cited by examiner]
Park et al. ,Data Synthesis based on Generative Adversarial Networks, vol. 11 No. 10 (June), Jul. 2018. (Year: 2018). [cited by examiner]
Acs et al., Differentially Private Mixture of Generative Neural Networks, pp. 1-13, Nov. 2017 (Year: 2017). [cited by examiner]
Park et al. , Data Synthesis based on Generative Adversarial Nertworks, vol. 11 No. 10 (June), Jul. 2018. (Year: 2018). [cited by examiner]
Beaulieu-Jones et al., Privacy-preserving generative deep neural networks support 1 clinical data sharing, Jul. 5, 2017, bioRxiv, total pp. 40, http://dx.doi.org/10.1101/159756 (Year: 2017). [cited by applicant]
Brkic et al., I Know That Person: Generative Full Body and Face De-Identification of People in Images, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1319-1328 (Year: 2017). [cited by applicant]
C. Willems, T. Holz and F. Freiling, “Toward Automated Dynamic Malware Analysis Using CWSandbox,” in IEEE Security & Privacy , vol. 5, No. 2, pp. 32-39, Mar.-Apr. 2007. (Year: 2007). [cited by applicant]
Dernoncourt, F., Lee, J. Y., Uzuner, 0., & Szolovits, P. (2017). De-identification of patient notes with recurrent neural networks. Journal of the American Medical Informatics Association, 24(3), 596-606. (Year: 2017). [cited by applicant]
Domadia, S. G., & Zaveri, T. (May 2011). Comparative analysis of unsupervised and supervised image classification techniques. In Proceeding of National Conference on Recent Trends in Engineering & Technology (pp. 1-5). … [cited by applicant]
Escovedo, Tatiana, et al. “Detect A: abrupt concept drift detection in non-stationary environments.” Applied Soft Computing 62 (2017 ): 119-133. (Year: 2017). [cited by applicant]
Gidaris, S., & Komodakis, N. (2017). Detect, replace, refine: Deep structured prediction for pixel wise labeling. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 5248-5257). (Year: … [cited by applicant]
Hasegawa et al. Interoperability for Mobile Agents by Incarnation Agents. AAMAS'03 Jul. 14-18, 2003, Melbourne, Australia. (Year: 2003). [cited by applicant]
Jiang, Z., Zhao, C., He, B., Guan, Y., & Jiang, J. (2017). De-identification of medical records using conditional random fields and long short-term memory networks. Journal of biomedical informatics, 75, S43-S53. (Year:… [cited by applicant]
Kim, Yoon. “Convolutional neural networks for sentence classification.” arXiv preprint arXiv: 1408. 5882 (2014). (Year: 2014). [cited by applicant]
Laszlo, M., & Mukherjee, S. (2013). Optimal univariate microaggregation with data suppression. Journal of Systems and Software, 86(3), 677-682. (Year: 2013). [cited by applicant]
Malekzadeh et al., Replacement Auto Encoder: A Privacy-Preserving Algorithm for Sensory Data Analysis, 2018 IEEE/ACM Third International Conference on Internet-of-Things Design and Implementation, pp. 166-176 (Year: 201… [cited by applicant]
Marc Aurelio Ranzato, Arthur Szlam, Joan Bruna, Michael Mathieu, Ronan Collobert, and Sumit Chopra, “Video ( Language) Modeling: A Baseline For Generative Models Of Natural Videos”, Article, May 4, 2016, 15 pages, Coura… [cited by applicant]
Matthias Feurer, Jost Tobias Springenberg, Aaron Klein, Manuel Blum, Katharina Eggensperger, and Frank Hutter, “Efficient and Robust Automated Machine Learning”, Advances in Neural Information Processing Systems 28 (Dec… [cited by applicant]
Park et al., Data Synthesis based on Generative Adversarial Networks, Aug. 2018, Proceedings of the VLDB Endowment, vol. 11, No. 10, pp. 1071-1083 (Year: 2018). [cited by applicant]
Qin Gao, Will Lewis, Chris Quirk, and Mei-Yuh Hwang. 2011. Incremental training and intentional over-fitting of word alignment. In Proceedings of MT Summit XIII. (Year: 2011). [cited by applicant]
Roberts, Mike. “Serverless Architectures”. https://martinfowler.com/articles/serverless.html. May 22, 2018. Accessed Jul. 22, 2019. ( Year: 2018). [cited by applicant]
Vendrick, Carl, Hamed Pirsiavash, and Antonio Torralba. “Generating videos with scene dynamics.” Advances In Neural Information Processing Systems. 2016 (Year: 2016). [cited by applicant]
Wiktionary. “Spin Up”. https://en.wiktionary.org/w/index.php?title=spin_up&oldid=49727714. Jun. 15, 2018. Accessed Jul. 19, 2019. (Year: 2018). [cited by applicant]
Xue, Tianfan, et al. “Visual dynamics: Probabilistic future frame synthesis via cross convolutional networks.” Advances in Neural Information Processing Systems. 2016 (Year: 2016). [cited by applicant]
Cited By (1)
US 12,530,600