IP Library › Granted Patent US 12,265,526
Granted Patent B2
US 12,265,526 · App. 17/710,036 · Granted Apr 1, 2025

Methods and apparatus for natural language interface for constructing complex database queries

Inventors: Joshua Daniel Saxe (Wichita, KS); Younghoo Lee (Asquith, AU)
Assignee: Sophos Limited
G06F16/2428G06F16/243G06N20/00H04L63/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,265,526
App. No.
17/710,036
Filed
Mar 31, 2022
Granted
Apr 1, 2025
Kind
B2
Art Unit
2443
USPC
726/1
Abstract

In some embodiments, a processor receives, via an interface, natural language data associated with a user request for performing an identified computational task associated with a cybersecurity management system. The processor is configured to provide the natural language data as input to a machine learning (ML) model. The ML model is configured to automatically infer a template query based on the natural language data. The processor is further configured to cause the template query to be displayed, via the interface. The processor is further configured to receive, via the interface, user input indicating a finalized query associated with the identified computational task, and to provide the finalized query as input to a system configured to perform the identified computational task. The processor is further configured to modify a security setting in the cybersecurity management system based on the performance of the identified computational task.

Claims (66)

1. An apparatus, comprising:

a memory; and

a processor operatively coupled to the memory, the processor configured to:

receive, via an interface, natural language data associated with a user request for performing an identified computational task associated with a cybersecurity management system;

provide the natural language data as input to a first machine learning (ML) model, the first ML model configured to automatically infer a template query based on the natural language data;

evaluate a performance of the first ML model;

generate a recommendation indicating a type of training data based on the performance;

train a second ML model to provide augmented training data, the augmented training data being the type of training data;

re-train the first ML model based on the augmented training data;

cause the template query to be displayed, via the interface, the template query being editable by a user;

receive, via the interface, user input indicating a finalized query associated with the identified computational task;

provide the finalized query as input to a system configured to perform the identified computational task; and

modify a security setting in the cybersecurity management system based on the performance of the identified computational task.

2. The apparatus of claim 1 , wherein the template query is a first template query, the processor configured to:

receive, via the interface, one or more edits made, by a user, to the first template query to generate a second template query; and

provide, as training input, the one or more edits, to the first ML model, the first ML model being trained to improve performance at inferring the second template query given the natural language data associated with the user request.

3. The apparatus of claim 1 , wherein the first ML model is configured to generate the template query by parsing the natural language data associated with a user request into a set of portions, each portion from the set of portions being associated with a parameter from a set of parameters, the processor configured to cause the display of the template query including the set of parameters via the interface.

4. The apparatus of claim 3 , wherein the processor is configured to cause the display of the set of parameters such that each portion from the set of portions is displayed as one option from a plurality of options associated with a parameter from the set of parameters, the processor configured to:

provide control tools, via the interface, the control tools configured to receive, from the user, a selection of at least one option from the plurality of options associated with each parameter from the set of parameters.

5. The apparatus of claim 1 , wherein the first ML model is configured to receive a partially complete portion of the natural language data associated with the user request for performing the identified computational task and automatically infer, based on the partially complete portion, at least a part of a remaining portion of the natural language data associated with the user request.

6. The apparatus of claim 1 , wherein the identified computational task is associated with implementing measures for malware detection and mitigation, the first ML model being trained to receive natural language data associated with a user request and automatically infer a corresponding template query based on training the first ML model using natural language data related to cybersecurity.

7. The apparatus of claim 6 , wherein the identified computational task includes at least one of blocking a communication or a host, applying a patch to a set of hosts, rebooting a machine, or executing a rule at an identified endpoint.

8. The apparatus of claim 6 , wherein the first ML model is configured to generate the template query by parsing the natural language data associated with the user request into a set of portions, each portion from the set of portions being associated with a parameter from a set of parameters, the set of parameters including at least one of an action parameter, an object parameter, or a descriptor parameter associated with the object parameter.

9. A method, comprising:

receiving, via an interface, a natural language request for performing an identified task in a cybersecurity management system;

parsing the natural language request into a set of portions to predict, using a first machine learning (ML) model, a template query based on the natural language request, the template query including the set of portions, each portion from the set of portions being associated with a parameter from a set of parameters;

evaluating a performance of the first ML model;

generating a recommendation indicating a type of training data based on the performance;

training a second ML model to provide augmented training data, the augmented training data being the type of training data;

re-training the first ML model based on the augmented training data;

displaying, via the interface, the set of portions of the template query, the interface configured to receive changes, provided by a user, to a portion from the set of portions of the template query to form a finalized query; and

providing the finalized query to the cybersecurity management system to implement the identified task.

10. The method of claim 9 , further comprising:

receiving an incomplete portion of the natural language request;

automatically predicting using the first ML model, based on the incomplete portion of the natural language request, a set of potential options, each option from the set of potential options providing a remaining portion of the natural language request; and

presenting, via the interface, the set of potential options to the user, the interface configured to allow the user to select at least one option from the set of potential options for providing a remaining portion of the natural language request.

11. The method of claim 9 , further comprising:

providing the changes to each portion from the set of portions of the template query to form a finalized query as training input to the first ML model, the training input configured to improve performance of the first ML model at inferring the finalized query based on the natural language request for performing the identified task.

12. The method of claim 9 , wherein the first ML model is configured to receive an incomplete portion of the natural language request, and based on the incomplete portion infer a context associated with the natural language request, the prediction of the template query being based on the inferred context.

13. A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the instructions comprising code to cause the processor to:

receive, via an interface, a first portion of a natural language request, the first portion of the natural language request indicating a context associated with a task to be performed via a management system;

provide, the first portion of the natural language request to a first machine learning (ML) model, the first ML model configured to predict from the first portion of the natural language request and the context, a set of options, each option from the set of options indicating a second portion of the natural language request to generate a complete natural language request;

invoke a display, via the interface, of the set of options as a selectable list;

receive, via the interface, a selection of an option from the set of options to generate a complete natural language request to perform an identified task;

provide the complete natural language request as an input to a second ML model;

generate, using the second ML model, a template query based on the complete natural language request, the template query configured to infer the task to be performed via the management system;

evaluate a performance of the second ML model;

generate a recommendation indicating a type of training data based on the performance;

train a third ML model to provide augmented training data, the augmented training data being the type of training data;

re-train the second ML model based on the augmented training data;

receive confirmation of the inferred task to be performed via the management system; and

implement the task via the management system.

14. The non-transitory processor-readable medium of claim 13 , wherein the second ML model is the same as the first ML model.

15. The non-transitory processor-readable medium of claim 13 , wherein the second ML model is different than the first ML model.

16. The non-transitory processor-readable medium of claim 13 , further comprising code to cause the processor to:

receive, from the second ML model, the template query including a set of portions forming the template query, each portion from the set of portions being associated with a parameter from a set of parameters, the second ML model configured to predict the set of parameters based on a context associated with the complete natural language request; and

display, via the interface, the template query including the set of portions forming the template query and the set of parameters.

17. The non-transitory processor-readable medium of claim 16 , further comprising code to cause the processor to:

invoke a display of the set of portions and the set of parameters such that each portion from the set of portions is displayed as a first option from a plurality of options associated with a parameter from the set of parameters, the interface configured to allow selection of a first option from the plurality of options associated with each parameter from the set of parameters;

receive changes to the template query, the changes being input as a selection of a second option from the plurality of options, the second option being different than the first option for at least one parameter from the set of parameters; and

generate a modified query based on the changes to the template query, the inferred task to be performed via the management system being based on the modified query.

18. The non-transitory processor-readable medium of claim 13 , wherein the first ML model or the second ML model is a transformer.

19. The non-transitory processor-readable medium of claim 13 , wherein the second ML model is trained on parsing natural language data obtained from a plurality of language corpuses, the code to cause the processor to generate the template query further comprising code to cause the processor to:

train the second ML model, using natural language data associated with potential actions performed for implementing cybersecurity, to receive a natural language phrase associated with a task to implement cybersecurity measures,

the code to cause the processor to provide the complete natural language request to the second ML model to generate a template query includes code to cause the processor to provide the complete natural language request to the second ML model to generate, based on the natural language phrase, the template query based on a set of parameters, the set of parameters including an action parameter associated with the cybersecurity measures.

20. The non-transitory processor-readable medium of claim 19 , wherein the action parameter associated with the cybersecurity measures includes at least one of blocking a communication or a host, allowing a communication, filtering a set of data, sorting a set of data, displaying a set of data, applying a patch, rebooting an endpoint, or executing a rule.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2022
From: SAXE, JOSHUA DANIEL; LEE, YOUNGHOO
To: SOPHOS LIMITED
Reel/Frame 061209/0018 →
Continuity (1)
Related Publication 20230315722A1 · Oct 5, 2023
References Cited (254)
US 5276789A · Besaw et al. · 1994 [cited by applicant]
US 5471399A · Tanaka et al. · 1995 [cited by applicant]
US 5793974A · Messinger · 1998 [cited by applicant]
US 5958012A · Battat et al. · 1999 [cited by applicant]
US 6225999B1 · Jain et al. · 2001 [cited by applicant]
US 6347336B1 · Song et al. · 2002 [cited by applicant]
US 6714976B1 · Wilson et al. · 2004 [cited by applicant]
US 6885387B1 · Machida · 2005 [cited by applicant]
US 6885641B1 · Chan et al. · 2005 [cited by applicant]
US 7155514B1 · Milford · 2006 [cited by applicant]
US 7194769B2 · Lippmann et al. · 2007 [cited by applicant]
US 7594270B2 · Church et al. · 2009 [cited by applicant]
US 7624448B2 · Coffman · 2009 [cited by applicant]
US 7934257B1 · Kienzle et al. · 2011 [cited by applicant]
US 7945787B2 · Gassoway · 2011 [cited by applicant]
US 8181244B2 · Boney · 2012 [cited by applicant]
US 8201243B2 · Boney · 2012 [cited by applicant]
US 8225394B2 · Gassoway · 2012 [cited by applicant]
US 8401982B1 · Satish et al. · 2013 [cited by applicant]
US 8418250B2 · Morris et al. · 2013 [cited by applicant]
US 8499204B2 · Lovy et al. · 2013 [cited by applicant]
US 8578490B2 · Moran · 2013 [cited by applicant]
US 8607347B2 · Harris et al. · 2013 [cited by applicant]
US 8719932B2 · Boney · 2014 [cited by applicant]
US 8726389B2 · Morris et al. · 2014 [cited by applicant]
US 8763123B2 · Morris et al. · 2014 [cited by applicant]
US 8779921B1 · Curtiss · 2014 [cited by applicant]
US 8805995B1 · Oliver · 2014 [cited by applicant]
US 8813236B1 · Saha et al. · 2014 [cited by applicant]
US 8856505B2 · Schneider · 2014 [cited by applicant]
US 8881288B1 · Levy et al. · 2014 [cited by applicant]
US 9141790B2 · Roundy et al. · 2015 [cited by applicant]
US 9185124B2 · Chakraborty · 2015 [cited by applicant]
US 9189634B2 · Lin · 2015 [cited by applicant]
US 9235716B1 · Brucker et al. · 2016 [cited by applicant]
US 9390263B2 · Thomas · 2016 [cited by applicant]
US 9392015B2 · Thomas · 2016 [cited by applicant]
US 9411953B1 · Kane et al. · 2016 [cited by applicant]
US 9413721B2 · Morris et al. · 2016 [cited by applicant]
US 9419989B2 · Harris et al. · 2016 [cited by applicant]
US 9516052B1 · Chauhan et al. · 2016 [cited by applicant]
US 9571512B2 · Ray et al. · 2017 [cited by applicant]
US 9578045B2 · Jaroch et al. · 2017 [cited by applicant]
US 9602530B2 · Ellis et al. · 2017 [cited by applicant]
US 9690938B1 · Saxe et al. · 2017 [cited by applicant]
US 9727726B1 · Allen · 2017 [cited by applicant]
US 9736182B1 · Madhukar et al. · 2017 [cited by applicant]
US 9774613B2 · Thomas et al. · 2017 [cited by applicant]
US 9842219B1 · Gates et al. · 2017 [cited by applicant]
US 9898604B2 · Fang et al. · 2018 [cited by applicant]
US 9917851B2 · Ray · 2018 [cited by applicant]
US 9917859B2 · Harris et al. · 2018 [cited by applicant]
US 9934378B1 · Hotta et al. · 2018 [cited by applicant]
US 9940459B1 · Saxe · 2018 [cited by applicant]
US 9965627B2 · Ray et al. · 2018 [cited by applicant]
US 9967282B2 · Thomas et al. · 2018 [cited by applicant]
US 9967283B2 · Ray et al. · 2018 [cited by applicant]
US 10061922B2 · Altman et al. · 2018 [cited by applicant]
US 10075462B2 · Mehta et al. · 2018 [cited by applicant]
US 10078571B2 · Altman et al. · 2018 [cited by applicant]
US 10120998B2 · Ghosh et al. · 2018 [cited by applicant]
US 10122687B2 · Thomas et al. · 2018 [cited by applicant]
US 10122753B2 · Thomas · 2018 [cited by applicant]
US 10181034B2 · Harrison et al. · 2019 [cited by applicant]
US 10205735B2 · Apostolopoulos · 2019 [cited by applicant]
US 10257224B2 · Jaroch et al. · 2019 [cited by applicant]
US 10284587B1 · Schlatter et al. · 2019 [cited by applicant]
US 10284591B2 · Giuliani et al. · 2019 [cited by applicant]
US 10333962B1 · Brandwine et al. · 2019 [cited by applicant]
US 10397261B2 · Ikuse et al. · 2019 [cited by applicant]
US 10440036B2 · Pal et al. · 2019 [cited by applicant]
US 10489587B1 · Kennedy et al. · 2019 [cited by applicant]
US 10581886B1 · Sharifi Mehr · 2020 [cited by applicant]
US 10599844B2 · Schmidtler et al. · 2020 [cited by applicant]
US 10791131B2 · Nor et al. · 2020 [cited by applicant]
US 10887331B2 · Nomura et al. · 2021 [cited by applicant]
US 10938838B2 · Saxe et al. · 2021 [cited by applicant]
US 10972485B2 · Ladnai et al. · 2021 [cited by applicant]
US 11016964B1 · Hinegardner · 2021 [cited by examiner]
US 11183175B2 · Larson et al. · 2021 [cited by applicant]
US 11269872B1 · Moo et al. · 2022 [cited by applicant]
US 11620379B1 · Hegde et al. · 2023 [cited by applicant]
US 11755974B2 · Saxe et al. · 2023 [cited by applicant]
US 20020113816A1 · Mitchell et al. · 2002 [cited by applicant]
US 20030046390A1 · Ball et al. · 2003 [cited by applicant]
US 20030146929A1 · Baldwin et al. · 2003 [cited by applicant]
US 20030159069A1 · Choi et al. · 2003 [cited by applicant]
US 20030172294A1 · Judge · 2003 [cited by applicant]
US 20040064545A1 · Miyake · 2004 [cited by applicant]
US 20050055641A1 · Machida · 2005 [cited by applicant]
US 20050071482A1 · Gopisetty et al. · 2005 [cited by applicant]
US 20050262569A1 · Shay · 2005 [cited by examiner]
US 20070150957A1 · Hartrell et al. · 2007 [cited by applicant]
US 20080134142A1 · Nathan et al. · 2008 [cited by applicant]
US 20090044024A1 · Oberheide et al. · 2009 [cited by applicant]
US 20090077664A1 · Hsu et al. · 2009 [cited by applicant]
US 20090300166A1 · Chen et al. · 2009 [cited by applicant]
US 20090328210A1 · Khachaturov et al. · 2009 [cited by applicant]
US 20100287229A1 · Hauser · 2010 [cited by applicant]
US 20110016208A1 · Jeong et al. · 2011 [cited by applicant]
US 20110023120A1 · Dai et al. · 2011 [cited by applicant]
US 20110196964A1 · Natarajan et al. · 2011 [cited by applicant]
US 20110246753A1 · Thomas · 2011 [cited by applicant]
US 20120198806A1 · Shay et al. · 2012 [cited by applicant]
US 20130036472A1 · Aziz · 2013 [cited by applicant]
US 20130117848A1 · Golshan et al. · 2013 [cited by applicant]
US 20130179460A1 · Acuña et al. · 2013 [cited by applicant]
US 20140040245A1 · Rubinstein et al. · 2014 [cited by applicant]
US 20140075557A1 · Balabine et al. · 2014 [cited by applicant]
US 20140143825A1 · Behrendt et al. · 2014 [cited by applicant]
US 20140181805A1 · Zaitsev · 2014 [cited by applicant]
US 20140223563A1 · Durie et al. · 2014 [cited by applicant]
US 20140325650A1 · Pavlyushchik · 2014 [cited by applicant]
US 20140359768A1 · Miliefsky · 2014 [cited by applicant]
US 20150096025A1 · Ismael · 2015 [cited by applicant]
US 20150293954A1 · Hsiao et al. · 2015 [cited by applicant]
US 20150294244A1 · Bade et al. · 2015 [cited by applicant]
US 20150310213A1 · Ronen et al. · 2015 [cited by applicant]
US 20150312267A1 · Thomas · 2015 [cited by applicant]
US 20150319261A1 · Lonas et al. · 2015 [cited by applicant]
US 20160055337A1 · El-Moussa · 2016 [cited by applicant]
US 20160078225A1 · Ray et al. · 2016 [cited by applicant]
US 20160127401A1 · Chauhan et al. · 2016 [cited by applicant]
US 20160173510A1 · Harris et al. · 2016 [cited by applicant]
US 20160191554A1 · Kaminsky · 2016 [cited by applicant]
US 20160215933A1 · Skelton et al. · 2016 [cited by applicant]
US 20160218933A1 · Porras et al. · 2016 [cited by applicant]
US 20160283715A1 · Duke et al. · 2016 [cited by applicant]
US 20160292016A1 · Bussard et al. · 2016 [cited by applicant]
US 20160292579A1 · Parikh et al. · 2016 [cited by applicant]
US 20170031565A1 · Chauhan et al. · 2017 [cited by applicant]
US 20170063896A1 · Muddu et al. · 2017 [cited by applicant]
US 20170063899A1 · Muddu et al. · 2017 [cited by applicant]
US 20170063903A1 · Muddu et al. · 2017 [cited by applicant]
US 20170083703A1 · Abbasi et al. · 2017 [cited by applicant]
US 20170118228A1 · Cp et al. · 2017 [cited by applicant]
US 20170134397A1 · Dennison et al. · 2017 [cited by applicant]
US 20170244762A1 · Kinder et al. · 2017 [cited by applicant]
US 20170339178A1 · Mahaffey et al. · 2017 [cited by applicant]
US 20170346835A1 · Thomas et al. · 2017 [cited by applicant]
US 20170359373A1 · Jaladi et al. · 2017 [cited by applicant]
US 20180091535A1 · Chrosziel et al. · 2018 [cited by applicant]
US 20180096146A1 · Hao et al. · 2018 [cited by applicant]
US 20180203998A1 · Maisel et al. · 2018 [cited by applicant]
US 20180219888A1 · Apostolopoulos · 2018 [cited by applicant]
US 20180253458A1 · Goyal et al. · 2018 [cited by applicant]
US 20180357266A1 · Zenger et al. · 2018 [cited by applicant]
US 20190007435A1 · Pritzkau et al. · 2019 [cited by applicant]
US 20190034410A1 · Hudson et al. · 2019 [cited by applicant]
US 20190034540A1 · Perkins · 2019 [cited by examiner]
US 20190034624A1 · Chen et al. · 2019 [cited by applicant]
US 20190050567A1 · Chistyakov et al. · 2019 [cited by applicant]
US 20190068627A1 · Thampy · 2019 [cited by applicant]
US 20190114539A1 · Chistyakov et al. · 2019 [cited by applicant]
US 20190121973A1 · Li et al. · 2019 [cited by applicant]
US 20190205322A1 · Dobrynin et al. · 2019 [cited by applicant]
US 20190220595A1 · Gehweiler et al. · 2019 [cited by applicant]
US 20190260779A1 · Bazalgette et al. · 2019 [cited by applicant]
US 20190260804A1 · Beck et al. · 2019 [cited by applicant]
US 20190311297A1 · Gapper · 2019 [cited by applicant]
US 20190318089A1 · Wang · 2019 [cited by applicant]
US 20190342330A1 · Wu et al. · 2019 [cited by applicant]
US 20190384897A1 · Urmanov et al. · 2019 [cited by applicant]
US 20200074078A1 · Saxe et al. · 2020 [cited by applicant]
US 20200074336A1 · Saxe et al. · 2020 [cited by applicant]
US 20200074360A1 · Humphries et al. · 2020 [cited by applicant]
US 20200076833A1 · Ladnai et al. · 2020 [cited by applicant]
US 20200076834A1 · Ladnai et al. · 2020 [cited by applicant]
US 20200233960A1 · Copty et al. · 2020 [cited by applicant]
US 20200301916A1 · Nguyen · 2020 [cited by examiner]
US 20200304528A1 · Ackerman et al. · 2020 [cited by applicant]
US 20210049158A1 · Jiao et al. · 2021 [cited by applicant]
US 20210211440A1 · Saxe et al. · 2021 [cited by applicant]
US 20210211441A1 · Humphries et al. · 2021 [cited by applicant]
US 20210250366A1 · Ladnai et al. · 2021 [cited by applicant]
US 20210406253A1 · Agarwal · 2021 [cited by applicant]
US 20220217166A1 · Ladnai et al. · 2022 [cited by applicant]
US 20220217167A1 · Saxe et al. · 2022 [cited by applicant]
US 20220292085A1 · Shahriar · 2022 [cited by examiner]
US 20220382527A1 · Wang et al. · 2022 [cited by applicant]
US 20220414228A1 · Difonzo · 2022 [cited by examiner]
US 20230106226A1 · Bahrami et al. · 2023 [cited by applicant]
US 20230146197A1 · Raman · 2023 [cited by examiner]
US 20230185915A1 · Rao et al. · 2023 [cited by applicant]
US 20230315856A1 · Lee et al. · 2023 [cited by applicant]
US 20230316005A1 · Saxe · 2023 [cited by applicant]
US 20230403286A1 · Saxe · 2023 [cited by applicant]
US 20240037477A1 · Ladnai et al. · 2024 [cited by applicant]
US 20240062133A1 · Saxe et al. · 2024 [cited by applicant]
US 20240112115A1 · Ladnai et al. · 2024 [cited by applicant]
CN 103914657A · 2014 [cited by applicant]
CN 104504337A · 2015 [cited by applicant]
CN 112395602A · 2021 [cited by applicant]
EP 3340570A1 · 2018 [cited by applicant]
GB 2587966A · 2021 [cited by applicant]
JP H0997150A · 1997 [cited by applicant]
JP 2009176132A · 2009 [cited by applicant]
JP 2017004233A · 2017 [cited by applicant]
KR 20090102001A · 2009 [cited by applicant]
RU 2659737C1 · 2018 [cited by applicant]
WO WO2014152469A1 · 2014 [cited by applicant]
WO WO2018086544A1 · 2018 [cited by applicant]
WO WO2023187319A1 · 2023 [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/GB2023/051290, mailed on Oct. 2, 2023, 16 pages. [cited by applicant]
Office Action for Great Britain Application No. GB2303441 dated Aug. 31, 2023, 4 pages. [cited by applicant]
Padala, V., et al., “A noise filtering algorithm for event-based asynchronous change detection image sensors on truenorth and its implementation on truenorth”, Frontiers in Neuroscience (2018); 12(118): 1-14. [cited by applicant]
Van De Erve, J., “Managing IIS Log File Storage” github (May 30, 2014) [online] https://github.com/MicrosoftDocs/iis-docs/blob/main/iis/manage/provisioning-and-managing-iis/managing-iis-log-file-storage.md (Access Date:… [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/GB2023/050650, dated May 22, 2023, 15 pages. [cited by applicant]
[Author Unknown] “GPT-3”. Wikipedia, Feb. 16, 2022, [Online] Retrieved from the Internet, https://web.archive.org/web/20220224001844/https:/en.wikipedia.org/wiki/GPT-3, 9 pages. [cited by applicant]
[Author Unknown] “Sigma”. SigmaHQ, Feb. 22, 2022, [Online] Retrieved from the Internet, https://archive.org/details/github.com-SigmaHQ-sigma_-_2022-02-22_18-10-22, 11 pages. [cited by applicant]
Lawton, George, “Exploring GPT-3 architecture”, TechTarget, Jul. 15, 2021, [Online] Retrieved from the Internet, https://www.techtarget.com/searchenterpriseai/feature/Exploring-GPT-3-architecture, 5 pages. [cited by applicant]
Agarwal, M., et al., “Neurips 2020 nlc2cmd competition: Translating natural language to bash commands”, NeurIPS 2020 Competition and Demonstration Track, Proceedings of Machine Learning Research (2021); 133: 302-324. [cited by applicant]
Combined Search and Examination Report for Great Britain Patent Application No. GB2303438.2 dated Feb. 9, 2024, 2 pages. [cited by applicant]
“Counterclaim-Defendants' Preliminary Invalidity Contentions Against Counterclaim Plaintiff Sophos Ltd”, United States District Court Western District of Texas Waco Division Nov. 23, 2022, 59 Pages. [cited by applicant]
Duan, Y., et al., “Detective: Automatically Identify and Analyze Malware Processes in Forensic Scenarios via DLLs”, IEEE ICC 2015—Next Generation Networking Symposium (2015); pp. 5691-5969. [cited by applicant]
Eberle, W., et al., “Insider Threat Detection Using a Graph-Based Approach”, Journal of Applied Security Research (2010); 6: 32-81 [online] https://eecs.wsu.edu/˜holder/pubs/EberleJASR11.pdf; 90 Pages. [cited by applicant]
Examination Report for Great Britain Patent Application No. GB2303438.2 dated Sep. 15, 2023, 5 pages. [cited by applicant]
Examination Report for Great Britain Patent Application No. GB2303438.2 mailed Aug. 9, 2024, 4 pages. [cited by applicant]
Examination Report for Great Britain Patent Application No. GB2303441.6 dated Aug. 7, 2024, 6 pages. [cited by applicant]
Examination Report for Great Britain Patent Application No. GB2303441.6 dated Feb. 2, 2024, 4 pages. [cited by applicant]
“Exhibit B-01 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Pat. No. 10,440,036 (“PAL”)”, United States District Court Western District of Texas Waco Division Nov. 23, 2022, 163 Page… [cited by applicant]
“Exhibit B-02 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Patent No. 9,736,182 B1 (“Madhukar”)”, United States District Court Western District of Texas Waco Division Nov. 23, 2022,… [cited by applicant]
“Exhibit B-03 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Patent Application Publication US 2015/0264062 (“Hagiwara”)”, United States District Court Western District of Texas Waco … [cited by applicant]
“Exhibit B-04 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Pat. No. 9,225,730 (“Brezinski”)”, United States District Court Western District of Texas Waco Division Nov. 23, 2022, 185… [cited by applicant]
“Exhibit B-05 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Pat. No. 9,225,730 (“Li”)”, United States District Court Western District of Texas Waco Division Nov. 23, 2022, 161 Pages. [cited by applicant]
“Exhibit B-06 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Pat. No. 10,397,261 (“Nomura”)”, United States District Court Western District of Texas Waco Division Nov. 23, 2022, 169 P… [cited by applicant]
“Exhibit B-07 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Pat. No. 8,881,288 (“NOR”)”, United States District Court Western District of Texas Waco Division Nov. 23, 2022, 178 Pages. [cited by applicant]
“Exhibit B-08 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of Chinese Patent Application Publication No. CN 104504337 (“TAO”)”, United States District Court Western District of Texas Waco D… [cited by applicant]
“Exhibit B-09 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Pat. No. 9,578,045 (“JAROCH”)”, United States District Court Western District of Texaswaco Division Nov. 23, 2022, 137 Pag… [cited by applicant]
“Exhibit B-10 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of U.S. Patent App. Publication No. 2011/0023120 (“DAI”)”, United States District Court Western District of Texaswaco Division Nov… [cited by applicant]
“Exhibit B-103 Invalidity of U.S. Pat. No. 9,967,267 Obviousness Chart Under AIA 35 U.S.C. 103”, United States District Court Western District of Texaswaco Division Nov. 23, 2022 , 115 Pages. [cited by applicant]
“Exhibit B-11 Invalidity of U.S. Pat. No. 9,967,267 Under AIA Section 102 or 103 in view of Prior Art Products”, United States District Court Western District of Texas Waco Division Nov. 23, 2022 , 88 Pages. [cited by applicant]
Faruki, P., “Mining control flow graph as API call-grams to detect portable executable malware”, Proceedings of the Fifth International Conference on Security of Information and Networks (Oct. 2012); pp. 130-137 [online… [cited by applicant]
Fu, Q., et al., “A transformer-based approach for translating natural language to bash commands”, 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), IEEE (2021); 1245-1248. [cited by applicant]
Gardiner, J., “Command & Control: Understanding, Denying and Detecting”, University of Birmingham (Feb. 2014); 38 pages. [cited by applicant]
Hu, X., et al., “Deep code comment generation”, 2018 ACM/IEEE 26th International Conference on Program Comprehension (ICPC '18), Gothenburg, Sweden (May 27-28, 2018); 200-210. [cited by applicant]
Jha, S., et al., “Two Formal Analyses of Attack Graphs”, Proceedings 15th IEEE Computer Security Foundations Workshop. CSFW-15., IEEE (2002) [online] https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=9dc8a7… [cited by applicant]
King, S., et al., “Backtracking Intrusions”, Department of Electrical Engineering and Computer Science, University of Michigan, Proceedings of the nineteenth ACM symposium on Operating systems principles (Oct. 2003); 14… [cited by applicant]
Lin, X. V., et al., “Program Synthesis from Natural Language Using Recurrent Neural Networks”, University of Washington Department of Computer Science and Engineering, Seattle, WA, USA, Tech. Rep. UW-CSE-17-03 1 (2017);… [cited by applicant]
Manadhata, P., “Detecting Malicious Domains via Graph Inference”, Proceedings of the 2014 Workshop on Artificial Intelligent and Security Workshop, ESORICS 2014, Part 1, LNCS 8712 (2014); 18 pages. [cited by applicant]
Marak, V., “Machine Learning Part 3: Ranking”, Infosec (Apr. 4, 2013) [online] https://resources.infosecinstitute.com/topics/machine-learning-and-ai/machine-learningpart-3-ranking (Access Date: Sep. 23, 2023); 6 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/709,574 dated Apr. 25, 2024, 21 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/710,127 dated Apr. 2, 2024, 8 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/710,127 mailed Jun. 27, 2024, 9 pages. [cited by applicant]
Ranade, P., et al., “CyBERT: Contextualized Embeddings for the Cybersecurity Domain”, 2021 IEEE International Conference on Big Data (Big Data) (2021); 3334-3342. [cited by applicant]
Raval, A., “Generation of Linux Commands Using Natural Language Descriptions”, A Thesis Presented to The Academic Faculty, In Partial Fulfillment of the Requirements for the Degree Masters of Science in Computer Science… [cited by applicant]
Rice, A., et al., “Command-and-control servers: The puppet masters that govern malware”, TechTarget (Jun. 2014) [online] https://www.techtarget.com/searchsecurity/feature/Command-and-control-servers-The-puppet-masters-t… [cited by applicant]
Shin, J., et al., “A survey of automatic code generation from natural language”, Journal of Information Processing Systems (2021); 17(3): 537-555. [cited by applicant]
Song, X., et al., “A survey of automatic generation of source code comments: Algorithms and techniques”, IEEE Access (2019); 7: 111411-111428. [cited by applicant]
Van De Erve, J., “Managing IIS Log File Storage” Microsoft Docs (May 3, 20140) [online] https://docs.microsoft.com/en-US/iis/manage/provisioning-and-managing-iis/managing-iis-log-file-storage (Access Date: Apr. 1, 20205… [cited by applicant]
Wang, P., et al., “An Advanced Hybrid Peer-to-Peer Botnet”, School of Electrical Engineering and Computer Science, University of Central Florida, IEEE (Jul. 2008); 15 pages. [cited by applicant]
Yin, H., et al., “Panorama: capturing system-wide information flow for malware detection and analysis”, Proceedings of the 14th ACM conference on Computer and Communications Security (Oct. 2007); 12 pages. DOI/10.1145/1… [cited by applicant]
Zhu, N., et al., “Design, Implementation, and Evaluation of Repairable File Service”, Proceedings of the 2003 International Conference on Dependable Systems and Networks (2003); 10 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/746,471 mailed Sep. 9, 2024, 30 pages. [cited by applicant]
Cited By (2)
US 12,526,289 US 12,697,987