IP Library Granted Patent US 12,224,992
Granted Patent B2
US 12,224,992 · App. 18/402,662 · Granted Feb 11, 2025

AI-driven defensive cybersecurity strategy analysis and recommendation system

Inventors: Jason Crabtree (Vienna, VA); Richard Kelley (Woodbridge, VA); Jason Hopper (Halifax, CA); David Park (Fairfax, VA)
Assignee: QOMPLX LLC
H04L63/0428H04L9/3236H04L9/3239H04L63/0807H04L63/0815H04L63/1425H04L63/1433H04L63/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,224,992
App. No.
18/402,662
Granted
Feb 11, 2025
Kind
B2
Abstract

A system and method for automated cybersecurity defensive strategy analysis that predicts the evolution of new cybersecurity attack strategies and makes recommendations for cybersecurity improvements to networked systems based on a cost/benefit analysis. The system and method use machine learning algorithms to run simulated attack and defense strategies against a model of the networked system created using a directed graph. Recommendations are generated based on an analysis of the simulation results against a variety of cost/benefit indicators.

Claims (32)

1. A system for automated cybersecurity defensive strategy analysis and recommendations, comprising:

a computing system comprising a processor, a memory, and a network interface;

an attack implementation subsystem comprising a first plurality of programming instructions that, when operating on the processor, cause the computing system to:

execute a cyberattack on a network under test; and

gather operational information during the cyberattack;

a machine learning simulator subsystem comprising a second plurality of programming instructions that, when operating on the processor, cause the computing system to:

use the operational information to generate a plurality of simulated attack outcomes using iterative simulations of a plurality of cyberattack strategy sequences each comprising a simulated attack on a model of the network under test and a simulated defense against the simulated attack, each simulated attack being generated by a first machine learning algorithm; and

determine a probability of success of the attack and a probability of success of the defense in each cyberattack strategy sequence; and

a recommendation engine subsystem comprising a third plurality of programming instructions that, when operating on the processor, cause the computing system to:

compare the simulated attack outcomes against one or more cost factors and one or more benefit factors; and

determine a cybersecurity improvement recommendation for the network under test based on the comparison.

2. The system of claim 1 , wherein the operational information further comprises system logs of one or more devices on the network under test.

3. The system of claim 1 , wherein the first machine learning algorithm is a reinforcement learning algorithm.

4. The system of claim 1 , further comprising a second machine learning algorithm, wherein each simulated defense is generated by the second machine learning algorithm, such that the first and second machine learning algorithms compete against each other in the simulation.

5. The system of claim 4 , wherein the second machine learning algorithm is an evolutionary algorithm.

6. The system of claim 5 , wherein the machine learning simulation is an online simulation and the evolutionary algorithm is a continual online evolutionary planning algorithm.

7. The system of claim 1 , wherein the cybersecurity improvement recommendation is implemented on the network under test.

8. The system of claim 7 , wherein the system is run iteratively, with each iteration resulting in a new cybersecurity improvement recommendation, which is implemented on the network under test prior to the next iteration.

9. A method for automated cybersecurity defensive strategy analysis and recommendations, comprising the steps of:

executing a cyberattack on a network under test;

gathering operational information during the cyberattack;

using the operational information to generate a plurality of simulated attack outcomes using iterative simulations of a cyberattack strategy sequences each comprising a simulated attack on a model of the network under test and a simulated defense against the simulated attack, each simulated attack being generated by a first machine learning algorithm;

determining a probability of success of the attack and a probability of success of the defense in each cyberattack strategy sequence;

comparing the simulated attack outcomes against one or more cost factors and one or more benefit factors; and

determining a cybersecurity improvement recommendation for the network under test based on the comparison.

10. The method of claim 9 , wherein the operational information further comprises system logs of one or more devices on the network under test.

11. The method of claim 9 , wherein the first machine learning algorithm is a reinforcement learning algorithm.

12. The method of claim 9 , further comprising a second machine learning algorithm, wherein each simulated defense is generated by the second machine learning algorithm, such that the first and second machine learning algorithms compete against each other in the simulation.

13. The method of claim 12 , wherein the second machine learning algorithm is an evolutionary algorithm.

14. The method of claim 13 , wherein the machine learning simulation is an online simulation and the evolutionary algorithm is a continual online evolutionary planning algorithm.

15. The method of claim 9 , wherein the cybersecurity improvement recommendation is implemented on the network under test.

16. The method of claim 15 , wherein the method is run iteratively, with each iteration resulting in a new cybersecurity improvement recommendation, which is implemented on the network under test prior to the next iteration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2024
From: CRABTREE, JASON; KELLEY, RICHARD; HOPPER, JASON; PARK, DAVID
To: QOMPLX LLC
Reel/Frame 067363/0471 →
Continuity (56)
Continuation In Part 18333414 · Jun 12, 2023
Continuation In Part 18297500 · Apr 7, 2023
Continuation In Part 18169203 · Feb 14, 2023
Continuation In Part 17986850 · Nov 14, 2022
Continuation In Part 17683242 · Feb 28, 2022
Continuation In Part 17567060 · Dec 31, 2021
Continuation In Part 17389863 · Jul 30, 2021
Continuation In Part 17245162 · Apr 30, 2021
Continuation In Part 17169924 · Feb 8, 2021
Continuation In Part 17170288 · Feb 8, 2021
Continuation In Part 17105025 · Nov 25, 2020
Continuation In Part 17102561 · Nov 24, 2020
Continuation 16896764 · Jun 9, 2020
Continuation 16836717 · Mar 31, 2020
Continuation 16792754 · Feb 17, 2020
Continuation In Part 16779801 · Feb 3, 2020
Continuation In Part 16777270 · Jan 30, 2020
Continuation In Part 16720383 · Dec 19, 2019
Continuation 16191054 · Nov 14, 2018
Continuation In Part 15887496 · Feb 2, 2018
Continuation In Part 15837845 · Dec 11, 2017
Continuation 15837845 · Dec 11, 2017
Continuation In Part 15825350 · Nov 29, 2017
Continuation 15823363 · Nov 27, 2017
Continuation In Part 15823285 · Nov 27, 2017
Continuation In Part 15818733 · Nov 20, 2017
Continuation 15790457 · Oct 23, 2017
Continuation In Part 15790327 · Oct 23, 2017
Continuation In Part 15788718 · Oct 19, 2017
Continuation In Part 15788002 · Oct 19, 2017
Continuation In Part 15787601 · Oct 18, 2017
Continuation In Part 15725274 · Oct 4, 2017
Continuation In Part 15725274 · Oct 4, 2017
Continuation In Part 15725274 · Oct 4, 2017
Continuation In Part 15655113 · Jul 20, 2017
Continuation In Part 15655113 · Jul 20, 2017
Continuation In Part 15616427 · Jun 7, 2017
Continuation In Part 15616427 · Jun 7, 2017
Continuation In Part 15616427 · Jun 7, 2017
Continuation In Part 15237625 · Aug 15, 2016
Continuation In Part 15206195 · Jul 8, 2016
Continuation In Part 15186453 · Jun 18, 2016
Continuation In Part 15166158 · May 26, 2016
Continuation In Part 15141752 · Apr 28, 2016
Continuation In Part 15141752 · Apr 28, 2016
Continuation In Part 15091563 · Apr 5, 2016
Continuation In Part 14986536 · Dec 31, 2015
Continuation In Part 14925974 · Oct 28, 2015
Continuation In Part 14925974 · Oct 28, 2015
Provisional Application 62596105 · Dec 7, 2017
Provisional Application 62568298 · Oct 4, 2017
Provisional Application 62568312 · Oct 4, 2017
Provisional Application 62568305 · Oct 4, 2017
Provisional Application 62568291 · Oct 4, 2017
Provisional Application 62568307 · Oct 4, 2017
Related Publication 20240406145A1 · Dec 5, 2024
References Cited (90)
US 5669000A · Jessen et al. · 1997 [cited by applicant]
US 6256544B1 · Weissinger · 2001 [cited by applicant]
US 6477572B1 · Elderton et al. · 2002 [cited by applicant]
US 7739653B2 · Venolia · 2010 [cited by applicant]
US 7818797B1 · Fan et al. · 2010 [cited by applicant]
US 8006303B1 · Dennerline et al. · 2011 [cited by applicant]
US 8132260B1 · Mayer et al. · 2012 [cited by applicant]
US 8516594B2 · Bennett et al. · 2013 [cited by applicant]
US 8516596B2 · Sandoval et al. · 2013 [cited by applicant]
US 8583639B2 · Chitnis et al. · 2013 [cited by applicant]
US 8595240B1 · Otey et al. · 2013 [cited by applicant]
US 8677473B2 · Dennerline et al. · 2014 [cited by applicant]
US 8725597B2 · Mauseth et al. · 2014 [cited by applicant]
US 8726393B2 · Macy et al. · 2014 [cited by applicant]
US 8949960B2 · Berkman et al. · 2015 [cited by applicant]
US 9141360B1 · Chen et al. · 2015 [cited by applicant]
US 9210185B1 · Wood et al. · 2015 [cited by applicant]
US 9306965B1 · Grossman et al. · 2016 [cited by applicant]
US 9319430B2 · Bell, Jr. et al. · 2016 [cited by applicant]
US 9602530B2 · Ellis et al. · 2017 [cited by applicant]
US 9672355B2 · Titonis et al. · 2017 [cited by applicant]
US 9712553B2 · Nguyen et al. · 2017 [cited by applicant]
US 9774616B2 · Flores et al. · 2017 [cited by applicant]
US 10061635B2 · Ellwein · 2018 [cited by applicant]
US 10185832B2 · Cam · 2019 [cited by applicant]
US 10210470B2 · Ray · 2019 [cited by applicant]
US 10212184B2 · Sweeney et al. · 2019 [cited by applicant]
US 10248910B2 · Crabtree et al. · 2019 [cited by applicant]
US 10320828B1 · Derbeko et al. · 2019 [cited by applicant]
US 10367829B2 · Huang et al. · 2019 [cited by applicant]
US 10462112B1 · Makmel et al. · 2019 [cited by applicant]
US 11005824B2 · Crabtree et al. · 2021 [cited by applicant]
US 20030009696A1 · Bunker V. · 2003 [cited by examiner]
US 20030041254A1 · Challener et al. · 2003 [cited by applicant]
US 20030145225A1 · Bruton et al. · 2003 [cited by applicant]
US 20050289072A1 · Sabharwal · 2005 [cited by applicant]
US 20060015943A1 · Mahieu · 2006 [cited by applicant]
US 20070036314A1 · Kloberdans et al. · 2007 [cited by applicant]
US 20070150744A1 · Cheng et al. · 2007 [cited by applicant]
US 20080270203A1 · Holmes et al. · 2008 [cited by applicant]
US 20090007270A1 · Futoransky · 2009 [cited by examiner]
US 20090182672A1 · Doyle · 2009 [cited by applicant]
US 20090199002A1 · Erickson · 2009 [cited by applicant]
US 20090222562A1 · Liu et al. · 2009 [cited by applicant]
US 20100125900A1 · Dennerline et al. · 2010 [cited by applicant]
US 20110061104A1 · Yamada et al. · 2011 [cited by applicant]
US 20110087888A1 · Rennie · 2011 [cited by applicant]
US 20110185432A1 · Sandoval et al. · 2011 [cited by applicant]
US 20110302640A1 · Liu et al. · 2011 [cited by applicant]
US 20120137367A1 · Dupont et al. · 2012 [cited by applicant]
US 20120266244A1 · Green et al. · 2012 [cited by applicant]
US 20130055404A1 · Khalili · 2013 [cited by examiner]
US 20130097706A1 · Titonis et al. · 2013 [cited by applicant]
US 20130347116A1 · Flores et al. · 2013 [cited by applicant]
US 20140156806A1 · Karpistsenko et al. · 2014 [cited by applicant]
US 20140279762A1 · Xaypanya et al. · 2014 [cited by applicant]
US 20150106941A1 · Muller · 2015 [cited by examiner]
US 20150149979A1 · Talby et al. · 2015 [cited by applicant]
US 20150169294A1 · Brock et al. · 2015 [cited by applicant]
US 20150195192A1 · Vasseur et al. · 2015 [cited by applicant]
US 20150281225A1 · Schoen et al. · 2015 [cited by applicant]
US 20150295948A1 · Hassell · 2015 [cited by examiner]
US 20150317481A1 · Gardner et al. · 2015 [cited by applicant]
US 20150365437A1 · Bell, Jr. et al. · 2015 [cited by applicant]
US 20150379072A1 · Dirac et al. · 2015 [cited by applicant]
US 20160004858A1 · Chen et al. · 2016 [cited by applicant]
US 20160028754A1 · Cruz Mota · 2016 [cited by examiner]
US 20160028758A1 · Ellis et al. · 2016 [cited by applicant]
US 20160072845A1 · Chiviendacz et al. · 2016 [cited by applicant]
US 20160078361A1 · Brueckner et al. · 2016 [cited by applicant]
US 20160099960A1 · Gerritz et al. · 2016 [cited by applicant]
US 20160134653A1 · Vallone et al. · 2016 [cited by applicant]
US 20160156656A1 · Boggs et al. · 2016 [cited by applicant]
US 20160275123A1 · Lin et al. · 2016 [cited by applicant]
US 20160364307A1 · Garg et al. · 2016 [cited by applicant]
US 20170019678A1 · Kim et al. · 2017 [cited by applicant]
US 20170032130A1 · Durairaj et al. · 2017 [cited by applicant]
US 20170126712A1 · Crabtree et al. · 2017 [cited by applicant]
US 20170139763A1 · Ellwein · 2017 [cited by applicant]
US 20170149802A1 · Huang et al. · 2017 [cited by applicant]
US 20170193110A1 · Crabtree et al. · 2017 [cited by applicant]
US 20170279844A1 · Bower, III et al. · 2017 [cited by applicant]
US 20170322959A1 · Tidwell et al. · 2017 [cited by applicant]
US 20170323089A1 · Duggal et al. · 2017 [cited by applicant]
US 20180288087A1 · Hittel et al. · 2018 [cited by applicant]
US 20180300930A1 · Kennedy et al. · 2018 [cited by applicant]
US 20190082305A1 · Proctor · 2019 [cited by applicant]
US 20200235935A1 · Cerna, Jr. · 2020 [cited by applicant]
WO 2014159150A1 · 2014 [cited by applicant]
WO 2017075543A1 · 2017 [cited by applicant]