IP Library Granted Patent US 11,962,552
Granted Patent B2
US 11,962,552 · App. 17/004,398 · Granted Apr 16, 2024

Endpoint agent extension of a machine learning cyber defense system for email

Inventors: Stephen Pickman (Huntingdon, GB); Matthew Dunn (Cambridgeshire, GB)
Assignee: Darktrace Holdings Limited
H04L51/212G06N20/00H04L51/18H04L63/14H04L63/1425H04L63/1433H04L63/1441H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,962,552
App. No.
17/004,398
Granted
Apr 16, 2024
Kind
B2
Abstract

An endpoint agent extension of a cyber defense system for email that includes modules and machine learning models. An integration module integrates with an email client application to detect email cyber threats in emails in the email client application as well as regulate emails. An action module interfaces with the email client application to direct autonomous actions against an outbound email and/or its files when a cyber threat module determines the email and/or its files (a) to be a data exfiltration threat, (b) to be both malicious and anomalous behavior as compared to a user's modeled email behavior, and (c) any combination of these. The autonomous actions can include actions of logging a user off the email client application, preventing the sending of the email, stripping the attached files and/or disabling the link to the files from the email, and sending a notification to cyber security personnel regarding the email.

Claims (46)

1. An apparatus, comprising:

an endpoint agent extension of a cyber defense system for email that includes two or more modules that are configure to cooperate with one or more machine learning models, comprising:

an integration module of the endpoint agent extension configured to integrate the endpoint agent extension with an email client application on an endpoint computing device to detect email cyber threats in emails in the email client application as well as regulate outbound emails;

an action module of the endpoint agent extension configured to interact with the email client application to direct autonomous actions, by the action module rather than a human taking an action, against at least an outbound email including its attached files and/or linked files under analysis when a cyber threat module determines the outbound email including its attached files and/or linked files (a) to be a data exfiltration threat, (b) to be both malicious and anomalous behavior as compared to a user's modeled email behavior, or (c) a combination of these two determinations, where the autonomous actions, against at least the outbound email and the files, include two or more actions selected from a group consisting of i) logging a user off the email client application, ii) preventing the sending of the outbound email, iii) stripping the attached files and/or disabling the link to the files from the outbound email, and iv) sending a notification to cyber security personnel of an organization regarding the outbound email; and

a secure communications module in the endpoint agent extension configured to securely communicate with one or more modules in a cyber security appliance of the cyber defense system located in a network connected to the endpoint computing device, an email module in the cyber security appliance is configured to reference the one or more machine learning models that are trained on the normal behavior of email activity and user activity associated with at least the email system, where the email module determines a threat risk parameter that factors in a likelihood that a chain of two or more unusual behaviors of the email activity and user activity under analysis fall outside of derived normal benign behavior; and thus, are likely malicious behavior, where the action module, the secure communications module, and the integration module are part of the two or more modules of the endpoint agent extension, where when portions of i) the endpoint agent extension and ii) any modules are implemented in software, then their instructions are stored in one or more non-transitory machine readable storage mediums in a format when executed by the endpoint computing device to cause said endpoint computing device to perform operations listed for the apparatus.

2. The apparatus of claim 1 , further comprising:

an attachment analyzer of the endpoint agent extension that is configured to scan a file i) attached to and/or ii) linked to the outbound email that is about to be sent in an outbox, in order to analyze content and meta data of the file via investigation of the file structure, a meta data analysis tool, and machine learning analysis to gather information about the file itself and the content in the file.

3. The apparatus of claim 1 , further comprising:

wherein the endpoint agent extension is implemented as one of i) a plug-in integration for the email client application and ii) a browser extension for integration with a browser-based email client application.

4. The apparatus of claim 1 , further comprising:

where the modules of the endpoint agent extension are configured to receive and factor in, both knowledge outside an email domain as well as metrics and other information from the email domain, collected by the one or more modules of the cyber defense appliance located on the network, where the modules of the endpoint agent extension also are configured to use the computing power of the one or more modules of the cyber defense appliance for one or more of the machine learning models, where the endpoint agent extension uses both the external computing power and additional knowledge collected outside the email domain in order to analyze contextual information about the outbound email under analysis, about user behavior of the user generating the outbound email, and/or about a particular file i) attached to or ii) linked to the outbound email.

5. The apparatus of claim 4 , further comprising:

where the cyber defense appliance of the cyber threat defense system is located in an IT network, an OT network, a SaaS environment, a cloud network, and/or any combination of these networks, to exchange secure communications with the endpoint agent extension to provide additional contextual information about user behavior outside the email domain, contextual information about attached files to the email under analysis to determine whether the outbound email under analysis and its attachments and/or links either i) are unusual or ii) are not unusual in context of a current user's behavior under analysis, to prevent incidents of data loss as well as wrongly addressed recipients.

6. The apparatus of claim 4 , further comprising:

where the email module of the cyber security appliance is configured to cooperate with the one or more machine learning models in the cyber security appliance to perform machine learning analysis on all inbound and outbound email flow for an organization to develop an awareness of a pattern-of-life for i) each individual user, ii) the organization as a whole, and iii) clustered groups of users the machine learning identifies as being closely associated with a given user, where the email module is configured to convey this information to the modules in the endpoint agent extension through the secure communications module.

7. The apparatus of claim 1 , further comprising:

where the secure communications module in the endpoint agent extension is configured to securely communicate with one or more modules in a cyber security appliance of the cyber defense system located in a network connected to the endpoint computing device in order to receive contextual information outside an email domain about the outbound email under analysis, as well as take instructions or receive additional information from an autonomous response module of the cyber security appliance regarding what autonomous action to take against the outbound email to mitigate a threat posed by the outbound email and its attachments and/or links.

8. The apparatus of claim 1 , further comprising:

where the endpoint agent extension and a cyber security appliance on a network cooperate to track and maintain a dynamic profile modeled for each email user in a domain who compose emails, which is 1) derived from a pattern-of-life for i) a corresponding email user in the email domain, ii) an organization that the individual user of the email domain is a part of, and iii) smaller clustered peer groups who have close associations with a given user on a per user basis, as well as 2) factor in network metrics with email domain metrics to make a decision that the behavior is deviating from the pattern-of-life for the email under analysis and any of its files attached or linked, where the cyber security appliance is configured to convey this information to the modules in the endpoint agent extension through the secure communications module.

9. The apparatus of claim 1 , further comprising:

where the email module in the network cyber security appliance is configured to track and maintain a dynamic profile modeled in a user model for each email user in the domain who compose emails, as well as cooperate with a model of email and network activities of each peer group in an organization as well as a model of an organization's email activity in general, where the inputs from all three of these different modeled insights is factored into the dynamic profile when making a decision whether the outbound email by the user is unusual and triggers a further analysis, and

wherein the secure communications module in the endpoint agent extension is configured to securely receive an instance of a dynamic profile, for each email user in the domain who composes emails, as well as a memory to store the instances of dynamic profiles for each of the users on the end point device for quicker processing of each outbound mail under analysis, where the email module is configured to generate the dynamic profiles sent to the secure communications module.

10. The apparatus of claim 1 , further comprising:

where, in addition to directing actions to prevent (a) the data exfiltration threat, (b) the malicious and anomalous behavior threat, or (c) the combination of these two determinations, the action module of the endpoint agent extension is further configured to direct the autonomous actions against the outbound email and its files when additional determinations are made including (d) sending a notification to the user on whether they intend to send the outbound email to a deemed errant email recipient address, as well as (e) sending a notification to the user when the email under analysis including any attached or linked files is determined to violate an email policy implemented by an organization that contains the user.

11. A method for a cyber security system, comprising:

configuring an endpoint agent extension of the cyber defense system for email that includes two or more modules and that cooperates with one or more machine learning models to be installable on an endpoint computing device;

configuring the endpoint agent extension to integrate with an email client application on the endpoint computing device to detect email cyber threats in emails in the email client application as well as regulate outbound emails;

configuring the endpoint agent extension to interact with the email client application to direct autonomous actions, by the action module rather than a human taking an action, against at least an outbound email including its attached files and/or linked files under analysis when a cyber threat module determines the outbound email including its attached files and/or linked files (a) to be a data exfiltration threat, (b) to be both malicious and anomalous behavior as compared to a user's modeled email behavior, or (c) a combination of these two determinations, where the autonomous actions, against at least the outbound email and the files, include two or more actions selected from a group consisting of i) logging a user off the email client application, ii) preventing the sending of the outbound email, iii) stripping the attached files and/or disabling the link to the files from the outbound email, and iv) sending a notification to cyber security personnel of an organization regarding the outbound email;

configuring a secure communications module in the endpoint agent extension to securely communicate with one or more modules in a cyber security appliance of the cyber defense system located in a network connected to the endpoint computing device, and configuring an email module in the cyber security appliance to reference the one or more machine learning models that are trained on the normal behavior of email activity and user activity associated with at least the email system, where the email module determines a threat risk parameter that factors in a likelihood that a chain of two or more unusual behaviors of the email activity and user activity under analysis fall outside of derived normal benign behavior; and thus, are likely malicious behavior, where the action module, the secure communications module, and the integration module are part of the two or more modules of the endpoint agent extension, where when portions of i) the endpoint agent extension and ii) any modules are implemented in software, then their instructions are stored in one or more non-transitory machine readable storage mediums in a format when executed by the endpoint computing device to cause said endpoint computing device to perform operations listed for the method.

12. The method of claim 11 , further comprising:

configuring the endpoint agent extension to scan a file i) attached to and/or ii) linked to the outbound email that is about to be sent in an outbox, in order to analyze content and meta data of the file via investigation of the file structure, a meta data analysis tool, and machine learning analysis to gather information about the file itself and the content in the file.

13. The method of claim 11 , further comprising:

wherein the endpoint agent extension is implemented as one of i) a plug-in integration for the email client application and ii) a browser extension for integration with a browser-based email client application.

14. The method of claim 11 , further comprising:

configuring the endpoint agent extension to securely receive and factor in, both knowledge outside an email domain as well as metrics and other information from the email domain, collected by the one or more modules of the cyber defense appliance located on the network, where the modules of the endpoint agent extension also are configured to use the computing power of the one or more modules of the cyber defense appliance for one or more of the machine learning models, where the endpoint agent extension uses both the external computing power and additional knowledge collected outside the email domain in order to analyze contextual information about the outbound email under analysis, about user behavior of the user generating the outbound email, and/or about a particular file i) attached to or ii) linked to the outbound email.

15. The method of claim 14 , further comprising:

where the cyber defense appliance of the cyber threat defense system is located in an IT network, an OT network, a SaaS environment, a cloud network, and/or any combination of these networks, to exchange secure communications with the endpoint agent extension to provide additional contextual information about user behavior outside the email domain, contextual information about attached files to the email under analysis to determine whether the outbound email under analysis and its attachments and/or links either i) are unusual or ii) are not unusual in context of a current user's behavior under analysis, to prevent incidents of data loss as well as wrongly addressed recipients.

16. The method of claim 14 , further comprising:

configuring the email module in the cyber security appliance to cooperate with the one or more machine learning models in the cyber security appliance to perform machine learning analysis on all inbound and outbound email flow for an organization to develop an awareness of a pattern-of-life for i) each individual user, ii) the organization as a whole, and iii) clustered groups of users the machine learning identifies as being closely associated with a given user, and then conveying this information to the modules in the endpoint agent extension through a secure communications module.

17. The method of claim 11 , further comprising:

configuring the endpoint agent extension to securely communicate with one or more modules in a cyber security appliance of the cyber defense system located in a network connected to the endpoint computing device in order to receive contextual information outside an email domain about the outbound email under analysis, as well as take instructions or receive additional information from an autonomous response module of the cyber security appliance regarding what autonomous action to take against the outbound email to mitigate a threat posed by the outbound email and its attachments and/or links.

18. The method of claim 11 , further comprising:

configuring the endpoint agent extension and a cyber security appliance on a network to track and maintain a dynamic profile modeled for each email user in a domain who compose emails, which is 1) derived from a pattern-of-life for i) a corresponding email user in the email domain, ii) an organization that the individual user of the email domain is a part of, and iii) smaller clustered peer groups who have close associations with a given user on a per user basis, as well as 2) factor in network metrics with email domain metrics to make a decision that the behavior is deviating from the pattern-of-life for the email under analysis and any of its files attached or linked.

19. The method of claim 11 , further comprising:

tracking and maintaining a dynamic profile modeled in a user model for each email user in the domain who compose emails, as well as cooperate with a model of email and network activities of each peer group in an organization as well as a model of an organization's email activity in general, where the inputs from all three of these different modeled insights is factored into the dynamic profile when making a decision whether the outbound email by the user is unusual and triggers a further analysis.

20. A non-transitory computer readable medium containing instructions, which when executed by a computing machine to cause said computing machine to perform the method of claim 11 .

Assignments (6)
SECURITY INTEREST Recorded Apr 7, 2025
From: DARKTRACE HOLDINGS LIMITED
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 070762/0576 →
SECURITY INTEREST Recorded Apr 7, 2025
From: DARKTRACE HOLDINGS LIMITED
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 070762/0592 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Dec 1, 2023
From: HSBC INNOVATION BANK LIMITED
To: DARKTRACE HOLDINGS LIMITED
Reel/Frame 065741/0608 →
CHANGE OF NAME Recorded Nov 3, 2021
From: DARKTRACE LIMITED
To: DARKTRACE HOLDINGS LIMITED
Reel/Frame 058011/0718 →
SECURITY INTEREST Recorded Jan 22, 2021
From: DARKTRACE LIMITED
To: SILICON VALLEY BANK
Reel/Frame 054996/0561 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2020
From: PICKMAN, STEPHEN; DUNN, MATTHEW
To: DARKTRACE LIMITED
Reel/Frame 053614/0758 →
Continuity (4)
Continuation In Part 16278932 · Feb 19, 2019
Provisional Application 62893350 · Aug 29, 2019
Provisional Application 62632623 · Feb 20, 2018
Related Publication 20200396190A1 · Dec 17, 2020