Feature-agnostic behavior profile based anomaly detection
Techniques for user behavior anomaly detection. At least one low-variance characteristic is compared to an expected result for the corresponding low-variance characteristics to determine if the low-variance characteristic(s) is/are within a pre-selected range of the expected results. A security response action is taken in response to the low-variance characteristic not being within the first pre-selected range of the expected results. At least one high-variance characteristic is compared to an expected result for the corresponding high-variance characteristics to determine if the high-variance characteristic(s) is/are within a pre-selected range of the expected results. A security response action is taken in response to the high-variance characteristic not being within the first pre-selected range of the expected results. Access is provided if the low-variance and the high-variance characteristics are within the respective expected ranges.
1. A method comprising:
receiving, with one or more hardware processors, application log data for a cloud-based software service that provides access for at least two organizations having different corresponding users, wherein the software service comprises at least a user application executing in a software operating system;
analyzing, with the one or more hardware processors, the application log data to extract interaction characteristics corresponding to an entity in an organization, wherein the entity is either a resource or a user;
grouping the extracted interaction characteristics into a first set of baseline low-variance interaction characteristics with one or more hardware processors;
training one or more statistical models with the one or more hardware processors utilizing the first set of baseline low-variance interaction characteristics and the second set of other interaction characteristics to evaluate in-app behavior of a first entity corresponding to the organization;
providing a baseline behavior profile for the first entity based on the one or more statistical models from the first set of baseline low-variance interaction characteristics, wherein the baseline behavior profile comprises a user baseline behavior median (BBM), a user behavior variance median absolute deviation (MAD), and a user abnormal behavior median of abnormality (MoA); and
generating an anomaly score based on the baseline behavior profile, the second set of other interaction characteristics and interaction characteristics with the software service by a second entity corresponding to the organization with one or more hardware processors.
2. The method of claim 1 wherein the BBM, the MAD and the MoA provide a distribution of historical behavior for the entity and a relative deviation is calculated to determine the anomaly score.
3. The method of claim 1 wherein the baseline low-variance interaction characteristics comprise a lowest M dimensions that represent no more than a pre selected percentage of total variance.
4. The method of claim 1 wherein the second set of other interaction characteristics comprise a top N dimensions that represent pre-selected percentage of total variance.
5. The method of claim 1 wherein the cloud-based software service comprises at least a multitenant database environment in which the multitenant database environment provides each of multiple organizations with a dedicated share of a software instance including one or more of organization-specific data, user management, organization-specific functionality, configuration, customizations, non-functional properties and associated applications.
6. A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, are configurable to cause the one or more processors to:
receive application log data for a cloud-based software service that provides access for at least two organizations having different corresponding users, wherein the software service comprises at least a user application executing in a software operating system;
analyze the application log data to extract interaction characteristics corresponding to an entity in an organization, wherein the entity is either a resource or a user;
group the extracted interaction characteristics into a first set of baseline low-variance interaction characteristics and a second set of other interaction characteristics;
train one or more statistical models utilizing the first set of baseline low-variance interaction characteristics and the second set of other interaction characteristics to evaluate in app behavior of a first entity corresponding to the organization;
generate an anomaly score based on the baseline behavior profile, the second set of other interaction characteristics and interaction characteristics with the software service by a second entity corresponding to the organization, wherein the baseline behavior profile comprises a user baseline behavior median (BBM), a user behavior variance median absolute deviation (MAD), and a user abnormal behavior median of abnormality (MoA).
7. The non-transitory computer-readable medium of claim 6 wherein the BBM, the MAD and the MoA provide a distribution of historical behavior for the entity and a relative deviation is calculated to determine the anomaly score.
8. The non-transitory computer-readable medium of claim 6 wherein the baseline low-variance interaction characteristics comprise a lowest M dimensions that represent no more than a pre-selected percentage of total variance.
9. The non-transitory computer-readable medium of claim 6 wherein the second set of other interaction characteristics comprise a top N dimensions that represent pre-selected percentage of total variance.
10. The non-transitory computer-readable medium of claim 6 wherein the cloud-based software service comprises at least a multitenant database environment in which the multitenant database environment provides each of multiple organizations with a dedicated share of a software instance including one or more of organization-specific data, user management, organization-specific functionality, configuration, customizations, non-functional properties and associated applications.
11. A system comprising:
a memory device;
one or more hardware processors coupled with the memory device, the one or more hardware processors configurable to receive application log data for a cloud-based software service that provides access for at least two organizations having different corresponding users, wherein the software service comprises at least a user application executing in a software operating system, to analyze the application log data to extract interaction characteristics corresponding to an entity in an organization, wherein the entity is either a resource or a user, to group the extracted interaction characteristics into a first set of baseline low-variance interaction characteristics and a second set of other interaction characteristics to train one or more statistical models utilizing the first set of baseline low-variance interaction characteristics and the second set of other interaction characteristics to evaluate in-app behavior of a first entity corresponding to the organization, and to generate an anomaly score based on the baseline behavior profile, the second set of other interaction characteristics and interaction characteristics with the software service by a second entity corresponding to the organization, wherein the baseline behavior profile comprises a user baseline behavior median (BBM), a user behavior variance median absolute deviation (MAD), and a user abnormal behavior median of abnormality (MoA).
12. The system of claim 11 wherein the BBM, the MAD and the MoA provide a distribution of historical behavior for the entity and a relative deviation is calculated to determine the anomaly score.
13. The system of claim 11 wherein the baseline low-variance interaction characteristics comprise a lowest M dimensions that represent no more than a pre selected percentage of total variance.
14. The system of claim 11 wherein the second set of other interaction characteristics comprise a top N dimensions that represent pre-selected percentage of total variance.
15. The system of claim 11 wherein the cloud-based software comprises at least a multitenant database environment in which the multitenant database environment provides each of multiple organizations with a dedicated share of a software instance including one or more of organization-specific data, user management, organization-specific functionality, configuration, customizations, non-functional properties and associated applications.