SYSTEMS AND METHODS TO IDENTIFY ILLEGITIMATE ONLINE ACCOUNTS
Systems, methods, and non-transitory computer readable media are configured to determine feature metrics associated with a value of a feature relating to a set of accounts. A combined score associated with the value of the feature can be generated based on a Pythagorean expectation formula and the feature metrics. At least one rule can be applied to redress illegitimate accounts from the set of accounts based on at least the combined score.
1 . A computer-implemented method comprising:
determining, by a computing system, feature metrics associated with a value of a feature relating to a set of accounts;
generating, by the computing system, a combined score associated with the value of the feature based on a Pythagorean expectation formula and the feature metrics; and
applying, by the computing system, at least one rule to redress illegitimate accounts from the set of accounts based on at least the combined score.
2 . The computer-implemented method of claim 1 , wherein the generating a combined score comprises:
generating a first score based on a Pythagorean expectation formula applied to a first set of feature metrics.
3 . The computer-implemented method of claim 2 , wherein the first set of feature metrics comprises a number of disabled accounts and a number of active accounts.
4 . The computer-implemented method of claim 3 , wherein the generating a combined score further comprises:
generating a second score based on a Pythagorean expectation formula applied to a second set of feature metrics.
5 . The computer-implemented method of claim 4 , wherein the second set of feature metrics comprises a number of manually disabled accounts and a number of disabled accounts that were not manually disabled.
6 . The computer-implemented method of claim 5 , wherein the generating a combined score further comprises:
averaging the first score and the second score to generate the combined score.
7 . The computer-implemented method of claim 1 , wherein the applying at least one rule comprises:
selecting criteria relating to at least one of a precision metric rate, a recall rate, and a false positive rate of a model that generates model scores for accounts relating to a probability of illegitimacy; and
determining a threshold value based on a model score that satisfies the selected criteria.
8 . The computer-implemented method of claim 7 , wherein the at least one rule is further based on the threshold value.
9 . The computer-implemented method of claim 8 , wherein the applying at least one rule further comprises:
disabling an account associated with the value of the feature when the combined score satisfies the threshold value.
10 . The computer-implemented method of claim 8 , wherein the applying at least one rule further comprises:
not disabling an account associated with the value of the feature when the combined score does not satisfy the threshold value.
11 . A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform:
determining feature metrics associated with a value of a feature relating to a set of accounts;
generating a combined score associated with the value of the feature based on a Pythagorean expectation formula and the feature metrics; and
applying at least one rule to redress illegitimate accounts from the set of accounts based on at least the combined score.
12 . The system of claim 11 , wherein the generating a combined score comprises:
generating a first score based on a Pythagorean expectation formula applied to a first set of feature metrics.
13 . The system of claim 12 , wherein the first set of feature metrics comprises a number of disabled accounts and a number of active accounts.
14 . The system of claim 13 , wherein the generating a combined score further comprises:
generating a second score based on a Pythagorean expectation formula applied to a second set of feature metrics.
15 . The system of claim 14 , wherein the second set of feature metrics comprises a number of manually disabled accounts and a number of disabled accounts that were not manually disabled.
16 . A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:
determining feature metrics associated with a value of a feature relating to a set of accounts;
generating a combined score associated with the value of the feature based on a Pythagorean expectation formula and the feature metrics; and
applying at least one rule to redress illegitimate accounts from the set of accounts based on at least the combined score.
17 . The non-transitory computer-readable storage medium of claim 16 , wherein the generating a combined score comprises:
generating a first score based on a Pythagorean expectation formula applied to a first set of feature metrics.
18 . The non-transitory computer-readable storage medium of claim 17 , wherein the first set of feature metrics comprises a number of disabled accounts and a number of active accounts.
19 . The non-transitory computer-readable storage medium of claim 18 , wherein the generating a combined score further comprises:
generating a second score based on a Pythagorean expectation formula applied to a second set of feature metrics.
20 . The non-transitory computer-readable storage medium of claim 19 , wherein the second set of feature metrics comprises a number of manually disabled accounts and a number of disabled accounts that were not manually disabled.