IP Library › Granted Patent US 11,495,086
Granted Patent B2
US 11,495,086 · App. 15/603,278 · Granted Nov 8, 2022

Detecting cheating in games with machine learning

Inventors: Yifeng Liu (Seattle, WA); Cierra D. McDonald (Seattle, WA); Timothy Arthur Gill (Kenmore, WA); Mark Allen Findlay (Issaquah, WA)
Assignee: Microsoft Technology Licensing, LLC
G07F17/3241G07F17/3239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,495,086
App. No.
15/603,278
Granted
Nov 8, 2022
Kind
B2
Abstract

Examples are disclosed that relate to detecting cheating at a game platform level using machine learning techniques. One example provides a computing system comprising a logic subsystem and a data-holding subsystem. The data-holding subsystem comprises instructions executable by the logic subsystem to receive notifications related to user progress in a game provided by the game to the online game platform, apply a classifying function to classify the user progress in the game as normal or outlying based upon the notifications, if the progress is classified as outlying then taking an action in response to the outlying classification, and if the progress is not classified as outlying then not taking the action.

Claims (28)

1. A computing system, comprising:

a logic subsystem including a logic device; and

a storage subsystem comprising a storage device, the storage subsystem comprising instructions executable by the logic subsystem to

implement an online game platform hosting a plurality of games, each game of the plurality of games configured to send notifications to the game platform;

implement a cheating detection module configured to, for a game available on the online game platform, classify user instance records for the game as normal or outlying via a trained machine-learning classification function, each user instance record comprising information provided by the game to the online game platform regarding achievements earned by a user of the game, and for each achievement a total game time it took the user to earn the achievement, wherein user instance records classified as outlying represent possible cheating behavior;

for the game available on the online game platform, receive for each player of a plurality of players information from the game regarding notifications related to user progress in the game, the notifications provided by the game to the online game platform for each user of a plurality of users;

for each user of the plurality of users,

store an instance record for the user, the instance record for the user comprising information regarding achievements earned by the user in the game and a total game play time it took the user to earn each achievement earned by the user in the game,

input the instance record for the user into the trained machine- learning classifying function to classify the instance record for the user as normal or as outlying,

based at least in part on the instance record for the user being classified as outlying, then take an action based upon classification as outlying, and

based at least in part on the instance record for the user not being classified as outlying, then not take the action,

wherein the instructions are further executable to update the instance record for each user periodically to form an updated instance record.

2. The computing system of claim 1 , wherein the instructions are further executable to apply the trained machine-learning classifying function to the updated instance record for each user.

3. On a computing system implementing an online game platform hosting a plurality of games, each game of the plurality of games configured to send notifications to the online game platform, the online game platform comprising a rewards system and a cheating detection module configured to, for a game available on the online game platform, classify user instance records for the game as normal or outlying via a trained machine-learning classification function, each user instance record comprising information provided by the game to the online game platform regarding achievements earned by a user of the game, and for each achievement a total game time it took the user to earn the achievement, wherein user instance records classified as outlying represent possible cheating behavior, a method comprising:

for each user of a plurality of users, receiving information comprising one or more notifications provided by the game of the plurality of games to the online game platform related to user progress in the game;

for each user of the plurality of users, storing the information from the game in the instance record for the user, the instance record for the user comprising information regarding achievements earned by the user in the game and a total game play time it took the user to earn each achievement earned by the user in the game;

inputting the instance record into the trained machine-learning classifying function to classify the instance record as normal or as outlying;

based at least in part on the instance record in the game being classified as outlying, then taking an action based upon classification as outlying; and

based at least in part on the instance record in the game not being classified as outlying, then not taking the action,

wherein receiving information comprising one or more notifications comprises receiving information comprising one or more notifications based upon one or more of achievements met in the game and points scored in the game.

4. A computing system, comprising:

a logic subsystem; and

a data-holding subsystem comprising computer-readable instructions to

implement an online game platform hosting a plurality of games each configured to send notifications to the game platform,

implement a cheating detection module configured to, for a game available on the online game platform, classify user instance records for the game as normal or outlying via a classification function trained by machine learning, each user instance record comprising information provided by the game to the online game platform regarding achievements earned by a user of the game, and for each achievement a total game time it took the user to earn the achievement, wherein user instance records classified as outlying represent possible cheating behavior,

for a selected game available in the online game platform, receive a training dataset comprising a plurality of labeled instance records each representing notifications provided by the game to the online game platform associated with user progress in the game, the labeled instance records comprising a subset of instance records labeled as outlying, each labeled instance record comprising information regarding achievements earned by a user in the game and a total game play time it took the user to earn each achievement earned by the user in the game, and

based upon the training dataset, train the classifying function of the cheating detection module to classify instance records as normal or outlying,

wherein the instructions are further executable to apply the classifying function during game play after training the classifying function.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2017
From: LIU, YIFENG; MCDONALD, CIERRA D.; GILL, TIMOTHY ARTHUR; FINDLAY, MARK ALLEN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 042483/0870 →
Continuity (2)
Provisional Application 62439775 · Dec 28, 2016
Related Publication 20180182208A1 · Jun 28, 2018