IP Library Granted Patent US 10,713,965
Granted Patent B2
US 10,713,965 · App. 15/856,192 · Granted Jul 14, 2020

Negative learning behavior alert system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,713,965
App. No.
15/856,192
Granted
Jul 14, 2020
Kind
B2
Abstract

A method and system for detecting negative learning behaviors associated with a student system in an education program environment. Activity information is collected that corresponds to the performance of learning events of the education program. Based on the activity information, a student profile corresponding to the student is generated. One or more features are extracted from the student profile and used by a machine learning model to classify the student profile as a negative learning indicator associated with the student. An alarm notification is generated that correspond to the negative learning behavior indicator.

Claims (46)

1. A method comprising:

providing, by a processing device of an education system, an education program to a plurality of user systems;

collecting activity information corresponding to performance by the plurality of user systems of learning events of the education program;

extracting a set of features from the activity information, wherein the set of features comprise a time-based measurement associated with the education program;

applying a machine learning model to the set of features to generate a labeled data set associated with a negative learning indicator;

generating, based on the activity information, a student profile corresponding to a first user system;

extracting a first set of features from the student profile corresponding to the first user system;

comparing the first set of features to the labeled data set to generate comparison data;

classifying, using the comparison data, the first set of features of the student profile as the negative learning indicator; and

generating an alarm notification corresponding to the negative learning behavior indicator associated with the student profile.

2. The method of claim 1 , further comprising causing a display of the alarm notification to an administrator system.

3. The method of claim 2 , further comprising receiving alert feedback from the administrator system, wherein the alert feedback indicates an assessment of the negative learning behavior indicator as it relates to the student profile.

4. The method of claim 3 , wherein the machine learning model is updated based on the alert feedback received from the administrator system.

5. The method of claim 1 , wherein the negative learning indicator comprises one of a stalling progress indicator, a procrastination indicator, or an unexpected progress indicator.

6. The method of claim 1 , wherein the learning events comprise at least one of a discrete learning event or a login-time learning event.

7. A system comprising:

a processing device; and

a memory operatively coupled to the processing device, the memory to store computer-executable instructions that, if executed, cause the processing device to:

provide, by an education system, an education program to a plurality of user systems,

collect activity information corresponding to performance by the plurality of user systems of learning events of the education program;

extract a set of features from the activity information, wherein the set of features comprise a time-based measurement associated with the education program;

apply a machine learning model to the set of features to generate a labeled data set associated with a negative learning indicator;

generate, based on the activity information, a student profile corresponding to a first user system;

extract a first set of features from the student profile corresponding to the first user system;

compare the first set of features to the labeled data set to generate comparison data;

classify, using the comparison data, the first set of features of the student profile as the negative learning indicator; and

generate an alarm notification corresponding to the negative learning behavior indicator associated with the student profile.

8. The system of claim 7 , the processing device to cause a display of the alarm notification to an administrator system.

9. The system of claim 8 , the processing device to receive alert feedback from the administrator system, wherein the alert feedback indicates an assessment of the negative learning behavior indicator as it relates to the student profile.

10. The system of claim 9 , wherein the first machine learning model is updated based on the alert feedback received from the administrator system.

11. The system of claim 7 , wherein the negative learning indicator comprises one of a stalling progress indicator, a procrastination indicator, or an unexpected progress indicator.

12. The system of claim 7 , wherein the learning events comprise at least one of a discrete learning event or a login-time learning event.

13. A non-transitory computer-readable storage device storing computer-executable instructions that, if executed by a processing device, cause the processing device to:

provide, by an education system, an education program to a plurality of user systems;

collect activity information corresponding to performance by the plurality of user systems of learning events of the education program;

extract a set of features from the activity information, wherein the set of features comprise a time-based measurement associated with the education program;

apply a machine learning model to the set of features to generate a labeled data set associated with a negative learning indicator;

generate, based on the activity information, a student profile corresponding to a first user system;

extract a first set of features from the student profile corresponding to the first user system;

compare the first set of features to the labeled data set to generate comparison data;

classify, using the comparison data, the first set of features of the student profile as the negative learning indicator; and

generate an alarm notification corresponding to the negative learning behavior indicator associated with the student profile.

14. The non-transitory computer-readable storage device of claim 13 , the processing device to cause a display of the alarm notification to an administrator system.

15. The non-transitory computer-readable storage device of claim 14 , the processing device to receive alert feedback from the administrator system, wherein the alert feedback indicates an assessment of the negative learning behavior indicator as it relates to the student profile.

16. The non-transitory computer-readable storage device of claim 15 , wherein the machine learning model is updated based on the alert feedback received from the administrator system.

17. The non-transitory computer-readable storage device of claim 13 , wherein the negative learning indicator comprises one of a stalling progress indicator, a procrastination indicator, or an unexpected progress indicator.

Assignments (12)
SECURITY INTEREST (NOTES) Recorded Aug 9, 2024
From: ACHIEVE3000, INC.; ACTIVELY LEARN INC.; MCGRAW HILL LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 068522/0031 →
RELEASE OF PATENT SECURITY AGREEMENT (FIRST LIEN) Recorded Aug 23, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS AGENT
To: MCGRAW HILL LLC
Reel/Frame 057263/0664 →
RELEASE OF SECURITY INTEREST Recorded Aug 3, 2021
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: MCGRAW HILL LLC
Reel/Frame 057070/0283 →
SECURITY AGREEMENT Recorded Jul 30, 2021
From: MCGRAW HILL LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057041/0925 →
ABL SECURITY AGREEMENT Recorded Jul 30, 2021
From: MCGRAW HILL LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057041/0934 →
NOTES SECURITY AGREEMENT Recorded Jul 30, 2021
From: MCGRAW HILL LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 057041/0977 →
SECURITY INTEREST Recorded Jan 22, 2021
From: MCGRAW HILL LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 055000/0643 →
MERGER Recorded Feb 7, 2020
From: MCGRAW-HILL GLOBAL EDUCATION HOLDINGS, LLC
To: MCGRAW HILL LLC
Reel/Frame 051754/0873 →
CHANGE OF ASSIGNEE ADDRESS Recorded Jan 28, 2020
From: MCGRAW HILL LLC
To: MCGRAW HILL LLC
Reel/Frame 051723/0187 →
MERGER AND CHANGE OF NAME Recorded Jan 22, 2020
From: MCGRAW-HILL GLOBAL EDUCATION HOLDINGS, LLC; MCGRAW-HILL SCHOOL EDUCATION LLC
To: MCGRAW HILL LLC
Reel/Frame 051586/0647 →
SECURITY INTEREST Recorded Jan 2, 2020
From: MCGRAW HILL LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 051402/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2018
From: COSYN, ERIC EMILE; MATAYOSHI, JEFFREY SEIICHI
To: MCGRAW-HILL GLOBAL EDUCATION HOLDINGS, LLC
Reel/Frame 044584/0896 →