IP Library Granted Patent US 11,295,234
Granted Patent B2
US 11,295,234 · App. 15/854,167 · Granted Apr 5, 2022

Methods and systems for training a machine learning system using a reduced data set

Inventors: Sankar Ardhanari (Windham, NH); Sai Rahul Reddy Pulikunta (North Andover, MA); Sashikumar Venkataraman (Andover, MA); Abubakkar Siddiq (Methuen, MA); Ganesh Ramamoorthy (Andover, MA)
Assignee: Rovi Guides, Inc.
G06N20/00G06F40/205G06K9/6253G06K9/6256G06K9/6267H04N21/482H04N21/84H04N21/4826
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,295,234
App. No.
15/854,167
Granted
Apr 5, 2022
Kind
B2
Abstract

Methods and systems are disclosed herein for accurately training a machine learning model with a reduced training data set. A large number of data records may be parsed. Each record may be reduced to a set of symbols representing the composition of each record. A user may assign a classification to each symbol within each record. Records with identical arrangements and classifications of symbols may be grouped together, and a representative sample of data records from each group may be fed into the model as the reduced training data set.

Claims (100)

1. A method for training a model using a reduced dataset, the method comprising:

receiving a first data record comprising a first sequence of characters;

detecting a first plurality of subsets of the first sequence of characters;

associating a first subset of the first plurality of subsets with a first symbol, wherein the first subset of the first plurality of subsets corresponds to a first type of character;

associating a second subset of the first plurality of subsets with a second symbol, wherein the second subset of the first plurality of subsets corresponds to a second type of character;

determining a first arrangement of the first and second symbols based on an arrangement of the first and second subsets of the first plurality of subsets within the first sequence of characters;

receiving, from a user input device, user input specifying a first classification for the first symbol and a second classification for the second symbol;

adding the first data record to a first group of records;

receiving a second data record comprising a second sequence of characters;

detecting a second plurality of subsets of the second sequence of characters;

associating a first subset of the second plurality of subsets with a third symbol, wherein the first subset of the second plurality of subsets corresponds to a third type of character;

associating a second subset of the second plurality of subsets with a fourth symbol, wherein the second subset of the second plurality of subsets corresponds to a fourth type of character;

determining a second arrangement of the third and fourth symbols based on an arrangement of the first and second subsets of the second plurality of subsets within the second sequence of characters;

receiving, from the user input device, user input specifying a third classification for the third symbol and a fourth classification for the fourth symbol;

determining whether the first arrangement and second arrangement are identical;

in response to determining that the first arrangement and the second arrangement are identical, adding the second data record to the first group of records;

in response to determining that the first arrangement and the second arrangement are not identical, adding the second data record to a second group of records;

feeding the first and second data records to the model as the reduced dataset; and

training the model with both the reduced dataset and the user specified first, second, third and fourth classifications.

2. The method of claim 1 , wherein feeding the first and second data records further comprises inputting data records from the first group of records and the second group of records in proportion to a first number of data records in the first group of records relative to a second number of data records in the second group of records.

3. The method of claim 1 , wherein the first arrangement of the first and second symbols is a summarized representation of the first data record, and the second arrangement of the third and fourth symbols is a summarized representation of the second data record.

4. The method of claim 1 , further comprising:

receiving the first data record and the second data record from a data source; and

wherein training the model with both the reduced dataset and the user specified first, second, third and fourth classifications further comprises training the model solely using data records from the data source.

5. The method of claim 1 , further comprising:

generating for display the first classification for the first symbol concurrently with the first subset of the first plurality of subsets in the first data record to a second user to verify classification; and

receiving a further user input from the second user specifying a fifth classification for the first symbol, the fifth classification differing from the first classification.

6. The method of claim 1 , further comprising:

extracting first textual information and first visual clues from the first data record;

translating the first visual clues to a first descriptive vector associated with the first data record;

processing the first textual information of the first data record to associate the first subset of the first plurality of subsets with the first symbol and the second subset of the first plurality of subsets with the second symbol;

extracting second textual information and second visual clues from the second data record;

translating the second visual clues to a second descriptive vector associated with the second data record;

processing the second textual information of the second data record to associate the first subset of the second plurality of subsets with the third symbol and the second subset of the second plurality of subsets with the fourth symbol; and

wherein training the model further comprises training the model with both the reduced dataset and the first and second descriptive vectors.

7. The method of claim 6 , wherein the first and second visual clues comprise text color, bold font, italics, indentations, spacing, graphics, icons, and glyphs.

8. The method of claim 6 , wherein only one descriptive vector is translated from the visual clues for each of the first and second groups.

9. The method of claim 1 , wherein the first, second, third, and fourth types of characters are alphanumeric symbols, numbers, punctuations, scientific operators, non-Latin scripts, and Unicode symbols.

10. The method of claim 1 , wherein:

the first sequence of characters comprises alphanumeric characters;

the first subset of the first plurality of subsets comprises alphabetic characters only;

the first symbol comprises a symbol representing an alphabetic character string;

the first type of character comprises alphabetic characters;

the second subset of the first plurality of subsets comprises numeric characters only;

the second symbol comprises a symbol representing a numeric character string;

the second type of character comprises numeric characters;

the first arrangement of the first and second symbols is a summarized representation of the first data record;

the first classification is a media asset title;

the second classification is a media asset release year; and

the second arrangement is a summarized representation of the second data record, and is different from the first arrangement.

11. A system for training a model using a reduced dataset comprising computer-readable memory, a user input device, and control circuitry configured to:

receive a first data record comprising a first sequence of characters;

detect a first plurality of subsets of the first sequence of characters;

associate a first subset of the first plurality of subsets with a first symbol, wherein the first subset of the first plurality of subsets corresponds to a first type of character;

associate a second subset of the first plurality of subsets with a second symbol, wherein the second subset of the first plurality of subsets corresponds to a second type of character;

determine a first arrangement of the first and second symbols based on an arrangement of the first and second subsets of the first plurality of subsets within the first sequence of characters;

receive, from the user input device, user input specifying a first classification for the first symbol and a second classification for the second symbol;

add the first data record to a first group of records;

receive a second data record comprising a second sequence of characters;

detect a second plurality of subsets of the second sequence of characters;

associate a first subset of the second plurality of subsets with a third symbol, wherein the first subset of the second plurality of subsets corresponds to a third type of character;

associate a second subset of the second plurality of subsets with a fourth symbol, wherein the second subset of the second plurality of subsets corresponds to a fourth type of character;

determine a second arrangement of the third and fourth symbols based on an arrangement of the first and second subsets of the second plurality of subsets within the second sequence of characters;

receive, from the user input device, user input specifying a third classification for the third symbol and a fourth classification for the fourth symbol;

determine whether the first arrangement and the second arrangement are identical;

in response to determining that the first arrangement and the second arrangement are identical, add the second data record to the first group of records;

in response to determining that the first arrangement and the second arrangement are not identical, add the second data record to a second group of records;

feed the first and second data records to the model as the reduced dataset; and

train the model with both the reduced dataset and the user specified first, second, third, and fourth classifications.

12. The system of claim 11 , wherein control circuitry configured to feed the first, second, and third data records is further configured to input data records from the first group and the second group in proportion to a first number of data records in the first group relative to a second number of data records in the second group.

13. The system of claim 11 , wherein the first arrangement of the first and second symbols is a summarized representation of the first data record, and the second arrangement of the third and fourth symbols is a summarized representation of the second data record.

14. The system of claim 11 , wherein the control circuitry is further configured to

receive the first data record and the third data record from a data source; and

train the model with both the reduced dataset and the user specified first, second, third, and fourth classifications solely using data records from the data source.

15. The system of claim 11 , wherein the control circuitry is further configured to:

generate for display the first classification for the first symbol concurrently with the first subset of the first plurality of subsets in the first data record to a second user to verify classification; and

receive a further user input from the second user specifying a fifth classification for the first symbol, the fifth classification differing from the first classification.

16. The system of claim 11 , wherein the control circuitry is further configured to:

extract first textual information and first visual clues from the first data record;

translate the first visual clues to a first descriptive vector associated with the first data record;

process the first textual information of the first data record to associate the first subset of the first plurality of subsets with the first symbol and the second subset of the first plurality of subsets with the second symbol;

extract second textual information and second visual clues from the second data record;

translate the second visual clues to a second descriptive vector associated with the second data record;

process the second textual information of the second data record to associate the first subset of the second plurality of subsets with the third symbol and the second subset of the second plurality of subsets with the fourth symbol; and

wherein training the model further comprises training the model with both the reduced dataset and the first and second descriptive vectors.

17. The system of claim 16 , wherein the first and second visual clues comprise text color, bold font, italics, indentations, spacing, graphics, icons, and glyphs.

18. The system of claim 16 , wherein only one descriptive vector is translated from the visual clues for each of the first and second groups.

19. The system of claim 11 , wherein the first, second, third, and fourth types of characters are alphanumeric symbols, numbers, punctuations, scientific operators, non-Latin scripts, and Unicode symbols.

20. The system of claim 11 , wherein:

the first sequence of characters comprises alphanumeric characters;

the first subset of the first plurality of subset comprises alphabetic characters only;

the first symbol comprises a symbol representing an alphabetic character string;

the first type of character comprises alphabetic characters;

the second subset of the first plurality of subsets comprises numeric characters only;

the second symbol comprises a symbol representing a numeric character string;

the second type of character comprises numeric characters;

the first arrangement of the first and second symbols is a summarized representation of the first data record;

the first classification is a media asset title;

the second classification is a media asset release year; and

the second arrangement is a summarized representation of the second data record, and is different from the first arrangement.

Assignments (9)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: ROVI PRODUCT CORPORATION (AS SUCCESSOR-IN-INTEREST TO ROVI GUIDES, INC.)
Reel/Frame 061786/0768 →
CHANGE OF NAME Recorded Oct 23, 2022
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 061746/0981 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2022
From: ADEIA GUIDES INC.
To: ROVI PRODUCT CORPORATION
Reel/Frame 061747/0001 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2017
From: ARDHANARI, SANKAR; PULIKUNTA, SAI RAHUL REDDY; VENKATARAMAN, SASHIKUMAR; SIDDIQ, ABUBAKKAR; RAMAMOORTHY, GANESH
To: ROVI GUIDES, INC.
Reel/Frame 044484/0657 →
Cited By (1)
US 12,493,825