IP Library Granted Patent US 9,576,014
Granted Patent B2
US 9,576,014 · App. 14/819,341 · Granted Feb 21, 2017

Computer readable electronic records automated classification system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,576,014
App. No.
14/819,341
Granted
Feb 21, 2017
Kind
B2
Abstract

Classifying an electronic document in a computer-based system is disclosed. For each classification instance in a plurality of classification instances, a confidence data indicating a degree of confidence that the electronic document is associated with that classification instance is determined. A classification, based on a first classification instance in the plurality of classification instances, is assigned without human intervention to the electronic document if the confidence data associated with the first classification instance exceeds a first threshold.

Claims (21)

1. A method for classifying an electronic document in a computer-based system, comprising:

generating, by one or more processors, a set of confidence data comprising for each of one or more classification instances a corresponding determined confidence data, wherein a confidence data indicates a degree of confidence that the electronic document is associated with a corresponding classification instance;

in the event at least one of the confidence data in the set exceeds a first predetermined threshold, assigning, by one or more processors, a classification to the electronic document without user input;

in the event none of the confidence data in the set exceeds the first predetermined threshold and that at least one of the confidence data in the set exceeds a second predetermined threshold that is lower than the first predetermined threshold, receiving via a user interface a user input indicating a selection of a classification comprising the set and determining, by one or more processors, based at least in part on the user input, that a user-selected classification should be assigned to the electronic document; and

assigning a review classification to the electronic document to indicate that the electronic document is required to be reviewed by a user if no classification instance a plurality of classification instances is associated with the confidence data that exceeds the first predetermined threshold and fewer than a prescribed number of classification instance(s) in the plurality of classification instances has the confidence data that exceeds the second predetermined threshold.

2. The method recited in claim 1 , wherein determining the confidence data includes using information obtained by analyzing at least one training document associated with a pre-assigned classification.

3. The method of claim 1 , further comprising in response to receiving the user input indicating the selection of the classification, assigning the classification to the electronic document based at least in part on the user input.

4. A system for classifying an electronic document, comprising:

a processor; and

a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:

generate a set of confidence data comprising for each of one or more classification instances a corresponding determined confidence data, wherein a confidence data indicates a degree of confidence that the electronic document is associated with a corresponding classification instance;

in the event at least one of the confidence data in the set exceeds a first predetermined threshold, assign a classification to the electronic document without user input;

in the event none of the confidence data in the set exceeds the first predetermined threshold and that at least one of the confidence data in the set exceeds a second predetermined threshold that is lower than the first predetermined threshold, receive via a user interface a user input indicating a selection of a classification comprising the set and determining, based at least in part on the user input, that a user-selected classification should be assigned to the electronic document; and

assigning a review classification to the electronic document to indicate that the electronic document is required to be reviewed by a user if no classification instance a plurality of classification instances is associated with the confidence data that exceeds the first predetermined threshold and fewer than a prescribed number of classification instance(s) in the plurality of classification instances has the confidence data that exceeds the second predetermined threshold.

5. The system recited in claim 4 , wherein determining the confidence data includes using information obtained by analyzing at least one training document associated with a pre-assigned classification.

6. A computer program product for classifying an electronic document, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

generating a set of confidence data comprising for each of one or more classification instances a corresponding determined confidence data, wherein a confidence data indicates a degree of confidence that the electronic document is associated with a corresponding classification instance;

in the event at least one of the confidence data in the set exceeds a first predetermined threshold, assigning a classification to the electronic document without user input; and

in the event none of the confidence data in the set exceeds the first predetermined threshold and that at least one of the confidence data in the set exceeds a second predetermined threshold that is lower than the first predetermined threshold, receiving via a user interface a user input indicating a selection of a classification comprising the set and determining, based at least in part on the user input, that a user-selected classification should be assigned to the electronic document; and

assigning a review classification to the electronic document to indicate that the electronic document is required to be reviewed by a user if no classification instance a plurality of classification instances is associated with the confidence data that exceeds the first predetermined threshold and fewer than a prescribed number of classification instance(s) in the plurality of classification instances has the confidence data that exceeds the second predetermined threshold.

7. The computer program product recited in claim 6 , wherein determining the confidence data includes using information obtained by analyzing at least one training document associated with a pre-assigned classification.

Assignments (13)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: EMC CORPORATION
To: OPEN TEXT CORPORATION
Reel/Frame 041141/0218 →
RELEASE OF SECURITY INTEREST Recorded Jan 23, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC CORPORATION
Reel/Frame 041073/0443 →
PATENT RELEASE (REEL:40134/FRAME:0001) Recorded Jan 23, 2017
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: EMC CORPORATION, AS GRANTOR
Reel/Frame 041073/0136 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
MERGER AND CHANGE OF NAME Recorded Sep 9, 2016
From: DOCUMENTUM RECORDS MANAGEMENT INC.; DOCUMENTUM CANADA COMPANY
To: DOCUMENTUM CANADA COMPANY
Reel/Frame 039981/0229 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2016
From: EMC CORPORATION OF CANADA
To: EMC CORPORATION
Reel/Frame 039689/0958 →
MERGER Recorded Sep 9, 2016
From: DOCUMENTUM CANADA COMPANY
To: EMC CORPORATION OF CANADA
Reel/Frame 039689/0928 →
MERGER Recorded Aug 5, 2015
From: DOCUMENTUM, INC.
To: EMC CORPORATION
Reel/Frame 036262/0937 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2015
From: SUMMERLIN, THOMAS A.; SHINKLE, TIMOTHY; STALTERS, RUSSELL E.
To: PROVENANCE SYSTEMS INC.
Reel/Frame 036262/0927 →
MERGER Recorded Aug 5, 2015
From: TRUEARC CORPORATION
To: DOCUMENTUM RECORDS MANAGEMENT INC.
Reel/Frame 036284/0035 →
CHANGE OF NAME Recorded Aug 5, 2015
From: PROVENANCE SYSTEMS INC.
To: TRUEARC CORPORATION
Reel/Frame 036284/0031 →