IP Library Granted Patent US 12,164,578
Granted Patent B2
US 12,164,578 · App. 18/306,400 · Granted Dec 10, 2024

Method, apparatus, and computer-readable medium for determining a data domain associated with data

Inventor: Igor Balabine (Menlo Park, CA)
Assignee: INFORMATICA LLC
G06F16/93G06F16/313G06F16/3347G06F40/205G06F40/211G06F40/216G06F40/284G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,164,578
App. No.
18/306,400
Granted
Dec 10, 2024
Kind
B2
Abstract

A system, method and computer-readable medium for determining a data domain associated with data, including parsing a document to generate one or more document indexes corresponding to the document, the one or more document indexes comprising a plurality of index terms and location information, determining a syntactic confidence score corresponding to a non-dictionary term in the plurality of index terms based on a syntactic analysis of the non-dictionary term, determining a proximity confidence score corresponding to the non-dictionary term based on the location information and at least one proximity query associated with the non-dictionary term and one or more other terms in the document index, determining a semantic confidence score based on a plurality of dictionary terms in the plurality of index terms, and determining an overall confidence score corresponding to the non-dictionary term based on the syntactic confidence score, the proximity confidence score, and the semantic confidence score.

Claims (65)

1. A method executed by one or more computing devices of a data domain classifier for classifying an unknown data object in an unstructured document, the method comprising:

parsing the unstructured document to generate one or more document indexes corresponding to the unstructured document, the one or more document indexes comprising a plurality of index terms and location information corresponding to locations of the plurality of index terms within the unstructured document;

determining a syntactic confidence score corresponding to an unknown data object in the plurality of index terms based at least in part on a syntactic analysis of the unknown data object, wherein the unknown data object comprises a term having an unknown data domain and wherein the syntactic confidence score indicates a confidence level associated with attributing a syntax of the unknown data object term to a data domain;

determining a proximity confidence score corresponding to the unknown data object based at least in part on the location information and at least one proximity query associated with the unknown data object and one or more other terms in the document index, the at least one proximity query being determined based at least in part on the syntax of the unknown data object, wherein the proximity confidence score indicates a confidence level associated with the at least one proximity query evaluating to true; and

classifying the unknown data object as an object in the data domain based at least in part on the syntactic confidence score and the proximity confidence score.

2. The method of claim 1 , wherein the data domain comprises a sensitive data domain, and further comprising:

applying one or more security protections to at least a portion of the unstructured document.

3. The method of claim 2 , wherein applying one or more security protections to at least a portion of the unstructured document comprises:

applying data masking to instances of the unknown data object within the unstructured document.

4. The method of claim 2 , wherein applying one or more security protections to at least a portion of the unstructured document comprises:

encrypting the unstructured document.

5. The method of claim 1 , wherein determining a syntactic confidence score corresponding to an unknown data object in the plurality of index terms based at least in part on a syntactic analysis of the unknown data object comprises:

identifying the syntax of the unknown data object based on one or more of: regular expression based pattern matching of the unknown data object, lookup of the unknown data object in a table of identified syntaxes, or probabilistic matching of the unknown data object to one of a plurality of syntaxes; and

determining the syntactic confidence score based at least in part on the identified syntax.

6. The method of claim 1 , wherein determining a proximity confidence score corresponding to the unknown data object based at least in part on the location information and at least one proximity query associated with the unknown data object and one or more other terms in the document index comprises:

identifying the at least one proximity query corresponding to the unknown data object based at least in part on the syntax of the unknown data object, the at least one proximity query indicating a query distance between a first query term corresponding to the unknown data object and at least one second query term corresponding to at least one of the one or more other terms;

determining an actual distance between the first query term and the at least one second query term based at least in part on the location information; and

determining the proximity confidence score based at least in part on the determined actual distance and the query distance.

7. The method of claim 1 , further comprising:

determining a semantic confidence score based at least in part on a plurality of dictionary terms in the plurality of index terms, wherein the semantic confidence score indicates a confidence level associated with attributing one or more topics associated with the unstructured document to the data domain;

wherein classifying the unknown data object as an object in the data domain further comprises classifying the unknown data object as an object in the data domain based at least in part on the syntactic confidence score, the proximity confidence score, and the semantic confidence score.

8. A data domain classifier apparatus for classifying an unknown data object in an unstructured document, the data domain classifier apparatus comprising:

one or more processors; and

one or more memories operatively coupled to at least one of the one or more processors and having instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:

parsing the unstructured document to generate one or more document indexes corresponding to the unstructured document, the one or more document indexes comprising a plurality of index terms and location information corresponding to locations of the plurality of index terms within the unstructured document;

determining a syntactic confidence score corresponding to an unknown data object in the plurality of index terms based at least in part on a syntactic analysis of the unknown data object, wherein the unknown data object comprises a term having an unknown data domain and wherein the syntactic confidence score indicates a confidence level associated with attributing a syntax of the unknown data object term to a data domain;

determining a proximity confidence score corresponding to the unknown data object based at least in part on the location information and at least one proximity query associated with the unknown data object and one or more other terms in the document index, the at least one proximity query being determined based at least in part on the syntax of the unknown data object, wherein the proximity confidence score indicates a confidence level associated with the at least one proximity query evaluating to true; and

classifying the unknown data object as an object in the data domain based at least in part on the syntactic confidence score and the proximity confidence score.

9. The data domain classifier apparatus of claim 8 , wherein the data domain comprises a sensitive data domain and wherein at least one of the one or more memories has further instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:

apply one or more security protections to at least a portion of the unstructured document.

10. The data domain classifier apparatus of claim 9 , wherein the instructions that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to apply one or more security protections to at least a portion of the unstructured document further cause at least one of the one or more processors to:

apply data masking to instances of the unknown data object within the unstructured document.

11. The data domain classifier apparatus of claim 9 , wherein the instructions that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to apply one or more security protections to at least a portion of the unstructured document further cause at least one of the one or more processors to:

encrypt the unstructured document.

12. The data domain classifier apparatus of claim 8 , wherein the instructions that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to determine a syntactic confidence score corresponding to an unknown data object in the plurality of index terms based at least in part on a syntactic analysis of the unknown data object further cause at least one of the one or more processors to:

identify the syntax of the unknown data object based on one or more of: regular expression based pattern matching of the unknown data object, lookup of the unknown data object in a table of identified syntaxes, or probabilistic matching of the unknown data object to one of a plurality of syntaxes; and

determine the syntactic confidence score based at least in part on the identified syntax.

13. The data domain classifier apparatus of claim 8 , wherein the instructions that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to determine a proximity confidence score corresponding to the unknown data object based at least in part on the location information and at least one proximity query associated with the unknown data object and one or more other terms in the document index further cause at least one of the one or more processors to:

identify the at least one proximity query corresponding to the unknown data object based at least in part on the syntax of the unknown data object, the at least one proximity query indicating a query distance between a first query term corresponding to the unknown data object and at least one second query term corresponding to at least one of the one or more other terms;

determine an actual distance between the first query term and the at least one second query term based at least in part on the location information; and

determine the proximity confidence score based at least in part on the determined actual distance and the query distance.

14. The data domain classifier apparatus of claim 8 , wherein at least one of the one or more memories has further instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:

determine a semantic confidence score based at least in part on a plurality of dictionary terms in the plurality of index terms, wherein the semantic confidence score indicates a confidence level associated with attributing one or more topics associated with the unstructured document to the data domain;

wherein the instructions that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to classify the unknown data object as an object in the data domain further cause at least one of the one or more processors to classify the unknown data object as an object in the data domain based at least in part on the syntactic confidence score, the proximity confidence score, and the semantic confidence score.

15. At least one non-transitory computer-readable medium storing computer-readable instructions for classifying an unknown data object in an unstructured document that, when executed by one or more computing devices of a data domain classifier, cause at least one of the one or more computing devices to:

parse the unstructured document to generate one or more document indexes corresponding to the unstructured document, the one or more document indexes comprising a plurality of index terms and location information corresponding to locations of the plurality of index terms within the unstructured document;

determine a syntactic confidence score corresponding to an unknown data object in the plurality of index terms based at least in part on a syntactic analysis of the unknown data object, wherein the unknown data object comprises a term having an unknown data domain and wherein the syntactic confidence score indicates a confidence level associated with attributing a syntax of the unknown data object term to a data domain;

determine a proximity confidence score corresponding to the unknown data object based at least in part on the location information and at least one proximity query associated with the unknown data object and one or more other terms in the document index, the at least one proximity query being determined based at least in part on the syntax of the unknown data object, wherein the proximity confidence score indicates a confidence level associated with the at least one proximity query evaluating to true; and

classify the unknown data object as an object in the data domain based at least in part on the syntactic confidence score and the proximity confidence score.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein the data domain comprises a sensitive data domain and further storing computer-readable instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to:

apply one or more security protections to at least a portion of the unstructured document.

17. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to apply one or more security protections to at least a portion of the unstructured document further cause at least one of the one or more computing devices to:

apply data masking to instances of the unknown data object within the unstructured document.

18. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to apply one or more security protections to at least a portion of the unstructured document further cause at least one of the one or more computing devices to:

encrypt the unstructured document.

19. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to determine a syntactic confidence score corresponding to an unknown data object in the plurality of index terms based at least in part on a syntactic analysis of the unknown data object further cause at least one of the one or more computing devices to:

identify the syntax of the unknown data object based on one or more of: regular expression based pattern matching of the unknown data object, lookup of the unknown data object in a table of identified syntaxes, or probabilistic matching of the unknown data object to one of a plurality of syntaxes; and

determine the syntactic confidence score based at least in part on the identified syntax.

20. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to determine a proximity confidence score corresponding to the unknown data object based at least in part on the location information and at least one proximity query associated with the unknown data object and one or more other terms in the document index further cause at least one of the one or more computing devices to:

identify the at least one proximity query corresponding to the unknown data object based at least in part on the syntax of the unknown data object, the at least one proximity query indicating a query distance between a first query term corresponding to the unknown data object and at least one second query term corresponding to at least one of the one or more other terms;

determine an actual distance between the first query term and the at least one second query term based at least in part on the location information; and

determine the proximity confidence score based at least in part on the determined actual distance and the query distance.

21. The at least one non-transitory computer-readable medium of claim 15 , further storing computer-readable instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to:

determine a semantic confidence score based at least in part on a plurality of dictionary terms in the plurality of index terms, wherein the semantic confidence score indicates a confidence level associated with attributing one or more topics associated with the unstructured document to the data domain;

wherein the instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to classify the unknown data object as an object in the data domain further cause at least one of the one or more computing devices to classify the unknown data object as an object in the data domain based at least in part on the syntactic confidence score, the proximity confidence score, and the semantic confidence score.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Nov 18, 2025
From: JPMORGAN CHASE BANK, N.A.
To: INFORMATICA LLC
Reel/Frame 073597/0722 →
SECURITY INTEREST Recorded Jun 12, 2024
From: INFORMATICA LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067706/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2023
From: BALABINE, IGOR
To: INFORMATICA LLC
Reel/Frame 065736/0131 →