Systems and methods of data record management

1. A system of data record management, the system comprising:

a communication interface;

at least one processor coupled to the communication interface; and

a memory coupled to the at least one processor and storing processor-executable instructions that, when executed, configure the at least one processor to:

receive a plurality of unstructured natural language data records;

generate a structured dataset based on the plurality of unstructured natural language data records, the structured dataset including a frequency value associated with respective terms of each of the plurality of unstructured natural language data records;

transform the structured dataset to normalize the respective frequency values based on inverse proportionality of the respective frequency values;

for each of the unstructured natural language data records, determine a redundancy prediction value associated with that unstructured natural language data record based on the transformed structured dataset; and

generate a communication signal for displaying on a graphical user interface a message identifying one or more unstructured natural language data records being associated with a redundancy prediction value greater than a threshold value.

2. The system of claim 1 , wherein the at least one processor is configure to determine a redundancy prediction value includes determining a cosine similarity value between that unstructured natural language data record and one or more other unstructured natural language data records in the plurality of unstructured natural language data records.

3. The system of claim 1 , wherein the at least one processor is configure to transform the structured dataset to normalize the respective frequency values includes generating a Term Frequency-Inverse Document Frequency (TF-IDF) matrix based on the structured dataset.

4. The system of claim 1 , wherein the at least one processor is configure to:

for each of the unstructured natural language data records, determine a topic prediction value associated with that unstructured natural language data record; and

wherein the at least one processor is configure to determine a redundancy prediction value for that unstructured natural language data records based on a relative number of data records in the plurality of unstructured natural language data records having the topic prediction value of that unstructured natural language data record.

5. The system of claim 4 , wherein the at least one processor is configure to determine the topic prediction value based on topic modelling including Non-Negative Matrix Factorization (NMF).

6. The system of claim 4 , wherein to determine the redundancy prediction value the at least one processor is configure to determine whether the topic prediction value associated with that unstructured natural language data record is similar to a data record category associated with that unstructured natural language data record.

7. The system of claim 4 , wherein the topic prediction value is one of a set of topic prediction values.

8. The system of claim 1 , wherein the at least one processor is configure to generate the structured dataset based on a bag-of-words model of the plurality of natural language data records.

9. The system of claim 8 , wherein the bag-of-words model is based on n-grams having two or more terms.

10. A method of data record management, the method comprising:

receiving a plurality of unstructured natural language data records;

generating a structured dataset based on the plurality of unstructured natural language data records, the structured dataset including a frequency value associated with respective terms of each of the plurality of unstructured natural language data records;

transforming the structured dataset to normalize the respective frequency values based on inverse proportionality of the respective frequency values;

for each of the unstructured natural language data records, determining a redundancy prediction value associated with that unstructured natural language data record based on the transformed structured dataset; and

generating a communication signal for displaying on a graphical user interface a message identifying one or more unstructured natural language data records being associated with a redundancy prediction value greater than a threshold value.

11. The method of claim 10 , wherein determining a redundancy prediction value includes determining a cosine similarity value between that unstructured natural language data record and one or more other unstructured natural language data records in the plurality of unstructured natural language data records.

12. The method of claim 10 , wherein transforming the structured dataset to normalize the respective frequency values includes generating a Term Frequency-Inverse Document Frequency (TF-IDF) matrix based on the structured dataset.

13. The method of claim 10 , comprising:

for each of the unstructured natural language data records, determining a topic prediction value associated with that unstructured natural language data record; and

determining a redundancy prediction value for that unstructured natural language data records based on a relative number of data records in the plurality of unstructured natural language data records having the topic prediction value of that unstructured natural language data record.

14. The method of claim 13 , comprising determining the topic prediction value based on topic modelling including Non-Negative Matrix Factorization (NMF).

15. The method of claim 13 , wherein determining the redundancy prediction value includes determining whether the topic prediction value associated with that unstructured natural language data record is similar to a data record category associated with that unstructured natural language data record.

16. The method of claim 13 , wherein the topic prediction value comprises one of a set of topic prediction values.

17. The method of claim 13 , comprising generating the structured dataset based on a bag-of-words model of the plurality of natural language data records.

18. The method of claim 17 , wherein the bag-of-words model is based on n-grams having two or more terms.

19. A non-transitory computer-readable medium or media having stored thereon machine interpretable instructions which, when executed by a processor, cause the processor to perform a computer implemented method of data record management, the method comprising:

receiving a plurality of unstructured natural language data records;

generating a structured dataset based on the plurality of unstructured natural language data records, the structured dataset including a frequency value associated with respective terms of each of the plurality of unstructured natural language data records;

transforming the structured dataset to normalize the respective frequency values based on inverse proportionality of the respective frequency values;

for each of the unstructured natural language data records, determining a redundancy prediction value associated with that unstructured natural language data record based on the transformed structured dataset; and

generating a communication signal for displaying on a graphical user interface a message identifying one or more unstructured natural language data records being associated with a redundancy prediction value greater than a threshold value.