Network node consolidation

1. A method, comprising:

storing, by a computer-based system, first entity attributes for a first entity in a distributed file system;

storing, by the computer-based system, second entity attributes for a second entity in the distributed file system;

standardizing, by the computer-based system, the first entity attributes and the second entity attributes;

cleansing, by the computer-based system, the first entity attributes and the second entity attributes by removing a public shared internet protocol (IP) address from the first entity attributes and the second entity attributes;

generating, by the computer-based system and based on an exact matching entity attribute between the first entity attributes and the second entity attributes, a network cluster comprising a first node representing the first entity and a second node representing the second entity;

loading, by the computer-based system, personally identifiable information for the first entity and the second entity;

calculating, by the computer-based system and based on the personally identifiable information, a node pair confidence score that indicates that the network cluster generated based on the exact matching entity attribute between the first node and the second node represent a same entity based upon a fuzzy matching of a remainder of individual attributes from the first entity and the second entity, wherein the individual attributes are weighted according to a respective importance and the fuzzy matching is based on a linear regression to calculate the node pair confidence score, wherein the node pair confidence score meets a threshold similarity score that indicates that the first entity and the second entity represent the same entity; and

assigning, by the computer-based system, a global identification to the first entity and the second entity.

2. The method of claim 1 , further comprising refining, by the computer-based system, the network cluster, wherein the refining comprises removing at least one node from the network cluster.

3. The method of claim 1 , further comprising generating, by the computer-based system, the network cluster in response to an update to the first entity attributes.

4. The method of claim 1 , further comprising calculating, by the computer-based system, a network cluster confidence score.

5. The method of claim 1 , further comprising associating, by the computer-based system, the global identification with a first entity identification for the first entity and a second entity identification for the second entity.

6. The method of claim 1 , further comprising calculating, by the computer-based system, an attribute similarity score for each of the first entity attributes.

7. The method of claim 6 , further comprising calculating, by the computer-based system, a node pair similarity score based on the attribute similarity scores.

8. A system comprising:

a processor,

a tangible, non-transitory memory configured to communicate with the processor, and

the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:

storing, by the processor, first entity attributes for a first entity in a distributed file system;

storing, by the processor, second entity attributes for a second entity in the distributed file system;

standardizing, by the processor, the first entity attributes and the second entity attributes;

cleansing, by the processor, the first entity attributes and the second entity attributes by removing a public shared internet protocol (IP) address from the first entity attributes and the second entity attributes;

generating, by the processor and based on an exact matching entity attribute between the first entity attributes and the second entity attributes, a network cluster comprising a first node representing the first entity and a second node representing the second entity;

loading, by the processor, personally identifiable information for the first entity and the second entity;

calculating, by the processor and based on the personally identifiable information, a node pair confidence score that indicates that the network cluster generated based on the exact matching entity attribute between the first node and the second node represent a same entity based upon a fuzzy matching of a remainder of individual attributes from the first entity and the second entity, wherein the individual attributes are weighted according to a respective importance and the fuzzy matching is based on a linear regression to calculate the node pair confidence score, wherein the node pair confidence score meets a threshold similarity score that indicates that the first entity and the second entity represent the same entity; and

assigning, by the processor, a global identification to the first entity and the second entity.

9. The system of claim 8 , the operations further comprising refining, by the processor, the network cluster, wherein the refining comprises removing at least one node from the network cluster.

10. The system of claim 8 , the operations further comprising generating, by the processor, the network cluster in response to an update to the first entity attributes.

11. The system of claim 8 , the operations further comprising calculating, by the processor, a network cluster confidence score.

12. The system of claim 8 , the operations further comprising associating, by the processor, the global identification with a first entity identification for the first entity and a second entity identification for the second entity.

13. The system of claim 8 , the operations further comprising calculating, by the processor, an attribute similarity score for each of the first entity attributes.

14. The system of claim 13 , the operations further comprising calculating, by the processor, a node pair similarity score based on the attribute similarity scores.

15. An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a computer-based system, cause the computer-based system to perform operations comprising:

storing, by the computer-based system, first entity attributes for a first entity in a distributed file system;

storing, by the computer-based system, second entity attributes for a second entity in the distributed file system;

standardizing, by the computer-based system, the first entity attributes and the second entity attributes;

cleansing, by the computer-based system, the first entity attributes and the second entity attributes by removing a public shared internet protocol (IP) address from the first entity attributes and the second entity attributes;

generating, by the computer-based system and based on an exact matching entity attribute between the first entity attributes and the second entity attributes, a network cluster comprising a first node representing the first entity and a second node representing the second entity;

loading, by the computer-based system, personally identifiable information for the first entity and the second entity;

calculating, by the computer-based system and based on the personally identifiable information, a node pair confidence score that indicates that the network cluster generated based on the exact matching entity attribute between the first node and the second node represent a same entity based upon a fuzzy matching of a remainder of individual attributes from the first entity and the second entity, wherein the individual attributes are weighted according to a respective importance and the fuzzy matching is based on a linear regression to calculate the node pair confidence score, wherein the node pair confidence score meets a threshold similarity score that indicates that the first entity and the second entity represent the same entity; and

assigning, by the computer-based system, a global identification to the first entity and the second entity.

16. The article of manufacture of claim 15 , the operations further comprising refining, by the computer-based system, the network cluster, wherein the refining comprises removing at least one node from the network cluster.

17. The article of manufacture of claim 15 , the operations further comprising generating, by the computer-based system, the network cluster in response to an update to the first entity attributes.

18. The article of manufacture of claim 15 , the operations further comprising calculating, by the computer-based system, a network cluster confidence score.

19. The article of manufacture of claim 15 , the operations further comprising associating, by the computer-based system, the global identification with a first entity identification for the first entity and a second entity identification for the second entity.

20. The article of manufacture of claim 15 , the operations further comprising calculating, by the computer-based system, an attribute similarity score for each of the first entity attributes.