System and method for providing a centralized network master database lake for network nodes
The present invention discloses a method for providing a centralized network master database lake ( 128 ). The method receives and stores input data, identifies a plurality of attributes associated with the input data, processes the input data to categorize the input data into a plurality of predefined data categories based on the plurality of attributes, and processes the categorized input data to determine if a record associated with the categorized input data exist in the centralized network master database lake ( 128 ). The method ( 1200 ) updates the record with the categorized input data when it is determined that the record exists, creating a new record to store the categorized input data into the centralized network master database lake ( 128 ) when it is determined that the record does not exist and processing the record to dynamically display the categorized input data.
1 . A system ( 118 ) for providing a centralized network master database lake ( 128 ), the system comprising:
a receiving unit ( 120 ) configured to receive a plurality of input data from a plurality of data sources ( 116 );
a database ( 124 ) configured to store the plurality of input data;
a processing unit ( 122 ) configured to receive the plurality of input data from the database ( 124 );
the processing unit ( 122 ) is configured to:
identify a plurality of attributes associated with the plurality of input data;
process the plurality of input data to categorize the plurality of input data into a plurality of predefined data categories based on the plurality of attributes;
process the categorized plurality of input data to determine if a record associated with the categorized plurality of input data exists in the centralized network master database lake ( 128 );
update the record with the categorized plurality of input data when it is determined that the record exists;
create a new record to store the categorized plurality of input data into the centralized network master database lake ( 128 ) when it is determined that the record does not exist; and
process the records to dynamically display the categorized plurality of input data.
2 . The system ( 118 ) as claimed in claim 1 , wherein the plurality of input data is categorized as a site related data or as a map related data when a data source from the plurality of data sources is a planning database.
3 . The system ( 118 ) as claimed in claim 2 , wherein when the plurality of input data is categorized as the site related data, then performing the following steps:
preprocessing the site related data;
storing the preprocessed site related data in at least one relational database; and
storing the preprocessed site related data in the centralized network master database lake ( 128 ).
4 . The system ( 118 ) as claimed in claim 2 , wherein when the plurality of input data is categorized as the map related data, then performing the following steps:
preprocessing the map related data;
storing the preprocessed map related data in at least one non-relational database; and
storing the preprocessed map related data in the centralized network master database lake ( 128 ).
5 . The system ( 118 ) as claimed in claim 3 , further configured to:
filter the site related data to get a site list comprising a plurality of site records;
determine a modified date and a created date for every site record in the site list;
identify a modified site record and a new site record from the site list based on the determined modified date and the determined created date respectively;
determine an existing site record from the site related data associated with the identified modified site record;
update the determined existing site record with details of the modified site record; and
insert the identified new site record in the at least one relational database.
6 . The system ( 118 ) as claimed in claim 1 , further configured to:
categorize the plurality of input data as a workorder data or as a cell data when a data source from the plurality of data sources is a plan to build (P2B) system;
determine if the cell data is a cell physical data or a cell level soft data;
update the centralized network master database lake ( 128 ) with the workorder data and the cell physical data; and
update the centralized network master database lake ( 128 ) with the cell level soft data when it is determined that a cell associated with the cell level soft data is not active and not present in a network operations support system (OSS).
7 . The system ( 118 ) as claimed in claim 1 , wherein the plurality of input data is categorized as an event based data or as a periodic based data when a data source from the plurality of data sources is the network OSS.
8 . A method ( 1200 ) for providing a centralized network master database lake ( 128 ), the method ( 1200 ) comprising:
receiving ( 1202 ) a plurality of input data from a plurality of data sources ( 116 ) by a receiving unit ( 120 );
storing ( 1203 ) the plurality of input data into a database ( 124 );
receiving ( 1204 ) the plurality of input data from the database ( 124 ) by a processing unit ( 122 );
identifying ( 1206 ) a plurality of attributes associated with the plurality of input data;
processing ( 1210 ) the plurality of input data to categorize the plurality of input data into a plurality of predefined data categories based on the plurality of attributes;
processing ( 1212 ) the categorized plurality of input data to determine if a record associated with the categorized plurality of input data exists in the centralized network master database lake ( 128 );
updating ( 1214 ) the record with the categorized plurality of input data when it is determined that the record exists;
creating ( 1216 ) a new record to store the categorized plurality of input data into the centralized network master database lake ( 128 ) when it is determined that the record does not exist; and
processing ( 1218 ) the record to dynamically display the categorized plurality of input data.
9 . The method ( 1200 ) as claimed in claim 8 , wherein the plurality of input data is categorized as a site related data or as a map related data when a data source from the plurality of data sources is a planning database.
10 . The method ( 1200 ) as claimed in claim 9 , wherein when the plurality of input data is categorized as the site related data, then performing the following steps:
preprocessing the site related data;
storing the preprocessed site related data in at least one relational database; and
storing the preprocessed site related data in the centralized network master database lake ( 128 ).
11 . The method ( 1200 ) as claimed in claim 9 , wherein when the plurality of input data is categorized as the map related data, then performing the following steps:
preprocessing the map related data;
storing the preprocessed map related data in at least one non-relational database; and
storing the preprocessed map related data in the centralized network master database lake ( 128 ).
12 . The method ( 1200 ) as claimed in claim 10 , further comprising:
filtering the site related data to get a site list comprising a plurality of site records;
determining a modified date and a created date for every site record in the site list;
identifying a modified site record and a new site record from the site list based on the determined modified date and the determined created date respectively;
determining an existing site record from the site related data associated with the identified modified site record;
updating the determined existing site record with details of the modified site record; and
inserting the identified new site record in the at least one relational database.
13 . The method ( 1200 ) as claimed in claim 8 , further comprising:
categorizing the plurality of input data as a workorder data or as a cell data when a data source from the plurality of data sources is a plan to build (P2B) system;
determining if the cell data is a cell physical data or a cell level soft data;
updating the centralized network master database lake ( 128 ) with the workorder data and the cell physical data; and
updating the centralized network master database lake ( 128 ) with the cell level soft data when it is determined that a cell associated with the cell level soft data is not active and not present in a network operations support system (OSS).
14 . The method ( 1200 ) as claimed in claim 8 , wherein the plurality of input data is categorized as an event based data or as a periodic based data when a data source from the plurality of data sources is the network OSS.
15 . A computer program product comprising a non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform a method for providing a centralized network master database lake ( 128 ), the method comprising:
receiving ( 1202 ) a plurality of input data from a plurality of data sources ( 116 ) by a receiving unit ( 120 );
storing ( 1203 ) the plurality of input data into a database ( 124 );
receiving ( 1204 ) the plurality of input data from the database ( 124 ) by a processing unit ( 122 );
identifying ( 1206 ) a plurality of attributes associated with the plurality of input data;
processing ( 1210 ) the plurality of input data to categorize the plurality of input data into a plurality of predefined data categories based on the plurality of attributes;
processing ( 1212 ) the categorized plurality of input data to determine if a record associated with the categorized plurality of input data exist in the centralized network master database lake ( 128 );
updating ( 1214 ) the record with the categorized plurality of input data when it is determined that the record exists;
creating ( 1216 ) a new record to store the categorized plurality of input data into the centralized network master database lake ( 128 ) when it is determined that the record does not exist; and
processing ( 1218 ) the record to dynamically display the categorized plurality of input data.