System and method for enhanced searching of databases using catalogued metadata
In one embodiment, a method comprises receiving a search request from a user; responsive to the search request, searching a plurality of metadata records corresponding to a plurality of databases, a metadata record of the plurality of metadata records comprising a plurality of searchable metadata items of a database of the plurality of databases, wherein the plurality of searchable metadata items of the metadata record includes a name of a table of the database; and providing search results responsive to the search request, the search results comprising indications of a subset of the plurality of metadata records that match the search request.
1 . A method for enhanced searching of databases using catalogued metadata, comprising:
scanning one or more computing resources within an organization to identify a plurality of database resources;
creating a plurality of snapshots of the identified plurality of database resources;
extracting metadata from each of the created plurality of snapshots to generate a plurality of database metadata records, wherein the generated plurality of database metadata records is used in providing the enhanced searching;
receiving a search request from a user;
responsive to the received search request, searching the generated plurality of database metadata records corresponding to a plurality of databases, a database metadata record of the plurality of database metadata records comprising a plurality of searchable metadata items of a database of the plurality of databases, wherein the plurality of searchable metadata items of the database metadata record includes a name of a table of the database; and
providing search results responsive to the received search request, the search results comprising indications of at least a subset of the generated plurality of database metadata records that match the received search request.
2 . The method of claim 1 , wherein the plurality of databases include at least one of a database that hasn't been backed up, a database that has been backed up, and multiple versions of a database.
3 . The method of claim 1 , wherein the plurality of searchable metadata items includes an indication of a change to the table made between a first version of the database and a second version of the database.
4 . The method of claim 3 , wherein the change to the table comprises an addition or deletion of the table or a column of the table.
5 . The method of claim 1 , wherein the plurality of searchable metadata items includes names of columns of the table of the database.
6 . The method of claim 1 , wherein the plurality of searchable metadata items includes content types of columns of the table of the database.
7 . The method of claim 1 , wherein the plurality of searchable metadata items includes either one or both of indications of which columns of the table of the database include personally identifiable information and indications of types of personally identifiable information included within columns of the table.
8 . The method of claim 1 , further comprising:
copying at least one of the created plurality of snapshots to an enhanced database search system.
9 . The method of claim 1 , further comprising aggregating the plurality of database metadata records into at least one table of a database that is accessed responsive to the received search request.
10 . A system for enhanced searching of databases using catalogued metadata comprising:
one or more processors configured to:
scan one or more computing resources within an organization to identify a plurality of database resources;
create a plurality of snapshots of the identified plurality of database resources;
extract metadata from each of the created plurality of snapshots to generate a plurality of database metadata records, wherein the generated plurality of database metadata records is used in providing the enhanced searching;
receive a search request;
responsive to the received search request, search the generated plurality of database metadata records corresponding to a plurality of databases, a database metadata record of the plurality of database metadata records comprising a plurality of searchable metadata items of a database of the plurality of databases, wherein the plurality of searchable metadata items of the database metadata record includes a name of a table of the database; and
provide search results responsive to the received search request, the search results comprising indications of at least a subset of the generated plurality of database metadata records that match the received search request.
11 . The system of claim 10 , wherein the received search request comprises a search expression and identifying at least one search result comprises determining that the name of the table or a name of a column of the table exactly matches the search expression.
12 . The system of claim 10 , wherein the received search request comprises a search expression and identifying at least one search result comprises determining that a portion of the name of the table or a portion of a name of a column of the table matches the search expression.
13 . The system of claim 10 , wherein the received search request comprises a search expression and identifying at least one search result comprises determining that the name of the table or a name of a column of the table semantically matches the search expression.
14 . The system of claim 10 , wherein identifying at least one search result comprises finding one or more tables with a deleted table name or column name that matches a search expression of the received search request.
15 . The system of claim 10 , wherein identifying at least one search result comprises applying a date range specified in the search request during searching of the plurality of database metadata records to identify a change that occurred to a database within the date range.
16 . The system of claim 15 , wherein the change includes a deletion of a table name or a column name.
17 . A non-transitory computer-readable medium storing a set of instructions for enhanced searching of databases using catalogued metadata, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the device to:
scan one or more computing resources within an organization to identify a plurality of database resources;
create a plurality of snapshots of the identified plurality of database resources;
extract metadata from each of the created plurality of snapshots to generate a plurality of database metadata records, wherein the generated plurality of database metadata records is used in providing the enhanced searching;
responsive to the received search request, search the generated plurality of database metadata records corresponding to a plurality of databases, a database metadata record of the plurality of database metadata records comprising a plurality of searchable metadata items of a database of the plurality of databases, wherein the plurality of searchable metadata items of the database metadata record includes a name of a table of the database; and
provide search results responsive to the received search request, the search results comprising indications of at least a subset of the generated plurality of database metadata records that match the received search request.
18 . The medium of claim 17 , wherein the plurality of searchable metadata items includes an indication of a change to the table made between a first version of the database and a second version of the database.
19 . The medium of claim 17 , wherein the plurality of searchable metadata items includes names of columns of the table of the database.
20 . The medium of claim 17 , wherein the plurality of searchable metadata items includes content types of columns of the table of the database.