Methods and systems for pathing analysis
Methods, systems and computer program products for pathing analysis are provided. The method includes receiving at a server, a query comprising one or more nodes. The method further includes identifying one or more prior queries, wherein the one or more prior queries comprise at least one of the one or more nodes. The method accesses metadata associated with the one or more prior queries. The method then selects based on the metadata, one or more data partitions for further processing. Next, the method causes one or more computers to identify one or more paths in the selected data partitions, wherein the one or more paths comprise at least the one or more nodes. Finally, the method presents the identified paths as an output to the query.
1. A method for pathing analysis, the method comprising:
receiving, at a server, a query identifying one or more nodes;
identifying one or more prior queries that include at least one of the one or more nodes;
accessing metadata associated with the one or more prior queries;
selecting, based on the metadata, one or more data partitions for further processing by analyzing a frequency of a least frequently occurring path for each of the one or more prior queries;
causing one or more computers to identify one or more paths in the selected data partitions, wherein the one or more paths comprise at least the one or more nodes; and
presenting the identified paths as an output to the query.
2. The method of claim 1 wherein identifying the one or more prior queries comprises searching one or more hash maps associated with the one or more nodes.
3. The method of claim 2 further comprising updating the one or more hash maps associated with the one or more nodes.
4. The method of claim 1 wherein the metadata comprises one or more of an identifier of a data partition, a number of unique paths comprising at least the one or more nodes, a maximum frequency associated with a first unique path, and a minimum frequency associated with a second unique path.
5. The method of claim 1 further comprising ordering the selected data partitions to form a processing order.
6. The method of claim 1 wherein causing the one or more computers to identify the one or more paths comprises transferring a processing order of the selected data partitions to the one or more computers.
7. The method of claim 1 further comprising storing metadata associated with the query.
8. The method of claim 1 , the one or more data partitions comprising partitions at a node-combination level.
9. The method of claim 8 , the partitions at the node-combination level determined based on a source node and a destination node.
10. The method of claim 1 , wherein at least one of the one or more data partitions is determined based on a length of at least one of the one or more paths.
11. The method of claim 1 , wherein the metadata is stored in a metadata table.
12. The method of claim 11 , wherein the metadata table includes an entry based on a node combination of the one or more nodes.
13. A system for path analysis, the system comprising:
one or more network interfaces;
at least one processor;
a memory; and
computer program code stored in a computer readable storage medium, wherein the computer program code, when executed, is operative to cause the at least one processor to:
receive at a server, a query comprising one or more nodes;
identify one or more prior queries, wherein the one or more prior queries comprise at least one of the one or more nodes;
access metadata associated with the one or more prior queries;
select based on the metadata, one or more data partitions for further processing by analyzing a frequency of a least frequently occurring path for each of the one or more prior queries;
cause one or more computers to identify one or more paths in the selected data partitions, wherein the one or more paths comprise at least the one or more nodes; and
present the identified paths as an output to the query.
14. The system of claim 13 , wherein the computer program code is further operative to cause the at least one processor to identify the one or more prior queries comprises searching one or more hash maps associated with the one or more nodes.
15. The system of claim 14 , wherein the computer program code is further operative to cause the at least one processor to update the one or more hash maps associated with the one or more nodes.
16. The system of claim 13 wherein the metadata comprises one or more of an identifier of a data partition, a number of unique paths comprising at least the one or more nodes, a maximum frequency associated with a first unique path, and a minimum frequency associated with a second unique path.
17. One or more computer-readable non-transitory storage media embodying software operable when executed by one or more computer systems to:
receive at a server, a query comprising one or more nodes;
identify one or more prior queries, wherein the one or more prior queries comprise at least one of the one or more nodes;
access metadata associated with the one or more prior queries;
select based on the metadata, one or more data partitions for further processing by analyzing a frequency of a least frequently occurring path for each of the one or more prior queries;
cause one or more computers to identify one or more paths in the selected data partitions, wherein the one or more paths comprise at least the one or more nodes; and
present the identified paths as an output to the query.
18. The computer-readable non-transitory storage media of claim 17 further embodying software operable when executed by one or more computer systems to identify the one or more prior queries comprises searching one or more hash maps associated with the one or more nodes.
19. The computer-readable non-transitory storage media of claim 18 further embodying software operable when executed by one or more computer systems to update the one or more hash maps associated with the one or more nodes.
20. The computer-readable non-transitory storage media of claim 17 wherein the metadata comprises one or more of an identifier of a data partition, a number of unique paths comprising at least the one or more nodes, a maximum frequency associated with a first unique path, and a minimum frequency associated with a second unique path.
21. The computer-readable non-transitory storage media of claim 17 further embodying software operable when executed by one or more computer systems to order the selected data partitions to form a processing order.
22. The computer-readable non-transitory storage media of claim 17 further embodying software operable when executed by one or more computer systems to transfer a processing order of the selected data partitions to the one or more computers.
23. The computer-readable non-transitory storage media of claim 17 further embodying software operable when executed by one or more computer systems to cause the at least one processor to store metadata associated with the query.