Timeliner for a data fabric service system
The disclosed embodiments include techniques for organizing and presenting search results obtained from within a big data ecosystem via a data intake and query system. In particular, a data intake and query system may cause output of the search results or data indicative of the search results on a display device.
1. A method comprising:
receiving, by a search service system, an indication of a request for a timeline visualization received by a data intake and query system;
creating, by the search service system, a plurality of result buckets for search results that correspond to a search query to a plurality of distributed data systems based on a number of partitions from which the search results are collected, wherein a particular partition of the partitions is generated using a first computing device of the data intake and query system, wherein the particular partition comprises multiple events that each include raw machine data associated with a timestamp and reflecting activity within an information technology infrastructure;
collecting, by the search service system, the search results obtained from the partitions into the plurality of result buckets in time-order based on a timestamp associated with each of the search results; and
transferring, by the search service system, one or more search results of the search results from the plurality of result buckets to the data intake and query system, wherein the data intake and query system associates the one or more search results to one or more interactive bins and causes a display to display the one or more interactive bins in the timeline visualization.
2. The method of claim 1 , wherein a particular interactive bin of the one or more interactive bins is associated with a specific range of time, and wherein search results associated with the particular interactive bin include a timestamp within the specific range of time.
3. The method of claim 1 , wherein the one or more interactive bins are displayed in chronological order.
4. The method of claim 1 , wherein a size of a particular interactive bin of the one or more interactive bins is based on a quantity of the one or more search results associated with the particular interactive bin.
5. The method of claim 1 , wherein each result bucket of the plurality of result buckets corresponds to a distinct portion of time.
6. The method of claim 1 , further comprising determining that a particular interactive bin of the one or more interactive bins has been selected and based on the determination, causing the display to display at least one search result of the search results associated with the particular bin.
7. The method of claim 1 , wherein the partitions comprise sharded data.
8. The method of claim 1 , wherein a particular interactive bin of the one or more interactive bins is associated with search results from various data systems.
9. The method of claim 5 , wherein the creating comprises creating at least two result buckets for each of the partitions.
10. The method of claim 1 , wherein for at least one result bucket of the plurality of result buckets, the collecting comprises collecting a search result from at least one of the plurality of distributed data systems that is timestamped with a value within a specific time range associated with the at least one result bucket.
11. The method of claim 1 , wherein all search results from across the plurality of distributed data systems are collected into the plurality of result buckets prior to the transferring the one or more search results.
12. The method of claim 1 , wherein the one or more search results are transferred in chronological order.
13. The method of claim 1 , wherein a quantity of search results transferred corresponds to a predetermined amount.
14. The method of claim 1 , further comprising determining, by the search service system, that the request for the timeline visualization is for search results of a time-ordered search.
15. The method of claim 1 , wherein the creating the plurality of result buckets comprises creating at least two result buckets for each of the partitions.
16. The method of claim 1 , wherein the partitions are associated with external data sources that store data in a structured format, and wherein the search results are in a specified format.
17. The method of claim 1 , wherein each partition of the partitions is sorted based on at least one user specified constraint.
18. The method of claim 17 , wherein the at least one user specified constraint comprises a time ordering constraint.
19. The method of claim 1 , wherein the search results from across the plurality of distributed data systems are collected into the plurality of result buckets prior to the transferring the one or more search results.
20. The method of claim 1 , wherein the one or more search results that are transferred correspond to a predetermined amount.
21. The method of claim 1 , wherein at least one data system of the plurality of distributed data systems comprises a data store that stores data as a plurality of time-indexed events including portions of raw machine data.
22. The method of claim 1 , wherein the plurality of distributed data systems comprises an internal data storage system of the data intake and query system and an external data storage system communicatively coupled to the data intake and query system over a computer network, wherein the internal data storage system stores data as a plurality of time-indexed events including portions of raw machine data.
23. The method of claim 22 , wherein search results associated with the internal data storage system are in a first format as a plurality of time-indexed events including raw machine data and search results associated with the external data storage system are in a second format different than the first format.
24. The method of claim 1 , wherein the search query is input by a user and expressed in a pipelined search language.
25. The method of claim 1 , wherein the display of the one or more interactive bins in the timeline visualization comprises:
a timeline graphic depicting the one or more interactive bins arranged along a time axis in a timeline lane; and
a search display field displaying search results associated with at least one interactive bin of the one or more interactive bins, the search display field comprising a display of contents of the at least one interactive bin and graphical components that enable investigating additional dimensions of the search results associated with the at least one interactive bin.
26. A system comprising:
a memory; and
a processing device coupled with the memory to:
receive an indication of a request for a timeline visualization received by a data intake and query system;
create a plurality of result buckets for search results that correspond to a search query to a plurality of distributed systems based on a number of partitions from which the search results are collected, wherein a particular partition of the partitions is generated using a first computing device of the data intake and query system, wherein the particular partition comprises multiple events that each include raw machine data associated with a timestamp and reflecting activity within an information technology infrastructure;
collect the search results obtained from the partitions into the plurality of result buckets in time-order based on a timestamp associated with each of the search results; and
transfer one or more search results of the search results from the plurality of result buckets to the data intake and query system, wherein the data intake and query system associates the one or more search results to one or more interactive bins and causes a display to display the one or more interactive bins in the timeline visualization.
27. The system of claim 26 , wherein a particular interactive bin of the one or more interactive bins is associated with a specific range of time, and wherein search results associated with the particular interactive bin include a timestamp within the specific range of time.
28. A non-transitory computer-readable medium encoding instructions thereon that, in response to execution by one or more processing devices, cause the one or more processing devices to perform operations comprising:
receiving an indication of a request for a timeline visualization received by a data intake and query system;
creating a plurality of result buckets for search results that correspond to a search query to a plurality of distributed data systems based on a number of partitions from which the search results are collected, wherein a particular partition of the partitions is generated using a first computing device of the data intake and query system, wherein the particular partition comprises multiple events that each include raw machine data associated with a timestamp and reflecting activity within an information technology infrastructure;
collecting the search results obtained from the partitions into the plurality of result buckets in time-order based on a timestamp associated with each of the search results; and
transferring one or more search results of the search results from the plurality of result buckets to the data intake and query system, wherein the data intake and query system associates the one or more search results to one or more interactive bins and causes a display to display the one or more interactive bins in the timeline visualization.
29. The non-transitory computer-readable medium of claim 28 , wherein a particular interactive bin of the one or more interactive bins is associated with a specific range of time, and wherein search results associated with the particular interactive bin include a timestamp within the specific range of time.
30. The non-transitory computer-readable medium of claim 28 , wherein the one or more search results are transferred in chronological order.