Systems and methods for indexing and aggregating data records
Computer-implemented systems and methods are disclosed for indexing and aggregating proxy server data. In accordance with some embodiments, the systems comprise a memory device configured to store a set of instructions, and one or more processors configured to execute the set of instructions to receive a plurality of log lines of proxy server data comprising a plurality of data components and index one or more of the plurality of data components for the plurality of log lines. The processors also generate a plurality of log data records, each including the one or more indexed data components, and generate a summarized data record by aggregating one or more log data records having at least one matching indexed data component.
1. A system comprising:
a memory device configured to store a set of instructions; and
one or more processors configured to execute the set of instructions to:
access a plurality of data records comprising a plurality of data values;
identify those of the plurality of data records having a matching data value within the plurality of data values of the data record, wherein the identified data records also include one or more non-matching data values;
determine a measure of the identified data records, wherein the measure of the identified data records is based on an aggregation of the identified data records; and
generate a summarized data record indicating the matching data value and the measure of the identified data records, wherein the summarized data record does not include at least some of the non-matching data values of the identified data records.
2. The system of claim 1 , wherein the set of instructions are further configured to:
generate a plurality of additional summarized data records each indicating a second matching data value and a second measure of a plurality of identified data records associated with the summarized data record.
3. The system of claim 2 , wherein the additional summarized data records do not include at least some non-matching data values of corresponding identified data records.
4. The system of claim 2 , wherein the set of instructions are further configured to:
identify the additional summarized data records having a third matching data value;
determine a third measure of the identified additional summarized data records; and
generate a further summarized data record indicating the identified third matching data value and the third measure of the identified additional summarized data records.
5. A computer-implemented method comprising:
accessing a plurality of data records comprising a plurality of data values;
identifying those of the plurality of data records having a matching data value within the plurality of data values of the data record, wherein the identified data records also include one or more non-matching data values;
determining a measure of the identified data records, wherein the measure of the identified data records is based on an aggregation of the identified data records; and
generating a summarized data record indicating the matching data value and the measure of the identified data records, wherein the summarized data record does not include at least some of the non-matching data values of the identified data records.
6. The method of claim 5 , further comprising:
generating a plurality of additional summarized data records each indicating a second matching data value and a second measure of a plurality of identified data records associated with the summarized data record.
7. The method of claim 6 , wherein the additional summarized data records do not include at least some non-matching data values of corresponding identified data records.
8. The method of claim 6 , further comprising:
identifying the additional summarized data records having a third matching data value;
determining a third measure of the identified additional summarized data records; and
generating a further summarized data record indicating the identified third matching data value and the third measure of the identified additional summarized data records.
9. A non-transitory computer-readable medium storing a set of instructions that are executable by one or more processors to cause a computing system to:
access a plurality of data records comprising a plurality of data values;
identify those of the plurality of data records having a matching data value within the plurality of data values of the data record, wherein the identified data records also include one or more non-matching data values;
determine a measure of the identified data records, wherein the measure of the identified data records is based on an aggregation of the identified data records; and
generate a summarized data record indicating the matching data value and the measure of the identified data records, wherein the summarized data record does not include at least some of the non-matching data values of the identified data records.
10. The non-transitory computer-readable medium of claim 9 , wherein the set of instructions are further configured to:
generate a plurality of additional summarized data records each indicating a second matching data value and a second measure of a plurality of identified data records associated with the summarized data record.
11. The non-transitory computer-readable medium of claim 9 , wherein the additional summarized data records do not include at least some non-matching data values of corresponding identified data records.
12. The non-transitory computer-readable medium of claim 10 , wherein the set of instructions are further configured to:
identify the additional summarized data records having a third matching data value;
determine a third measure of the identified additional summarized data records; and
generate a further summarized data record indicating the identified third matching data value and the third measure of the identified additional summarized data records.