Searchable and size-constrained local log repositories for tracking visitors' access to web content
View Patent ↗A method and system for tracking visitors' access to web content using a searchable and size-constrained local log repository is disclosed. A repository indexer receives visitor logs from a remote source and indexes the logs to include a usage field indicating when or how frequently an associated visitor log was accessed from a local log repository by a report request manager. The local log repository stores the logs and is size constrained. A repository manager removes a subset of the logs in the local log repository based on parameters within the subset of the logs' usage field. The report request manager receives a request from a requestor for a report indicating visitors' access to a content object, searches for logs within the local log repository pertinent to the request, aggregates data across the logs responsive to the search, and generates a report presenting the aggregated data.
1. A system for tracking visitors' access to web content using a searchable and size-constrained local log repository, the system comprising:
one or more processors;
a repository indexer, using the one or more processors, that receives visitor logs from a remote source and indexes the received visitor logs to include a usage field, each visitor log indicating a content object requested by a visitor and a date, the usage field indicating at least one of when or how frequently an associated visitor log was accessed from a local log repository by a report request manager;
the local log repository, the local log repository storing in memory the visitor logs received and indexed by the repository indexer and the local log repository being size constrained;
a repository manager, using the one or more processors, that removes a subset of the visitor logs in the local log repository based on parameters within the subset of the visitor logs' usage field; and
the report request manager, using the one or more processors, wherein the report request manager:
receives a request from a requestor for a report indicating visitors' access to a content object,
searches for visitor logs within the local log repository pertinent to the request,
aggregates data across the visitor logs responsive to the search, and generates a report presenting the aggregated data.
2. The system for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 1 , wherein the report request manager further initiates a collection of visitor logs from the remote source, and wherein the aggregation includes aggregating data a set of visitor logs, the set of visitor logs including the visitor logs responsive to the search and the visitor logs collected from the remote source.
3. The system for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 1 , wherein the repository indexer receives the visitor logs from the remote source subsequent to receipt by the report request manager of a first request pertaining to the visitor logs, and wherein the request from the requestor is received subsequent to the receiving of the first request.
4. The system for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 1 , wherein the remote source comprises a central server, the central server comprising a central log repository storing visitor logs supplied by a plurality of web servers.
5. The system for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 1 , wherein the report request manager further tracks parameters associated with requests precipitating receipt by the repository indexer of the visitor logs from the remote source.
6. The system for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 1 , wherein the generated report comprises a dynamic report that allows the requestor to interact with the report, wherein data presented in the report changes as a result of the interaction.
7. The system for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 1 , wherein the generated report indicates a geographical distribution of visitors accessing the content object.
8. A method for tracking visitors' access to web content using a searchable and size-constrained local log repository, the method comprising:
receiving visitor logs from a remote source, each visitor log indicating a content object accessed by a visitor and a date;
indexing the received visitor logs to include a usage field, the usage field indicating at least one of when or how frequently an associated visitor log was accessed from a local log repository;
storing the indexed visitor logs in the local log repository, the local log repository being size constrained;
receiving a request from a requestor for a report indicating visitors' access to a content object;
searching for visitor logs within the local log repository to the request;
aggregating data across the visitor logs responsive to the search;
updating parameters within the usage field of the visitor logs responsive to the search to indicate that the logs were accessed;
generating a report presenting the aggregated data; and
removing a subset of the visitor logs in the local log repository based on parameters within the subset of the visitor logs' usage field.
9. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 8 , wherein the usage field indicates a number of times that the associated visitor log was accessed from the local log repository.
10. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 8 , wherein the usage field indicates a date and time at which the associated visitor log was accessed from the local log repository.
11. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 8 , the method further comprising:
requesting other visitor logs pertinent to the request from a remote source.
12. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 8 , wherein the generated report indicates a distribution of user agents associated with visitors' access to the content object.
13. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 8 , wherein the subset of visitor logs are removed from the local log repository after detecting that a size of the local log repository has exceeded a threshold.
14. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 8 , further comprising:
detecting that the visitor has interacted with the report; and
adjusting the report to present a new aggregation of the data of at least some of the visitor logs responsive to the search.
15. A method for tracking visitors' access to web content using a searchable and size-constrained local log repository, the method comprising:
receiving visitor logs from a remote source, each visitor log indicating a content object accessed by a visitor and a date;
indexing the received visitor logs to add, remove or modify a field of the visitor logs;
storing the indexed visitor logs in a local log repository, the local log repository being size-constrained;
receiving a request from a requestor for a report indicating visitors' access to a content object;
searching for visitor logs within the local log repository pertinent to the request;
aggregating data across the visitor logs responsive to the search;
generating a report presenting the aggregated data; and
removing a subset of the visitor logs in the local log repository.
16. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 15 , wherein the received visitor logs are indexed to add a usage field, the usage field indicating a when or how frequently an associated visitor log was accessed from the local log repository.
17. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 15 , wherein the generated report comprises a dynamic report that allows the requestor to interact with the report, wherein data presented in the report changes as a result of the interaction.
18. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 15 , wherein the generated report indicates a geographical distribution of visitors accessing the content object, and wherein the visitor can dynamically interact with the report to set a geographical discretization of the distribution.
19. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 15 , wherein the request identifies a content provider and the content object is associated with the content provider.
20. The method for tracking visitors' access to web content using the searchable and size-constrained local log repository as recited in claim 15 , the method further comprising:
requesting other visitor logs pertinent to the request from a remote source.