Progressive prefetching
The present invention relates to systems, apparatus, and methods of using usage data to determine the dependency structures of a web application, including dependency structures between follow-on objects of an initial object in a web transaction. In one embodiment, an input URL and associated dynamic response data are analyzed for such nested or dependent relationships. In further embodiments, analysis of these relationships are used to improve prefetching operations to lower overall page load times.
1. A method for performing progressive prefetching in a web page transaction, the method comprising:
observing, using a computing device, at least a portion of a first web page transaction including a first root request for a first root object and a first root response to the first root request;
identifying serialization indicators in the first root request or the first root response;
responsive to determining that the first web page transaction has previously been observed as part of a previous web page transaction, retrieving serialization information for the first web page transaction based on the previous web page transaction, the retrieved serialization information added to the identified serialization indicators;
retrieving one or more child objects based at least in part on the serialization indicators;
observing, using the computing device, further portions of the first web page transaction including one or more child requests for the one or more child objects and one or more child responses to the one or more child requests;
upon completion of the first web page transaction, analyzing the first web page transaction to identify serializing interdependencies between objects that include the first root object and the one or more child objects; and
responsive to determining that the serializing interdependencies includes new serialization indicators, updating the serialization indicators associated with the first web page transaction to generate updated serialization indicators.
2. The method of claim 1 , wherein the retrieved serialization information for the first web page transaction comprises a root template.
3. The method of claim 2 further comprising updating the root template with the updated serialization indicators.
4. The method of claim 1 , wherein observing further portions of the first web page transaction occurs concurrently with retrieving the one or more child objects.
5. The method of claim 1 , wherein the serializing interdependencies includes timing analysis in conjunction with previous records for web page transactions analogous to the first web page transaction.
6. The method of claim 1 further comprising, responsive to determining that the first web page transaction has not previously been observed as part of any previous web page transaction, creating a new entry in a data store for the first web page transaction that includes the updated serialization indicators.
7. The method of claim 1 further comprising, responsive to determining that the first web page transaction has not previously been observed as part of any previous web page transaction, creating a new root template for the first web page transaction that includes the updated serialization indicators.
8. The method of claim 1 further comprising updating one or more child origin models using the updated serialization indicators.
9. The method of claim 1 further comprising updating the serialization information with the updated serialization indicators in one or more web page templates responsive to determining that the one or more web page templates includes objects related to the first root object or the one or more child objects.
10. The method of claim 1 , wherein analyzing the first web page transaction to identify the serializing interdependencies between objects comprises analyzing timing information of the first root object and the one or more child objects.
11. A computing device configured to perform progressive prefetching, the computing device comprising:
a processor;
a network connection communicatively coupled to a client computer and a content server computer; and
a computer-readable storage medium having instructions stored thereon for causing the processor to execute a progressive prefetcher, the progressive prefetcher configured to:
observe at least a portion of a first web page transaction including a first root request for a first root object and a first root response to the first root request;
identify serialization indicators in the first root request or the first root response;
responsive to determining that the first web page transaction has previously been observed as part of a previous web page transaction, retrieve serialization information for the first web page transaction based on the previous web page transaction, the retrieved serialization information added to the identified serialization indicators;
retrieve one or more child objects based at least in part on the serialization indicators;
observe further portions of the first web page transaction including one or more child requests for the one or more child objects and one or more child responses to the one or more child requests;
upon completion of the first web page transaction, analyze the first web page transaction to identify serializing interdependencies between objects that include the first root object and the one or more child objects; and
responsive to determining that the serializing interdependencies includes new serialization indicators, update the serialization indicators associated with the first web page transaction to generate updated serialization indicators in the computer-readable storage medium.
12. The computing device of claim 11 , wherein the computing device comprises a proxy server.
13. The computing device of claim 11 , wherein the computing device comprises a prefetch analysis server.
14. The computing device of claim 11 , wherein the computing device comprises a client device.
15. The computing device of claim 11 , wherein the progressive prefetcher is further configured to generate a list of instructions regarding timing of child requests.
16. The computing device of claim 11 , wherein the updated serialization indicators include information indicating a point within a web page transaction when a child object is to be prefetched within a chain of child requests.
17. The computing device of claim 11 , wherein the progressive prefetcher is further configured to, responsive to determining that the first web page transaction has not previously been observed as part of any previous web page transaction, create new data in the computer-readable storage medium for the first web page transaction that includes the updated serialization indicators.
18. The computing device of claim 11 , wherein the progressive prefetcher is further configured to update the serialization information with the updated serialization indicators in one or more web page templates responsive to determining that the one or more web page templates includes objects related to the first root object or the one or more child objects.
19. The computing device of claim 11 , wherein the progressive prefetcher is further configured to observe the further portions of the first web page transaction occurs concurrently with retrieving the one or more child objects.
20. The computing device of claim 11 , wherein the serializing interdependencies includes timing analysis in conjunction with previous records for web page transactions analogous to the first web page transaction.