Asynchronous predictive caching of content listed in search results
Technologies described reduce the amount of time between requesting content and receiving the requested content. In some embodiments, a client provides a search query. A search result page is generated and, prior to returning the search result page to the client, some or all of the search results are asynchronously pre-fetched and cached. The search query can include custom parameters that are also included in the pre-fetch requests. Web addresses in the search results page can be modified to indicate whether a prefetch operation was initiated. Once a user activates one of the search results, the responding web server uses the cached data while generating a response.
1 . A method, comprising:
identifying a plurality of search result Uniform Resource Locators (URLs) based on a search query received from a client;
initiating a request for content to at least one of the plurality of search result URLs;
retrieving a page received in response to the request and classifying the page by identifying:
a first portion of content items of the page that is generated specific to the client; and
a second portion of the content items of the page that is client agnostic;
caching the page by storing the second portion of the content items of the page at a data storage location in a cache and excluding the first portion of the content items of the page that is generated specific to the client from the data storage location;
receiving a request from the client for the at least one of the plurality of search result URLs;
generating a response to the request based on the second portion of the content items of the page stored in the data storage location; and
responsive to receiving a request from a different client for the at least one of the plurality of search result URLs, transmitting a response to the different client that includes at least some of the second portion of the content items of the page stored in the data storage location.
2 . The method of claim 1 , wherein initiating the request for content to at least one of the plurality of search result URLs comprises initiating requests for content to two or more of the plurality of search result URLs.
3 . The method of claim 1 , further comprising separately caching the first portion of the content items of the page that is generated specific to the client by storing the first portion of the content items of the page at a different data storage location and, responsive to receiving a subsequent request for the at least one of the plurality of search result URLs from the client, transmitting a response to the client that includes at least some of the first portion of the content items of the page.
4 . The method of claim 1 , further comprising causing output, at the client, of a search result page comprising hyperlinks to the plurality of search result URLs.
5 . The method of claim 4 , further comprising modifying one of the hyperlinks corresponding to the at least one of the plurality of search result URLs to indicate performance of caching the page.
6 . The method of claim 4 , wherein initiating the request for content to the at least one of the plurality of search result URLs is performed before causing output of the search result page.
7 . The method of claim 1 , wherein the search query comprises:
a text search query defined by user input at the client; and
context data defining one or more parameters of the client, wherein identifying the first portion of the content items of the page that is generated specific to the client is performed based on the context data.
8 . The method of claim 1 , wherein generating the response to the request based on the second portion of the content items of the page comprises identifying, in the second portion of the content items of the page, a pointer to at least one content item stored in a data store separate from the data storage location, and generating the response to the request comprises retrieving the at least one content item from the data store.
9 . A system comprising:
one or more processors; and
a computer-readable storage medium storing instructions that are executable by the one or more processors to perform operations comprising:
identifying a plurality of search result Uniform Resource Locators (URLs) based on a search query received from a client;
initiating a request for content to at least one of the plurality of search result URLs;
retrieving a page received in response to the request and classifying the page to identify:
a first portion of content items of the page that is generated specific to the client; and
a second portion of the content items of the page that is client agnostic;
caching the page by storing the second portion of the content items of the page in a data storage location in a cache and excluding the first portion of the content items of the page that is generated specific to the client from the data storage location;
receiving a request from the client for the at least one of the plurality of search result URLs;
generating a response to the request based on the second portion of the page stored in the data storage location; and
responsive to receiving a request from a different client for the at least one of the plurality of search result URLs, transmitting a response to the different client that includes at least some of the second portion of the content items of the page stored in the data storage location.
10 . The system of claim 9 , wherein initiating the request for content to at least one of the plurality of search result URLs comprises initiating requests for content to two or more of the plurality of search result URLs.
11 . The system of claim 9 , the operations further comprising separately caching the first portion of the content items of the page that is generated specific to the client by storing the first portion of the content items of the page in a different data storage location and, responsive to receiving a subsequent request for the at least one of the plurality of search result URLs from the client, transmitting a response to the client that includes at least some of the first portion of the content items of the page.
12 . The system of claim 9 , the operations further comprising causing output, at the client, of a search result page comprising hyperlinks to the plurality of search result URLs.
13 . The system of claim 12 , the operations further comprising modifying one of the hyperlinks corresponding to the at least one of the plurality of search result URLs to indicate performance of caching the page.
14 . The system of claim 12 , wherein initiating the request for content to the at least one of the plurality of search result URLs is performed before causing output of the search result page.
15 . The system of claim 9 , wherein the search query comprises:
a text search query defined by user input at the client; and
context data defining one or more parameters of the client, wherein identifying the first portion of the content items of the page that is generated specific to the client is performed based on the context data.
16 . The system of claim 9 , wherein generating the response to the request based on the second portion of the content items of the page comprises identifying, in the second portion of the content items of the page, a pointer to at least one content item stored in a data store separate from the data storage location, and generating the response to the request comprises retrieving the at least one content item from the data store.
17 . A method, comprising:
identifying a plurality of search result Uniform Resource Locators (URLs) based on a search query received from a client;
initiating a request for content to at least one of the plurality of search result URLs;
retrieving a page received in response to the request and classifying the page to identify:
a first portion of content items of the page that is generated specific to the client; and
a second portion of the content items of the page that is client agnostic;
caching the page by:
storing the first portion of the content items of the page that is generated specific to the client in a first data storage location in a cache; and
storing the second portion of the content items of the page that is client agnostic in a second data storage location in the cache;
receiving a request from the client for the at least one of the plurality of search result URLs;
generating a response to the request by retrieving at least some of the first portion of the content items of the page from the first data storage location and retrieving at least some of the second portion of the content items of the page from the second data storage location;
maintaining the first portion of the content items of the page in the first data storage location and maintaining the second portion of the content items of the page in the second data storage location after generating the response; and
responsive to receiving a request from a different client for the at least one of the plurality of search result URLs, transmitting a response to the different client that includes at least some of the second portion of the content items of the page and excludes the first portion of the content items of the page.
18 . The method of claim 17 , wherein initiating the request for content to at least one of the plurality of search result URLs comprises initiating requests for content to two or more of the plurality of search result URLs.
19 . The method of claim 17 , further comprising causing output, at the client, of a search result page comprising hyperlinks to the plurality of search result URLs.
20 . The method of claim 17 , wherein generating the response to the request comprises identifying, in the second portion of the content items of the page, a pointer to at least one content item stored in a data store separate from the second data storage location, and generating the response to the request comprises retrieving the at least one content item from the data store.