Method and system for automated analysis and transformation of web pages
A method and system for modifying web pages, including dynamic web pages, based on automated analysis wherein web pages are transformed based on transformation instructions in nearly real-time, and wherein analysis is performed and transformation instructions based on the analysis are prepared prior to a request for the web page. The system has two primary components, an analyzer which asynchronously and repeatedly analyzes web pages creating and updating transformation instructions relating to the web pages, and a transformer which intercepts traffic to a web server in response to a request for the web page, receives the returned web pages, and transforms them based on stored transformation instructions.
1. Apparatus, comprising:
one or more hardware processors;
computer memory associated with the one or more hardware processors;
computer program instructions held in the computer memory and executed by the one or more hardware processors to change the content of an object, in response to a request for the document from a client, the computer program instructions comprising:
first program code operative asynchronous to, and prior to the request from the client, to analyze at least a portion of the object to identify at least a predetermined characteristic and, in response thereto, to create one or more transformation instructions corresponding to the characteristic;
second program code operative to store the one or more transformation instructions prior to the request from the client; and
third program code operative upon receipt of the request for the object to modify the object based on the one or more transformation instructions previously stored, and to return the modified object to the client in response to the request for the object;
wherein the third program code operates in a request and response processing flow between the client and an origin server that publishes the object, and the first program code operates externally to the request and response processing flow between the client and the origin server.
2. The apparatus as described in claim 1 , wherein the transformation instructions are search and replace instructions.
3. The apparatus as defined in claim 1 , wherein the first program code and the third program code utilize different ones of the one or more hardware processors.
4. The apparatus as defined in claim 1 , wherein the first program code utilizes computer memory at a first location, and wherein the third program code utilizes local cache memory at a second location different from the first location.
5. The apparatus as described in claim 1 , wherein a transformation instruction is created without knowledge of the object to be transformed.
6. The apparatus as described in claim 1 , wherein the third program code operates in an edge server of a content delivery network.
7. The apparatus as described in claim 1 , wherein the computer program instructions include fourth program code for storing the transformation instructions.
8. The apparatus as described in claim 1 , wherein the transformation instructions are executed on hardware processors located at different locations.
9. The apparatus as described in claim 1 , wherein the object is available for delivery from a content delivery network, and wherein a transformation instruction references the object.
10. The apparatus as described in claim 1 , wherein the first program code monitors a repository to identify content objects from a set of content objects that include the object and that the first program code should analyze to identify the predetermined characteristic.