Document generation based on referral
A document machine may detect a request for provision of a document while that document is available for provisioning. The document machine may update a count of referrals to the document and, based on the count of referrals transgressing a threshold value, generate a substitute document based on the original document. This substitute document may then be provided in response to further requests for the original document after the original document is no longer available for provision. The updating of the count of referrals is based on the identifier of a network that referred a request detected while the first document was still available for provision. The document machine may then provide the substitute document in lieu of the original document in response to a further request for provision of the first document.
1. A method comprising:
detecting, by one or more processors of a machine, a request for provision of a first document that is available for provision;
updating a count of referrals based on determining the request was sent from a set of one or more networks, the count of referrals comprising a number of requests for provision of the first document received from the set of one or more networks;
retrieving a second document based on the first document and on the count of referrals transgressing a threshold value; and
providing the second document in response to a subsequent request for the first document, the subsequent request occurring after expiration of an availability of the first document.
2. The method of claim 1 , further comprising redirecting the subsequent request from the first document to the second document.
3. The method of claim 2 , wherein redirecting the subsequent request further comprises:
identifying a first locator for the first document within the subsequent request;
substituting a second locator for the second document within the subsequent request; and
transmitting the subsequent request to the second locator.
4. The method of claim 2 , wherein redirecting the subsequent request further comprises:
determining the first document is unavailable for provision; and
determining the second document is a substitute for the first document.
5. The method of claim 1 , further comprising:
generating the second document from the first document and including at least a portion of the first document in the second document.
6. The method of claim 1 , further comprising:
identifying a plurality of references based on the first document, the plurality of references associated with documents that are similar to the first document; and
providing one or more of the plurality of references within the second document.
7. The method of claim 1 , further comprising:
determining a different request for provision of the first document is received from a web crawling operation of a search engine, the search engine excluded from the set of one or more networks; and
excluding the different request for provision from updating the count of referrals for the first document.
8. A system comprising:
one or more processors; and
a non-transitory machine-readable storage medium coupled to the one or more processors, the non-transitory machine-readable storage medium comprising instructions that, when executed by the one or more processors, implement operations comprising:
detecting a request for provision of a first document that is available for provision,
updating a count of referrals based on determining the request was sent from a set of one or more networks, the count of referrals comprising a number of requests for provision of the first document,
retrieving a second document based on the first document and on the count of referrals transgressing a threshold value, and
providing the second document in response to a subsequent request for the first document, the subsequent request occurring after expiration of an availability of the first document.
9. The system of claim 8 , wherein the operations further comprise redirecting the subsequent request from the first document to the second document.
10. The system of claim 9 , wherein redirecting the subsequent request further comprises:
identifying a first locator for the first document within the subsequent request;
substituting a second locator for the second document within the subsequent request; and
transmitting the subsequent request to the second locator.
11. The system of claim 9 , wherein redirecting the subsequent request further comprises:
determining the first document is unavailable for provision; and
determining the second document is a substitute for the first document.
12. The system of claim 8 wherein the operations further comprise:
generating the second document from the first document and including at least a portion of the first document in the second document.
13. The system of claim 8 , wherein the operations further comprise:
identifying a plurality of references based on the first document, the plurality of references associated with documents that are similar to the first document; and
providing one or more of the plurality of references within the second document.
14. The system of claim 8 , wherein the operations further comprise:
determining a different request for provision of the first document is received from a web crawling operation of a search engine, the search engine excluded from the set of one or more networks; and
excluding the different request for provision from updating the count of referrals for the first document.
15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
detecting a request for provision of a first document that is available for provision;
updating a count of referrals based on determining the request was sent from a set of one or more networks, the count of referrals comprising a number of requests for provision of the first document;
retrieving a second document based on the first document and on the count of referrals transgressing a threshold value; and
providing the second document in response to a subsequent request for the first document, the subsequent request occurring after expiration of an availability of the first document.
16. The non-transitory machine-readable storage medium of claim 15 , wherein the operations further comprise redirecting the subsequent request from the first document to the second document.
17. The non-transitory machine-readable storage medium of claim 16 , wherein redirecting the subsequent request for provision further comprises:
identifying a first locator for the first document within the subsequent request;
substituting a second locator for the second document within the subsequent request; and
transmitting the subsequent request to the second locator.
18. The non-transitory machine-readable storage medium of claim 16 , wherein redirecting the request further comprises:
determining the first document is unavailable for provision; and
determining the second document is a substitute for the first document.
19. The non-transitory machine-readable storage medium of claim 15 , wherein the operations further comprise:
identifying a plurality of references based on the first document, the plurality of references associated with documents that are similar to the first document; and
providing one or more of the plurality of references within the second document.
20. The non-transitory machine-readable storage medium of claim 15 , wherein the operations further comprise:
determining a different request for provision of the first document is received from a web crawling operation of a search engine, the search engine excluded from the set of one or more networks; and
excluding the different request for provision from updating the count of referrals for the first document.