Methods and apparatus for freshness and completeness of information
A system that facilitates publishing and consuming information that is of time sensitivity, for example, price information. Methods are employed to achieve completeness and freshness in information for a given domain. A preferred embodiment is a shopping site that is capable of comparing prices, purchasing bundled products and dealing with coupons.
1. A method of publishing, comprising:
providing a publication site server configured to store and to publish first time-sensitive data from a first data provider and second time-sensitive data pushed from a second data provider;
the publication site server conducting an auction, and incorporating auction results into at least one of an update fee schedule and a gathering fee schedule;
the publication site server differentially updating the first and second data (1) according to the update fee schedule indicating when updating should occur in exchange for which update fee, (2) according to the gathering fee schedule indicating when first and second websites of the first and second data providers should be crawled in exchange for which gathering fee; and (3) in response to receiving at least one of the fees from at least one of the first and the second data providers; and
providing a user interface configured to allow the publication site server to present the updated first and second data.
2. The method of claim 1 , wherein the update fee schedule provides for updating the first data at least daily.
3. The method of claim 1 , wherein the update fee schedule provides for updating the first data at least hourly.
4. The method of claim 1 , wherein the update fee schedule associates the first and second data with first and second update delays, respectively.
5. The method of claim 1 , wherein the update fee schedule associates the first and second data with first and second update queues, respectively.
6. The method of claim 1 , wherein the gathering fee schedule provides for differential delays in crawling first and second websites of the first and second data providers, respectively.
7. The method of claim 1 , wherein the gathering fee schedule provides for differential delays in crawling a first and second portions of a website.
8. The method of claim 1 , further comprising obtaining additional data representing updates of the first data for publication on the publication site by action of a human digger not associated with either of the data providers.
9. The method of claim 8 , wherein the additional data comprises a correction to the first data.
10. The method of claim 1 , further comprising allowing a consumer to search for goods and services and to compare prices of the goods and services via the publication site server.
11. The method of claim 1 , further comprising including price information of at least one of goods and services in each of the first and the second data.
12. The method of claim 1 , further comprising including price information of items within a bundled combination in the first and the second data.
13. The method of claim 1 , further comprising storing price information for at least 10,000 items where the first and the second data comprises at least a portion of the price information.
14. The method of claim 1 , further comprising offering a coupon, where the first data comprises the coupon.
15. The method of claim 1 , wherein the step of providing the publication site server includes the server presenting the user interface selected from the group consisting of a website, a bulletin board, a forum, and a blog.
16. The method of claim 1 , wherein the auction results in the fees within at least one of the update and the gathering fee schedule.
17. The method of claim 16 , wherein the auction involves associating the first and second data with first and second update delays within the update fee schedule, respectively.
18. The method of claim 16 , wherein the auction involves associating differential delays of the gathering fee schedule with crawling first and second websites related to the first and second data, respectively.
19. The method of claim 16 , wherein the auction is operated in a partially blind manner to establish a position within at least one of the fee schedules.