Scalable, high performance and highly available distributed storage system for internet content
A method for content storage on behalf of participating content providers begins by having a given content provider identify content for storage. The content provider then uploads the content to a given storage site selected from a set of storage sites. Following upload, the content is replicated from the given storage site to at least one other storage site in the set. Upon request from a given entity, a given storage site from which the given entity may retrieve the content is then identified. The content is then downloaded from the identified given storage site to the given entity. In an illustrative embodiment, the given entity is an edge server of a content delivery network (CDN).
1. A content storage and delivery system operated by a content delivery network (CDN) service provider on behalf of participating content providers, where the participating content providers are distinct from the CDN service provider, comprising:
a plurality of CDN content servers that are organized into sets;
a plurality of CDN storage sites, comprising: (i) a first content storage system that receives and stores a plurality of first content objects, where the plurality of first content objects are content that a first participating content provider desires to be stored and delivered over the CDN; and (ii) a second content storage system that receives and stores a plurality of second content objects, where the plurality of second content objects are content that a second participating content providers desires to be stored and delivered over the CDN;
where the plurality of first content objects of the first participating content provider are stored over multiple storage areas associated with at least one CDN storage site of the plurality of CDN storage sites;
where the plurality of second content objects of the second participating content provider are stored over multiple storage areas associated with at least one CDN storage site of the plurality of CDN storage sites; and
one or more CDN-managed domain name servers each of which is authoritative to resolve CDN-specific hostnames, where a first CDN-specific hostname has a first portion uniquely associated with the first participating content provider and a second portion associated with the CDN service provider, and where the first CDN-specific hostname also has associated therewith a value associated with a given one of the multiple storage areas in which a copy of a first content object can be obtained; and
where a second CDN-specific hostname has a first portion uniquely associated with the second participating content provider and the second portion associated with the CDN service provider, and where the second CDN-specific hostname also has associated therewith a value associated with a given one of the multiple storage areas from which a copy of a second content object can be obtained.
2. The content storage and delivery system as described in claim 1 where the plurality of CDN storage sites include first and second CDN storage sites that are each located in different Internet-accessible locations.
3. The content storage and delivery system as described in claim 2 wherein the first and second CDN storage sites operate independently from one another.
4. The content storage and delivery system as described in claim 1 wherein the first CDN-specific hostname comprises a portion of a URL.
5. The content storage and delivery system as described in claim 1 wherein the first CDN-specific hostname comprises a portion of a URL, where the URL also includes the value associated with a given one of the multiple storage areas from which a copy of a first content object can be obtained.
6. The content storage and delivery system as described in claim 1 wherein the multiple storage areas associated with at least one CDN storage site of the plurality of CDN storage sites comprises a set of directories.