Switched stream server architecture
A method for allocating content requests to a server pool includes directing a stream requesting a novel title to one of a least-busy server in a server pool and a least-miss-traffic server in the server pool; setting the server to which the novel title was directed to the requested title's preferred server; directing a stream requesting a familiar title to the title's preferred server; and directing a stream requesting a crowded title to one of a least-busy server and the least-miss-traffic server.
1. A method comprising: directing a stream requesting a novel title to one of a least-busy server in a server pool and a least-miss-traffic server in the server pool, even if the novel title is already cached on a not full server that is not the least busy or least miss server in the pool; setting the server to which the novel title was directed to the requested title's preferred server, directing a stream requesting a familiar title to the title's preferred server, even if the familiar title is not already cached on the preferred server, directing a stream requesting a crowded title to one of a least-busy server and the least-miss-traffic server.
2. The method of claim 1 , further comprising: the server to which the crowded title is directed does not become the title's new preferred server.
3. A method comprising: directing a stream requesting a novel title to a least-busy server of a server pool; adding the server to which the novel title was directed to the requested title's preferred-servers list; directing a stream requesting a familiar title to the least-busy server from the requested title's preferred-servers list, where the preferred servers list comprises at least one server that does not already cache the familiar title.
4. The method of claim 3 , further comprising: directing a stream requesting a crowded title to the least busy server in the server pool.
5. The method of claim 3 , further comprising: checking one or more titles periodically for an opportunity to remove some servers that cache the title from the title's preferred list.
6. The method of claim 3 , further comprising: if a title has cooled, and at least one of the servers on its preferred server list is not full, remove the most-busy of the servers on the title's preferred-servers list.
7. A server system comprising: non-transitory machine memory and/or circuits embodying logic to direct a stream requesting a novel title to a least-busy server of a server pool; add the server to which the novel title was directed to the requested title's preferred-servers list; direct a stream requesting a familiar title to the least-busy server from the requested title's preferred-servers list, where the preferred servers list comprises at least one server that does not already cache the familiar title.
8. The server system of claim 7 , further comprising: non-transitory machine memory and/or circuits embodying logic to direct a stream requesting a crowded title to the least busy server in the server pool.
9. The server system of claim 7 , further comprising: non-transitory machine memory and/or circuits embodying logic to add the least-busy server to the title's preferred-servers list if and only if the title is hot.
10. The server system of claim 7 , further comprising: non-transitory machine memory and/or circuits embodying logic to check one or more titles periodically for an opportunity to remove some servers from the title's preferred list.
11. The server system of claim 7 , further comprising: non-transitory machine memory and/or circuits embodying logic to if a title has cooled, and at least one of the servers on its preferred server list is not full, remove the most-busy, of the servers on the title's preferred-servers list.