Non-Disruptively Scaling Artificial Intelligence and Machine Learning Hyperscale Infrastructures
A hyperscale artificial intelligence and machine learning infrastructure includes a plurality of racks, where: at least one or more of the racks include one or more GPU servers; at least one or more of the racks include one or more storage systems; each of the racks include one or more switches coupled to at least one switch in another rack; and the one or more GPU servers are configured to execute one or more artificial intelligence or machine learning applications, wherein data stored within the one or more storage systems is used as input to the one or more artificial intelligence or machine learning applications.
1 . A hyperscale artificial intelligence (AI) and machine learning (ML) infrastructure, the hyperscale artificial intelligence and machine learning infrastructure including:
at least one rack comprising:
one or more storage systems including one or more storage resources that store data; and
at least one GPU (‘Graphical Processor Unit’) server configured to execute AI or ML applications using the data;
the at least one rack configured for:
performing, for at least one component of the hyperscale AI or ML infrastructure, a scaling operation that is non-disruptive to another component of the hyperscale AI or ML infrastructure, wherein the scaling operation comprises updating a namespace that exposes the one or more storage resources.
2 . The infrastructure of claim 1 , wherein the one or more storage systems comprises a fabric module configured to provision a software defined network for storage resources.
3 . The infrastructure of claim 2 , wherein the fabric module of the one or more storage systems presents the namespace for the at least one rack.
4 . The infrastructure of claim 3 , wherein:
the at least one rack is configured to maintain the namespace upon coupling of an additional rack.
5 . The infrastructure of claim 1 , wherein the at least one rack is configured in a leaf-spine network topology.
6 . The infrastructure of claim 1 , wherein the at least one rack is configured in a torus network topology.
7 . The infrastructure of claim 1 , wherein the at least one rack is configured in a hierarchical network topology.
8 . The infrastructure of claim 1 , wherein the at least one rack further comprises one or more switches.
9 . The infrastructure of claim 1 , wherein the at least one rack comprises at least two racks, wherein a first rack of the at least two racks comprises at least one GPU server, one or more switches, and no storage systems, and wherein a second rack of the at least two racks comprises at least one storage system, one or more switches, and no GPU servers.
10 . The infrastructure of claim 1 , wherein the namespace is a network address.
11 . A method of performing artificial intelligence and machine learning processes in a hyperscale artificial intelligence and machine learning infrastructure, the infrastructure comprising:
at least one rack comprising:
one or more storage systems including one or more storage resources that store data; and
at least one GPU (‘Graphical Processor Unit’) server configured to execute AI or ML applications using the data;
the at least one rack configured for:
performing, for at least one component of the hyperscale AI or ML infrastructure, a scaling operation that is non-disruptive to another component of the hyperscale AI or ML infrastructure, wherein the scaling operation comprises updating a namespace that exposes the one or more storage resources.
12 . The method of claim 11 , further comprising,
provisioning, by a fabric module of the one or more storage systems, a software defined network for storage resources.
13 . The method of claim 12 , wherein the fabric module of the one or more storage systems presents the namespace for the at least one rack.
14 . The method of claim 13 , wherein:
the at least one rack is configured to maintain the namespace upon coupling of an additional rack.
15 . The method of claim 11 , wherein the at least one rack is configured in a leaf-spine network topology.
16 . The method of claim 11 , wherein the at least one rack is configured in a torus network topology.
17 . The method of claim 11 , wherein the at least one rack is configured in a hierarchical network topology.
18 . The method of claim 11 , wherein the at least one rack further comprises one or more switches.
19 . The method of claim 11 , wherein the at least one rack comprises at least two racks, wherein a first rack of the at least two racks comprises at least one GPU server, one or more switches, and no storage systems, and wherein a second rack of the at least two racks comprises at least one storage system, one or more switches, and no GPU servers.
20 . The method of claim 11 , wherein the namespace is a network address.