Assignment of resources in an input/output (I/O) virtualization system
An Input/Output (IO) Virtualization (IOV) system provides a mechanism for sharing computer peripheral devices or resources between multiple host computers by presenting a single resource multiple times to numerous host systems. The IOV system provides IO virtualization and host-to-host communication services to the host computers. The system comprises device interfaces coupled to the IO devices. Each IO device comprises at least one endpoint function (EPF). Host interfaces are each coupled to one of a number of host computers. Each host interface includes a proxy, and each proxy comprises configuration data.
1. A system, comprising:
a plurality of device interfaces configured to couple to a transport fabric and to a plurality of input/output (IO) devices, wherein each IO device comprises at least one endpoint function (EPF); and
a plurality of host interfaces configured to couple to the transport fabric and to a respective one of a plurality of independent host computers, wherein each host interface includes a device proxy configured to:
reserve resources of a host computer prior to assignment of an EPF corresponding to one of the plurality of IO devices, wherein the resources are usable by the EPF; and
expose the EPF to the host computer responsive to the EPF being assigned.
2. The system of claim 1 , wherein the system is configured to:
discover and enumerate a device proxy in a first domain of a host computer;
discover and enumerate an EPF assigned to the device proxy in a second domain, distinct from the first domain.
3. The system of claim 2 , wherein the first and second domains are Peripheral Component Interconnect Express (PCle) domains.
4. The system of claim 2 , wherein the device proxy is configured store configuration data of the EPF responsive to an assignment of the EPF.
5. The system of claim 4 , wherein the configuration data comprises a bus-device-function (BDF) number in the second domain.
6. The system of claim 4 , wherein the configuration data comprises a memory range identifier.
7. The system of claim 4 , wherein the configuration data comprises an endpoint function (EPF) identifier of the EPF.
8. The system of claim 4 , wherein the configuration data comprises a destination address of a device interface corresponding to the EPF.
9. The system of claim 4 , wherein the corresponding host computer is configured to rescan a bus coupled to the device proxy.
10. The system of claim 9 , wherein the rescan occurs in response to a PCIe hot-plug event.
11. The system of claim 9 , wherein the EPF is discoverable in the first domain via use of the configuration data.
12. The system of claim 1 , wherein the device proxies are reprogrammable to an original state that is a state of the device proxy prior to programming of the device proxy with the configuration data.
13. The system of claim 1 , wherein the device proxies are configured to expose PCle resource functions embodied in the EPFs as separate PCle devices.
14. The system of claim 1 , wherein the plurality of IO devices include an IO device with one endpoint function (EPF), wherein the IO device with one EPF is assigned to a single host computer that has privileged control over the EPF.
15. The system of claim 1 , wherein the plurality of IO devices include an IO device with a plurality of endpoint functions (EPFs), wherein the IO device with the plurality of EPFs is shared across ones of the plurality of independent host computers.
16. The system of claim 1 , wherein the device interfaces and the host interfaces are configured to communicate via packets that encapsulate Peripheral Component Interconnect Express (PCle) traffic to traverse the transport fabric.
17. A host computer, comprising:
a host interface configured to couple the host computer to a transport fabric usable to communicate with a plurality of input/output (IO) devices, wherein each IO device includes at least one endpoint function (EPF);
wherein the host interface implements a device proxy configured to:
reserve resources of the host computer prior to assignment of an EPF corresponding to one of the plurality of IO devices, wherein the resources are usable by the EPF; and
expose the EPF to the host computer responsive to the EPF being assigned.
18. The host computer of claim 17 , wherein the host computer is configured to enumerate the device proxy in a Peripheral Component Interconnect Express (PCle) domain of the host computer; and
wherein the device proxy is configured to expose an EPF enumerated in a PCIe domain distinct from the PCIe domain of the host computer.
19. The host computer of claim 17 , wherein the device proxy is configured to:
responsive to an assignment of the EPF:
store configuration information of the EPF, wherein the configuration information is usable to enumerate the EPF; and
indicate a hot-plug event to the host computer to cause the host computer to rescan a bus of the host computer and enumerate the EPF.
20. The host computer of claim 19 , wherein the configuration information includes a bus-device-function (BDF) number and an endpoint function (EPF) identifier of the EPF.
21. The host computer of claim 19 , wherein the host computer is configured to load a driver for the EPF responsive to indication of the hot-plug event.
22. The host computer of claim 17 , wherein the host interface is configured to:
encapsulate Peripheral Component Interconnect Express (PCle) traffic associated with the EPF within one or more packets;
communicate the one or more packets over the transport fabric.
23. The host computer of claim 17 , wherein the host interface is configured to share the IO device with one or more other host computers.
24. The host computer of claim 17 , wherein the device proxy is configured to expose an EPF assigned by a management central processor unit (MCPU) coupled to the transport fabric.