Using virtual bus to form virtual network
A data processing system in embodiments of this application includes a storage layer, a virtual bus, and a service layer. The storage layer includes a plurality of storage devices that are configured to provide storage space. The virtual bus is configured to receive registration of the plurality of storage devices to form a virtual network comprising the plurality of storage devices. The service layer is configured to provide a service for a user based on the virtual network.
1 . A data processing system, comprising:
a plurality of storage devices, and a virtual bus, wherein
the plurality of storage devices are configured to provide storage space;
the virtual bus is configured to receive a registration of the plurality of storage devices; and wherein
the plurality of storage devices are connected to the virtual bus, and the plurality of storage devices are not directly connected to each other, and the plurality of storage devices exchange data or transfer a message to each other through the virtual bus;
wherein the plurality of storage devices exchange data through the virtual bus comprises: a transmit end of the plurality of storage devices is configured to push data to a pre-divided cache space of the virtual bus, and a receive end of the plurality of storage devices is configured to fetch the data from the pre-divided cache space; and
wherein the plurality of storage devices transfer a message to each other through the virtual bus comprises: the plurality of storage devices transfer a message to each other through a message queue of the virtual bus, and the message queue is configured to store the message transferred between the plurality of storage devices.
2 . The system according to claim 1 , wherein the plurality of storage devices comprise one or more of a storage array, a storage server, a public cloud, a private cloud, or a hybrid cloud.
3 . The system according to claim 1 , wherein one of the plurality of storage devices is configured to submit registration information to the virtual bus.
4 . The system according to claim 3 , wherein the registration information comprises device information of the storage device.
5 . The system according to claim 3 , wherein the registration information comprises metadata of data.
6 . The system according to claim 3 , wherein the registration information comprises information about a storage pool.
7 . The system according to claim 3 , wherein the registration information satisfies a preset data format.
8 . The system according to claim 3 , wherein the one of the plurality of storage devices is configured to submit the registration information to the virtual bus after obtaining authorization.
9 . The system according to claim 1 , wherein the virtual bus further comprises a message queue, and the message queue is configured to store a message about at least one of the plurality of storage devices.
10 . The system according to claim 9 , wherein
the message queue is configured to record a data push request from the receive end, and the data push request requests the transmit end to push target data;
the transmit end is configured to push the target data to a preset location in the pre-divided cache space; and
the message queue is configured to record a data preparation message related to the receive end, and the data preparation message notifies the receive end to fetch the target data from the preset location.
11 . A data processing method, comprising:
receiving, by using a virtual bus, a registration of a plurality of storage devices, wherein the plurality of storage devices are configured to provide storage space, wherein the plurality of storage devices are connected to the virtual bus, the plurality of storage devices are not directly connected to each other, the plurality of storage devices exchange data or transfer a message to each other through the virtual bus;
pushing, by a transmit end of the plurality of storage devices, data to a pre-divided cache space of the virtual bus; and
fetching, by a receive end of the plurality of storage devices, the data from the pre-divided cache space; and wherein
the plurality of storage devices transfer a message to each other through the virtual bus comprises: the plurality of storage devices transfer a message to each other through a message queue of the virtual bus, and the message queue is configured to store the message transferred between the plurality of storage devices.
12 . The method according to claim 11 , wherein the plurality of storage devices comprise one or more of a storage array, a storage server, a public cloud, a private cloud, or a hybrid cloud.
13 . The method according to claim 11 , wherein the method further comprises:
submitting, by one of the plurality of storage devices, registration information to the virtual bus.
14 . The method according to claim 13 , wherein the registration information comprises device information of the storage device.
15 . The method according to claim 13 , wherein the registration information comprises metadata of data.
16 . The method according to claim 13 , wherein the registration information comprises information about a storage pool.
17 . The method according to claim 13 , wherein the registration information satisfies a preset data format.
18 . The method according to claim 13 , wherein the method further comprises:
submitting, by the one of the plurality of storage devices, the registration information to the virtual bus after obtaining authorization.