Smart network interface card-based splitter for data replication
One example method includes a splitter for data protection operations including replication operations. The splitter is located on or integrated into a smart network interface card and operates in two modes. The splitter is controlled by a replication controller. In one mode, the control path and the data path both go to the replication controller. In another mode, the data path is directly from the splitter to one or more targets without passing through the replication controller.
1. A method, comprising:
receiving a write at a splitter, wherein the splitter is on a network card and is integrated with storage functions of the network card and wherein the splitter is controlled by a replication controller via a control path;
determining a source of the write and a policy associated with the source;
replicating the write in accordance with the policy; and
transporting the write to a target based on a mode of the splitter and transmitting the write to a storage associated with the source.
2. The method of claim 1 , further comprising transporting the write to the target through the replication controller when operating in a first mode and transporting the write directly to the target when operating in a second mode.
3. The method of claim 2 , wherein the second mode is associated with disaggregated targets such that a data path of writes replicated by the splitter do not pass through the replication controller.
4. The method of claim 1 , further comprising hard coding the splitter into an ASIC.
5. The method of claim 1 , further comprising programming the splitter into an FPGA.
6. The method of claim 2 , wherein the second mode is associated with a plurality of targets, the method further comprising journaling at each of the plurality of targets.
7. The method of claim 1 , further comprising controlling the splitter, by the replication controller, over the control path, wherein controlling splitter includes one or more of turning functionality on/off for specific storage targets, associating specific storage target low-level (network) addresses with high-level storage volumes identifiers, specifying network target addresses for specific data streams, managing the life-cycle and updates of the splitter, managing operation of the splitter at least when a virtual server is migrated to a different physical host and the splitter needs to flush the existing data and transfer responsibility to another splitter on another physical host.
8. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving a write at a splitter, wherein the splitter is on a network card and is integrated with storage functions of the network card and wherein the splitter is controlled by a replication controller via a control path;
determining a source of the write and a policy associated with the source;
replicating the write in accordance with the policy; and
transporting the write to a target based on a mode of the splitter and transmitting the write to a storage associated with the source.
9. The non-transitory storage medium of claim 8 , further comprising transporting the write to the target through the replication controller when operating in a first mode and transporting the write directly to the target when operating in a second mode.
10. The non-transitory storage medium of claim 9 , wherein the second mode is associated with disaggregated targets such that a data path of writes replicated by the splitter do not pass through the replication controller.
11. The non-transitory storage medium of claim 8 , further comprising hard coding the splitter into an ASIC.
12. The non-transitory storage medium of claim 8 , further comprising programming the splitter into an FPGA.
13. The non-transitory storage medium of claim 9 , wherein the second mode is associated with a plurality of targets, the method further comprising journaling at each of the plurality of targets.
14. The non-transitory storage medium of claim 8 , further comprising controlling the splitter, by the replication controller, over the control path wherein controlling splitter includes one or more of turning functionality on/off for specific storage targets, associating specific storage target low-level (network) addresses with high-level storage volumes identifiers, specifying network target addresses for specific data streams, managing the life-cycle and updates of the splitter, managing operation of the splitter at least when a virtual server is migrated to a different physical host and the splitter needs to flush the existing data and transfer responsibility to another splitter on another physical host.
15. A smart network interface card configured to provide network functions to a source and to storage, the card comprising:
a transport block comprising a processor, an ASIC, or an FPGA, the transport block configured to perform network transport functions for the source, the source including servers;
a storage block comprising the processor, an ASIC, or an FPGA, the storage block configured to perform storage functions, wherein the storage block is aware of the storage and types of the storage;
a splitter integrated into the storage block and controlled by a replication controller via a control path, wherein the splitter is configured to replicate writes from the source to at least one target by:
receiving the writes from the servers;
identifying, for each of the writes, an associated one of the servers and a policy associated with that server;
replicating the write in accordance with the policy to a particular target; and
transporting the write to the target based on a mode of the splitter and transmitting the write to the storage associated with the server.
16. The card according to claim 15 , wherein the mode is one of a first mode and a second mode, wherein a data path for the first mode includes the replication controller and wherein a data path for the second mode does not include the replication controller.
17. The card according to claim 16 , wherein the second mode is associated with disaggregated targets such that the data path associated with the second mode is directly from the splitter to at least one of the disaggregated targets.
18. The card according to claim 16 , wherein the splitter is hard coded into the ASIC or programmed into the FPGA.
19. The card according to claim 15 , further comprising controlling the splitter, by the replication controller, over the control path.