Smartnic based virtual splitter ensuring microsecond latencies
A data protection system includes a splitter configured to reduce latencies when splitting writes in a computing environment. The splitter captures a write and adds metadata to augment the write with virtual related information. The augmented data is provided to a smartNIC while the write is then processed in the IO stack. The smartNIC may have a volume only visible to the splitter. The smartNIC also includes processing power that allows data protection operations to be performed at the smartNIC rather than with the processing resources of the host.
1. A method comprising:
receiving a write from an application at a filter framework implemented in a write path of a computing environment;
generating an augmented write by adding metadata to the write, wherein the metadata includes information for a destination of the write and an offset of the write in the destination;
transmitting the augmented write to a splitter component on a network interface card, wherein the splitter component is associated with a memory for storing the augmented write;
processing the augmented write stored in the memory of the network interface card; and
processing the write in the write path such that the write is committed to storage in the computing environment.
2. The method of claim 1 , wherein the destination comprises a virtual disk and an offset of the write in the virtual disk or a container and an offset of the write in the container.
3. The method of claim 1 , further comprising invoking a filter to augment the write, wherein the filter framework and the filter are implemented in a hypervisor or a container management layer.
4. The method of claim 1 , further comprising processing the augmented write at the network interface card, wherein the network interface card is a smart network interface and the processing includes one or more of resolving the write with other writes, compressing the write, deduplicating the write, encrypting the write, batching the write, and transmitting the write to a data protection system over a network.
5. The method of claim 3 , further comprising implementing a volume at the network interface card in the memory, wherein the volume is only visible to the filter framework and/or the filter.
6. The method of claim 5 , further comprising adding the metadata using a shared memory, wherein the shared memory is shared by the network interface card and the filter.
7. The method of claim 5 , further comprising adding the metadata using a fake write command to the volume and storing the fake write command until the write is received through the write path.
8. The method of claim 1 , further comprising transmitting the augmented write to the splitter component without further processing of the augmented write in a write stack.
9. The method of claim 1 , further comprising processing the write in the write path after the filter component acknowledges the augmented write to the filter.
10. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving a write from an application at a filter framework implemented in a write path of a computing environment;
generating an augmented write by adding metadata to the write, wherein the metadata includes information for a destination of the write and an offset of the write in the destination;
transmitting the augmented write to a splitter component on a network interface card, wherein the splitter component is associated with a memory for storing the augmented write;
processing the augmented write stored in the memory of the network interface card; and
processing the write in the write path such that the write is committed to storage in the computing environment.
11. The non-transitory storage medium of claim 10 , wherein the destination comprises a virtual disk and an offset of the write in the virtual disk or a container and an offset of the write in the container.
12. The non-transitory storage medium of claim 10 , further comprising invoking a filter to augment the write, wherein the filter framework and the filter are implemented in a hypervisor or a container management layer.
13. The non-transitory storage medium of claim 10 , further comprising processing the augmented write at the network interface card, wherein the network interface card is a smart network interface and the processing includes one or more of resolving the write with other writes, compressing the write, deduplicating the write, encrypting the write, batching the write, and transmitting the write to a data protection system over a network.
14. The non-transitory storage medium of claim 12 , further comprising implementing a volume at the network interface card in the memory, wherein the volume is only visible to the filter framework and the filter.
15. The non-transitory storage medium of claim 14 , further comprising adding the metadata using a shared memory, wherein the shared memory is shared by the network interface card and the filter.
16. The non-transitory storage medium of claim 14 , further comprising adding the metadata using a fake write command to the volume and storing the fake write command until the write is received through the write path.
17. The non-transitory storage medium of claim 10 , further comprising transmitting the augmented write to the splitter component without further processing of the augmented write in a write stack.
18. The non-transitory storage medium of claim 10 , further comprising processing the write in the write path after the filter component acknowledges the augmented write to the filter.
19. A method comprising:
receiving a write generated by an application at a device, wherein the write flows to a write path to a first write stack portion;
receiving the write at a filter framework in a kernel space, wherein the filter framework initials a process of splitting the write;
transmitting the write to a filter in a user space, wherein the filter generates an augmented write and transmits the augmented write to a network interface card;
after receiving an acknowledgement from the network interface card that the augmented write has been received, transmitting the write to the filter framework, wherein the filter framework passes the write to a second stack portion;
storing the write, which now has a physical address, in a storage device.
20. The method of claim 19 , further comprising processing the augmented write at the network interface card, wherein the processing includes one or more of resolving the write with other writes, compressing the write, deduplicating the write, encrypting the write, batching the write, and transmitting the write to a data protection system over a network,
wherein the device is controller, and
wherein augmenting the write includes adding metadata that includes information for a destination of the write and an offset of the write in the destination.