SmartNIC based virtual splitter ensuring microsecond latencies
A data protection system includes a splitter configured to reduce latencies when splitting writes in a computing environment. The splitter captures a write and adds metadata to augment the write with virtual related information. The augmented data is provided to a smartNIC while the write is then processed in the IO stack. The smartNIC may have a volume only visible to the splitter. The smartNIC also includes processing power that allows data protection operations to be performed at the smartNIC rather than with the processing resources of the host.
1. A method, comprising:
receiving a write from an application at a filter framework implemented in a write path of a computing environment;
generating an augmented write by adding metadata to the write, wherein the metadata includes information for a source virtual disk of the write and an offset of the write in the source virtual disk;
transmitting the augmented write to a splitter component on a network interface card, wherein the splitter component is part of a data protection system; and
processing the write, after receiving an acknowledgment from the splitter component, in the write path such that the write is committed to storage.
2. The method of claim 1 , invoking a filter to augment the write, wherein the filter is in a user space and the filter framework is in a kernel.
3. The method of claim 1 , further comprising processing the augmented write at the network interface card, wherein the network interface case is a smart network interface and the processing includes one or more of resolving the write with other writes, compressing the write, deduplicating the write, encrypting the write, batching the write, and transmitting the write to the data protection system over a network.
4. The method of claim 1 , further comprising adding the metadata using end to end encryption.
5. The method of claim 2 , further comprising implementing a volume at the network interface card, wherein the volume is only visible to the filter framework, and the filter.
6. The method of claim 5 , further comprising adding the metadata using a shared memory, wherein the shared memory is shared by the network interface card and the filter.
7. The method of claim 5 , further comprising adding the metadata using a fake write command to the volume.
8. The method of claim 7 , further comprising storing the fake write command until the write is received through the write path.
9. The method of claim 2 , further comprising implementing the filter framework and the filter in a hypervisor or a container management layer.
10. The method of claim 1 , transmitting the augmented write to the splitter component without further processing of the augmented write in the stack.
11. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving a write from an application at a filter framework implemented in an write path of a computing environment;
generating an augmented write by adding metadata to the write, wherein the metadata includes information for a source virtual disk of the write and an offset of the write in the source virtual disk;
transmitting the augmented write to a splitter component on a network interface card, wherein the splitter component is part of a data protection system; and
processing the write, after receiving an acknowledgment from the splitter component, in the write path such that the write is committed to storage.
12. The non-transitory storage medium of claim 11 , invoking a filter to augment the write, wherein the filter is in a user space and the filter framework is in a kernel.
13. The non-transitory storage medium of claim 11 , further comprising processing the augmented write at the network interface card, wherein the network interface case is a smart network interface and the processing includes one or more of resolving the write with other writes, compressing the write, deduplicating the write, encrypting the write, batching the write, and transmitting the write to the data protection system over a network.
14. The non-transitory storage medium of claim 11 , further comprising adding the metadata using end to end encryption.
15. The non-transitory storage medium of claim 12 , further comprising implementing a volume at the network interface card, wherein the volume is only visible to the filter framework, and the filter.
16. The non-transitory storage medium of claim 15 , further comprising adding the metadata using a shared memory, wherein the shared memory is shared by the network interface card and the filter.
17. The non-transitory storage medium of claim 15 , further comprising adding the metadata using a fake write command to the volume.
18. The non-transitory storage medium of claim 17 , further comprising storing the fake write command until the write is received through the write path.
19. The non-transitory storage medium of claim 12 , further comprising implementing the filter framework and the filter in a hypervisor or a container management layer.
20. The non-transitory storage medium of claim 11 , transmitting the augmented write to the splitter component without further processing of the augmented write in the stack.