Efficient networking for a distributed storage system
A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. Data communication is made more efficient by removing the need to copy data in the networking stack, using hardware accelerated end-to-end checksum calculation, and supporting transmission formatting of data and header for special cases.
1. A system comprising:
a processor configured to generate a checksum seed such that a checksum generated according to the checksum seed is equal to zero; and
a transmitter configured to transmit a data block and a header block according to the checksum seed.
2. The system of claim 1 , wherein the processor is configured to use a partial checksum to generate the checksum.
3. The system of claim 1 , wherein the processor is configured to generate the checksum according to a baseline header field.
4. The system of claim 1 , wherein the processor is configured to generate the checksum according to a pre-determined header field that is not expected to change from a transmission of a first data block to a transmission of a second data block.
5. The system of claim 1 , wherein the transmitter is configured to transmit a special frame prior to the header block, if a number of bytes in the header block is greater than a threshold.
6. The system of claim 1 , wherein the transmitter is configured to transmit a special frame prior to the data block, if a number of bytes in the data block is greater than a threshold.
7. The system of claim 1 , wherein the processor is configured to:
execute a child partition on the processor; and
send outbound traffic from the child partition directly to the transmitter.
8. The system of claim 1 , wherein the checksum, generated according to the checksum seed, is a header checksum.
9. The system of claim 1 , wherein the checksum seed is one of a plurality of pre-determined numbers.
10. The system of claim 1 , wherein the checksum is generated by adding a partial checksum to a checksum of a non-baseline field.
11. A method comprising:
generating a checksum seed, via a processor, such that a checksum generated according to the checksum seed is equal to zero; and
transmitting a data block and a header block according to the checksum seed.
12. The method of claim 11 , wherein the method comprises generating the checksum according to a partial checksum.
13. The method of claim 11 , wherein the method comprises generating the checksum according to a baseline header field.
14. The method of claim 11 , wherein the method comprises generating the according to a pre-determined header field that is not expected to change between a transmission of a first data block and a transmission of a second data block.
15. The method of claim 11 , wherein the method comprises transmitting a special frame prior to the header block, if a number of bytes in the header block is greater than a threshold.
16. The method of claim 11 , wherein the method comprises transmitting a special frame prior to the data block, if a number of bytes in the data block is greater than a threshold.
17. The method of claim 11 , wherein the method comprises:
executing a child partition on the processor; and
sending outbound traffic from the child partition directly to the transmitter.
18. The method of claim 11 , wherein the checksum, generated according to the checksum seed, is a header checksum.
19. The method of claim 11 , wherein the checksum seed is one of a plurality of pre-determined numbers.
20. The method of claim 11 , wherein the method comprises generating the checksum by adding a partial checksum to a checksum of a non-baseline field.