Application specific network telemetry and diagnostics
In certain embodiments, a method includes identifying, by a NIC of a node where application sender of an application executes, a network data unit for telemetry metadata insertion based on performing a match operation on information associated with the network data unit, wherein the network data unit is being transmitted from the application sender to an application receiver executing on another node; inserting, based on a first success of the first match operation, telemetry metadata into the network data unit, the telemetry metadata comprising network information and application specific information; stripping, by a last hop device along the data flow path, the telemetry metadata from the network data unit; generating, by the last hop device, a telemetry metadata report using the telemetry metadata; and providing the telemetry metadata report to an application collector executing on the second node.
1. A computer-implemented method, comprising:
identifying, by a network interface card (NIC) of a first node on which an application sender of an application executes, a network data unit for telemetry metadata insertion based on performing a first match operation on information associated with the network data unit, wherein the network data unit is being transmitted from the application sender of the first node to an application receiver of the application executing on a second node;
inserting, by the NIC and based on a first success of the first match operation, initial telemetry metadata into the network data unit, the initial telemetry metadata comprising network information and application specific information corresponding to the application,
wherein the application specific information identifies the application;
performing, by a network device of a hop along a data flow path of the network data unit, a second match operation using at least one of the information associated with the network data unit and the initial telemetry metadata;
inserting, by the network device and based on a second success of the second match operation, additional telemetry metadata into the network data unit;
stripping, by a last hop device of a last hop along the data flow path, the initial telemetry metadata and the additional telemetry metadata from the network data unit to obtain a stripped network data unit;
generating, by the last hop device, a telemetry metadata report using the initial telemetry metadata and the additional telemetry metadata stripped from the network data unit; and
providing the telemetry metadata report to an application collector executing on the second node.
2. The computer-implemented method of claim 1 , wherein the last hop device comprises a second NIC of the second node.
3. The computer-implemented method of claim 1 , wherein the last hop device comprises a second network device along the data flow path.
4. The computer-implemented method of claim 1 , wherein the application specific information further identifies a portion of the application.
5. The computer-implemented method of claim 1 , further comprising:
transmitting, by the last hop device, the stripped network data unit towards the application receiver along the data flow path.
6. The computer-implemented method of claim 1 , wherein:
identifying the network data unit is performed as part of executing a match action rule, and
the match action rule specifies that only a portion of network data units having a successful first match operation have respective initial telemetry metadata inserted.
7. The computer-implemented method of claim 1 , wherein:
identifying the network data unit is performed as part of executing a match action rule, and
the match action rule specifies that any network data unit below a size threshold does not have the initial telemetry metadata inserted.
8. A non-transitory computer-readable medium storing programming for execution by one or more processors, the programming comprising instructions to:
identify, by a network interface card (NIC) of a first node on which an application sender of an application executes, a network data unit for telemetry metadata insertion based on performing a first match operation on information associated with the network data unit, wherein the network data unit is being transmitted from the application sender of the first node to an application receiver of the application executing on a second node;
insert, by the NIC and based on a first success of the first match operation, initial telemetry metadata into the network data unit, the initial telemetry metadata comprising network information and application specific information corresponding to the application,
wherein the application specific information identifies the application;
strip, by a last hop device of a last hop along a data flow path of the network data unit, the initial telemetry metadata from the network data unit to obtain a stripped network data unit;
generate, by the last hop device, a telemetry metadata report using the initial telemetry metadata stripped from the network data unit; and
provide the telemetry metadata report to an application collector executing on the second node.
9. The non-transitory computer-readable medium of claim 8 , wherein the last hop device comprises a second NIC of the second node.
10. The non-transitory computer-readable medium of claim 8 , wherein the last hop device comprises a second network device along the data flow path.
11. The non-transitory computer-readable medium of claim 8 , wherein:
the programming comprises further instructions to:
perform, by a network device of a hop along the data flow path of the network data unit, a second match operation using at least one of the information associated with the network data unit and the initial telemetry metadata; and
insert, by the network device and based on a second success of the second match operation, additional telemetry metadata into the network data unit,
the last hop device further strips the additional telemetry metadata from the network data unit, and
the additional telemetry metadata is also used to generate the telemetry metadata report.
12. The non-transitory computer-readable medium of claim 8 , wherein the application specific information further identifies a portion of the application.
13. The non-transitory computer-readable medium of claim 8 , further comprising:
transmitting, by the last hop device, the stripped network data unit towards the application receiver along the data flow path.
14. The non-transitory computer-readable medium of claim 8 , wherein:
identifying the network data unit is performed as part of executing a match action rule, and
the match action rule specifies that only a portion of network data units having a successful first match operation have respective initial telemetry metadata inserted.
15. The non-transitory computer-readable medium of claim 8 , wherein:
identifying the network data unit is performed as part of executing a match action rule, and
the match action rule specifies that any network data unit below a size threshold does not have the initial telemetry metadata inserted.
16. A network device, comprising:
one or more processors; and
one or more non-transitory computer readable media storing instructions which, when executed by the one or more processors, cause the one or more processors to:
receive a network data unit comprising initial telemetry metadata inserted into the network data unit by a network interface card (NIC) of a first node on which an application sender of an application executes, wherein:
the initial telemetry metadata comprises network information and application specific information corresponding to the application,
the application specific information identifies the application,
the network device is a device along a data flow path of the network data unit, and
the network data unit is intended for an application receiver executing on a second node;
perform a match operation using at least one of information associated with the network data unit and the initial telemetry metadata;
insert, based on a second success of the match operation, additional telemetry metadata into the network data unit; and
transmit the network data unit towards a last hop device along the data flow path of the network data unit.
17. A system, comprising:
the network device of claim 16 ;
the NIC of the first node; and
the last hop device,
wherein the last hop device is configured to:
strip the initial telemetry metadata and the additional telemetry metadata from the network data unit to obtain a stripped network data unit;
generate a telemetry metadata report using the initial telemetry metadata and the additional telemetry metadata stripped from the network data unit; and
provide the telemetry metadata report to an application collector executing on the second node.
18. The system of claim 17 , wherein the last hop device is one of a second NIC on the second node or a second network device along the data flow path.
19. The system of claim 17 , wherein the last hop device is further configured to:
transmit the stripped network data unit towards the application receiver along the data flow path.
20. The network device of claim 16 , wherein the application specific information further identifies a portion of the application.