Messaging between remote controller and forwarding element
Some embodiments of the invention provide a forwarding element that can be configured through in-band data-plane messages from a remote controller that is a physically separate machine from the forwarding element. The forwarding element of some embodiments has data plane circuits that include several configurable message-processing stages, several storage queues, and a data-plane configurator. A set of one or more message-processing stages of the data plane are configured (1) to process configuration messages received by the data plane from the remote controller and (2) to store the configuration messages in a set of one or more storage queues. The data-plane configurator receives the configuration messages stored in the set of storage queues and configures one or more of the configurable message-processing stages based on configuration data in the configuration messages.
1. Integrated circuit for use with a remote controller and at least one network, the integrated circuit including processor and memory, the integrated circuit being for use in network forwarding operations associated with forwarding received frame data toward at least one destination via the at least one network, the received frame data comprising header data, the integrated circuit comprising:
programmable packet processing pipeline circuitry configurable, based upon programming instructions to be received by the integrated circuit, to comprise:
at least one match-action unit to modify the header data, based upon comparison of at least one portion of the header data with table data, for use in generating at least one output frame; and
frame data processing circuitry for use in queuing-related, scheduling-related, quality of service-related, and/or replication-related operations associated with processing of the received frame data;
wherein:
the integrated circuit is programmable based upon Ethernet frame data to be received by the integrated circuit from the remote controller via the at least one network; and
the programming instructions are to be:
generated local to the integrated circuit; and
provided to the integrated circuit via an interface of the integrated circuit.
2. The integrated circuit of claim 1 , wherein: the Ethernet frame data comprises header field information associated with the remote controller, at least in part; in response the Ethernet frame data, the integrated circuit is to generate, other Ethernet frame data for transmission to the remote controller via the packet processing pipeline circuitry; the other Ethernet frame data is to include identifying data to indicate that the other Ethernet frame data constitutes a reply to the Ethernet frame data from the remote controller; and the at least one match action-unit is configurable to perform at least one action that is to be determined based at least in part upon at least one matching operation involving, at least in part, the Ethernet frame data.
3. The integrated circuit of claim 2 , wherein: the programmable packet processing pipeline circuitry is also configurable, based upon the programming instructions to be received by the integrated circuit, to comprise: parser circuitry to obtain, at least in part, the header data; and at least one stage to generate, at least in part, at least one output frame that is to be forwarded toward the at least one destination via the at least one network; and the interface of the integrated circuit comprises microcontroller and PCIe components.
4. The integrated circuit of claim 3 , wherein: the integrated circuit is configurable to implement one or more of the following: a top-of-rack switch; a router; and/or a spine switch; and the integrated circuit is configurable for use with: at least one network fabric; and/or at least one TCAM.
5. The integrated circuit of claim 3 , wherein: the integrated circuit is programmable to generate statistical data related to the integrated circuit for transmission via the at least one network; and the statistical data is associated with counter data.
6. At least one non-transitory machine-readable memory storing program instructions to be executed by an integrated circuit, the integrated circuit being for use with a remote controller and at least one network, the integrated circuit also being for use in network forwarding operations associated with forwarding received frame data toward at least one destination via the at least one network, the received frame data comprising header data, the program instructions, when executed by the integrated circuit, resulting in the integrated circuit being configured to perform operations comprising: processing, by programmable packet processing pipeline circuitry of the integrated circuit, the received frame data, the programmable packet processing pipeline circuitry being configurable, based upon other instructions to be received by the integrated circuit, to comprise: at least one match-action unit to modify the header data, based upon comparison of at least one portion of the header data with table data, for use in generating at least one output frame; and processing, by frame data processing circuitry of the integrated circuit, the received frame data, in queuing-related, scheduling-related, quality of service-related, and/or replication-related operations; wherein: the integrated circuit is programmable based upon Ethernet frame data to be received by the integrated circuit from the remote controller via the at least one network; and the other instructions are to be: generated local to the integrated circuit; and provided to the integrated circuit via an interface of the integrated circuit.
7. The at least one non-transitory machine-readable memory of claim 6 , wherein: the Ethernet frame data comprises header field information associated with the remote controller, at least in part; in response the Ethernet frame data, the integrated circuit is to generate, other Ethernet frame data for transmission to the remote controller via the packet processing pipeline circuitry; the other Ethernet frame data is to include identifying data to indicate that the other Ethernet frame data constitutes a reply to the Ethernet frame data from the remote controller; and the at least one match action-unit is configurable to perform at least one action that is to be determined based at least in part upon at least one matching operation involving, at least in part, the Ethernet frame data.
8. The at least one non-transitory machine-readable memory of claim 7 , wherein: the programmable packet processing pipeline circuitry is also configurable, based upon the other instructions to be received by the integrated circuit, to comprise: parser circuitry to obtain, at least in part, the header data; and at least one stage to generate, at least in part, at least one output frame that is to be forwarded toward the at least one destination via the at least one network; and the interface of the integrated circuit comprises microcontroller and PCIe components.
9. The at least one non-transitory machine-readable memory of claim 8 , wherein: the integrated circuit is configurable to implement one or more of the following: a top-of-rack switch; a router; and/or a spine switch; and the integrated circuit is configurable for use with: at least one network fabric; and/or at least one TCAM.
10. The at least one non-transitory machine-readable memory of claim 8 , wherein: the integrated circuit is programmable to generate statistical data related to the integrated circuit for transmission via the at least one network; and the statistical data is associated with counter data.
11. A method implemented using an integrated circuit, the integrated circuit being for use with a remote controller and at least one network, the integrated circuit also being for use in network forwarding operations associated with forwarding received frame data toward at least one destination via the at least one network, the received frame data comprising header data, the method comprising: processing, by programmable packet processing pipeline circuitry of the integrated circuit, the received frame data, the programmable packet processing pipeline circuitry being configurable, based upon programming instructions to be received by the integrated circuit, to comprise: at least one match-action unit to modify the header data, based upon comparison of at least one portion of the header data with table data, for use in generating at least one output frame; and processing, by frame data processing circuitry of the integrated circuit, the received frame data, in queuing-related, scheduling-related, quality of service-related, and/or replication-related operations; wherein: the integrated circuit is programmable based upon Ethernet frame data to be received by the integrated circuit from the remote controller via the at least one network; and the programming instructions are to be: generated local to the integrated circuit; and provided to the integrated circuit via an interface of the integrated circuit.
12. The method of claim 11 , wherein: the Ethernet frame data comprises header field information associated with the remote controller, at least in part; in response the Ethernet frame data, the integrated circuit is to generate, other Ethernet frame data for transmission to the remote controller via the packet processing pipeline circuitry; the other Ethernet frame data is to include identifying data to indicate that the other Ethernet frame data constitutes a reply to the Ethernet frame data from the remote controller; and the at least one match action-unit is configurable to perform at least one action that is to be determined based at least in part upon at least one matching operation involving, at least in part, the Ethernet frame data.
13. The method of claim 12 , wherein: the programmable packet processing pipeline circuitry is also configurable, based upon the programming instructions to be received by the integrated circuit, to comprise: parser circuitry to obtain, at least in part, the header data; and at least one stage to generate, at least in part, at least one output frame that is to be forwarded toward the at least one destination via the at least one network; and the interface of the integrated circuit comprises microcontroller and PCIe components.
14. The method of claim 13 , wherein: the integrated circuit is configurable to implement one or more of the following: a top-of-rack switch; a router; and/or a spine switch; and the integrated circuit is configurable for use with: at least one network fabric; and/or at least one TCAM.
15. The method of claim 13 , wherein: the integrated circuit is programmable to generate statistical data related to the integrated circuit for transmission via the at least one network; and the statistical data is associated with counter data.
16. Network switch circuitry for use with a remote controller and at least one network, the network switch circuitry including processor and memory, the network switch circuitry being for use in network forwarding operations associated with forwarding received frame data toward at least one destination via the at least one network, the received frame data comprising header data, the network switch circuitry comprising:
physical ports to be coupled to the at least one network, the physical ports to be used in frame data reception and transmission via the at least one network; and
an integrated circuit coupled to the physical ports, the integrated circuit comprising:
programmable packet processing pipeline circuitry configurable, based upon programming instructions to be received by the integrated circuit, to comprise:
at least one match-action unit to modify the header data, based upon comparison of at least one portion of the header data with table data, for use in generating at least one output frame; and
frame data processing circuitry for use in queuing-related, scheduling-related, quality of service-related, and/or replication-related operations associated with processing of the received frame data;
wherein:
the integrated circuit is programmable based upon Ethernet frame data to be received by the integrated circuit from the remote controller via the at least one network; and
the programming instructions are to be:
generated local to the integrated circuit; and
provided to the integrated circuit via an interface of the integrated circuit.
17. The network switch circuitry of claim 16 , wherein: the Ethernet frame data comprises header field information associated with the remote controller, at least in part; in response the Ethernet frame data, the integrated circuit is to generate, other Ethernet frame data for transmission to the remote controller via the packet processing pipeline circuitry; the other Ethernet frame data is to include identifying data to indicate that the other Ethernet frame data constitutes a reply to the Ethernet frame data from the remote controller; and the at least one match action-unit is configurable to perform at least one action that is to be determined based at least in part upon at least one matching operation involving, at least in part, the Ethernet frame data.
18. The network switch circuitry of claim 17 , wherein: the programmable packet processing pipeline circuitry is also configurable, based upon the programming instructions to be received by the integrated circuit, to comprise: parser circuitry to obtain, at least in part, the header data; and at least one stage to generate, at least in part, at least one output frame that is to be forwarded toward the at least one destination via the at least one network; and the interface of the integrated circuit comprises microcontroller and PCIe components.
19. The network switch circuitry of claim 18 , wherein: the integrated circuit is configurable to implement one or more of the following: a top-of-rack switch; a router; and/or a spine switch; and the integrated circuit is configurable for use with: at least one network fabric; and/or at least one TCAM.
20. The network switch circuitry of claim 18 , wherein: the integrated circuit is programmable to generate statistical data related to the integrated circuit for transmission via the at least one network; and the statistical data is associated with counter data.