IP Library › Granted Patent US 12,333,347
Granted Patent B2
US 12,333,347 · App. 18/658,717 · Granted Jun 17, 2025

Monitoring and policy control of distributed data and control planes for virtual nodes

Inventors: Harshit Naresh Chitalia (Mountain View, CA); Travis Gregory Newhouse (Encinitas, CA); Sumeet Singh (Saratoga, CA)
Assignee: Juniper Networks, Inc.
G06F9/5072H04L41/14H04L41/22G06F3/0481
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,347
App. No.
18/658,717
Granted
Jun 17, 2025
Kind
B2
Abstract

A computing system includes a computing device configured to execute a plurality of virtual machines, each virtual machine of the plurality of virtual machines configured to provide control plane functionality for at least a different respective subset of forwarding units of a network device, the computing device distinct from the network devices. The computing system also includes a policy agent configured to execute on the computing device. The agent is configured to determine that a particular virtual machine of the plurality of virtual machines provides control plane functionality for one or more forwarding units of the network device; determine control plane usage metrics for resources of the particular virtual machine; and output, to a policy controller, data associated with the control plane usage metrics and data associating the particular virtual machine with the one or more forwarding units for which the particular virtual machine provides control plane functionality.

Claims (37)

1. A computing system comprising:

a computing device configured to execute a virtualized instance configured to provide control plane functionality for one or more physical forwarding units of a network device, the computing device distinct from the network device; and

a policy agent configured to execute on the computing device, the policy agent configured to:

determine that the virtualized instance provides the control plane functionality for the one or more physical forwarding units of the network device;

determine control plane usage metrics for resources of the virtualized instance; and

output, to a policy controller, (i) data associated with the control plane usage metrics for resources of the virtualized instance and (ii) data associating the virtualized instance with a unique identifier of the one or more physical forwarding units for which the virtualized instance provides control plane functionality, wherein the data associating the virtualized instance with the unique identifier enables the policy controller to correlate the control plane usage metrics for resources of the virtualized instance with data plane usage metrics for resources of the one or more physical forwarding units of the network device.

2. The computing system of claim 1 , wherein the one or more physical forwarding units of the network device comprises one or more line cards of the network device.

3. The computing system of claim 1 , wherein the virtualized instance executing on the computing device comprises one of a virtual machine or a container.

4. The computing system of claim 1 , wherein the policy controller is further configured to:

determine whether the data associated with the control plane usage metrics and the data associated with the data plane usage metrics are associated with a same virtual routing node based at least in part on the data associating the virtualized instance with the one or more unique identifiers of the one or more physical forwarding units; and

based on a determination that the data associated with the control plane usage metrics and the data associated with the data plane usage metrics are associated with the same virtual routing node, output, to a dashboard software system, data indicative of the data plane usage metrics,

wherein the dashboard software system is further configured to output, for display in a single graphical user interface, the data indicative of the data plane usage metrics and the control plane usage metrics.

5. The computing system of claim 1 , wherein the one or more physical forwarding units of the network device and the virtualized instance form a single virtual routing node that appears, to external network devices, as a single physical routing node in a network.

6. Non-transitory computer-readable storage media comprising instructions that, when executed by processing circuitry, cause the processing circuitry to:

execute a virtualized instance on a computing device, the virtualized instance configured to provide control plane functionality for one or more physical forwarding units of a network device, the computing device distinct from the network device; and

determine that the virtualized instance provides the control plane functionality for the one or more physical forwarding units of the network device;

determine control plane usage metrics for resources of the virtualized instance; and

output, to a policy controller, (i) data associated with the control plane usage metrics for resources of the virtualized instance and (ii) data associating the virtualized instance with a unique identifier of the one or more physical forwarding units for which the virtualized instance provides control plane functionality, wherein the data associating the virtualized instance with the unique identifier enables the policy controller to correlate the control plane usage metrics for resources of the virtualized instance with data plane usage metrics for resources of the one or more physical forwarding units of the network device.

7. The non-transitory computer-readable storage media of claim 6 , wherein the one or more physical forwarding units of the network device comprises one or more line cards of the network device.

8. The non-transitory computer-readable storage media of claim 6 , wherein the virtualized instance executing on the computing device comprises one of a virtual machine or a container.

9. The non-transitory computer-readable storage media of claim 6 , further comprising instructions that, when executed by the processing circuitry, cause the processing circuitry to:

determine whether the data associated with the control plane usage metrics and the data associated with the data plane usage metrics are associated with a same virtual routing node based at least in part on the data associating the virtualized instance with the one or more unique identifiers of the one or more physical forwarding units; and

based on a determination that the data associated with the control plane usage metrics and the data associated with the data plane usage metrics are associated with the same virtual routing node, output data indicative of the data plane usage metrics,

output, for display in a single graphical user interface, the data indicative of the data plane usage metrics and the control plane usage metrics.

10. The non-transitory computer-readable storage media of claim 6 , wherein the one or more physical forwarding units of the network device and the virtualized instance form a single virtual routing node that appears, to external network devices, as a single physical routing node in a network.

11. A method comprising:

executing a virtualized instance on a computing device, the virtualized instance configured to provide control plane functionality for one or more physical forwarding units of a network device, the computing device distinct from the network device; and

determining that the virtualized instance provides the control plane functionality for the one or more physical forwarding units of the network device;

determining control plane usage metrics for resources of the virtualized instance; and

outputting, to a policy controller, (i) data associated with the control plane usage metrics for resources of the virtualized instance and (ii) data associating the virtualized instance with a unique identifier of the one or more physical forwarding units for which the virtualized instance provides control plane functionality, wherein the data associating the virtualized instance with the unique identifier enables the policy controller to correlate the control plane usage metrics for resources of the virtualized instance with data plane usage metrics for resources of the one or more physical forwarding units of the network device.

12. The method of claim 11 , wherein the one or more physical forwarding units of the network device comprises one or more line cards of the network device.

13. The method of claim 11 , wherein the virtualized instance executing on the computing device comprises one of a virtual machine or a container.

14. The method of claim 11 , further comprising:

determining whether the data associated with the control plane usage metrics and the data associated with the data plane usage metrics are associated with a same virtual routing node based at least in part on the data associating the virtualized instance with the one or more unique identifiers of the one or more physical forwarding units; and

based on determining that the data associated with the control plane usage metrics and the data associated with the data plane usage metrics are associated with the same virtual routing node, outputting data indicative of the data plane usage metrics,

outputting, for display in a single graphical user interface, the data indicative of the data plane usage metrics and the control plane usage metrics.

15. The method of claim 11 , wherein the one or more physical forwarding units of the network device and the virtualized instance form a single virtual routing node that appears, to external network devices, as a single physical routing node in a network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2025
From: CHITALIA, HARSHIT NARESH; NEWHOUSE, TRAVIS GREGORY; SINGH, SUMEET
To: JUNIPER NETWORKS, INC.
Reel/Frame 071838/0679 →
Continuity (3)
Division 18327518 · Jun 1, 2023
Continuation 16024108 · Jun 29, 2018
Related Publication 20240297827A1 · Sep 5, 2024
References Cited (71)
US 8612612B1 · Dukes et al. · 2013 [cited by applicant]
US 8953439B1 · Lin et al. · 2015 [cited by applicant]
US 9258195B1 · Pendleton et al. · 2016 [cited by applicant]
US 9838309B1 · Ghosh et al. · 2017 [cited by applicant]
US 9853898B1 · Subramanian et al. · 2017 [cited by applicant]
US 10394597B1 · Kowalski · 2019 [cited by examiner]
US 10476766B1 · Rodriguez · 2019 [cited by applicant]
US 10511546B2 · Singarayan et al. · 2019 [cited by applicant]
US 10534629B1 · St. Pierre · 2020 [cited by examiner]
US 10547521B1 · Roy et al. · 2020 [cited by applicant]
US 10728121B1 · Chitalia et al. · 2020 [cited by applicant]
US 10742690B2 · Miriyala et al. · 2020 [cited by applicant]
US 10868742B2 · Chitalia et al. · 2020 [cited by applicant]
US 11159389B1 · Miriyala et al. · 2021 [cited by applicant]
US 11323327B1 · Chitalia et al. · 2022 [cited by applicant]
US 11706099B2 · Chitalia et al. · 2023 [cited by applicant]
US 20060230407A1 · Rosu et al. · 2006 [cited by applicant]
US 20140123212A1 · Wanser et al. · 2014 [cited by applicant]
US 20140215077A1 · Soudan et al. · 2014 [cited by applicant]
US 20150200808A1 · Gourlay et al. · 2015 [cited by applicant]
US 20150381384A1 · Visser et al. · 2015 [cited by applicant]
US 20160277249A1 · Singh et al. · 2016 [cited by applicant]
US 20170111274A1 · Bays et al. · 2017 [cited by applicant]
US 20170288981A1 · Hong et al. · 2017 [cited by applicant]
US 20180181348A1 · Kusters et al. · 2018 [cited by applicant]
US 20190334787A1 · Kelly · 2019 [cited by applicant]
US 20190342175A1 · Wan et al. · 2019 [cited by applicant]
US 20190386891A1 · Chitalia et al. · 2019 [cited by applicant]
US 20200004569A1 · Gupta · 2020 [cited by examiner]
US 20230308358A1 · Chitalia et al. · 2023 [cited by applicant]
WO 2013184846A1 · 2013 [cited by applicant]
Bari et al. Data Center Network Virtualization: A Survey. IEEE Communications Surveys & Tutorials, vol. 15 No. 2. 2013. 909-928. (Year: 2013). [cited by examiner]
Blenk et al. Survey on Network Virtualization Hypervisors for Software Defined Networking. IEEE Communications Surveys & Tutorials, vol. 18 No. 1. 2016. pp. 655-685. (Year: 2016). [cited by examiner]
Kaljic et al. A Survey on Data Plane Flexibility and Programmability in Software-Defined Networking. IEEE Access vol. 7, 2019. pp. 47804-47840 (Year: 2019). [cited by examiner]
Communication pursuant to Article 94(3) EPC from counterpart European Application No. 23177065.2 dated Jun. 25, 2024, 5 pp. [cited by applicant]
Anonymous, “Carrier Routing System”, Wikipedia, Jul. 31, 2017, p. 5. [cited by applicant]
Anonymous, “Juniper Networks Unveils 5G- and IoT-Ready MX Routing”, Nomios Group, Jun. 14, 2018, 3 pp. [cited by applicant]
AppFormix User Guide. Juniper Networks. 110 Pages. (Year: 2017). [cited by applicant]
Bament et al., “Designing Engineering Innovation & Simplicity into Network Slicing,” https://blogs.juniper.net/en-us/service-provider-transformation/designing-engineering-innovation-simplicity-into-network-slicing, Feb.… [cited by applicant]
Bhaumik et al., “Software-Defined Optical Networks (SDONs): A Survey,” Photonic Network Communications, vol. 28, Jun. 15, 2014, pp. 4-18. [cited by applicant]
Brief Communication from counterpart European Application No. 19180278.4 dated May 22, 2023. 38 pp. [cited by applicant]
Brief Communication from the Examining Division before Oral Proceedings in counterpart European Application No. 19180278.4, dated May 22, 2023, 4 pp. [cited by applicant]
Chowdhury et al., “PayLess: A Low Cost Network Monitoring Framework for Software Defined Networks,” IEEE Network Operations and Management Symposium (NOMS), IEEE, May 5, 2014, 9 pp. [cited by applicant]
Communication pursuant to Article 94(3) from counterpart European Application No. 19180278.4, dated Dec. 9, 2021, 4 pp. [cited by applicant]
Extended Search Report from counterpart European Application No. 19180278.4, dated Nov. 4, 2019, 10 pp. [cited by applicant]
Extended Search Report from counterpart European Application No. 23177065.2 dated Oct. 4, 2023, 16 pp. [cited by applicant]
First Office Action and Search Report, and translation thereof, from counterpart Chinese Application No. 201910556605.1 dated Nov. 18, 2022, 12 pp. [cited by applicant]
Gutierrez-Aguado et al., “IaaSMon: Monitoring Architecture for Public Cloud Computing Data Centers,” Springer, Journal of Grid Computing, vol. 14, No. 2, Mar. 4, 2016, 15 pp. [cited by applicant]
Isolani et al., “Interactive Monitoring, Visualization, and Configuration of OpenFlow-Based SDN,” IFIP/IEEE International Symposium on Integrated Network Management (IM), May 15, 2015, 9 pp. [cited by applicant]
Juniper Networks, “AppFormix Network Monitoring and Analytics with Streaming Telemetry”, Juniper Networks, Inc., Apr. 1, 2018, 5 pp., URL: http://www.wdn.com.np/storage/product/Juniper/re1_1566536554.pdf. [cited by applicant]
Juniper Networks, “AppFormix User Guide”, Juniper Networks, Inc., Aug. 31, 2017, 110 pp., URL: https://www.juniper.net/documentation/en_US/appformix/information-products/pathway-pages/pwp-appformix-reference-guide.pdf. [cited by applicant]
Juniper Networks, “Contrail Feature Guide”, Juniper Networks, Inc., Jun. 13, 2016, 620 pp., URL: https://www.juniper.net/documentation/en_US/contrail2.21/information-products/pathway-pages/contrail-feature-guide-pwp.pdf. [cited by applicant]
Juniper Networks, “Contrail Service Orchestration User Guide”, Juniper Networks, Inc., Jul. 25, 2017, 300 pp., URL: https://www.juniper.net/documentation/en_US/cso3.0/information-products/pathway-pages/user-guide.pdf. [cited by applicant]
Juniper Networks, “Junos Space Network Management Platform Complete Software Guide”, Juniper Networks, Inc., Sep. 24, 2020, pp. 1-400, URL: https://www.juniper.net/documentation/en_US/junos-space19.3/platform/informatio… [cited by applicant]
Ordonez-Lucena et al., “Network Slicing for 5G with SDN/NFV: Concepts, Architectures, and Challenges,” IEEE Communications Magazine, May 2017, pp. 80-87. [cited by applicant]
Prosecution History from U.S. Appl. No. 16/024,108, dated Nov. 6, 2019 through Jun. 12, 2023, 199 pp. [cited by applicant]
Prosecution History from U.S. Appl. No. 18/327,518, dated Nov. 6, 2023 through Feb. 6, 2024, 17 pp. [cited by applicant]
Q. Wang, G. Shou, Y. Liu, Y. Hu, Z. Guo and W. Chang, “Implementation of Multipath Network Virtualization With SDN and NFV,” in IEEE Access, vol. 6, Jun. 29, 2018, pp. 32460-32470. [cited by applicant]
Response filed Jul. 1, 2020 to the Extended Search Report from counterpart European Application No. 19180278.4, dated Nov. 4, 2019, 25 pp. [cited by applicant]
Response to Communication pursuant to Article 94(3) EPC dated Dec. 9, 2021, from counterpart European Application No. 19180278.4 filed Apr. 13, 2022, 15 pp. [cited by applicant]
Response to Extended Search Report dated Oct. 5, 2023, from counterpart European Application No. 23177065.2 filed May 1, 2024, 45 pp. [cited by applicant]
Response to Summons to Attend Oral Proceedings pursuant to Rule 115(1) EPC dated Dec. 13, 2022, including Main Request, from European Patent Application No. 19180278.4] filed May 2, 2023, 41 pp. [cited by applicant]
Shah et al., “An Adaptive Load Monitoring Solution for Logically Centralized SDN Controller,” 18th Asia-Pacific Network Operations and Management Symposium (APNOMS), IEICE, Oct. 5, 2016, 6 pp. [cited by applicant]
Summons to Attend Oral Proceedings Pursuant to Rule 115(1) EPC from counterpart European Application No. 19180278.4 dated Nov. 29, 2022, 9 pp. [cited by applicant]
Vassilaras et al., “The Algorithmic Aspects of Network Slicing,” IEEE Communications Magazine, Aug. 2017, pp. 112-119. [cited by applicant]
Anonymous, “Junos OS Junos Node Slicing Feature Guide”, Juniper Networks, Inc., Aug. 9, 2017, 84 pp. [cited by applicant]
Response to Communication pursuant to Article 94(3) EPC dated Jun. 25, 2024, from counterpart European Application No. 23177065.2 filed Oct. 25, 2024, 5 pp. [cited by applicant]
Summons to Attend Oral Proceedings Pursuant to Rule 115(1) EPC from counterpart European Application No. 23177065.2 dated Nov. 25, 2024, 15 pp. [cited by applicant]
Preliminary Opinion from EPO in counterpart European Application No. 23177065.2, dated Apr. 1, 2025, 4 pp. [cited by applicant]
MWIGET, “OpenConfig and gRPC Junos Telemetry Interface”, Blog Viewer, Juniper Networks, Nov. 29, 2017, p. 9, https://community.juniper.net/blogs/marcel-wiget1/2020/10/22/openconfig-and-grpc-junos-telemetry-interface. [cited by applicant]
Response to Summons to Attend Oral Proceedings pursuant to Rule 115(1) EPC, including Main Request and Auxiliary Request, from European Patent Application No. 23177065.2, dated Mar. 14, 2025, 36 pp. [cited by applicant]
Cited By (1)
US 12,549,494