IP Library Granted Patent US 12,450,101
Granted Patent B2
US 12,450,101 · App. 17/549,859 · Granted Oct 21, 2025

Techniques for secure intra-node communication between edge devices

Inventors: Aliaksei Zayats (Atlanta, GA); Igors Sajenko (Cumming, GA)
Assignee: Oracle International Corporation
G06F9/5077G06F9/455G06F9/5005G06F11/3409G06F11/3414G06F11/3433G06F11/3457G06F2009/45562G06F2009/45587H04L41/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,101
App. No.
17/549,859
Granted
Oct 21, 2025
Kind
B2
Abstract

Techniques are described for implementing secure communications between edge devices providing cloud computing services in an edge environment. A computing cluster can include a plurality of cloud-computing edge devices. The computing cluster can implement a distributed control plane for performing operations related to managing cloud infrastructure resources within the computing cluster. The cloud-computing edge devices can be connected to an intra-node switch to form a substrate network. The data related to control plane operations may be transmitted over the substrate from one edge device to another, such that control plane operations can be performed at any suitable edge device in the cluster. The edge devices can use an encryption protocol to encrypt the data transmitted over the substrate network via the intra-node switch.

Claims (58)

1. A computer-implemented method, comprising:

implementing, by a computing cluster comprising a plurality of cloud-computing edge devices, a distributed control plane in which each of the plurality of cloud-computing edge devices is configured to provision and manage cloud infrastructure resources of the computing cluster independent from communicating with a device that is external to the computing cluster, the plurality of cloud-computing edge devices being communicatively connected to one another via an intra-node switch of the computing cluster, each of the plurality of cloud-computing edge devices being individually configured to encrypt or decrypt control plane data transmitted via the intra-node switch based at least in part on each of the plurality of cloud-computing edge devices being previously provisioned with encryption keys and a root certificate for the computing cluster;

generating, by a first cloud-computing edge device of the distributed control plane, a message comprising data related to control plane operations corresponding to a first resource of the cloud infrastructure resources of the computing cluster;

generating, by the first cloud-computing edge device of the distributed control plane and based at least in part on an encryption protocol and a first data encryption key of the encryption keys provisioned on the first cloud-computing edge device, an encrypted message from the message comprising the data related to the control plane operations corresponding to the first resource of the cloud infrastructure resources of the computing cluster;

authenticating, by the first cloud-computing edge device using the root certificate, a second cloud-computing edge device of the distributed control plane;

responsive to the authentication, transmitting, by the first cloud-computing edge device to the second cloud-computing edge device of the distributed control plane, the encrypted message via the intra-node switch;

decrypting, by the second cloud-computing edge device using a second data encryption key of the encryption keys provisioned on the second cloud-computing edge device, the encrypted message to obtain the data related to the control plane operations corresponding to the first resource of the cloud infrastructure resources of the computing cluster; and

based at least in part on obtaining the data related to the control plane operations that correspond to the first resource of the cloud infrastructure resources of the computing cluster, executing, by the second cloud-computing edge device, an operation for provisioning or managing the first resource of the cloud infrastructure resources of the computing cluster.

2. The computer-implemented method of claim 1 , wherein the plurality of cloud-computing edge devices are communicatively connected to a client switch, and further comprising:

receiving, from the client switch at the first cloud-computing edge device, an additional message initiated from a client device, the additional message being encrypted with a second encryption protocol;

decrypting, by the first cloud-computing edge device and using the second encryption protocol, the additional message to obtain message data; and

executing, by the first cloud-computing edge device, one or more operations based at least in part on the message data obtained.

3. The computer-implemented method of claim 1 , wherein the first data encryption key is stored in a key storage at the first cloud-computing edge device, the first data encryption key encrypted with a third encryption protocol comprising a master key, the master key stored at a trusted platform module of the first cloud-computing edge device.

4. The computer-implemented method of claim 3 , further comprising:

retrieving, by the first cloud-computing edge device, the first data encryption key from the key storage; and

decrypting, by the trusted platform module, the first data encryption key using the master key.

5. The computer-implemented method of claim 2 , wherein the encryption protocol is different from the second encryption protocol.

6. The computer-implemented method of claim 1 , wherein the encryption protocol is a media access control security protocol.

7. A computing cluster, comprising:

an intra-node switch;

a plurality of cloud-computing edge devices communicatively connected to one another via the intra-node switch, the plurality of cloud-computing edge devices comprising one or more processors and one or more memories storing computer-executable instructions that, when executed with the one or more processors, cause the computing cluster to:

implement a distributed control plane in which each of the plurality of cloud-computing edge devices is configured to provision and manage cloud infrastructure resources of the computing cluster independent from communicating with a device that is external to the computing cluster, each of the plurality of cloud-computing edge devices being individually configured to encrypt or decrypt control plane data transmitted via the intra-node switch based at least in part on each of the plurality of cloud-computing edge devices being previously provisioned with encryption keys and a root certificate for the computing cluster;

generate, by a first cloud-computing edge device of the distributed control plane, a message comprising data related to control plane operations corresponding to a first resource of the cloud infrastructure resources of the computing cluster;

generate, by the first cloud-computing edge device of the distributed control plane and based at least in part on an encryption protocol and a first data encryption key of the encryption keys provisioned on the first cloud-computing edge device, an encrypted message from the message comprising the data related to the control plane operations corresponding to the first resource of the cloud infrastructure resources of the computing cluster;

authenticate, by the first cloud-computing edge device using the root certificate, a second cloud-computing edge device of the distributed control plane;

responsive to the authentication, transmit, by the first cloud-computing edge device to the second cloud-computing edge device of the distributed control plane, the encrypted message via the intra-node switch;

decrypt, by the second cloud-computing edge device using a second data encryption key of the encryption keys provisioned on the second cloud-computing edge device, the encrypted message to obtain the data related to the control plane operations corresponding to the first resource of the cloud infrastructure resources of the computing cluster; and

based at least in part on obtaining the data related to the control plane operations that correspond to the first resource of the cloud infrastructure resources of the computing cluster, execute, by the second cloud-computing edge device, an operation for provisioning or managing the first resource of the cloud infrastructure resources of the computing cluster.

8. The computing cluster of claim 7 , wherein the plurality of cloud-computing edge devices are communicatively connected to a client switch, and wherein the one or more memories store further instructions that, when executed by the one or more processors, cause the computing cluster to further:

receive, from the client switch at the first cloud-computing edge device, an additional message initiated from a client device, the additional message being encrypted with a second encryption protocol;

decrypt, by the first cloud-computing edge device and using the second encryption protocol, the additional message to obtain message data; and

execute, by the first cloud-computing edge device, one or more operations based at least in part on the message data obtained.

9. The computing cluster of claim 7 , wherein the first data encryption key stored in a key storage at the first cloud-computing edge device, the first data encryption key encrypted with a third encryption protocol comprising a master key, the master key stored at a trusted platform module of the first cloud-computing edge device.

10. The computing cluster of claim 9 , wherein the one or more memories store further instructions that, when executed by the one or more processors, cause the computing cluster to further:

retrieve, by the first cloud-computing edge device, the first data encryption key from the key storage; and

decrypt, by the trusted platform module, the first data encryption key using the master key.

11. The computing cluster of claim 8 , wherein the encryption protocol is different from the second encryption protocol.

12. The computing cluster of claim 7 , wherein the encryption protocol is a media access control security protocol.

13. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by one or more processors of a computing cluster comprising a plurality of cloud-computing edge devices, cause the computing cluster to:

implement a distributed control plane in which each of the plurality of cloud-computing edge devices is configured to provision and manage cloud infrastructure resources of the computing cluster independent from communicating with a device that is external to the computing cluster, the plurality of cloud-computing edge devices being communicatively connected to one another via an intra-node switch of the computing cluster, each of the plurality of cloud-computing edge devices being individually configured to encrypt or decrypt control plane data transmitted via the intra-node switch based at least in part on each of the plurality of cloud-computing edge devices being previously provisioned with encryption keys and a root certificate for the computing cluster;

generate, by a first cloud-computing edge device of the distributed control plane, a message comprising data related to control plane operations corresponding to a first resource of the cloud infrastructure resources of the computing cluster;

generate, by the first cloud-computing edge device of the distributed control plane and based at least in part on an encryption protocol and a first data encryption key of the encryption keys provisioned on the first cloud-computing edge device, an encrypted message from the message comprising the data related to the control plane operations corresponding to the first resource of the cloud infrastructure resources of the computing cluster;

authenticate, by the first cloud-computing edge device using the root certificate, a second cloud-computing edge device of the distributed control plane;

responsive to the authentication, transmit, by the first cloud-computing edge device to the second cloud-computing edge device of the distributed control plane, the encrypted message via the intra-node switch;

decrypt, by the second cloud-computing edge device using a second data encryption key of the encryption keys provisioned on the second cloud-computing edge device, the encrypted message to obtain the data related to the control plane operations corresponding to the first resource of the cloud infrastructure resources of the computing cluster; and

based at least in part on obtaining the data related to the control plane operations that correspond to the first resource of the cloud infrastructure resources of the computing cluster, execute, by the second cloud-computing edge device, an operation for provisioning or managing the first resource of the cloud infrastructure resources of the computing cluster.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the plurality of cloud-computing edge devices are communicatively connected to a client switch, and further comprising additional instructions that, when executed by the one or more processors, cause the computing cluster to further:

receive, from the client switch at the first cloud-computing edge device, an additional message initiated from a client device, the additional message being encrypted with a second encryption protocol;

decrypt, by the first cloud-computing edge device and using the second encryption protocol, the additional message to obtain message data; and

execute, by the first cloud-computing edge device, one or more operations based at least in part on the message data obtained.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the first data encryption key stored in a key storage at the first cloud-computing edge device, the first data encryption key encrypted with a third encryption protocol comprising a master key, the master key stored at a trusted platform module of the first cloud-computing edge device.

16. The non-transitory computer-readable storage medium of claim 15 , further comprising additional instructions that, when executed by the one or more processors, cause the computing cluster to further:

retrieve, by the first cloud-computing edge device, the first data encryption key from the key storage; and

decrypt, by the trusted platform module, the first data encryption key using the master key.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the encryption protocol is a media access control security protocol.

18. The computer-implemented method of claim 1 , wherein the first data encryption key and the second data encryption key are the same.

19. The computing cluster of claim 7 , wherein the first data encryption key and the second data encryption key are the same.

20. The non-transitory computer-readable storage medium of claim 13 , wherein the first data encryption key and the second data encryption key are the same.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: ZAYATS, ALIAKSEI; SAJENKO, IGORS
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 058490/0659 →
Continuity (2)
Provisional Application 63173244 · Apr 9, 2021
Related Publication 20220329628A1 · Oct 13, 2022
References Cited (59)
US 10880743B1 · Berzin · 2020 [cited by examiner]
US 11050781B2 · Samuel et al. · 2021 [cited by applicant]
US 11201789B1 · Keane et al. · 2021 [cited by applicant]
US 11452054B2 · Tang · 2022 [cited by examiner]
US 11582027B1 · Lawton · 2023 [cited by examiner]
US 20040252717A1 · Solomon et al. · 2004 [cited by applicant]
US 20160266922A1 · Brandwine et al. · 2016 [cited by applicant]
US 20170201455A1 · Amulothu · 2017 [cited by examiner]
US 20180004953A1 · Smith, II et al. · 2018 [cited by applicant]
US 20180054490A1 · Wadhwa · 2018 [cited by examiner]
US 20190138294A1 · Smith et al. · 2019 [cited by applicant]
US 20190253262A1 · Smith et al. · 2019 [cited by applicant]
US 20190327312A1 · Gupta · 2019 [cited by examiner]
US 20200097274A1 · Sarkar et al. · 2020 [cited by applicant]
US 20200103888A1 · Sayyarrodsari · 2020 [cited by examiner]
US 20200153623A1 · Asanghanwa · 2020 [cited by examiner]
US 20200213227A1 · Pianigiani et al. · 2020 [cited by applicant]
US 20200293477A1 · Lefebvre · 2020 [cited by examiner]
US 20200296138A1 · Crabtree et al. · 2020 [cited by applicant]
US 20200344847A1 · Nardini · 2020 [cited by examiner]
US 20200351380A1 · Fedorov · 2020 [cited by examiner]
US 20210014113A1 · Guim Bernat et al. · 2021 [cited by applicant]
US 20210112034A1 · Sundararajan et al. · 2021 [cited by applicant]
US 20210132976A1 · Chandrappa et al. · 2021 [cited by applicant]
US 20210168203A1 · Parulkar · 2021 [cited by examiner]
US 20210256824A1 · Wyseur · 2021 [cited by examiner]
US 20210314423A1 · Rolando et al. · 2021 [cited by applicant]
US 20220019422A1 · Anderson · 2022 [cited by examiner]
US 20220051762A1 · Sharma · 2022 [cited by examiner]
US 20220083245A1 · Kant et al. · 2022 [cited by applicant]
US 20220100182A1 · Mehrotra · 2022 [cited by examiner]
US 20220329628A1 · Zayats et al. · 2022 [cited by applicant]
US 20220334725A1 · Mertes et al. · 2022 [cited by applicant]
US 20220405157A1 · Bender · 2022 [cited by examiner]
US 20220413974A1 · Wang et al. · 2022 [cited by applicant]
US 20230254943A1 · Nardini · 2023 [cited by examiner]
US 20230283517A1 · Maheshwari · 2023 [cited by examiner]
US 20240171391A1 · Ananthanarayanan · 2024 [cited by examiner]
CN 112543429B · 2022 [cited by examiner]
EP 2369782 · 2011 [cited by applicant]
EP 3391588 · 2018 [cited by applicant]
WO 2016069638 · 2016 [cited by applicant]
WO 2019236181 · 2019 [cited by applicant]
WO 2020052322 · 2020 [cited by applicant]
AWS Snowball Edge Developer Guide AWS Snowball Edge, Available Online at: https://docs.aws.amazon.com/snowball/latest/developer-guide/AWSSnowball-dg.pdf#UsingCluster, 2021, 227 pages. [cited by applicant]
Cisco SD-WAN Design Guide, Available Online at: https://www.cisco.com/c/en/us/td/docs/solutions/CVD/SDWAN/cisco-sdwan-design-guide.html, Sep. 2020, 102 pages. [cited by applicant]
Device Update APT Manifest, Available Online at: https://docs.microsoft.com/en-US/azure/iot-hub-device-update/device-update-apt-manifest, Feb. 17, 2021, 2 pages. [cited by applicant]
Encrypting Traffic Between Nodeswith IPsec, Available Online at: https://docs.openshift.com/container-platform/3.11/admin_guide/ipsec.html, Accessed from Intemet on May 21, 2021, 8 pages. [cited by applicant]
NSX-T Data Center, Available Online at: https://docs.vmware.com/en/VMware-NSX-T-Data-Center/2.5/nsxt_25_install.pdf, Jul. 31, 2020, 276 pages. [cited by applicant]
Software Installation and Upgrade for vEdge Routers, Available Online at: https://www.cisco.com/c/en/us/td/docs/routers/sdwan/configuration/sdwan-xe-gs-book/hardware-and-software-installation.html, 2021, 2 pages. [cited by applicant]
Upgrade an Edge Cluster, Available Online at: https://partners-intl.aliyun.com/help/doc-detail/154532.htm, 2021, 4 pages. [cited by applicant]
Upgrade NSX Edge Cluster, Available Online at: https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.1/nsxt_31_upgrade.pdf, 2021, pp. 1-57. [cited by applicant]
Akesson et al., How to Build a Resilient Over-the-Air Update Solution, Available Online at: https://techcommunity.microsoft.com/t5/internet-of-things/how-to-build-a-resilient-over-the-air-update-solution/ba-p/2163991, M… [cited by applicant]
Asif et al., Prototype Implementation of Edge Encryption in IoT Architecture, 10th International Conference on Computing, Communication and Networking Technologies, Jul. 6-8, 2019, 7 pages. [cited by applicant]
Pavlik, Managing Thousands of Edge Kubernetes Clusterswith GitOps, Available Online at: https://www.volterra.io/resources/blog/managing-thousands-of-edge-kubernetes-clusters-with-gitops, Dec. 18, 2019, 8 pages. [cited by applicant]
U.S. Appl. No. 17/581,802, Non-Final Office Action mailed on Feb. 13, 2024, 24 pages. [cited by applicant]
U.S. Appl. No. 17/581,802, Corrected Notice of Allowability mailed on Apr. 15, 2025, 18 pages. [cited by applicant]
U.S. Appl. No. 17/581,802, Final Office Action mailed on Oct. 15, 2024, 36 pages. [cited by applicant]
U.S. Appl. No. 17/581,802, Notice of Allowance mailed on Apr. 2, 2025, 22 pages. [cited by applicant]