Systems and methods for deploying microservices in a networked microservices system

1. A method performed by a plurality of networked servers each having a memory, a hypervisor, and a plurality of virtual machines (VMs), the method comprising:

measuring central processing unit (CPU), network, and memory utilization of each of the servers;

generating, for each of the VMs, a suitability value comprising a sum of a plurality of weighted server properties each multiplying one of the measured CPU, network, and memory utilization by a weight, and a plurality of weighted VM properties each multiplying a second weight by one of the same properties as the weighted server properties, as seen by the VM;

receiving a request to instantiate microservices of a security service;

selecting the most suitable VM based on the generated suitability values;

deploying the microservices on the selected VM to perform security processing on packets within the security service comprising an interface microservice, a transmission control protocol/Internet protocol (TCP/IP) security microservice, a deep packet inspection (DPI) security microservice, and a secure sockets layer (SSL) security microservice; and

receiving packets and performing security processing by the deployed microservices.

2. The method of claim 1 , wherein the interface microservice is to capture network traffic from a physical server.

3. The method of claim 1 , wherein when one of the plurality of weighted VM properties is zero, the corresponding weighted server property is to be treated as zero.

4. The method of claim 1 , wherein the deploying the microservice includes creating a new microservice.

5. The method of claim 1 , wherein the selected virtual machine has been instantiated before the receiving the request.

6. The method of claim 1 , wherein the selected virtual machine is a newly instantiated virtual machine.

7. A system comprising:

a plurality of networked servers each having a memory and a plurality of VMs;

a plurality of microservices of a security service running on the plurality of VMs, each microservice to periodically obtain CPU, network, and memory utilization measurements from one or more of: an operating system, a hypervisor, or its own counters and statistics; and

measuring CPU, network, and memory utilization of each of the servers,

wherein the system is to:

generate and maintain CPU, network, and memory utilization statistics;

generate, for each VM, a suitability value comprising a sum of a plurality of weighted server properties each multiplying one of the measured CPU, network, and memory utilization by a weight, and a plurality of weighted VM properties each multiplying a second weight by one of the same properties as the weighted server properties, as seen by the VM;

receive a request to instantiate microservices of the security service;

select the most suitable VM based on the generated suitability values;

deploy the microservices on the selected VM to perform security processing on packets within a security service comprising an interface microservice, a transmission control protocol/Internet protocol (TCP/IP) security microservice, a deep packet inspection (DPI) security microservice, and a secure sockets layer (SSL) security microservice; and

receive packets and perform security processing by the deployed microservices.

8. The system of claim 7 , wherein the interface microservice is to capture network traffic from a physical server.

9. The system of claim 7 , wherein when one of the plurality of weighted VM properties is zero, the corresponding weighted server property is to be treated as zero.

10. The system of claim 7 , wherein the deploying the microservice includes creating a new microservice.

11. The system of claim 7 , wherein the selected virtual machine has been instantiated before the receiving the request.

12. The system of claim 7 , wherein the selected virtual machine is a newly instantiated virtual machine.

13. A non-transitory computer-readable medium containing instructions that, when performed by a system comprising a plurality of networked servers each having a memory, a hypervisor, and a plurality of virtual machines (VMs), cause the system to respond by:

measuring CPU, memory, and input/output (I/O) utilization of each of the servers;

generating and maintaining CPU, network, and memory utilization statistics;

generating, for each of the VMs, a suitability value comprising a sum of a plurality of weighted server properties each multiplying one of the measured CPU, network, and memory utilization by a weight, and a plurality of weighted VM properties each multiplying a second weight by one of the same properties as the weighted server properties, as seen by the VM;

receiving a request to instantiate microservices of a security service;

selecting the most suitable VM based on the generated suitability values;

deploying the microservices on the selected VM to perform security processing on packets within the security service comprising an interface microservice, a transmission control protocol/Internet protocol (TCP/IP) security microservice, a deep packet inspection (DPI) security microservice, and a secure sockets layer (SSL) security microservice; and

receiving packets and performing security processing by the deployed microservices.

14. The non-transitory computer-readable medium of claim 13 , wherein the most suitable VM is not necessarily the least loaded VM.

15. The non-transitory computer-readable medium of claim 13 , wherein the interface microservice is to capture network traffic from a physical server.

16. The non-transitory computer-readable medium of claim 13 , wherein when one of the plurality of weighted VM properties is zero, the corresponding weighted server property is to be treated as zero.

17. The non-transitory computer-readable medium of claim 13 , wherein the deploying the microservice includes creating a new microservice.

18. The non-transitory computer-readable medium of claim 13 , wherein the selected virtual machine has been instantiated before the receiving the request.