IP Library › Granted Patent US 12,693,906
Granted Patent B2
US 12,693,906 · App. 17/745,069 · Granted Jul 28, 2026

Container management device and storage medium storing container management program

Inventors: Chunghan Lee (Chiyoda-ku, JP); Byoungkwon Choi (Daejeon, KR); Jinwoo Park (Daejeon, KR); Dongsu Han (Daejeon, KR)
Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA; KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
G06F9/505G06F9/5016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,693,906
App. No.
17/745,069
Filed
May 16, 2022
Granted
Jul 28, 2026
Kind
B2
Art Unit
2196
USPC
718/105
Abstract

A container management device including a processor, wherein the processor is configured to acquire, for a service including interconnected respective microservices installed with containers for executing processing, a workload relating to the service, connection information that is information relating to how the microservices are interconnected, and a service chain for propagation of respective processing related to the workload across the microservices; employ a prediction model expressing a relationship between a workload of each of the microservices and a resource usage to find a resource usage of each of the microservices from the acquired workload, the acquired connection information, and the acquired service chain, and to predict a number of containers; and control container installation at a same moment for the respective microservices by installation with the predicted number of containers for each of the microservices.

Claims (28)

1 . A container management device including a processor, wherein the processor is configured to:

acquire, for a service including interconnected respective microservices installed with containers for executing processing, a historical workload relating to the service, connection information that is information relating to how the microservices are interconnected, and a service chain for propagation of respective processing related to a workload from a microservice at a front end to a microservice at a back end;

acquire resource information regarding the historical workload;

use the historical workload to generate a prediction model expressing a relationship between the workload of each of the microservices and a resource usage to find a resource usage of each of the microservices from the acquired historical workload, the acquired connection information, and the acquired service chain, the prediction model is a linear regression model when an amount of data in the resource information is greater than a predetermined threshold, and the prediction model is a Gaussian process when the amount of data in the resource information is less than or equal to the predetermined threshold;

determine whether the workload has been generated in the service;

upon determination that the workload has been generated in the service, acquire the workload currently generated in the service, the service chain of the workload, and the connection information;

estimate a current workload of each of the microservices using the acquired workload currently generated in the service, the service chain, and the connection information;

use the prediction model for each of the microservices to find the resource usage, and predict a number of containers required; and

control container installation at a same moment for the respective microservices by installation with the predicted number of containers for each of the microservices.

2 . The container management device of claim 1 , wherein the processor is configured to:

further acquire resource information that is information regarding the historical workload and a resource usage for each of the microservices; and

employ the resource information to generate the prediction model.

3 . The container management device of claim 2 , wherein the prediction model is a predetermined regression model, or is a regression model determined by a Gaussian process.

4 . The container management device of claim 3 , wherein the processor is configured to select the predetermined regression model or the regression model determined by a Gaussian process according to an amount of data in the resource information.

5 . The container management device of claim 1 , wherein the processor is configured to:

identify from the service chain which microservices processing will propagate through;

estimate the workload for each of the microservices; and

employ the prediction model to find the resource usage from the workload estimated for each of the microservices.

6 . The container management device of claim 1 , wherein the connection information is a tree topology, a bus topology, a star topology, a ring topology, or a fully connected topology.

7 . A non-transitory storage medium storing a container management program executable by a computer to perform processing comprising:

acquiring, for a service including interconnected respective microservices installed with containers for executing processing, a historical workload relating to the service, connection information that is information relating to how the microservices are interconnected, and a service chain for propagation of respective processing related to a workload from a microservice at a front end to a microservice at a back end;

acquiring resource information regarding the historical workload;

using the historical workload to generate a prediction model expressing a relationship between the workload of each of the microservices and a resource usage to find a resource usage of each of the microservices from the acquired historical workload, the acquired connection information, and the acquired service chain, the prediction model is a linear regression model when an amount of data in the resource information is greater than a predetermined threshold, and the prediction model is a Gaussian process when the amount of data in the resource information is less than or equal to the predetermined threshold;

determining whether the workload has been generated in the service;

upon determination that the workload has been generated in the service, acquiring the workload currently generated in the service, the service chain of the workload, and the connection information;

estimating a current workload of each of the microservices using the acquired workload currently generated in the service, the service chain, and the connection information;

using the prediction model for each of the microservices to find the resource usage, and predicting a number of containers required; and

controlling container installation at a same moment for the respective microservices by installation with the predicted number of containers for each of the microservices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2022
From: LEE, CHUNGHAN; CHOI, BYOUNGKWON; PARK, JINWOO; HAN, DONGSU
To: TOYOTA JIDOSHA KABUSHIKI KAISHA; KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Reel/Frame 059918/0127 →
Priority Claims (1)
JP 2021-084145 · May 18, 2021 · national
Continuity (1)
Related Publication 20220374268A1 · Nov 24, 2022
References Cited (30)
US 10402733B1 · Li · 2019 [cited by examiner]
US 12231304B2 · Illikkal · 2025 [cited by examiner]
US 20090235268A1 · Seidman · 2009 [cited by examiner]
US 20100174514A1 · Melkumyan · 2010 [cited by examiner]
US 20130007753A1 · Jain · 2013 [cited by examiner]
US 20140282591A1 · Stich · 2014 [cited by examiner]
US 20160080908A1 · Julian · 2016 [cited by examiner]
US 20180316759A1 · Shen · 2018 [cited by examiner]
US 20180349168A1 · Ahmed · 2018 [cited by examiner]
US 20190347134A1 · Zhuo · 2019 [cited by examiner]
US 20200259715A1 · Schermann · 2020 [cited by examiner]
US 20200364035A1 · White · 2020 [cited by examiner]
US 20220060526A1 · Jónsson · 2022 [cited by examiner]
US 20220164186A1 · Pamidala · 2022 [cited by examiner]
Predicting the End-to-End Tail Latency of Containerized Microservices in the Cloud Joy Rahman and Palden Lama (Year: 2019). [cited by examiner]
Robust Resource Scaling of Containerized Microservices with Probabilistic Machine learning Peng Kang and Palden Lama (Year: 2020). [cited by examiner]
Gaussian process for predicting CPU utilization and its application to energy efficiency Dinh-Mao Bui, Huu-Quoc Nguyen, Yonglk Yoon, Sunglk Jun, Muhammad Bilal Amin, Sungyoung Lee (Year: 2015). [cited by examiner]
Modelling and Managing Deployment Costs of Microservice-Based Cloud Applications Philipp Leitner and Jürgen Cito, Emanuel Stöckli (Year: 2016). [cited by examiner]
Resource Allocation Based on Workflow for Enhancing the Performance of Composite Service BangYu Wu, Chi-Hung Chi, Zhe Chen (Year: 2007). [cited by examiner]
A Holistic Auto-Scaling Algorithm for Multi-Service Applications Based on Balanced Queuing Network Jingwan Tong, Mingchang Wei, Maolin Pan and Yang Yu (Year: 2021). [cited by examiner]
PHPA: A Proactive Autoscaling Framework for Microservice Chain Jinwoo Park, Byungkwon Choi, Chunghan Lee, Dongsu Han (Year: 2021). [cited by examiner]
Graf: A Graph Neural Network based Proactive Resource Allocation Framework for SLO-Oriented Microservices Jinwoo Park, Byungkwon Choi, Chunghan Lee, Dongsu Han (Year: 2021). [cited by examiner]
Autoregressive Integrated Moving Average (ARIMA)—Interpreting data and make future predictions using time-series analysis and statistical analysis CFI Team; corporatefinanceinstitute.com/resources/data-science/autoregre… [cited by examiner]
Understanding ARIMA (Time Series Modeling) Using the Past in an Attempt to Forecast the Future Tony Yiu towardsdatascience.com/understanding-arima-time-series-modeling-d99cd11be3f8/ (Year: 2020). [cited by examiner]
Burst-Aware Predictive Autoscaling for Containerized Microservices Muhammad Abdullah, Waheed Iqbal, Josep Lluis Berral, Jorda Polo, and David Carrera (Year: 2020). [cited by examiner]
Chamulteon: Coordinated Auto-Scaling of Micro-Services Andre Bauer, Veronika Lesch, Laurens Versluis, Alexey Ilyushkin, Nikolas Herbst, and Samuel Kounev (Year: 2019). [cited by examiner]
A Holistic Machine Learning-Based Autoscaling Approach for Microservice Applications Alireza Goli, Nima Mahmoudi, Hamzeh Khazaei and Omid Ardakanian (Year: 2021). [cited by examiner]
Predictive Autoscaling of Microservices Hosted in Fog Microdata Center Muhammad Abdullah, Waheed Iqbal, Arif Mahmood, Faisal Bukhari, and Abdelkarim Erradi (Year: 2020). [cited by examiner]
Sizing and Coordinated Scaling of Microservices Preyashi Agarwal and J. Lakshmi (Year: 2020). [cited by examiner]
“Horizontal Pod Autoscaling”, Kubernetes. Last modified Mar. 28, 2022, URL; https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale/. [cited by applicant]