Techniques for consistent multi-tenant behavior in microservices based applications
Techniques are disclosed for using a multi-tenant framework for microservices in a microservices-based application to implement a tenant-aware distributed cache. The microservices-based application can include at least one microservice that incorporates the multi-tenant framework. The multi-tenant framework includes software components configured to provide multi-tenant functionality for the microservice. A microservice may receive first request associated with a tenant and comprising tenant context data. A first software component of the multi-tenant framework can extract the tenant context data from the request. The microservice can receive a second request comprising request data. A second software component of the multi-tenant framework can use the tenant context data to store the request data in a cache.
1 . A computer implemented method, comprising:
receiving, at an interface of a microservice executing within a distributed computing system, a first request associated with a tenant of the distributed computing system, the microservice comprising a multi-tenant framework having a plurality of software components, the microservice agnostic to the tenant of the distributed computing system, and the first request comprising tenant context data;
extracting, by a first software component of the plurality of software components, the tenant context data, the first software component corresponding to the interface;
receiving, at the interface of the microservice, a second request comprising request data; and
storing, by a second software component of the plurality of software components and using the tenant context data, the request data in a cache.
2 . The computer implemented method of claim 1 , wherein receiving the second request comprises receiving the second request from a tenant manager service executing within the distributed computing system.
3 . The computer implemented method of claim 1 , wherein the request data comprises tenant database configuration information.
4 . The computer implemented method of claim 1 , wherein storing the request data using the tenant context data comprises injecting the tenant context data into a caching request generated by the microservice.
5 . The computer implemented method of claim 1 , wherein storing the request data using the tenant context data comprises storing the tenant context data in the cache with the request data, the tenant context data associated with the request data in the cache.
6 . The computer implemented method of claim 1 , wherein the second software component comprises a multi-tenant cache manager.
7 . The computer implemented method of claim 1 , further comprising:
determining, by the second software component using an eviction rule associated with the tenant, that the request data is invalid; and
in accordance with a determination that the request data is invalid, evicting, by the second software component and using the tenant context data, the request data from the cache.
8 . The computer implemented method of claim 7 , wherein evicting the request data comprises:
identifying the request data using the tenant context data; and
removing the request data from the cache.
9 . A distributed computing system, comprising:
one or more processors; and
one or more memories storing computer-executable instructions that when executed by the one or more processors, cause the distributed computing system to:
receive, at an interface of a microservice executing within the distributed computing system, a first request associated with a tenant of the distributed computing system, the microservice comprising a multi-tenant framework having a plurality of software components, the microservice agnostic to the tenant of the distributed computing system, and the first request comprising tenant context data;
extract, by a first software component of the plurality of software components, the tenant context data, the first software component corresponding to the interface;
receive, at the interface of the microservice, a second request comprising request data; and
store, by a second software component of the plurality of software components and using the tenant context data, the request data in a cache.
10 . The distributed computing system of claim 9 , wherein receiving the second request comprises receiving the second request from a tenant manager service executing within the distributed computing system.
11 . The distributed computing system of claim 9 , wherein the request data comprises tenant database configuration information.
12 . The distributed computing system of claim 9 , wherein storing the request data using the tenant context data comprises injecting the tenant context data into a caching request generated by the microservice.
13 . The distributed computing system of claim 9 , wherein storing the request data using the tenant context data comprises storing the tenant context data in the cache with the request data, the tenant context data associated with the request data in the cache.
14 . The distributed computing system of claim 9 , wherein the second software component comprises a multi-tenant cache manager.
15 . The distributed computing system of claim 9 , wherein the one or more memories store additional instructions that, when executed by the one or more processors, cause the distributed computing system to further:
determine, by the second software component using an eviction rule associated with the tenant, that the request data is invalid; and
in accordance with a determination that the request data is invalid, evict, by the second software component and using the tenant context data, the request data from the cache.
16 . The distributed computing system of claim 15 , wherein evicting the request data comprises:
identifying the request data using the tenant context data; and
removing the request data from the cache.
17 . A non-transitory computer-readable storage medium comprising executable instructions that, when executed by one or more processors of a distributed computing system, cause the distributed computing system to:
receive, at an interface of a microservice executing within the distributed computing system, a first request associated with a tenant of the distributed computing system, the microservice comprising a multi-tenant framework having a plurality of software components, the microservice agnostic to the tenant of the distributed computing system, and the first request comprising tenant context data;
extract, by a first software component of the plurality of software components, the tenant context data, the first software component corresponding to the interface;
receive, at the interface of the microservice, a second request comprising request data; and
store, by a second software component of the plurality of software components and using the tenant context data, the request data in a cache.
18 . The non-transitory computer-readable storage medium of claim 17 , wherein storing the request data using the tenant context data comprises injecting the tenant context data into a caching request generated by the microservice.
19 . The non-transitory computer-readable storage medium of claim 17 , wherein storing the request data using the tenant context data comprises storing the tenant context data in the cache with the request data, the tenant context data associated with the request data in the cache.
20 . The non-transitory computer-readable storage medium of claim 17 , comprising additional instructions that, when executed by the one or more processors, cause the distributed computing system to further:
determine, by the second software component using an eviction rule associated with the tenant, that the request data is invalid; and
in accordance with a determination that the request data is invalid, evict, by the second software component and using the tenant context data, the request data from the cache.