Data volume management
Embodiments are directed towards a system and method for a cloud-based front end that may abstract and enable access to the underlying cloud-hosted elements and objects that may be part of a multi-tenant application, such as a search application. Search objects may be employed to access indexed objects. An amount of indexed data accessible to a user may be based on an index storage limit selected by the user, such that data that exceeds the index storage limit may continue to be indexed. Also, one or more projects can be elastically scaled for a user to provide resources that may meet the specific needs of each project.
1. A computer-implemented method, comprising:
receiving, on a computing device, raw data for a plurality of projects in a multi-tenant environment;
indexing the raw data, wherein indexing includes dividing the raw data into time stamped searchable events;
associating indexed data with each project in the plurality of projects in the multi-tenant environment;
storing the indexed data in one or more indexed data stores;
determining at least one role for each of the projects, wherein a role controls permissions to an indexed data store for a requestor for a project;
receiving a request from a requestor to access an indexed data store for a project;
determining a role of the requestor for the project, wherein the role controls permissions of the requestor to the indexed data store for the project;
determining whether the requestor has permission to access the indexed data store based on the role determined for the requestor; and
allowing access to the indexed data store when the role indicates that the requestor has permission to access the indexed data store.
2. The method of claim 1 , wherein the role of the requestor for the project grants the requestor permission to provide data to be indexed in an indexed data store.
3. The method of claim 1 , wherein the role of the requestor for the project grants the requestor permission to search indexed data in an indexed data store.
4. The method of claim 1 , wherein the role of the requestor for the project grants the requestor permission to provide data to be indexed in an indexed data store and grants the requestor permission to search indexed data in the indexed data store.
5. The method of claim 1 , wherein the request to access the indexed data store includes a request to provide data to be indexed in the indexed data store or a request to search indexed data in the indexed data store.
6. The method of claim 1 , further comprising:
receiving input corresponding to an invitation to provide access to the project to a second requestor.
7. The method of claim 6 , wherein the second requestor inherits the role for the project from the requestor.
8. The method of claim 7 , further comprising:
receiving a second request from the second requestor; and
determining whether the second requestor has access to the indexed data store based on the inherited role.
9. The method of claim 6 , further comprising:
determining a role for the second requestor, wherein the role for the second requestor controls permissions of the second requestor to the indexed data store for the project.
10. The method of claim 1 , further comprising:
establishing a data volume limit on an amount of storage for the project in the indexed data store;
receiving additional raw data;
determining that the data volume limit has been reached for the project; and
declining to store in the indexed data store additional indexed data resulting from indexing the additional raw data, wherein additional indexed data is declined for storage until after instructions have been received to increase the data volume limit for the project.
11. The method of claim 10 , wherein declining to store includes storing the additional data in overflow memory not accessible by a search query, and further comprising:
receiving instructions to increase the data volume limit for the project;
indexing the additional data to produce additional indexed data; and
storing the additional indexed data in the indexed data store for the project.
12. A system, comprising:
a processor; and
a non-transitory computer-readable storage medium containing instructions configured to cause the processor to perform operations including:
receiving raw data for a plurality of projects in a multi-tenant environment;
indexing the raw data, wherein indexing includes dividing the raw data into time stamped searchable events;
associating indexed data with each project in the plurality of projects in the multi-tenant environment;
storing the indexed data in one or more indexed data stores;
determining at least one role for each of the projects, wherein a role controls permissions to an indexed data store for a requestor for a project;
receiving a request from a requestor to access an indexed data store for a project;
determining a role of the requestor for the project, wherein the role controls permissions of the requestor to the indexed data store for the project;
determining whether the requestor has permission to access the indexed data store based on the role determined for the requestor; and
allowing access to the indexed data store when the role indicates that the requestor has permission to access the indexed data store.
13. The system of claim 12 , wherein the role of the requestor for the project grants the requestor permission to provide data to be indexed in an indexed data store.
14. The system of claim 12 , wherein the role of the requestor for the project grants the requestor permission to search indexed data in an indexed data store.
15. The system of claim 12 , wherein the role of the requestor for the project grants the requestor permission to provide data to be indexed in an indexed data store and grants the requestor permission to search indexed data in the indexed data store.
16. The system of claim 12 , wherein the request to access the indexed data store includes a request to provide data to be indexed in the indexed data store or a request to search indexed data in the indexed data store.
17. The system of claim 12 , wherein the non-transitory computer-readable storage medium contains further instructions configured to cause the processor to perform operations including:
receiving input corresponding to an invitation to provide access to the project to a second requestor.
18. The system of claim 17 , wherein the second requestor inherits the role for the project from the requestor.
19. The system of claim 18 , wherein the non-transitory computer-readable storage medium contains further instructions configured to cause the processor to perform operations including:
receiving a second request from the second requestor; and
determining whether the second requestor has access to the indexed data store based on the inherited role.
20. The system of claim 17 , wherein the non-transitory computer-readable storage medium contains further instructions configured to cause the processor to perform operations including:
determining a role for the second requestor, wherein the role for the second requestor controls permissions of the second requestor to the indexed data store for the project.
21. The system of claim 12 , wherein the non-transitory computer-readable storage medium contains further instructions configured to cause the processor to perform operations including:
establishing a data volume limit on an amount of storage for the project in the indexed data store;
receiving additional raw data;
determining that the data volume limit has been reached for the project; and
declining to store in the indexed data store additional indexed data resulting from indexing the additional raw data, wherein additional indexed data is declined for storage until after instructions have been received to increase the data volume limit for the project.
22. The system of claim 21 , wherein declining to store includes storing the additional data in overflow memory not accessible by a search query, and wherein the non-transitory computer-readable storage medium contains further instructions configured to cause the processor to perform operations including:
receiving instructions to increase the data volume limit for the project;
indexing the additional data to produce additional indexed data; and
storing the additional indexed data in the indexed data store for the project.
23. A computer-program product, tangibly embodied in a non-transitory machine-readable medium, including instructions configured to cause a data processing apparatus to:
receive raw data for a plurality of projects in a multi-tenant environment;
index the raw data, wherein indexing includes dividing the raw data into time stamped searchable events;
associate indexed data with each project in the plurality of projects in the multi-tenant environment;
store the indexed data in one or more indexed data stores;
determine at least one role for each of the projects, wherein a role controls permissions to an indexed data store for a requestor for a project;
receive a request from a requestor to access an indexed data store for a project;
determine a role of the requestor for the project, wherein the role controls permissions of the requestor to the indexed data store for the project;
determine whether the requestor has permission to access the indexed data store based on the role determined for the requestor; and
allow access to the indexed data store when the role indicates that the requestor has permission to access the indexed data store.
24. The system of claim 23 , wherein the role of the requestor for the project grants the requestor permission to provide data to be indexed in an indexed data store or grants the requestor permission to search indexed data in the indexed data store.
25. The system of claim 23 , wherein the role of the requestor for the project grants the requestor permission to provide data to be indexed in an indexed data store and grants the requestor permission to search indexed data in the indexed data store.
26. The system of claim 23 , wherein the request to access the indexed data store includes a request to provide data to be indexed in the indexed data store or a request to search indexed data in the indexed data store.
27. The system of claim 23 , further including instructions configured to cause the data processing apparatus to:
receiving input corresponding to an invitation to provide access to the project to a second requestor.
28. The system of claim 27 , wherein the second requestor inherits the role for the project from the requestor.
29. The system of claim 28 , further including instructions configured to cause the data processing apparatus to:
receiving a second request from the second requestor; and
determining whether the second requestor has access to the indexed data store based on the inherited role.
30. The system of claim 27 , further including instructions configured to cause the data processing apparatus to:
determining a role for the second requestor, wherein the role for the second requestor controls permissions of the second requestor to the indexed data store for the project.