System and method for efficient data collection based on data access pattern for reporting in large scale multi tenancy environment
One example method includes collecting information concerning respective data access patterns of one or more customers, using the information, and work window information, to calculate a respective data retrieval frequency for each of the customers, and enabling the customers to retrieve data according to their respective data retrieval frequency. The collected information may be weighted prior to calculation of the data retrieval frequency, and the data retrieval frequency may be updated automatically in response to changes in customer data.
1. A method, comprising:
receiving a data access history of one or more customers;
collecting, by a computing entity that comprises a data collector, information concerning respective data access patterns of the one or more customers based on the data access history;
deriving work window information based on the data access history;
using the information, and the work window information, to calculate, by a computing entity that comprises a data collection scheduler, a respective data retrieval frequency (DRF) for each of the customers, wherein the DRF for one of the customers is calculated using the formula:
DRF=Number of working hours×weighted data access frequency×weighted least recently accessed data×weighted data change frequency; and
enabling the customers to retrieve data according to their respective data retrieval frequency.
2. The method as recited in claim 1 , wherein the data collection scheduler operates in a multi tenancy environment that supports the data requirements of all of the customers.
3. The method as recited in claim 1 , further comprising weighting the collected information, and weighting information is used in calculation of the data retrieval frequencies.
4. The method as recited in claim 1 , wherein one of the data retrieval frequencies is recalculated automatically based on changes to data of the customer to which that data retrieval frequency applies.
5. The method as recited in claim 1 , wherein the collected information comprises data access frequency information.
6. The method as recited in claim 1 , wherein the collected information comprises information about least recently accessed data.
7. The method as recited in claim 1 , wherein the collected information comprises data change frequency information.
8. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving a data access history of one or more customers;
collecting, by a computing entity that comprises a data collector, information concerning respective data access patterns of the one or more customers based on the data access history;
deriving work window information based on the data access history;
using the information, and the work window information, to calculate, by a computing entity that comprises a data collection scheduler, a respective data retrieval frequency (DRF) for each of the customers, wherein the DRF for one of the customers is calculated using the formula:
DRF=Number of working hours×weighted data access frequency×weighted least recently accessed data×weighted data change frequency; and
enabling the customers to retrieve data according to their respective data retrieval frequency.
9. The non-transitory storage medium as recited in claim 8 , wherein the data collection scheduler operates in a multi tenancy environment that supports the data requirements of all of the customers.
10. The non-transitory storage medium as recited in claim 8 , further comprising weighting the collected information, and weighting information is used in calculation of the data retrieval frequencies.
11. The non-transitory storage medium as recited in claim 8 , wherein one of the data retrieval frequencies is recalculated automatically based on changes to data of the customer to which that data retrieval frequency applies.
12. The non-transitory storage medium as recited in claim 8 , wherein the collected information comprises data access frequency information.
13. The non-transitory storage medium as recited in claim 8 , wherein the collected information comprises information about least recently accessed data.
14. The non-transitory storage medium as recited in claim 8 , wherein the collected information comprises data change frequency information.
15. A system, comprising:
one or more hardware processors; and
a non-transitory storage medium having stored therein instructions that are executable by the one or more hardware processors to perform operations comprising:
receiving a data access history of one or more customers;
collecting, by a computing entity that comprises a data collector, information concerning respective data access patterns of the one or more customers based on the data access history;
deriving work window information based on the data access history;
using the information, and work window information, to calculate, by a data collection scheduler, a respective data retrieval frequency (DRF) for each of the customers, wherein the DRF for one of the customers is calculated using the formula:
DRF=Number of working hours×weighted data access frequency×weighted least recently accessed data×weighted data change frequency; and
enabling the customers to retrieve data according to their respective data retrieval frequency.
16. The system as recited in claim 15 , wherein one of the data retrieval frequencies is recalculated automatically based on changes to data of the customer to which that data retrieval frequency applies.
17. The system as recited in claim 15 , further comprising weighting the collected information, and weighting information is used in calculation of the data retrieval frequencies.