Unified table query processing
A system and method of query processing in a multi-level storage system having a unified table architecture. A query is received by a common query execution engine connected with the unified table architecture, the query specifying a data record. The common query execution engine performs a look-up for the data record based on the query at the first level storage structure. If the data record is not present at the first level storage structure, the common query execution engine performs separate look-ups in each of the second level storage structure and the main store.
1. A method comprising:
receiving a query for data stored in a database, wherein the database stores the data in accordance with a multi-level storage structure that includes a first level storage structure, a second level storage structure, and a main store, wherein the first level storage structure is configured to store at least a first data in a write-optimized logical row store, wherein the second level storage structure is configured to store at least a second data in a column store, and wherein the main store is configured to store at least a third data in a corresponding column store; and
in order to respond to the query, performing a look-up for the data in the multi-level storage structure, the look-up performed first at the first level storage structure, and if the data is not found at the first level storage structure, the look-up for the data is performed at the second level storage structure, and if the data is not found at the second level storage structure, the look-up for the data is performed at the main store.
2. The method in accordance with claim 1 , wherein at least one of the look-up is based at least in part on a sorted dictionary.
3. The method in accordance with claim 1 , wherein the look-up of the first level storage structure is based on an unsorted dictionary.
4. The method in accordance with claim 1 , wherein the look-up of the second level storage structure is based on a sorted dictionary and an index.
5. The method of claim 1 , further comprising merging, into a main dictionary that is sorted, a first dictionary for the first level storage structure and a second dictionary of the second level storage structure.
6. The method in accordance with claim 1 further comprising storing a new version of the data, when the first level storage structure receives a request comprising an update operation, an insert operation, or a delete operation.
7. The method in accordance with claim 6 , further comprising storing the new version of the data, when the second level storage structure receives a bulk insert.
8. The method of claim 1 , wherein the database comprises an in-memory database.
9. A system comprising:
at least one programmable processor;
at least one memory including program code which when executed causes operations comprising:
receiving query for data stored in a database, wherein the database stores the data in accordance with a multi-level storage structure that includes a first level storage structure, a second level storage structure, and a main store, wherein the first level storage structure is configured to store at least a first data in a write-optimized logical row store, wherein the second level storage structure is configured to store at least a second data in a column store, and wherein the main store is configured to store at least a third data in a corresponding column store; and
in order to respond to the query, performing a look-up for the data in the multi-level storage structure, the look-up performed first at the first level storage structure, and if the data is not found at the first level storage structure, the look-up for the data is performed at the second level storage structure, and if the data is not found at the second level storage structure, the look-up for the data is performed at the main store.
10. The system in accordance with claim 9 , wherein at least one of the look-up is based at least in part on a sorted dictionary.
11. The system in accordance with claim 9 , wherein the look-up of the first level storage structure is based on an unsorted dictionary.
12. The system in accordance with claim 9 , wherein the look-up of the second level storage structure is based on a sorted dictionary and an index.
13. The system in accordance with claim 9 , further comprising merging, into a main dictionary that is sorted, a first dictionary for the first level storage structure and a second dictionary of the second level storage structure.
14. The system in accordance with claim 9 further comprising storing a new version of the data, when the first level storage structure receives a request comprising an update operation, an insert operation, or a delete operation.
15. The system in accordance with claim 14 , further comprising storing the new version of the data, when the second level storage structure receives a bulk insert.
16. The system in accordance with claim 9 , wherein the database comprises an in-memory database.
17. A non-transitory computer-readable storage medium including program code which when executed by at least one programmable processor causes operations comprising:
receiving a query for data stored in a database, wherein the database stores the data in accordance with a multi-level storage structure that includes a first level storage structure, a second level storage structure, and a main store, wherein the first level storage structure is configured to store at least a first data in a write-optimized logical row store, wherein the second level storage structure is configured to store at least a second data in a column store, and wherein the main store is configured to store at least a third data in a corresponding column store; and
in order to respond to the query, performing a look-up for the data in the multi-level storage structure, the look-up performed first at the first level storage structure, and if the data is not found at the first level storage structure, the look-up for the data is performed at the second level storage structure, and if the data is not found at the second level storage structure, the look-up for the data is performed at the main store.
18. The non-transitory computer-readable storage medium in accordance with claim 17 , wherein at least one of the look-up is based at least in part on a sorted dictionary.
19. The non-transitory computer-readable storage medium in accordance with claim 17 , wherein the look-up of the first level storage structure is based on an unsorted dictionary.
20. The non-transitory computer-readable storage medium in accordance with claim 17 , wherein the look-up of the second level storage structure is based on a sorted dictionary and an index.