Hybrid database table stored as both row and column store
A hybrid database table is stored as both a row and a column store. One or more techniques may be employed alone or in combination to enhance performance of the hybrid table by regulating access to, and/or the size of, the processing-intensive column store data. For example during an insert operation, the column store data may be searched for a uniqueness violation only after certain filtering and/or boundary conditions have been considered. In another technique, a hybrid table manager may control movement of data to the column store based upon considerations such as frequency of access, or underlying business logic. In still another technique, querying of the hybrid table may result in a search of the column store data only after an initial search of row store data fails to return a result.
1. A computer-implemented method comprising:
providing in a non-transitory computer readable storage medium, a database created in an application level language and comprising row partitioned store and column partitioned store;
causing a row engine to insert a record into the row partitioned store;
performing an optimization based upon additional information to determine that a uniqueness violation may exist with respect to the record;
when it is determined that a uniqueness violation may exist, performing a search of the column partitioned store to determine whether a uniqueness violation exists with respect to the record;
receiving a query on the database;
performing a search on the row partitioned store of the database using the query;
selectively searching the column partitioned store using the query depending on an analysis of the search performed on the row partitioned store; and
returning a search result.
2. The computer-implemented method of claim 1 wherein the optimization comprises maintaining min/max values of unique columns in the column partitioned store with a latch-free structure to minimize contention.
3. The computer-implemented method of claim 1 wherein the optimization comprises maintaining a filter for unique columns.
4. The computer-implemented method of claim 3 wherein the filter comprises a Bloom filter.
5. The computer-implemented method of claim 3 wherein the filter is scalable.
6. The computer-implemented method of claim 3 further comprising updating or rehashing when data is moved from the row partitioned store to the column partitioned store.
7. A non-transitory computer readable storage medium embodying a computer program for performing a method, said method comprising:
receiving records to be inserted into a database created in an application level language in a non-transitory storage medium and comprising row partitioned store and column partitioned store;
causing a row engine to insert a record into the row partitioned store;
performing an optimization based upon additional information to determine that a uniqueness violation may exist with respect to the record;
when it is determined that a uniqueness violation may exist, performing a search of the column partitioned store to determine whether a uniqueness violation exists with respect to the record;
receiving a query on the database;
performing a search on the row partitioned store of the database using the query;
selectively searching the column partitioned store using the query depending on an analysis of the search performed on the row partitioned store; and
returning a search result.
8. The non-transitory computer readable storage medium of claim 7 wherein the optimization comprises maintaining min/max values of unique columns in the column partitioned store with a latch-free structure to minimize contention.
9. The non-transitory computer readable storage medium of claim 7 wherein the optimization comprises maintaining a filter for unique columns.
10. The non-transitory computer readable storage medium of claim 9 wherein the filter comprises a Bloom filter.
11. The non-transitory computer readable storage medium of claim 9 wherein the filter is scalable.
12. The non-transitory computer readable storage medium of claim 9 wherein the method further comprises updating or rehashing when data is moved from the row partitioned store to the column partitioned store.
13. A computer system comprising:
one or more processors;
a software program, executable on said computer system, the software program configured to:
receive records to be inserted into a database created in an application level language in a non-transitory storage medium and comprising row partitioned store and column partitioned store;
cause a row engine to insert a record into the row partitioned store;
perform an optimization based upon additional information to determine that a uniqueness violation may exist with respect to the record;
when it is determined that a uniqueness violation may exist, performing a search of the column partitioned store to determine whether a uniqueness violation exists with respect to the record;
receive a query on the database;
perform a search on the row partitioned store of the database using the query;
selectively search the column partitioned store using the query depending on an analysis of the search performed on the row partitioned store; and
return a search result.
14. The computer system of claim 13 wherein the optimization comprises maintaining min/max values of unique columns in the column partitioned store with a latch-free structure to minimize contention.
15. The computer system of claim 13 wherein the optimization comprises maintaining a filter for unique columns.
16. The computer system of claim 15 wherein the filter comprises a Bloom filter.
17. The computer system of claim 15 wherein the filter is scalable.