SYSTEM AND METHOD USING PARTIAL JUST-IN-TIME COMPLATION TO RESOLVE MEMORY ACCESS PATTERN PROBLEMS IN HASH TABLE PROBING
A system and method for just in time compilation for hash table probing are disclosed. In one implementation, the method of using just-in-time compilation is used to combine the stages of hash value computation and initial lookup into a single compound operation. In another implementation, the method of using just-in-time compilation is used to combine the stages of a hash table record and input record checking to detect if these records are equal, and if not, fetching the next possible record in the linked list of the per-bucket records.
1 . An apparatus for hash table lookups in a block oriented processing system, the apparatus comprising:
a database that performs block oriented processing;
the database having a database engine that just in time compiles compound operations into compound functions that are used to perform efficient hash table lookups in the block oriented processing system.
2 . The apparatus of claim 1 , wherein the compound function is a hash value computation and an initial lookup.
3 . The apparatus of claim 1 , wherein the compound function is a hash table record and an input record equality checking
4 . The apparatus of claim 3 , where the compound function additionally performs the fetching of the next record in the hash table bucket-chain list for records that failed equality check.
5 . The apparatus of claim 4 , wherein the compound function additionally performs the fetching of attribute values for records that passed equality check.
6 . The apparatus of claim 1 further comprising a store that stores the compiled compound function and allows reusing them by future tasks with equivalent hash-table structure.
7 . The apparatus of claim 1 , wherein the block oriented processing system is a vectorized database system.
8 . A method for hash table lookups in a block oriented processing system using just in time compiling of compound operations, the method comprising:
performing block oriented processing of records on a database;
just-in-time compiling, by a database engine associated with the database, compound operations into compound functions that are used to perform efficient hash table lookups in a the block oriented processing system.
9 . The method of claim 8 , wherein the compound function is a hash value computation and an initial lookup.
10 . The method of claim 8 , wherein the compound function is a hash table record and an input record equality checking.
11 . The method of claim 10 , where the compound function additionally performs fetching of the next record in the hash table bucket-chain list for records that failed equality check.
12 . The method of claim 8 , wherein the compound function additionally performs fetching of an attribute value in the database.
13 . The method of claim 8 further comprising a store that stores the compiled compound function and allows reusing them by future tasks with equivalent hash-table structure.
14 . The method of claim 8 , wherein the block oriented processing system is a vectorized database system.