SYSTEM AND METHOD FOR EFFICIENT MANAGEMENT OF BIG DATA IN A DATABASE USING STREAMING TABLES

1 . A system comprising:

a shared disk database cluster with multiple database nodes, the nodes configured to perform multiple processes, each database node configured to:

insert data to the same table;

assign a unique location for the insert in the same table, the location representing a primary key of a table including an ID of a storage node containing the data; and

update the table without contention with other processes updating the same table.

2 . The system of claim 1 , wherein each node is further configured to provide a consistent and complete view of the data to a user querying the data.

3 . A database method, comprising:

connecting rows that share the same key value, based on a linked list, wherein an anchor of the linked list is from a structure where entries in the structure represent the key values, and

searching for rows by one of the key values; and

retrieving an entry that represents the key value and following the linked list to retrieve the rows.

4 . The method of claim 3 , wherein, to retrieve all the rows in a table that share the same key, multiple linked lists originating at multiple anchors are considered.

5 . A database system, comprising:

one or more database nodes or servers;

one or more storage nodes or servers;

an index structure including entries on a local structure on the storage nodes, the entries representing key values, wherein

entries in the structure maintain a link,

the link connects an entry to a row in a data file,

the row contains one or more columns with the key value which is represented by the entry, and

the one or more storage nodes or servers configured to:

locate the entry in the local structure and follow the link to find the first row, and locating the other rows by sequentially retrieving rows from a location which is relative to the first row.

6 . A clustered database system, wherein different database nodes insert new rows to a table, on each database node one or more processes insert rows to the table and update index files, the process on each node is completed without needing to share data with a process on a different node.

7 . A database system comprising one or more database nodes, the one or more database nodes configured to:

maintain an index in a storage node such that entries in the index represent a time, and a link that identifies a location in a file; and

sequentially search, using the index, by locating a time entry that identifies an offset in a file from which a scan is initiated.