System and method for blockchain data compaction
A system and method for faster communication between blockchain mining nodes and faster block validation. The system uses machine learning on data chunks to generate codebooks which compact the data to be stored, processed, or sent with a smaller data profile than uncompacted data. The system uses a data compaction in an existing blockchain fork or implemented in a new blockchain protocol from which nodes that wish to or need to use the blockchain can do so with a reduced storage requirement. The system uses network data compaction across all nodes to increase the speed of and decrease the size of a blockchain's data packets. The system uses data compaction firmware to increase the efficiency at which mining rigs can computationally validate new blocks on the blockchain. The system can be implemented using any combination of the three data compaction services to meet the needs of the desired blockchain technology.
1. A blockchain data compaction system, comprising:
a blockchain computing node communicatively coupled to a plurality of other blockchain computing nodes, each blockchain computing node comprising a memory and a processor, and wherein the sum of blockchain computing nodes creates a consensus pool for a blockchain;
a network compaction service, comprising a first plurality of programming instructions stored in the memory and operating on the multi-core processor on each of the blockchain computing nodes, wherein the first plurality of programming instructions, when operating on the processor, cause the processor to:
store a first reference codebook in the memory of each of the blockchain computing nodes, the first reference codebook pretrained by machine learning to determine sourceblocks and to associate codewords to each sourceblock;
store a first deconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the first deconstruction algorithm, when operating on the processor, causes the processor to:
receive network data intended for the consensus pool;
deconstruct the network data intended for the consensus pool into a plurality of sourceblocks;
encode the first plurality of sourceblocks into a first codeword using the first reference codebook; and
send the first codeword to the consensus pool; and
store a first reconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the first reconstruction algorithm, when operating on the processor, causes the processor to:
receive the first codeword; and
reconstruct the network data by decoding the first plurality of sourceblocks using the first reference codebook; and
a blockchain compaction module, comprising a second plurality of programming instructions stored in the memory and operating on the processor, wherein the second plurality of programming instructions, when operating on the processor, cause the processor to:
store a second reference codebook in the memory of each of the blockchain computing nodes, the second reference codebook pretrained by machine learning to determine sourceblocks and associated codewords of the blockchain; and
store a second deconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the first deconstruction algorithm, when operating on the processor, causes the processor to:
receive a blockchain block;
deconstruct the blockchain block into a second plurality of sourceblocks;
encode the second plurality of sourceblocks into a second codeword using the second reference codebook; and
append the second codeword to a compacted blockchain, the compacted blockchain comprising codewords for each block on the blockchain.
2. The system of claim 1 , wherein the deconstruction of the network data intended for the consensus pool generates a sourceblock and association not in the first reference codebook, attach the sourceblock and association to the first codeword, the first reconstruction algorithm updating the first reference codebook.
3. The system of claim 1 , wherein the deconstruction of the blockchain block generates a sourceblock and association not in the second reference codebook, add the sourceblock and association to the second reference codebook.
4. The system of claim 1 , wherein the blockchain compaction module further causes the processor to store a second reconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the second reconstruction algorithm, when operating on the processor, causes the processor to reconstruct the blockchain block by decoding the second plurality of sourceblocks using the second reference codebook.
5. The system of claim 1 , further comprising a proof system compaction firmware and wherein the processor is a multi-core processor, comprising a third plurality of programming instructions stored in the memory and operating on the multi-core processor, wherein the third plurality of programming instructions, when operating on the multi-core processor, cause each the multi-core processor to:
store a third reference codebook embedded as firmware in the memory of each core in the multi-core processor, the third reference codebook pretrained by machine learning to determine sourceblocks and to associate codewords to each sourceblock;
store a third deconstruction algorithm embedded as firmware in the memory of each core in the multi-core processor, wherein the third deconstruction algorithm, when operating on each core, cause the multi-core processor to:
receive data intended for a different core;
deconstruct the data intended for a different core into a third plurality of sourceblocks;
encode the third plurality of sourceblocks into a third codeword using the third reference codebook; and
send the third codeword to the intended core; and
store a third reconstruction algorithm embedded as firmware in the memory of each core in the multi-core processor, wherein the third reconstruction algorithm, when operating on each core, cause the multi-core processor to:
receive the third codeword at the intended core; and
reconstruct the data intended for a different core by decoding the third plurality of sourceblocks using the third reference codebook.
6. The system of claim 5 , wherein the deconstruction of data intended for a different core generates a sourceblock and association not in the third reference codebook, attach the sourceblock and association to the third codeword, the third reconstruction algorithm updating the third reference codebook.
7. The system of claim 1 , wherein each reference codebook is stored as a blockchain.
8. The system of claim 1 , wherein the blockchain data compaction system is implemented as a unique blockchain protocol.
9. The system of claim 1 , wherein the blockchain data compaction system is implemented in a fork of an existing blockchain protocol.
10. The system of claim 1 , wherein the blockchain compaction module permanently deletes a portion from one or more reference codebooks to redact information on the blockchain.
11. A method for blockchain data compaction, comprising the steps of:
storing a first reference codebook in the memory of a blockchain computing node communicatively coupled to a plurality of other blockchain computing nodes, each blockchain computing node comprising a memory and a processor, and wherein the sum of blockchain computing nodes creates a consensus pool for a blockchain, and wherein the first reference codebook is pretrained by machine learning to determine sourceblocks and to associate codewords to each sourceblock;
storing a first deconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the first deconstruction algorithm, when operating on the processor, cause the processor to:
receive network data intended for the consensus pool;
deconstruct the network data intended for the consensus pool into a plurality of sourceblocks;
encode the first plurality of sourceblocks into a first codeword using the first reference codebook; and
send the first codeword to the consensus pool;
storing a first reconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the first reconstruction algorithm, when operating on the processor, causes the processor to:
receive the first codeword; and
reconstruct the network data by decoding the first plurality of sourceblocks using the first reference codebook;
storing a second reference codebook in the memory of each of the blockchain computing nodes, the second reference codebook pretrained by machine learning to determine sourceblocks and associated codewords of the blockchain; and
storing a second deconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the first deconstruction algorithm, when operating on each of the processor, cause the multi-core processors to:
receive a blockchain block;
deconstruct the blockchain block into a second plurality of sourceblocks;
encode the second plurality of sourceblocks into a second codeword using the second reference codebook; and
append the second codeword to a compacted blockchain, the compacted blockchain comprising codewords for each block on the blockchain.
12. The method of claim 11 , wherein the deconstruction of the network data intended for the consensus pool generates a sourceblock and association not in the first reference codebook, attach the sourceblock and association to the first codeword, the first reconstruction algorithm updating the first reference codebook.
13. The method of claim 11 , wherein the deconstruction of the blockchain block generates a sourceblock and association not in the second reference codebook, add the sourceblock and association to the second reference codebook.
14. The method of claim 11 , further comprising the steps of storing a second reconstruction algorithm in the memory of each of the blockchain computing nodes, wherein the second reconstruction algorithm, when operating on each of the processor, causes the processor to reconstruct the blockchain block by decoding the second plurality of sourceblocks using the second reference codebook.
15. The method of claim 11 , wherein the processor is a multi-core processor, further comprising the steps of storing a third reference codebook embedded as firmware in the memory of each core in each of the multi-core processors, the third reference codebook pretrained by machine learning to determine sourceblocks and to associate codewords to each sourceblock;
storing a third deconstruction algorithm embedded as firmware in the memory of each core in each of the multi-core processors, wherein the third deconstruction algorithm, when operating on each core, cause the multi-core processors to:
receive data intended for a different core;
deconstruct the data intended for a different core into a third plurality of sourceblocks;
encode the third plurality of sourceblocks into a third codeword using the third reference codebook; and
send the third codeword to the intended core; and
storing a third reconstruction algorithm embedded as firmware in the memory of each core in each of the multi-core processors, wherein the third reconstruction algorithm, when operating on each core, cause the multi-core processors to:
receive the third codeword at the intended core; and
reconstruct the data intended for a different core by decoding the third plurality of sourceblocks using the third reference codebook.
16. The method of claim 15 , wherein the deconstruction of data intended for a different core generates a sourceblock and association not in the third reference codebook, attach the sourceblock and association to the third codeword, the third reconstruction algorithm updating the third reference codebook.
17. The method of claim 11 , wherein each reference codebook is stored as a blockchain.
18. The method of claim 11 , wherein the blockchain data compaction method is implemented in a unique blockchain protocol.
19. The method of claim 11 , wherein the blockchain data compaction method is implemented in a fork of an existing blockchain protocol.
20. The method of claim 11 , further comprising the step of permanently deleting a portion from one or more reference codebooks to redact information on the blockchain.