Systems, methods, and computer-readable media for utilizing anonymous sharding techniques to protect distributed data
Systems, methods, and computer-readable media for protecting distributed data are provided. The data is distributed according to a time-based shard distribution scheme that splits data into multiple pieces to prevent an attacker who successfully breaches a terminal device from reassembling the pieces.
1. A method comprising:
accessing a communication stream at a terminal device within a communications system, wherein the communications stream comprises communications data records arranged in a communication stream time order;
organizing the communication stream into a plurality of epochs, wherein each epoch is associated with a particular epoch timeframe having a start time and an end time within the communication stream time order, and wherein each epoch is further associated with at least one data page of the communications data records;
classifying each of the at least one data page as one of a historical data page and a current data page;
maintaining at least one current data page on the terminal device;
applying a shard distribution scheme to each historical data page, wherein each historical data page is divided into a plurality of shard units, each shard unit including a data shard and an anonymous address known only to the terminal device; and
transmitting the shard units to remote servers for storage.
2. The method of claim 1 , further comprising:
executing a panic mode in response to a detected attack event; and
instructing the remote servers to not provide any shard units when the panic mode is active.
3. The method of claim 1 , further comprising:
receiving a request to access historical communications stream data from a user at the terminal device;
determining a historical data page the user wishes to access;
fetching shard units from the remote servers based on the determined historical data page; and
reconstructing the historical data page from the fetched shard units.
4. The method of claim 1 , wherein the at least one current data page being maintained on the terminal device contains the only data within the communications stream that can be compromised during an attack.
5. The method of claim 1 , wherein applying the shard distribution scheme further comprises:
splitting the historical data page into a plurality of data shards;
generating an anonymous address for each of the plurality of data shards; and
merging the anonymous address generated for each of the plurality of data shards with a corresponding data shard to form the plurality of shard units.
6. The method of claim 5 , wherein the plurality of data shards comprises a fixed number data shards for all data pages that are split during application of the shard distribution scheme.