SYSTEM AND METHOD FOR TESTING SYSTEM SCALE UP
A system and method for simulating data system scaling, including: receiving a first data stream including a plurality of transactions, wherein each of the plurality of transactions includes at least a timestamp and an event, wherein the first data stream is directed at a first system; generating a simulated second data stream based on the first data stream; and configuring a second system to process the second data stream.
1 . A method for simulating data system scaling, comprising:
receiving a first data stream including a plurality of transactions, wherein each of the plurality of transactions includes at least a timestamp and an event, wherein the first data stream is directed at a first system;
generating a simulated second data stream based on the first data stream; and
configuring a second system to process the second data stream.
2 . The method of claim 1 , further comprising:
measuring the load on components of the second data system based on the processed second data stream.
3 . The method of claim 1 , wherein generating the simulated second data stream further comprising:
altering at least a portion of the timestamps of a first portion of the plurality of transactions such that the second data stream spans a total time shorter than the first data stream; and
duplicating at least a second portion of the plurality of transactions.
4 . The method of claim 1 , further comprising:
generating a second plurality of transactions based on the first plurality of transactions; and
generating the second data stream further based on the second plurality of transactions.
5 . The method of claim 1 , further comprising:
generating a measurement based on a key performance indicator (KPI) of the second data stream.
6 . The method of claim 5 , wherein the KPI is based on a measurement of a load any one of: a processor, a memory, and a storage.
7 . The method of claim 5 , further comprising:
causing the second data system to cease processing of the second data stream when a KPI value does not meet a threshold.
8 . The method of claim 1 , wherein the second system is any one of: the first system, a system different than the first system, and a combination of the first system and the second system.
9 . The method of claim 1 , wherein the second system comprises the first system, utilizing secondary components.
10 . The method of claim 1 , further comprising:
causing the second system to process a real time data stream together with the second data stream, wherein the second data stream is generated in real time to supplement the real time data stream.
11 . A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to perform a process, the process comprising:
receiving a first data stream including a plurality of transactions, wherein each of the plurality of transactions includes at least a timestamp and an event, wherein the first data stream is directed at a first system;
generating a simulated second data stream based on the first data stream; and
configuring a second system to process the second data stream.
12 . A system for simulating data system scaling, comprising:
a processing circuitry; and
a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to:
receive a first data stream including a plurality of transactions, wherein each of the plurality of transactions includes at least a timestamp and an event, wherein the first data stream is directed at a first system;
generate a simulated second data stream based on the first data stream; and
configure a second system to process the second data stream.
13 . The system of claim 12 , wherein the system is further configured to:
measure the load on components of the second data system based on the processes second data stream.
14 . The system of claim 12 , wherein the system is further configured to:
alter at least a portion of the timestamps of a first portion of the plurality of transactions such that the second data stream spans a total time shorter than the first data stream; and
duplicate at least a second portion of the plurality of transactions.
15 . The system of claim 12 , wherein the system is further configured to:
generate a second plurality of transactions based on the first plurality of transactions; and
generate the second data stream further based on the second plurality of transactions.
16 . The system of claim 12 , wherein the system is further configured to:
generate a measurement based on a key performance indicator (KPI) of the second data stream.
17 . The system of claim 16 , wherein the KPI is based on a measurement of a load any one of: a processor, a memory, and a storage.
18 . The system of claim 16 , wherein the system is further configured to:
cause the second data system to cease processing of the second data stream when a KPI value does not meet a threshold.
19 . The system of claim 12 , wherein the second system is any one of: the first system, a system different than the first system, and a combination of the first system and the second system.
20 . The system of claim 12 , wherein the second system comprises the first system, utilizing secondary components.
21 . The system of claim 12 , wherein the system is further configured to:
cause the second system to process a real time data stream together with the second data stream, wherein the second data stream is generated in real time to supplement the real time data stream.