Method and system for preprocessing optimization of streaming video data
A method of improving a main output of a main processing application processing first video data includes analyzing incoming video data via a first processing pipeline and analyzing incoming video data via a second processing pipeline. The second processing pipeline includes identifying, by a parameter optimization module, first test preprocessing parameters; preprocessing the incoming video data according to the first test preprocessing parameters, wherein the first test preprocessing includes formatting the incoming video data to create first test video data; processing the first test video data by a test processing application to determine a first test output that is indicative of a first test inference dependent upon the first test video data; and comparing the first test output and the main output to a baseline criterion. In response to the first test output satisfying the baseline criterion, the parameter optimization module can alter the first preprocessing parameters to be similar to the first test preprocessing parameters.
1. A method of improving a main output of a main processing application for processing first video data, the method comprising:
analyzing incoming video data via a first processing pipeline, the first processing pipeline comprising:
preprocessing the incoming video data according to first preprocessing parameters, wherein the preprocessing includes formatting the incoming video data to create the first video data; and
processing the first video data by the main processing application to determine the main output that is dependent upon the first video data;
analyzing incoming video data via a second processing pipeline, the second processing pipeline comprising:
identifying first test preprocessing parameters;
preprocessing the incoming video data according to the first test preprocessing parameters, wherein the first test preprocessing includes formatting the incoming video data to create first test video data; and
processing the first test video data by a test processing application to determine a first test output dependent upon the first test video data;
comparing the first test output to a value representative of an accuracy of the main output; and
in response to the first test output being more accurate than the value representative of the accuracy of the main output, altering the first preprocessing parameters.
2. The method of claim 1 , wherein the step of identifying the first test preprocessing parameters is performed by a parameter optimization module.
3. The method of claim 1 , wherein the value representative of the accuracy of the main output is a baseline criterion dependent upon the main output.
4. The method of claim 1 , wherein the first preprocessing parameters are altered to be at least substantially similar to the first test preprocessing parameters in response to the first test output being more accurate than the value representative of the accuracy of the main output.
5. The method of claim 1 , wherein the main output is indicative of a first inference dependent upon the first video data.
6. The method of claim 1 , wherein the first test output is a value representative of an accuracy of the first test output.
7. The method of claim 6 , wherein the first test output is more accurate than the value representative of the accuracy of the main output when the value representative of the accuracy of the first test output is greater than the value representative of the accuracy of the main output.
8. The method of claim 1 , wherein the main processing application at least partially includes an AI model.
9. The method of claim 1 , wherein the value representative of the accuracy of the main output is dependent upon an amount of correctly identified inferences by the main processing application.
10. The method of claim 1 , wherein the value representative of the accuracy of the main output is dependent upon a latency of the processing of the first video data by the main processing application.
11. The method of claim 1 , wherein the step of altering the first preprocessing parameters further includes updating the first preprocessing parameters with the first test preprocessing parameters.
12. The method of claim 1 , further comprising:
in response to the first test output being less accurate that the value representative of the accuracy of the main output, replacing the first test preprocessing parameters with second test preprocessing parameters that are different from the first test preprocessing parameters and repeating the steps of analyzing the incoming video data via the second preprocessing pipeline.
13. The method of claim 1 , wherein the step of preprocessing the incoming video data according to the first preprocessing parameters is performed by a first computer processor.
14. The method of claim 1 , wherein the main processing application and the test processing application are the same processing application such that processing the first video data to determine the main output and processing the test video data to determine the test output are performed by one processing application.
15. A system for improving a main output of a main processing application that is configured to analyze video data, the system comprising:
a first processing pipeline for analyzing incoming video data, the first processing pipeline comprising:
first preprocessing parameters for formatting the incoming video data;
a first gateway that is configured to receive the incoming video data and preprocess the incoming video data according to the first preprocessing parameters,
wherein the preprocessing of the incoming video data by the first gateway creates first video data;
the main processing application configured to access the first video data and process the first video data to determine a main output that is dependent upon the first video data; and
a second processing pipeline for analyzing the incoming video data, the second processing pipeline comprising:
first test preprocessing parameters for formatting the incoming video data;
a parameter optimization module that is configured to receive the incoming video data and preprocess the incoming video data according to the first test preprocessing parameters, wherein the test preprocessing includes formatting the incoming video data to create first test video data;
a test processing application configured to access the first test video data and process the first test video data to determine a test output,
wherein the parameter optimization module is configured to:
compare the test output to a value representative of an accuracy of the main output; and
in response to the test output being more accurate than the value representative of the accuracy of the main output, alter the first preprocessing parameters.
16. The system of claim 15 , wherein the parameter optimization module is further configured to access the main output, the test output, and the first preprocessing parameters before comparing the test output to the value representative of the accuracy of the main output.
17. The system of claim 15 , further comprising:
a first computer processor that at least partially includes at least one of the first gateway, the main processing application, the parameter optimization module, and the test processing application.
18. The system of claim 15 , wherein the value representative of the accuracy of the main output is a baseline criterion dependent upon the main output.
19. The system of claim 15 , wherein the first preprocessing parameters are altered to be at least substantially similar to the first test preprocessing parameters in response to the first test output being more accurate than the value representative of the accuracy of the main output.
20. The system of claim 15 , wherein the parameter optimization module is configured to, in response to the test output being less accurate that the value representative of the accuracy of the main output, replace the first test preprocessing parameters with second test preprocessing parameters that are different from the first test preprocessing parameters and repeating the preprocessing of the incoming video data to create second test video data and the processing of the second test video data by the test processing application.