Method and system for testing and monitoring a real-time streaming media recognition service provider
A computer system obtains a streaming media signal source, selects a testing sample from the streaming media signal source, records characteristics of the testing sample, and obtains an expected output according to the characteristics of the testing sample. Next, the computer system converts the testing sample into a digital streaming format preset by a service provider and initiates a media recognition request according to the testing sample in the digital streaming format to the service provider. After receiving a media recognition result of the testing sample returned by the service provider according to the media recognition request, the computer system compares the media recognition result with the expected output and indicates whether the service provider is normal in accordance with the comparison result.
1. A method of testing and monitoring a real-time streaming media recognition service provider, the method comprising:
at a computer system having one or more processors and memory for storing programs to be executed by the one or more processors:
obtaining a streaming media signal source;
selecting a testing sample from the streaming media signal source;
recording characteristics of the testing sample;
obtaining an expected output according to the characteristics of the testing sample;
converting the testing sample into a digital streaming format preset by the real-time streaming media service provider;
initiating a media recognition request according to the testing sample in the digital streaming format to the real-time streaming media recognition service provider;
receiving a media recognition result of the testing sample returned by the real-time streaming media recognition service provider according to the media recognition request;
comparing the media recognition result with the expected output;
indicating whether the real-time streaming media recognition service provider is normal in accordance with the comparison result.
2. The method of claim 1 , wherein the testing sample is selected from the streaming media signal source at a preset time interval.
3. The method of claim 1 , wherein the digital streaming format is supported by a predefined set of client-side electronic devices.
4. The method of claim 3 , wherein the media recognition request is a simulation of a request from one of the predefined set of client-side electronic devices supporting the digital streaming format.
5. The method of claim 3 , wherein the real-time streaming media recognition service provider is normal when the media recognition result is the same as the expected output and the real-time streaming media recognition service provider is abnormal when the media recognition result is different from the expected output.
6. The method of claim 1 , wherein the testing sample is one selected from the group consisting of television audio, an image screenshot, and radio audio, and the recorded characteristics of the testing sample include a predefined set of attributes of the testing sample including time when the testing sample is extracted, length and size of the testing sample.
7. A computer system, comprising:
one or more processors;
memory; and
one or more program modules stored in the memory, wherein the one or more program modules include instructions to be executed by the one or more processors, the instructions further including:
obtaining a streaming media signal source;
selecting a testing sample from the streaming media signal source;
recording characteristics of the testing sample;
obtaining an expected output according to the characteristics of the testing sample;
converting the testing sample into a digital streaming format preset by the real-time streaming media service provider;
initiating a media recognition request according to the testing sample in the digital streaming format to the real-time streaming media recognition service provider;
receiving a media recognition result of the testing sample returned by the real-time streaming media recognition service provider according to the media recognition request;
comparing the media recognition result with the expected output;
indicating whether the real-time streaming media recognition service provider is normal in accordance with the comparison result.
8. The computer system of claim 7 , wherein the testing sample is selected from the streaming media signal source at a preset time interval.
9. The computer system of claim 7 , wherein the digital streaming format is supported by a predefined set of client-side electronic devices.
10. The computer system of claim 9 , wherein the media recognition request is a simulation of a request from one of the predefined set of client-side electronic devices supporting the digital streaming format.
11. The computer system of claim 7 , wherein the real-time streaming media recognition service provider is normal when the media recognition result is the same as the expected output and the real-time streaming media recognition service provider is abnormal when the media recognition result is different from the expected output.
12. The computer system of claim 7 , wherein the testing sample is one selected from the group consisting of television audio, an image screenshot, and radio audio, and the recorded characteristics of the testing sample include a predefined set of attributes of the testing sample including time when the testing sample is extracted, length and size of the testing sample.
13. A non-transitory computer readable storage medium storing one or more program modules, the one or more program modules comprising instructions, which, when executed by one or more processors of a computer system, cause the processors to perform operations including:
obtaining a streaming media signal source;
selecting a testing sample from the streaming media signal source;
recording characteristics of the testing sample;
obtaining an expected output according to the characteristics of the testing sample;
converting the testing sample into a digital streaming format preset by the real-time streaming media service provider;
initiating a media recognition request according to the testing sample in the digital streaming format to the real-time streaming media recognition service provider;
receiving a media recognition result of the testing sample returned by the real-time streaming media recognition service provider according to the media recognition request;
comparing the media recognition result with the expected output;
indicating whether the real-time streaming media recognition service provider is normal in accordance with the comparison result.
14. The non-transitory computer readable storage medium of claim 13 , wherein the testing sample is selected from the streaming media signal source at a preset time interval.
15. The non-transitory computer readable storage medium of claim 13 , wherein the digital streaming format is supported by a predefined set of client-side electronic devices.
16. The non-transitory computer readable storage medium of claim 15 , wherein the media recognition request is a simulation of a request from one of the predefined set of client-side electronic devices supporting the digital streaming format.
17. The non-transitory computer readable storage medium of claim 13 , wherein the real-time streaming media recognition service provider is normal when the media recognition result is the same as the expected output and the real-time streaming media recognition service provider is abnormal when the media recognition result is different from the expected output.