Source agnostic audio/visual analysis framework
Systems and methods for determining the quality of video playback are provided. Errors in video playback may be detected at any point of transmission at which video can be extracted regardless of the means of transmission or the type of device through which transmission occurs thus allowing for testing of a plurality of devices or transmission means with the same testing system. Such devices or transmission means may provide direct or indirect input for analysis and identification of frame glitches, pulldown performance, frame jitter, frame judder, frame skip, frame tear, audio synchronization, quality comparison and MOS scoring.
1. A source agnostic audio/video analysis system for testing image playback display comprising:
a video content server;
a client device capable of receiving wireless video transmission;
a first display capture device;
an audio/video analysis server; and
a second display capture device;
wherein the first display capture device is adapted to capture video frames from the video content server displayed on the client device at a rate higher than a frame display rate on the client device;
wherein the second display capture device captures video frames from the video content server displayed on the client device at a higher resolution and a slower frame rate than the first display capture device; and
wherein the captured video frames are analyzed by the audio/video analysis server to locate and identify errors subject to aliasing at the client device frame display rate and map the errors to a time point in a video playback at which they occur.
2. The audio/video analysis system of claim 1 , wherein the frame display rate on the client device is 23.98 progressive frames per second.
3. The audio/video analysis system of claim 1 , wherein the rate higher than the frame display rate on the client device is at least 338 frames per second.
4. The audio/video analysis system of claim 1 , wherein video displayed on the client device is sent through an air medium to a lens of the first display capture device.
5. The audio/video analysis system of claim 1 , wherein the rate higher than the frame display rate is about two times a refresh rate of the client device.
6. The audio/video analysis system of claim 1 , wherein each captured video frame is tagged.
7. The audio/video analysis system of claim 6 , wherein each frame is tagged in real time.
8. The audio/video analysis system of claim 1 , wherein audio of each frame is tagged.
9. The audio/video analysis system of claim 8 , wherein a combination of at least seven tones is used to create the tag for the audio.
10. A method for analyzing audio/video playback comprising:
oversampling an audio/video playback on a display using a first high speed camera to capture errors subject to aliasing at a rate of playback on the display;
wherein frames captured by the first high speed camera are captured at about two times a refresh rate of the audio/video playback of the display;
transferring the captured frames to a frame analyzer;
analyzing frames captured by the first high speed camera with the frame analyzer, wherein the captured frames are compared to reference frames and analyzed according to end user experience metrics; and
generating a report of playback errors using a result generator, wherein the playback errors are mapped to a time point at which they occur based on an analysis of images captured by the first high speed camera.
11. The method of claim 10 , wherein the frames captured by the first high speed camera are captured at a rate of at least 338 frames per second.
12. The method of claim 10 , wherein the audio/video playback is on a tablet.
13. The method of claim 10 , wherein the audio/video playback is Miracast from a smartphone.
14. The method of claim 10 , wherein the time point of the playback errors is identified.
15. The method of claim 10 , wherein a second high speed camera captures the audio/video playback at a higher resolution and slower frame rate than the first high speed camera.
16. A source agnostic audio/video analysis system for testing image playback display comprising:
a video content server;
a client device capable of receiving wireless video transmission;
a first display capture device; and
an audio/video analysis server;
wherein the first display capture device is adapted to capture video frames from the video content server displayed on the client device at a rate higher than a frame display rate on the client device;
wherein the rate higher than the frame display rate is about two times a refresh rate of the client device; and
wherein the captured video frames are analyzed by the audio/video analysis server to locate and identify errors subject to aliasing at the client device frame display rate and map the errors to a time point in a video playback at which they occur.
17. The audio/video analysis system of claim 16 , wherein each frame is tagged.