Methods, systems, and media for certifying a playback device

1. A method for certifying capabilities of a playback device using a certification device, the method comprising:

displaying a test image on a display coupled to a playback device;

capturing the test image displayed on the display coupled to the playback device using a camera coupled to a certification device;

processing the test image using the certification device to identify a plurality of capabilities associated with the playback device;

identifying a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:

an interactivity a playback capabilities certification test,

a shared secret certification test,

a security protocol certification test, and

a video and audio synchronization test;

directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device;

capturing information produced by the playback device according to the series of operations using the certification device; and

determining, using a hardware processor, whether the playback device has passed the certification tests according to captured information using the certification device.

2. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:

receiving a plurality of media streams corresponding to a certification test from a server;

causing a first media stream to be presented by the playback device;

changing a streaming condition experienced by the playback device;

causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution.

3. The method of claim 2 , wherein the first resolution is greater than the second resolution.

4. The method of claim 3 , further comprising:

determining whether a re-buffering event has occurred based at least in part on the video signal; and

determining that the playback device has failed the certification test in response to determining that a re-buffering event has occurred.

5. The method of claim 1 , further comprising performing bandwidth throttling.

6. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:

receiving a first test stream of interactivity content from a server on the playback device;

playing back the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application;

receiving interactivity input to the first test stream of interactivity content on the playback device;

capturing a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and

verifying that the screenshot matches expected interactivity playback capabilities according to the interactivity playback capabilities certification test using the certification device.

7. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the video and audio synchronization test comprises directing the playback device to perform the following operations:

receiving a first test stream of media content corresponding to the particular certification test from a server using the playback device;

playing back the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device;

capturing, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback;

capturing, using a microphone coupled to the certification device, an audio signal from the first test stream during playback;

determining a presentation time of a video frame of the video signal using the certification device;

determining a presentation time of an audio frame of the audio signal using the certification device; and

when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determining that the playback device has failed the video and audio synchronization test using the certification device.

8. The method of claim 1 wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television.

9. The method of claim 1 , further comprising transmitting a result of a certification test to the server.

10. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:

directing the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and

verifying, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device.

11. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the security protocol certification test further comprises directing the playback device to perform the following operations:

transmitting an invalid certificate associated with a server to the playback device; and

verifying that the playback device successfully rejects the invalid certificate using the certification device.

12. A system for certifying capabilities of a playback device, the system comprising:

a playback device;

a certification device; and

at least one hardware processor that is configured to:

display a test image on a display coupled to the playback device;

capture the test image displayed on the display coupled to the playback device using a camera coupled to the certification device;

processing the test image using the certification device to identify a plurality of capabilities associated with the playback device;

identify a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:

an interactivity a playback capabilities certification test,

a shared secret certification test,

a security protocol certification test, and

a video and audio synchronization test;

direct the playback device to perform a series of operations according to the interactivity playback capabilities certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device;

capture information produced by the playback device according to the series of operations using the certification device; and

determine whether the playback device has passed the certification tests according to captured information using the certification device.

13. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:

receive a plurality of media streams corresponding to a certification test from a server;

cause a first media stream to be presented by the playback device;

change a streaming condition experienced by the playback device;

causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution.

14. The system of claim 13 , wherein the first resolution is greater than the second resolution.

15. The system of claim 14 , wherein the hardware processor is further configured to:

determine whether a re-buffering event has occurred based at least in part on the video signal; and

determine that the playback device has failed the certification test in response to determining that a re-buffering event has occurred.

16. The system of claim 12 , wherein the hardware processor is further configured to perform bandwidth throttling,.

17. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:

receive a first test stream of interactivity content from a server on the playback device;

playback the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application;

receive interactivity input to the first test stream of interactivity content on the playback device;

capture a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and

verify that the screenshot matches expected interactivity capabilities according to the interactivity playback capabilities certification test using the certification device.

18. The system of claim 12 , wherein screenshot matches expected interactivity capabilities according to the interactivity certification test using the certification device directing the playback device to perform a series of operations according to the playback capabilities certification test further comprises directing the playback device to perform the following operations:

receive a first test stream of media content corresponding to the particular certification test from a server using the playback device;

playback the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device;

capture, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback;

capture, using a microphone coupled to the certification device, an audio signal from the first test stream during playback;

determine a presentation time of a video frame of the video signal using the certification device;

determine a presentation time of an audio frame of the audio signal using the certification device; and

when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determine that the playback device has failed the video and audio synchronization test using the certification device.

19. The system of claim 12 , wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television.

20. The system of claim 12 , wherein the hardware processor is further configured to transmit a result of a certification test to the server.

21. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:

direct the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and

verify, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device.

22. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity security protocol certification test further comprises directing the playback device to perform the following operations:

transmit an invalid certificate associated with a server to the playback device; and

verify that the playback device successfully rejects the invalid certificate using the certification device.

23. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processing circuitry, cause the processing circuitry to perform a method for certifying capabilities of a playback device, the method comprising:

displaying a test image on a display coupled to a playback device;

capturing the test image displayed on the display coupled to the playback device using a camera coupled to a certification device;

processing the test image using the certification device to identify a plurality of capabilities associated with the playback device;

identifying a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:

an interactivity a playback capabilities certification test,

a shared secret certification test,

a security protocol certification test, and

a video and audio synchronization test;

directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device;

capturing information produced by the playback device according to the series of operations using the certification device; and

determining whether the playback device has passed the certification tests according to captured information using the certification device.

24. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:

receiving a plurality of media streams corresponding to a certification test from a server;

causing a first media stream to be presented by the playback device;

changing a streaming condition experienced by the playback device;

causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution.

25. The non-transitory computer-readable medium of claim 24 , wherein the first resolution is greater than the second resolution.

26. The Eon-transitory computer-readable medium of claim 25 , wherein the method further comprises:

determining whether a re-buffering event has occurred based at least in part on the video signal; and

determining that the playback device has failed the certification test in response to determining that a re-buffering event has occurred.

27. The non-transitory computer-readable medium of claim 23 , wherein the method further comprises performing bandwidth throttling.

28. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:

receiving a first test stream of interactivity content from a server on the playback device;

playing back the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application;

receiving interactivity input to the first test stream of interactivity content on the playback device;

capturing a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and

verifying that the screenshot matches expected interactivity capabilities according to the interactivity playback capabilities certification test using the certification device.

29. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the video and audio synchronization test comprises directing the playback device to perform the following operations:

receiving a first test stream of media content corresponding to the particular certification test from a server using the playback device;

playing back the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device;

capturing, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback;

capturing, using a microphone coupled to the certification device, an audio signal from the first test stream during playback;

determining a presentation time of a video frame of the video signal using the certification device;

determining a presentation time of an audio frame of the audio signal using the certification device; and

when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determining that the playback device has failed the video and audio synchronization test using the certification device.

30. The non-transitory computer-readable medium of claim 23 , wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television.

31. The non-transitory computer-readable medium of claim 23 , wherein the method further comprises transmitting a result of a certification test to the server.

32. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:

directing the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and

verifying, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device.

33. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the security protocol certification test further comprises directing the playback device to perform the following operations:

transmitting an invalid certificate associated with a server to the playback device; and

verifying that the playback device successfully rejects the invalid certificate.