Methods, systems, and media for certifying a playback device

1. A method for certifying capabilities of a playback device using a certification device, the method comprising:

displaying a test image on a display coupled to a playback device;

capturing the test image displayed on the display coupled to the playback device using a camera coupled to a certification device;

processing the test image using the certification device to identify a plurality of capabilities associated with the playback device;

identifying a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:

an interactivity certification test,

a shared secret certification test,

a security protocol certification test, and

a video and audio synchronization test;

directing the playback device to perform a series of operations according to the interactivity certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device;

capturing information produced by the playback device according to the series of operations using the certification device; and

determining, using a hardware processor, whether the playback device has passed the certification tests according to captured information using the certification device.

2. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

receiving a plurality of media streams corresponding to a certification test from a server;

causing a first media stream to be presented by the playback device;

changing a streaming condition experienced by the playback device;

causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution.

3. The method of claim 2 , wherein the first resolution is greater than the second resolution.

4. The method of claim 3 , further comprising:

determining whether a re-buffering event has occurred based at least in part on the video signal; and

determining that the playback device has failed the certification test in response to determining that a re-buffering event has occurred.

5. The method of claim 1 , further comprising performing bandwidth throttling.

6. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

receiving a first test stream of interactivity content from a server on the playback device;

playing back the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application;

receiving interactivity input to the first test stream of interactivity content on the playback device;

capturing a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and

verifying that the screenshot matches expected interactivity capabilities according to the interactivity certification test using the certification device.

7. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the video and audio synchronization test comprises directing the playback device to perform the following operations:

receiving a first test stream of media content corresponding to the particular certification test from a server using the playback device;

playing back the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device;

capturing, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback;

capturing, using a microphone coupled to the certification device, an audio signal from the first test stream during playback;

determining a presentation time of a video frame of the video signal using the certification device;

determining a presentation time of an audio frame of the audio signal using the certification device; and

when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determining that the playback device has failed the video and audio synchronization test using the certification device.

8. The method of claim 1 wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television.

9. The method of claim 1 , further comprising transmitting a result of a certification test to the server.

10. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:

directing the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and

verifying, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device.

11. The method of claim 1 , wherein directing the playback device to perform a series of operations according to the security protocol certification test further comprises directing the playback device to perform the following operations:

transmitting an invalid certificate associated with a server to the playback device; and

verifying that the playback device successfully rejects the invalid certificate using the certification device.

12. A system for certifying capabilities of a playback device, the system comprising:

a playback device;

a certification device; and

at least one hardware processor that is configured to:

display a test image on a display coupled to the playback device;

capture the test image displayed on the display coupled to the playback device using a camera coupled to the certification device;

processing the test image using the certification device to identify a plurality of capabilities associated with the playback device;

identify a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:

an interactivity certification test,

a shared secret certification test,

a security protocol certification test, and

a video and audio synchronization test;

direct the playback device to perform a series of operations according to the interactivity certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device;

capture information produced by the playback device according to the series of operations using the certification device; and

determine whether the playback device has passed the certification tests according to captured information using the certification device.

13. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

receive a plurality of media streams corresponding to a certification test from a server;

cause a first media stream to be presented by the playback device;

change a streaming condition experienced by the playback device;

causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution.

14. The system of claim 13 , wherein the first resolution is greater than the second resolution.

15. The system of claim 14 , wherein the hardware processor is further configured to:

determine whether a re-buffering event has occurred based at least in part on the video signal; and

determine that the playback device has failed the certification test in response to determining that a re-buffering event has occurred.

16. The system of claim 12 , wherein the hardware processor is further configured to perform bandwidth throttling.

17. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

receive a first test stream of interactivity content from a server on the playback device;

playback the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application;

receive interactivity input to the first test stream of interactivity content on the playback device;

capture a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and

verify that the screenshot matches expected interactivity capabilities according to the interactivity certification test using the certification device.

18. The system of claim 12 , wherein screenshot matches expected interactivity capabilities according to the interactivity certification test using the certification device:

receive a first test stream of media content corresponding to the particular certification test from a server using the playback device;

playback the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device;

capture, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback;

capture, using a microphone coupled to the certification device, an audio signal from the first test stream during playback;

determine a presentation time of a video frame of the video signal using the certification device;

determine a presentation time of an audio frame of the audio signal using the certification device; and

when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determine that the playback device has failed the video and audio synchronization test using the certification device.

19. The system of claim 12 , wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television.

20. The system of claim 12 , wherein the hardware processor is further configured to transmit a result of a certification test to the server.

21. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:

direct the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and

verify, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device.

22. The system of claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

transmit an invalid certificate associated with a server to the playback device;

verify that the playback device successfully rejects the invalid certificate using the certification device.

23. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processing circuitry, cause the processing circuitry to perform a method for certifying capabilities of a playback device, the method comprising:

displaying a test image on a display coupled to a playback device;

capturing the test image displayed on the display coupled to the playback device using a camera coupled to a certification device;

processing the test image using the certification device to identify a plurality of capabilities associated with the playback device;

identifying a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:

an interactivity certification test,

a shared secret certification test,

a security protocol certification test, and

a video and audio synchronization test;

directing the playback device to perform a series of operations according to the interactivity certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device;

capturing information produced by the playback device according to the series of operations using the certification device; and

determining whether the playback device has passed the certification tests according to captured information using the certification device.

24. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

receiving a plurality of media streams corresponding to a certification test from a server;

causing a first media stream to be presented by the playback device;

changing a streaming condition experienced by the playback device;

causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution.

25. The non-transitory computer-readable medium of claim 24 , wherein the first resolution is greater than the second resolution.

26. The non-transitory computer-readable medium of claim 25 , wherein the method further comprises:

determining whether a re-buffering event has occurred based at least in part on the video signal; and

determining that the playback device has failed the certification test in response to determining that a re-buffering event has occurred.

27. The non-transitory computer-readable medium of claim 23 , wherein the method further comprises performing bandwidth throttling.

28. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the interactivity certification test further comprises directing the playback device to perform the following operations:

receiving a first test stream of interactivity content from a server on the playback device;

playing back the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application;

receiving interactivity input to the first test stream of interactivity content on the playback device;

capturing a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and

verifying that the screenshot matches expected interactivity capabilities according to the interactivity certification test using the certification device.

29. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the video and audio synchronization test comprises directing the playback device to perform the following operations:

receiving a first test stream of media content corresponding to the particular certification test from a server using the playback device;

playing back the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device;

capturing, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback;

capturing, using a microphone coupled to the certification device, an audio signal from the first test stream during playback;

determining a presentation time of a video frame of the video signal using the certification device;

determining a presentation time of an audio frame of the audio signal using the certification device; and

when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determining that the playback device has failed the video and audio synchronization test using the certification device.

30. The non-transitory computer-readable medium of claim 23 , wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television.

31. The non-transitory computer-readable medium of claim 23 , wherein the method further comprises transmitting a result of a certification test to the server.

32. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:

directing the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and

verifying, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device.

33. The non-transitory computer-readable medium of claim 23 , wherein directing the playback device to perform a series of operations according to the security protocol certification test further comprises directing the playback device to perform the following operations:

transmitting an invalid certificate associated with a server to the playback device; and

verifying that the playback device successfully rejects the invalid certificate.