Automatically determining an optimal supplemental content spot in a media stream

1. A computer implemented method for transmitting supplemental content in an optimal supplemental content spot in a media stream to a media device, comprising:

performing automated content recognition (ACR) on the media stream, thereby determining scene changes in the media stream;

identifying a plurality of potential supplemental content spots in the media stream based on the scene changes;

selecting a subset of media devices from a plurality of media devices based on one or more characteristics of the plurality of media devices;

in response to the selecting, performing a multivariate test involving a test supplemental content item positioned in different ones of the plurality of potential supplemental content spots to the subset of media devices, wherein the performing the multivariate test comprises:

receiving an indication from each media device of the subset of media devices that specifies whether the respective media device outputted an entirety of the test supplemental content item positioned in one of the plurality of potential content spots; and

determining an optimal supplemental content spot among the plurality of potential supplemental content spots in the media stream based on each indication received from the plurality of media devices; and

in response to performing the multivariate test, transmitting the media stream with supplemental content in the optimal supplemental content spot to the media device.

2. The computer implemented method of claim 1 , wherein the test supplemental content item is an advertisement.

3. The computer implemented method of claim 1 , wherein the multivariate test is an AB test.

4. The computer implemented method of claim 1 , wherein the selecting further comprises:

selecting the subset of media devices based on a geographic region or a time of day characteristic.

5. The computer implemented method of claim 1 , wherein the selecting further comprises:

selecting the subset of media devices based on historical playback information.

6. The computer implemented method of claim 1 , wherein the performing the multivariate test further comprises:

determining a portion of the subset of media devices that outputted an entirety of the test supplemental content item.

7. The computer implemented method of claim 6 , wherein the performing the multivariate test further comprises:

determining the optimal supplemental content spot among the plurality of potential supplemental content spots in the media stream based on the portion of the subset of media devices that outputted the entirety of the test supplemental content item.

8. A system, comprising:

at least one processor configured to:

perform automated content recognition (ACR) on a media stream, thereby determining scene changes in the media stream;

identify a plurality of potential supplemental content spots in the media stream based on the scene changes;

select a subset of media devices from a plurality of media devices based on one or more characteristics of the plurality of media devices;

in response to the selecting, perform a multivariate test involving a test supplemental content item positioned in different ones of the plurality of potential supplemental content spots to the subset of media devices, wherein to perform the multivariate test the at least one processor is further configured to:

receive an indication from each media device of the subset of media devices that specifies whether the respective media device outputted an entirety of the test supplemental content item positioned in one of the plurality of potential content spots; and

determine an optimal supplemental content spot among the plurality of potential supplemental content spots in the media stream based on each indication received from the plurality of media devices; and

in response to performing the multivariate test, transmit the media stream with supplemental content in the optimal supplemental content spot to a media device.

9. The system of claim 8 , wherein the test supplemental content item is an advertisement.

10. The system of claim 8 , wherein the multivariate test is an AB test.

11. The system of claim 8 , wherein to select the subset of media devices, the at least one processor is further configured to:

select the subset of media devices based on a geographic region or a time of day characteristic.

12. The system of claim 8 , wherein to select the subset of media devices, the at least one processor is further configured to:

select the subset of media devices based on historical playback information.

13. The system of claim 8 , wherein to perform the multivariate test, the at least one processor is further configured to:

determine a portion of the subset of media devices that outputted an entirety of the test supplemental content item.

14. The system of claim 13 , wherein to perform the multivariate test, the at least one processor is further configured to:

determine the optimal supplemental content spot among the plurality of potential supplemental content spots in the media stream based on the portion of the subset of media devices that outputted the entirety of the test supplemental content item.

15. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

performing automated content recognition (ACR) on a media stream, thereby determining scene changes in the media stream;

identifying a plurality of potential supplemental content spots in the media stream based on the scene changes;

selecting a subset of media devices from a plurality of media devices based on one or more characteristics of the plurality of media devices;

in response to the selecting, performing a multivariate test involving a test supplemental content item positioned in different ones of the plurality of potential supplemental content spots to the subset of media devices, wherein the performing the multivariate test comprises:

receiving an indication from each media device of the subset of media devices that specifies whether the respective media device outputted an entirety of the test supplemental content item positioned in one of the plurality of potential content spots; and

determining an optimal supplemental content spot among the plurality of potential supplemental content spots in the media stream based on each indication received from the plurality of media devices; and

in response to performing the multivariate test, transmitting the media stream with supplemental content in the optimal supplemental content spot to a media device.

16. The non-transitory computer-readable medium of claim 15 , wherein the test supplemental content item is an advertisement.

17. The non-transitory computer-readable medium of claim 15 , wherein the selecting further comprises:

selecting the subset of media devices based on a geographic region or a time of day characteristic.

18. The non-transitory computer-readable medium of claim 15 , wherein the selecting further comprises:

selecting the subset of media devices based on historical playback information.

19. The non-transitory computer-readable medium of claim 15 , wherein the performing the multivariate test further comprises:

determining a portion of the subset of media devices that outputted an entirety of the test supplemental content item.

20. The non-transitory computer-readable medium of claim 19 , wherein the performing the multivariate test further comprises:

determining the optimal supplemental content spot among the plurality of potential supplemental content spots in the media stream based on the portion of the subset of media devices that outputted the entirety of the test supplemental content item.