Frame certainty for automatic content recognition
A method for a frame certainty metric for automatic content recognition. The method includes determining a frame match between media device frames of a media device stream relative to broadcast frames of a broadcast media stream and determining whether to shift the frame match by determining the following: a first frame certainty metric based on a first media device fingerprint and a target broadcast fingerprint; a second frame certainty metric based on a second media device fingerprint sequentially adjacent the first media device fingerprint and the target broadcast fingerprint; a third frame certainty metric based on a third media device fingerprint sequentially adjacent the first media device fingerprint and the target broadcast fingerprint; and a greatest frame certainty metric. The method further includes identifying the media device fingerprint corresponding to the greatest frame certainty metric as a target media device fingerprint matching the target broadcast fingerprint.
1. A method comprising:
identifying a first match between a first frame of a media device stream and a broadcast frame of a broadcast media stream, wherein the media device stream is designated for playback by a media device;
determining a first frame certainty metric that characterizes the first match;
determining a second frame certainty metric that characterizes a second match between a second frame of the media device stream and the broadcast frame, wherein the second frame precedes the first frame in the media device stream;
determining a third frame certainty metric that characterizes a third match between a third frame of the media device stream and the broadcast frame, wherein the third frame follows the first frame in the media device stream;
making a determination of which of the first frame certainty metric, the second frame certainty metric, and the third frame certainty metric indicates a best match; and
performing an operation based on the determination, wherein performing the operation comprises:
selecting, based on the determination, a first set of frames of the media device stream for replacement by a second set of frames;
causing replacement of the first set of frames with the second set of frames within the media device stream; and
causing playback of the second set of frames by the media device.
2. The method of claim 1 , wherein the second set of frames comprises the first set of frames augmented with overlay video content.
3. The method of claim 1 , wherein the second frame immediately precedes the first frame in the media device stream.
4. The method of claim 1 , wherein the third frame immediately follows the first frame in the media device stream.
5. The method of claim 1 , wherein making the determination comprises determining that the first frame certainty metric indicates the best match.
6. The method of claim 1 , wherein making the determination comprises determining that the second frame certainty metric indicates the best match, the method further comprising:
determining a fourth frame certainty metric that characterizes a fourth match between a fourth frame of the media device stream and the broadcast frame, wherein the fourth frame precedes the second frame in the media device stream; and
making a second determination of which of the second frame certainty metric or the fourth frame certainty metric indicates a better match,
wherein performing the operation comprises performing the operation based additionally on the second determination.
7. The method of claim 1 , wherein making the determination comprises determining that the third frame certainty metric indicates the best match, the method further comprising:
determining a fourth frame certainty metric that characterizes a fourth match between a fourth frame of the media device stream and the broadcast frame, wherein the fourth frame follows the third frame in the media device stream; and
making a second determination of which of the third frame certainty metric or the fourth frame certainty metric indicates a better match,
wherein performing the operation comprises performing the operation based additionally on the second determination.
8. The method of claim 1 , further comprising determining that the first frame certainty metric, the second frame certainty metric, or the third frame certainty metric satisfies a frame certainty metric threshold.
9. The method of claim 1 , further comprising associating a frame location corresponding to the broadcast frame with a frame of the media device stream.
10. The method of claim 1 , wherein a frame rate of the media device stream is less than a frame rate of the broadcast media stream.
11. A non-transitory computer readable medium storing instructions that, when executed by a computing device, cause the computing device to perform functions comprising:
identifying a first match between a first frame of a media device stream and a broadcast frame of a broadcast media stream, wherein the media device stream is designated for playback by a media device;
determining a first frame certainty metric that characterizes the first match;
determining a second frame certainty metric that characterizes a second match between a second frame of the media device stream and the broadcast frame, wherein the second frame precedes the first frame in the media device stream;
determining a third frame certainty metric that characterizes a third match between a third frame of the media device stream and the broadcast frame, wherein the third frame follows the first frame in the media device stream;
making a determination of which of the first frame certainty metric, the second frame certainty metric, and the third frame certainty metric indicates a best match; and
performing an operation based on the determination, wherein performing the operation comprises:
selecting, based on the determination, a first set of frames of the media device stream for replacement by a second set of frames;
causing replacement of the first set of frames with the second set of frames within the media device stream; and
causing playback of the second set of frames by the media device.
12. A computing device comprising a processor and a computer readable medium storing instructions that, when executed by the processor, cause the computing device to perform functions comprising:
identifying a first match between a first frame of a media device stream and a broadcast frame of a broadcast media stream, wherein the media device stream is designated for playback by a media device;
determining a first frame certainty metric that characterizes the first match;
determining a second frame certainty metric that characterizes a second match between a second frame of the media device stream and the broadcast frame, wherein the second frame precedes the first frame in the media device stream;
determining a third frame certainty metric that characterizes a third match between a third frame of the media device stream and the broadcast frame, wherein the third frame follows the first frame in the media device stream;
making a determination of which of the first frame certainty metric, the second frame certainty metric, and the third frame certainty metric indicates a best match; and
performing an operation based on the determination, wherein performing the operation comprises:
selecting, based on the determination, a first set of frames of the media device stream for replacement by a second set of frames;
causing replacement of the first set of frames with the second set of frames within the media device stream; and
causing playback of the second set of frames by the media device.
13. The computing device of claim 12 , wherein the second set of frames comprise the first set of frames augmented with overlay video content.
14. The computing device of claim 12 , wherein the second frame immediately precedes the first frame in the media device stream.
15. The computing device of claim 12 , wherein the third frame immediately follows the first frame in the media device stream.
16. The computing device of claim 12 , wherein making the determination comprises determining that the first frame certainty metric indicates the best match.
17. The computing device of claim 12 , wherein making the determination comprises determining that the second frame certainty metric indicates the best match, the functions further comprising:
determining a fourth frame certainty metric that characterizes a fourth match between a fourth frame of the media device stream and the broadcast frame, wherein the fourth frame precedes the second frame in the media device stream; and
making a second determination of which of the second frame certainty metric or the fourth frame certainty metric indicates a better match,
wherein performing the operation comprises performing the operation based additionally on the second determination.
18. The computing device of claim 12 , wherein making the determination comprises determining that the third frame certainty metric indicates the best match, the functions further comprising:
determining a fourth frame certainty metric that characterizes a fourth match between a fourth frame of the media device stream and the broadcast frame, wherein the fourth frame follows the third frame in the media device stream; and
making a second determination of which of the third frame certainty metric or the fourth frame certainty metric indicates a better match,
wherein performing the operation comprises performing the operation based additionally on the second determination.