Method and system for testing closed caption content of video assets
View Patent ↗A method and system for monitoring video assets provided by a multimedia content distribution network includes testing closed captions provided in output video signals. A video and audio portion of a video signal are acquired during a time period that a closed caption occurs. A first text string is extracted from a text portion of a video image, while a second text string is extracted from speech content in the audio portion. A degree of matching between the strings is evaluated based on a threshold to determine when a caption error occurs. Various operations may be performed when the caption error occurs, including logging caption error data and sending notifications of the caption error.
1. A method, comprising:
receiving, by a monitoring platform, a baseband signal corresponding to a multimedia program output from a multimedia handling device configured to receive digital multimedia content from a service provider;
determining, by the monitoring platform, a closed caption interval corresponding to particular closed captioned text;
detecting, by the monitoring platform, particular audio content corresponding to speech communicated during the closed caption interval performing, by the monitoring platform, a speech-to-text algorithm on the particular audio content to obtain audio text;
determining, by the monitoring platform, a degree of matching between the particular closed caption text and the audio text; and
responsive to determining a degree of matching that is less than a threshold, generating a caption error including a timestamp and an indication of the multimedia program.
2. The method of claim 1 , further comprising:
determining, by the monitoring platform, a beginning of the closed caption interval responsive to detecting a change in closed caption text displayed in the multimedia program.
3. The method of claim 1 , wherein the multimedia program includes video content comprising a plurality of video frames and wherein the closed caption interval corresponds to a subset of the video frames, wherein the subset comprises video frames in which the particular closed caption text appears.
4. The method of claim 3 , further comprising:
buffering a particular portion of the video frames, wherein the particular portion begins before the subset and ends after the subset.
5. The method of claim 3 , further comprising:
acquiring, by the monitoring platform, a particular video image corresponding to a particular video frame in the subset.
6. The method of claim 5 , further comprising:
performing image processing operations to extract the particular closed caption text from the particular video image.
7. The method of claim 6 , wherein:
the multimedia handling device comprises a particular multimedia handling device of a plurality of multimedia handling devices coupled to the monitoring platform; and
receiving the baseband signal comprises receiving the baseband signal from a video matrix switch configured to:
receive a baseband signal from each of the plurality of multimedia handling devices including the particular multimedia handling device; and
select one of the multimedia handling devices in accordance with a selection signal provided by the monitoring platform.
8. A monitoring platform computer system, comprising:
receiving, by a monitoring platform, a baseband signal corresponding to a multimedia program output from a multimedia handling device configured to receive digital multimedia content from a service provider;
determining, by the monitoring platform, a closed caption interval corresponding to particular closed captioned text;
detecting, by the monitoring platform, particular audio content corresponding to speech communicated during the closed caption interval;
performing, by the monitoring platform, a speech-to-text algorithm on the particular audio content to obtain audio text; and
determining, by the monitoring platform, a degree of matching between the particular closed caption text and the audio text responsive to determining a degree of matching that is less than a threshold, generating a caption error including a timestamp and an indication of the multimedia program.
9. The computer system of claim 8 , wherein the operations include:
determining, by the monitoring platform, a beginning of the closed caption interval responsive to detecting a change in closed caption text displayed in the multimedia program.
10. The computer system of claim 8 , wherein the multimedia program includes video content comprising a plurality of video frames and wherein the closed caption interval corresponds to a subset of the video frames, wherein the subset comprises video frames in which the particular closed caption text appears.
11. The computer system of claim 10 , wherein the operations include:
buffering a particular portion of the video frames, wherein the particular portion begins before the subset and ends after the subset.
12. The computer system of claim 10 , wherein the operations include:
acquiring, by the monitoring platform, a particular video image corresponding to a particular video frame in the subset.
13. The computer system of claim 12 , wherein the operations include:
performing image processing operations to extract the particular closed caption text from the particular video image.
14. The computer system of claim 13 , wherein:
the multimedia handling device comprises a particular multimedia handling device of a plurality of multimedia handling devices coupled to the monitoring platform; and
receiving the baseband signal comprises receiving the baseband signal from a video matrix switch configured to:
receive a baseband signal from each of the plurality of multimedia handling devices including the particular multimedia handling device; and
select one of the multimedia handling devices in accordance with a selection signal provided by the monitoring platform.
15. A non-transitory computer readable memory including program instructions, executable by a processor, that, when executed by the processor, cause the processor to perform operations, comprising:
receiving, by a monitoring platform, a baseband signal corresponding to a multimedia program output from a multimedia handling device configured to receive digital multimedia content from a service provider;
determining, by the monitoring platform, a closed caption interval corresponding to particular closed captioned text;
detecting, by the monitoring platform, particular audio content corresponding to speech communicated during the closed caption interval;
performing, by the monitoring platform, a speech-to-text algorithm on the particular audio content to obtain audio text; and
determining, by the monitoring platform, a degree of matching between the particular closed caption text and the audio text responsive to determining a degree of matching that is less than a threshold, generating a caption error including a timestamp and an indication of the multimedia program.
16. The non-transitory computer system of claim 15 , wherein the operations include:
determining, by the monitoring platform, a beginning of the closed caption interval responsive to detecting a change in closed caption text displayed in the multimedia program.
17. The computer system of claim 15 , wherein the multimedia program includes video content comprising a plurality of video frames and wherein the closed caption interval corresponds to a subset of the video frames, wherein the subset comprises video frames in which the particular closed caption text appears.
18. The computer system of claim 17 , wherein the operations include:
buffering a particular portion of the video frames, wherein the particular portion begins before the subset and ends after the subset.
19. The computer system of claim 17 , wherein the operations include:
acquiring, by the monitoring platform, a particular video image corresponding to a particular video frame in the subset; and
performing image processing operations to extract the particular closed caption text from the particular video image.
20. The computer system of claim 13 , wherein:
the multimedia handling device comprises a particular multimedia handling device of a plurality of multimedia handling devices coupled to the monitoring platform; and
receiving the baseband signal comprises receiving the baseband signal from a video matrix switch configured to:
receive a baseband signal from each of the plurality of multimedia handling devices including the particular multimedia handling device; and
select one of the multimedia handling devices in accordance with a selection signal provided by the monitoring platform.