IP Library Granted Patent US 12,610,096
Granted Patent B1
US 12,610,096 · App. 19/010,531 · Granted Apr 21, 2026

Methods and systems for detecting and correcting video encoder and streaming faults

Inventors: Alexander Hernandez (Coral Springs, FL); Jacob Harrison Robins (Chicago, IL)
Assignee: CBS Interactive Inc.
H04N21/2407H04N21/25
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,610,096
App. No.
19/010,531
Granted
Apr 21, 2026
Kind
B1
Abstract

Methods and systems are disclosed configured to detect and correct content streaming-related faults. Streaming video content comprising a color component is monitored. A central tendency of the color component is determined using color component intensity values from a plurality of frames of the streaming video content. A determination is made as to whether the central tendency value satisfies a corresponding threshold value. If the central tendency value fails to satisfy the corresponding threshold value, a corrective action is initiated comprising restarting a video encoder used to encode the streaming video content, switching to an alternate video encoder, and/or transmitting an electronic message to one or more destinations. Optionally, interruptions of closed captions for streaming video content may be detected using a determination of word quantities over a time. Such interruptions of closed captions may be corrected by accessing an alternate server and/or by transmitting an electronic message.

Claims (72)

1 . A system configured to detect and correct streaming-related faults, the system comprising:

a computer device; and

non-transitory computer readable memory having program instructions stored thereon that when executed by the computer device cause the system to perform operations comprising:

monitor streaming video content comprising three color components associated with a first colorspace;

determine at least three central tendency values corresponding to the three color components using color component intensity values from a plurality of frames of the streaming video content;

determine if the three central tendency values satisfy corresponding threshold values in a first set of threshold values; and

at least partly in response to determining that at least one of the three central tendency values fails to satisfy a corresponding threshold value in the first set of threshold values:

initiate a corrective action comprising restart of a video encoder used to encode the streaming video content, switch to an alternate video encoder, and/or transmission of an electronic communication to one or more destinations.

2 . The system as defined in claim 1 , wherein the operations further comprise:

extract closed captioning data for a first item of streaming video content over a first time window;

determine a closed caption word count from the closed captioning data;

determine if the word count satisfies a first word quantity threshold; and

at least partly in response to determining that the word count fails to satisfy the closed caption server and/or transmission of an electronic communication indicating a closed caption fault to one or more destinations.

3 . The system as defined in claim 1 , wherein the operations further comprise:

extract closed captioning data for a first item of streaming video content over a first time window;

detect a start of a first pod of a first type;

at least partly in response to detecting a start of the first pod of the first type, pause an elapse of the first time window;

detect an end of the first pod of the first type;

at least partly in response to detecting the end of the first pod of the first type, un-pause the elapse of the first time window;

determine a closed caption word count from the closed captioning data over the first time window;

determine if the word count satisfies a first word quantity threshold; and

at least partly in response to determining that the word count fails to satisfy the first word quantity threshold, initiate a corrective action.

4 . The system as defined in claim 1 , wherein the system is configured to select the first set of threshold values based at least in part on a linear channel associated with the streaming video content.

5 . The system as defined in claim 1 , wherein the system is configured to select the first set of threshold values based at least in part on a genre associated with the streaming video content.

6 . The system as defined in claim 1 , wherein the first set of threshold values is configured to detect when one or more of the color components exceed a corresponding central tendency value by more than a first amount or first percentage.

7 . The system as defined in claim 1 , wherein the first set of threshold values is configured to detect when one or more of the color components are undergoing an outage.

8 . A computer-implemented method, the method comprising:

monitoring streaming video content comprising a least a first color component associated with a first colorspace;

determining a first central tendency value corresponding to the first color component using color component intensity values of the first color component from a plurality of frames of the streaming video content;

determining if the first central tendency value satisfies a first threshold value in a first set of threshold values; and

at least partly in response to determining that the first central tendency value fails to satisfy the first threshold value, initiating a corrective action comprising restarting of a video encoder used to encode the streaming video content, switching to an alternate video encoder, and/or transmitting an electronic communication to one or more destinations.

9 . The computer-implemented method as defined in claim 8 , the method further comprising:

extracting closed captioning data for a first item of streaming video content over a first time window;

determining a closed caption word count from the closed captioning data;

determining if the word count satisfies a first word quantity threshold; and

at least partly in response to determining that the word count fails to satisfy the first word quantity threshold, initiating a corrective action.

10 . The method as defined in claim 8 , the method further comprising:

extracting closed captioning data for a first item of streaming video content over a first time window;

detecting a start of a first pod of a first type;

at least partly in response to detecting the start of the first pod of the first type, pausing an elapse of the first time window;

detecting an end of the first pod of the first type;

at least partly in response to detecting the end of the first pod of the first type, un-pausing the elapse of the first time window;

determining a closed caption word count from the closed captioning data over the first time window;

determining if the word count satisfies a first word quantity threshold; and

at least partly in response to determining that the word count fails to satisfy the first word quantity threshold, initiating a corrective action.

11 . The computer-implemented method as defined in claim 8 , the method further comprising selecting the first set of threshold values based at least in part on a linear channel associated with the streaming video content.

12 . The computer-implemented method as defined in claim 8 , the method further comprising selecting the first set of threshold values based at least in part on a genre associated with the streaming video content.

13 . The computer-implemented method as defined in claim 8 , wherein the first set of threshold values is configured to detect when the first color component exceeds the first central tendency value by more than a first amount or first percentage.

14 . The computer-implemented method as defined in claim 8 , wherein the first set of threshold values is configured to detect when the first color component is undergoing an outage.

15 . Non-transitory computer readable memory having program instructions stored thereon that when executed by at least one computing device cause the at least one computing device to perform operations comprising:

monitor streaming video content comprising a least a first color component associated with a first colorspace;

determine a first central tendency value corresponding to the first color component using color component intensity values of the first color component from a plurality of frames of the streaming video content;

determine if the first central tendency value satisfies a first threshold value in a first set of threshold values; and

at least partly in response to determining that the first central tendency value fails to satisfy the first threshold value, initiate a corrective action comprising restart of a video encoder used to encode the streaming video content, switch to an alternate video encoder, and/or transmission of an electronic communication to one or more destinations.

16 . The non-transitory computer readable memory as defined in claim 15 , the operations further comprising:

extract closed captioning data for a first item of streaming video content over a first time window;

determine a closed caption word count from the closed captioning data;

determine if the word count satisfies a first word quantity threshold; and

at least partly in response to determining that the word count fails to satisfy the first word quantity threshold, initiate a corrective action.

17 . The non-transitory computer readable memory as defined in claim 15 , the operations further comprising:

extract closed captioning data for a first item of streaming video content over a first time window;

detect a start of a first pod of a first type;

at least partly in response to detecting the start of the first pod of the first type, pause an elapse of the first time window;

detect an end of the first pod of the first type;

at least partly in response to detecting the end of the first pod of the first type, un-pause the elapse of the first time window;

determine a closed caption word count from the closed captioning data over the first time window;

determine if the word count satisfies a first word quantity threshold; and

at least partly in response to determining that the word count fails to satisfy the first word quantity threshold, initiate a corrective action.

18 . The non-transitory computer readable memory as defined in claim 15 , the operations further comprising: select the first set of threshold values based at least in part on a linear channel associated with the streaming video content.

19 . The non-transitory computer readable memory as defined in claim 15 , the operations further comprising: select the first set of threshold values based at least in part on a genre associated with the streaming video content.

20 . The non-transitory computer readable memory as defined in claim 15 , wherein the first set of threshold values is configured to detect when the first color component exceeds the first central tendency value by more than a first amount or first percentage.

21 . The non-transitory computer readable memory as defined in claim 15 , wherein the first set of threshold values is configured to detect when the first color component is undergoing an outage.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2025
From: HERNANDEZ, ALEXANDER; ROBINS, JACOB HARRISON
To: CBS INTERACTIVE INC.
Reel/Frame 070052/0822 →
References Cited (31)
US 5835493A · Magee · 1998 [cited by examiner]
US 6018366A · Asai · 2000 [cited by examiner]
US 6421359B1 · Bennett · 2002 [cited by examiner]
US 9258589B2 · Grouf et al. · 2016 [cited by applicant]
US 11178433B2 · Hou · 2021 [cited by applicant]
US 11533527B2 · Shanson et al. · 2022 [cited by applicant]
US 20070058730A1 · Bowra · 2007 [cited by examiner]
US 20080170621A1 · Dvir · 2008 [cited by examiner]
US 20080282299A1 · Koat · 2008 [cited by examiner]
US 20090190670A1 · Lin · 2009 [cited by examiner]
US 20100226444A1 · Thevathasan · 2010 [cited by examiner]
US 20120260277A1 · Kosciewicz · 2012 [cited by examiner]
US 20140095668A1 · Oyman · 2014 [cited by applicant]
US 20150003517A1 · Misumi · 2015 [cited by examiner]
US 20150163275A1 · Green · 2015 [cited by applicant]
US 20160261884A1 · Li · 2016 [cited by examiner]
US 20160261885A1 · Li · 2016 [cited by examiner]
US 20170041238A1 · Do et al. · 2017 [cited by applicant]
US 20170374581A1 · Dao · 2017 [cited by applicant]
US 20190082238A1 · Sengupta · 2019 [cited by examiner]
BR 112015001111B1 · 2021 [cited by examiner]
CN 101500170A · 2009 [cited by examiner]
CN 102365868A · 2012 [cited by examiner]
CN 108156481A · 2018 [cited by examiner]
CN 104410918B · 2019 [cited by examiner]
EP 4050897A1 · 2022 [cited by examiner]
KR 100684290B1 · 2007 [cited by examiner]
KR 20170100847A · 2017 [cited by examiner]
WO WO2012130069A1 · 2012 [cited by examiner]
WO WO2012136260A1 · 2012 [cited by examiner]
WO WO2013124223A1 · 2013 [cited by examiner]