IP Library Granted Patent US 8,692,936
Granted Patent B2
US 8,692,936 · App. 13/732,019 · Granted Apr 8, 2014

Captioning evaluation system

Inventors: Richard T. Polumbus (Englewood, CO); Troy Greenwood (Centennial, CO)
Assignee: Caption Colorado, LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,692,936
App. No.
13/732,019
Granted
Apr 8, 2014
Kind
B2
Abstract

A captioning evaluation system. The system accepts captioning data and determines a number of errors in the captioning data, as well as the number of words per minute across the entirety of an event corresponding to the captioning data and time intervals of the event. The errors may be used to determine the accuracy of the captioning and the words per minute, both for the entire event and the time intervals, used to determine a cadence and/or rhythm for the captioning. The accuracy and cadence may be used to score the captioning data and captioner.

Claims (63)

1. A system for determining an accuracy of a caption data set, comprising:

at least one computing device; and

a captioning evaluation tool, executing on the at least one computing device, that determines the accuracy of a caption data set by:

receiving the caption data set;

determining a number of errors in the caption data set; and

determining the accuracy of the caption data set using at least the number of errors in the caption data set.

2. The system of claim 1 , wherein the captioning evaluation tool further:

segments the caption data set into a number of intervals;

determines a number of words per minute for each of the intervals; and

determines a cadence for the caption data set using the number of words per minute for each of the intervals.

3. The system of claim 2 , wherein the captioning evaluation tool further:

generates a report displaying at least the accuracy and cadence for the caption data set.

4. The system of claim 2 , wherein the caption data set comprises closed captions for an audiovisual event.

5. The system of claim 2 , wherein the caption data set comprises a transcription of a live event.

6. The system of claim 2 , wherein the captioning evaluation tool segments the caption data set into a number of intervals by:

determining a length of time; and

breaking the caption data set into a series of intervals based on the length of time.

7. The system of claim 6 , wherein the captioning evaluation tool determines the accuracy of the caption data set using the number of errors in the caption data operation of using the number of errors by:

counting a first number of errors within at least a first interval;

counting a second number of errors within at least a second interval;

counting a first number of words within the at least first interval;

counting a second number of words within the at least second interval;

adding the first number of errors and second number of errors to produce a total error;

adding the first number of words and second number of words to produce a total word count; and

dividing the total error by the total word count to yield the accuracy.

8. The system of claim 6 , wherein the captioning evaluation tool determines a cadence for the caption data set using the number of words per minute for each of the intervals by:

calculating a plurality of distributions;

assigning each of a plurality of intervals to one of the plurality of distributions based on a characteristic of each of the plurality of intervals;

determining a number of intervals in each of the plurality of distributions; and

reporting a grouping of the plurality of intervals within a subset of the plurality of distributions.

9. The system of claim 8 , wherein each of the plurality of intervals is assigned to one of the plurality of distributions based on a number of words present in the interval.

10. The system of claim 9 , wherein each of the plurality of intervals corresponds to a range of word counts.

11. A method for electronically determining an accuracy of a caption data set, comprising:

receiving a caption data set utilizing at least one processing unit;

evaluating the caption data set, utilizing the at least one processing unit, to determine at least one of a number of errors in the caption data set or a cadence of the caption data set; and

determining an accuracy of the caption data set, utilizing the at least one processing unit based at least on at least one of the number of errors and the cadence.

12. The method of claim 11 , further comprising evaluating the caption data set to determine a number of spelling errors in the caption data set by at least one of:

evaluating the caption data set utilizing a spell-checker;

comparing the caption data set to a transcript of an event associated with the caption data set; or

receiving user input indicating spelling errors in the caption data set.

13. The method of claim 11 , further comprising evaluating the caption data set to determine a number of grammar errors in the caption data set by at least one of:

comparing the caption data set to a standard set of grammar rules;

comparing the caption data set to a transcript of an event associated with the caption data set; or

receiving user input indicating grammar errors in the caption data set.

14. The method of claim 11 , further comprising evaluating the caption data set to determine a number of omitted words in the caption data set by at least one of:

comparing the caption data set to a standard set of grammar rules;

comparing the caption data set to a transcript of an event associated with the caption data set; or

receiving user input indicating omitted words in the caption data set.

15. The method of claim 11 , further comprising evaluating the caption data set to determine at least one of a number of omitted captioning symbols and a number of incorrect captioning symbols by at least one of:

comparing the caption data set to a rule set for symbol use;

comparing the caption data set to a transcript of an event associated with the caption data set; or

receiving user input indicating at least one of omitted captioning symbols and incorrect captioning symbols in the caption data set.

16. The method of claim 11 , further comprising evaluating the caption data set to determine a number of transposed words in the caption data set by at least one of:

comparing the caption data set to a standard set of grammar rules;

comparing the caption data set to a transcript of an event associated with the caption data set; or

receiving user input indicating transposed words in the caption data set.

17. The method of claim 11 , wherein said operation of determining the accuracy of the caption data set further comprises dividing a total number of errors in the caption data set by at least one of a total number of words in the caption data set and a total number of units of time.

18. The method of claim 11 , further comprising:

assigning a first weight to a first kind of error;

assigning a second weight to a second kind of error; and

computing a total number of errors in the caption data set by adding a product of the first weight times a number of the first kind of error in the caption data set to a product of the second weight times a number of the second kind of error in the caption data set.

19. The method of claim 11 , wherein said operation of determining the accuracy of the caption data set further comprises determining whether the cadence indicates at least one of bursting of captions and caption lag.

20. The method of claim 11 , further comprising transmitting the accuracy of the caption data set to a user as part of a scoring report.

Assignments (5)
SECURITY INTEREST Recorded Sep 14, 2021
From: VITAC CORPORATION
To: SILICON VALLEY BANK
Reel/Frame 057477/0671 →
RELEASE OF SECURITY INTEREST Recorded May 11, 2021
From: ABACUS FINANCE GROUP, LLC
To: VITAC CORPORATION
Reel/Frame 056202/0563 →
SECURITY INTEREST Recorded Feb 10, 2017
From: VITAC CORPORATION
To: ABACUS FINANCE GROUP, LLC
Reel/Frame 041228/0786 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2017
From: CAPTION COLORADO, L.L.C.
To: VITAC CORPORATION
Reel/Frame 041134/0404 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2013
From: POLUMBUS, RICHARD T.; GREENWOOD, TROY A.
To: CAPTION COLORADO L.L.C.
Reel/Frame 031544/0283 →
Continuity (3)
Continuation 12104216 · Apr 16, 2008
Provisional Application 60912165 · Apr 16, 2007
Related Publication 20130242114A1 · Sep 19, 2013