IP Library Patent Application 16581566
Patent Application
App. No. 16/581,566

METHODS AND SYSTEMS FOR TRANSCRIPTION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/581,566
Abstract

Methods and systems for transcribing a media file using a human intelligence task service and/or reinforcement learning are provided. The disclosed systems and methods provide opportunities for a segment of the input media file to be automatically re-analyzed, re-transcribed, and/or modified for re-transcription using a human intelligence task (HIT) service for verification and/or modification of the transcription results. The segment can also be reanalyzed, reconstructed, and re-transcribed using a reinforcement learning enabled transcription model.

Claims (72)

1 . A method for transcription, the method comprising:

receiving, from a first transcription engine, one or more transcribed portions of a media file;

determining a confidence of accuracy value for each of the one or more transcribed portions;

identifying, by a transcription analyzer, a first transcribed portion, from the one or more transcribed portions, with a first confidence value below a first predetermined threshold;

requesting analysis of the first transcribed portion;

receiving, in response to requesting for analysis, an analysis result having a revised-transcription portion of the first transcribed portion, wherein the revised-transcription portion comprises one or more parts of the first transcribed potion that have been revised; and

replacing the first transcribed portion with the revised-transcription portion.

2 . The method of claim 1 further comprises, after identifying the first transcribed portion and before requesting analysis on the first transcribed portion:

sending an audio segment corresponding to the first transcribed portion to a successive plurality of transcription engines;

receiving successive transcribed portions from the successive plurality of transcription engines; and

replacing the first transcribed portion with one of the received successive transcribed portions based on the second confidence value of the one of the received successive transcribed portions, wherein the revised-transcription portion comprises one or more parts having errors that have been corrected as part of the analysis.

3 . The method of claim 1 , further comprising:

training a machine learning model using a training data set that includes an audio segment corresponding to the first transcribed portion;

identifying, by a transcription analyzer, a second transcribed portion having a third confidence value below a second predetermined threshold from the one or more transcribed portions; and

using the trained machine learning model, re-transcribing a second audio segment of the media file that corresponds with the second transcribed portion.

4 . The method of claim 1 , wherein the analysis further comprises:

identifying one or more transcription errors in one or more parts of the first transcribed portion;

correcting the identified one or more transcription errors in the one or more parts; and

labelling the one or more corrected transcription errors in the one or more parts.

5 . The method of claim 1 , wherein requesting analysis on the first transcribed portion further comprises:

constructing a phoneme sequence of an audio segment corresponding to the first transcribed portion based on at least on a reward function;

creating a new audio waveform based at least on the constructed phoneme sequence; and

generating a new transcription using a transcription engine based on the new audio waveform.

6 . The method of claim 6 , further comprising:

generating a string of cumulants comprising of one or more transcription portions preceding and following the low confidence of accuracy portion, wherein the constructed phoneme sequence is based at least one the string of cumulants; and

generating a reward function based at least on one or more characteristics of the transcription engine.

7 . The method of claim 6 , wherein generating the reward function comprises learning characteristics of the transcription engine by computing a Shannon entropy.

8 . The method of claim 6 , wherein generating the reward function comprises solving a Bellman equation using backward induction.

9 . The method of claim 9 , wherein the Bellman equation comprises a Dempster Shafer possibility transition matrix.

10 . A system for transcription, the system comprising:

a memory;

one or more processors coupled to the memory, the one or more processors configured to:

receive, from a first transcription engine, one or more transcribed portions of a media file;

identify, by a transcription analyzer of the conductor, a first transcribed portion, from the one or more transcribed portions, with a confidence value below a predetermined threshold;

request analysis of a first audio segment corresponding to the first transcribed portion;

receive, in response to request for analysis, an analysis result having a revised-transcription portion of the first audio segment, wherein the revised-transcription portion comprises one or more segments of the first transcribed potion that have been revised; and

replace the first transcribed portion with the revised-transcription portion.

11 . The system of claim 11 , wherein the one or more processors, after identifying the first transcribed portion and before requesting analysis on the first transcribed portion, are further configured to:

send the first audio segment to a plurality of transcription engines;

receive successive transcribed portions from the plurality of transcription engines; and

replace the first transcribed portion with one of the received successive transcribed portions based on the second confidence value of the one of the received successive transcribed portions.

12 . The system of claim 18 , wherein the one or more processors are further configured to:

train a machine learning model using a training data set from the low-confidence database;

identify, by a transcription analyzer, a second transcribed portion having a third confidence value below a second predetermined threshold from the one or more transcribed portions; and

using the trained machine learning model, re-transcribe a second audio segment of the media file that corresponds with the second transcribed portion.

13 . The system of claim 11 , further comprising:

a ground truth engine configured to:

identify one or more transcription errors in one or more parts of the first transcribed portion;

correct the identified one or more transcription errors in the one or more parts; and

label the one or more corrected transcription errors in the one or more parts.

14 . The system of claim 10 , wherein request analysis on the first transcribed portion further comprises instructions that cause the one or more processor to:

construct a phoneme sequence of an audio segment corresponding to the first transcribed portion based on at least on a reward function;

create a new audio waveform based at least on the constructed phoneme sequence; and

generate a new transcription using a transcription engine based on the new audio waveform.

15 . The system of claim 10 , wherein the one or more processors are further configured to:

generate a string of cumulants comprising of one or more transcription portions preceding and following the low confidence of accuracy portion, wherein the constructed phoneme sequence is based at least one the string of cumulants; and

generate a reward function based at least on one or more characteristics of the transcription engine.

16 . The system of claim 15 , wherein generate the reward function comprises learning characteristics of the transcription engine by computing a Shannon entropy.

17 . The system of claim 15 , wherein generate the reward function comprises solving a Bellman equation using backward induction.

18 . The system of claim 17 , wherein the Bellman equation comprises a Dempster Shafer possibility transition matrix.

19 . A method for transcription, the method comprising:

receiving one or more transcribed portions of a media file;

determining a confidence of accuracy value for each of the one or more transcribed portions;

identifying a first transcribed portion that has a first confidence value below a predetermined threshold;

constructing a phoneme sequence of an audio segment corresponding to the first transcribed portion based on at least on a reward function;

creating a new audio waveform based at least on the constructed phoneme sequence;

generating a new transcription using a transcription engine based on the new audio waveform; and

replacing the first transcribed portion with the new transcription.

20 . The method of claim 19 wherein generating the new transcription further comprises:

sending the new audio waveform to a plurality of transcription engines;

receiving transcription results from the plurality of transcription engines; and

replacing the first transcribed portion with one of the transcription results based on a second confidence value, wherein each transcription result includes a confidence value.

Assignments (2)
RELEASE OF SECURITY INTEREST Recorded Nov 19, 2025
From: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
To: VERITONE, INC.
Reel/Frame 073634/0333 →
SECURITY INTEREST Recorded Dec 13, 2023
From: VERITONE, INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 066140/0513 →