IP Library Granted Patent US 12,254,866
Granted Patent B2
US 12,254,866 · App. 17/069,462 · Granted Mar 18, 2025

Systems and methods for aligning a reference sequence of symbols with hypothesis requiring reduced processing and memory

Inventors: Jean-Philippe Robichaud (Mercier, CA); Miguel Jette (Squamish, CA); Joshua Ian Dong (Austin, TX); Quinten McNamara (Austin, TX); Nishchal Bhandari (Austin, TX); Michelle Kai Yu Huang (Austin, TX)
Assignee: Rev.com, Inc.
G10L15/06G10L15/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,866
App. No.
17/069,462
Granted
Mar 18, 2025
Kind
B2
Abstract

A method of determining an alignment sequence between a reference sequence of symbols and a hypothesis sequence of symbols includes loading a reference sequence of symbols to a computing system and creating a reference finite state automaton for the reference sequence of symbols. The method further includes loading a hypothesis sequence of symbols to the computing system and creating a hypothesis finite state automaton for the hypothesis sequence of symbols. The method further includes traversing the reference finite state automaton, adding new reference arcs and new reference transforming properties arcs and traversing the hypothesis finite state automaton, adding new hypothesis arcs and new hypothesis transforming properties arcs. The method further includes composing the hypothesis finite state automaton with the reference finite state automaton creating alternative paths to form a composed finite state automaton and tracking a number of the alternative paths created. The method further includes pruning the alternative paths based on likely top paths, backtracking over most likely paths of the composed finite state automaton, and rescoring edit-distances of the composed finite state automaton.

Claims (22)

1. A system for determining an alignment sequence between a reference sequence of symbols and a hypothesis sequence of symbols, the system comprising:

a loading module executing code and configured to:

load a reference sequence of symbols to a computing system;

load a hypothesis sequence of symbols to the computing system;

load a reference sequence of symbols meta-data;

load hypothesis sequence of symbols meta-data;

a finite state automaton module executing code and configured to:

create a reference finite state automaton for the reference sequence of symbols;

create a hypothesis finite state automaton for the hypothesis sequence of symbols;

a traversing module executing code and configured to:

traverse the reference finite state automaton, adding new reference arcs and new reference transforming properties;

create arcs in the reference finite state automaton for the reference sequence of symbols meta-data;

create arcs in the hypothesis finite state automaton for the hypothesis sequence of symbols meta-data, wherein the hypothesis sequence of symbols meta-data is representative of at least one property of the hypothesis sequence of symbols and each arc of the hypothesis finite state automaton represents a word;

traverse the hypothesis finite state automaton, adding new hypothesis arcs and new hypothesis transforming properties;

a composing module, executing code and configured to:

compose the hypothesis finite state automaton with the reference finite state automaton creating alternative paths to form a composed finite state automaton;

track a number of the alternative paths created;

prune the alternative paths based on likely top paths;

a scoring module, executing code and configured to:

backtrack over most likely paths of the composed finite state automaton;

rescore edit-distances of the composed finite state automaton;

determine an alignment sequence of the reference sequence of symbols and the reference sequence of symbols meta-data based the edit-distances of the composed finite state automaton; wherein the reference sequence of symbols meta-data is representative of at least one property of the reference sequence of symbols, the reference sequence of symbols is representative of one of transcribed speech and translated speech, and each arc of the reference finite state automaton represents a word.

Assignments (3)
SECURITY INTEREST Recorded Aug 8, 2024
From: REV.COM, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 068224/0202 →
SECURITY INTEREST Recorded Nov 30, 2021
From: REV.COM, INC.
To: SILICON VALLEY BANK, AS AGENT
Reel/Frame 058246/0707 →
SECURITY INTEREST Recorded Nov 30, 2021
From: REV.COM, INC.
To: SILICON VALLEY BANK
Reel/Frame 058246/0828 →
Continuity (1)
Related Publication 20220115003A1 · Apr 14, 2022
References Cited (29)
US 6963837B1 · Finke · 2005 [cited by examiner]
US 8290774B1 · Mohri · 2012 [cited by examiner]
US 9697827B1 · Lilly et al. · 2017 [cited by applicant]
US 9966066B1 · Corfield · 2018 [cited by examiner]
US 10109274B2 · Nagao · 2018 [cited by examiner]
US 11398236B2 · Secker-Walker · 2022 [cited by examiner]
US 20030009335A1 · Schalkwyk et al. · 2003 [cited by applicant]
US 20080307435A1 · Rehman · 2008 [cited by examiner]
US 20110302489A1 · Zimmerman · 2011 [cited by applicant]
US 20120059656A1 · Garland et al. · 2012 [cited by applicant]
US 20130166285A1 · Chang et al. · 2013 [cited by applicant]
US 20140074467A1 · Ziv et al. · 2014 [cited by applicant]
US 20140136210A1 · Johnston · 2014 [cited by examiner]
US 20140163959A1 · Hebert · 2014 [cited by examiner]
US 20150255069A1 · Adams · 2015 [cited by examiner]
US 20160217792A1 · Gorodetski · 2016 [cited by applicant]
US 20160283185A1 · McLaren et al. · 2016 [cited by applicant]
US 20170053653A1 · Sidi · 2017 [cited by examiner]
US 20170372706A1 · Shepstone et al. · 2017 [cited by applicant]
US 20180211670A1 · Gorodetski · 2018 [cited by examiner]
US 20200388282A1 · Secker-Walker · 2020 [cited by examiner]
US 20210201913A1 · Zelenko · 2021 [cited by examiner]
CN 103700370A · 2014 [cited by applicant]
CN 104485105A · 2015 [cited by applicant]
CN 107210038A · 2017 [cited by applicant]
WO 2018009969A1 · 2018 [cited by applicant]
International Search Report and Written Opinion dated Jan. 12, 2022 issued in related PCT App. No. PCT/US2021/054620 (6 pages). [cited by applicant]
International Search Report and Written Opinion dated Mar. 3, 2020 issued in PCT App. No. PCT/US19/58870 (19 pages). [cited by applicant]
Office Action dated Aug. 10, 2023 issued in Chinese patent application No. 201980070755.X (15 pages). [cited by applicant]