IP Library Granted Patent US 11,830,472
Granted Patent B2
US 11,830,472 · App. 17/573,551 · Granted Nov 28, 2023

Training a device specific acoustic model

Inventors: Keyvan Mohajer (Los Gatos, CA); Mehul Patel (Saratoga, CA)
Assignee: SOUNDHOUND AI IP, LLC
G10L15/22G06F3/167G10L15/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,830,472
App. No.
17/573,551
Granted
Nov 28, 2023
Kind
B2
Abstract

Developers can configure custom acoustic models by providing audio files with custom recordings. The custom acoustic model is trained by tuning a baseline model using the audio files. Audio files may contain custom noise to apply to clean speech for training. The custom acoustic model is provided as an alternative to a standard acoustic model. Device developers can select an acoustic model by a user interface. Speech recognition is performed on speech audio using one or more acoustic models. The result can be provided to developers through the user interface, and an error rate can be computed and also provided.

Claims (16)

1. A method comprising:

providing a user interface for developers to select between a standard acoustic model and a custom acoustic model;

receiving, from a developer, one or more audio files of custom recordings appropriate for a specific device;

training the custom acoustic model from a baseline acoustic model tuned to the custom recordings;

receiving, from the developer, a selection of the custom acoustic model; and

deploying the custom acoustic model for speech recognition by the specific device.

2. The method of claim 1 wherein the one or more audio files of custom recordings contain custom noise and the baseline acoustic model is based on clean speech.

3. The method of claim 1 further comprising:

performing automatic speech recognition of speech in the one or more audio files using the standard acoustic model to determine a first transcription;

performing automatic speech recognition of speech in the one or more audio files using the custom acoustic model to determine a second transcription; and

providing an output to a visual display showing differences between the first transcription and the second transcription.

4. The method of claim 1 further comprising:

receiving, from the developer, labeled transcription data corresponding to the one or more audio files;

performing automatic speech recognition of speech in the one or more audio files using the custom acoustic model to determine machine transcription data;

comparing the labeled transcription data to the machine transcription data to compute an error rate; and

providing the error rate to a developer.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2022
From: PATEL, MEHUL; MOHAJER, KEYVAN
To: SOUNDHOUND, INC.
Reel/Frame 058625/0016 →
Continuity (3)
Continuation 17237003 · Apr 21, 2021
Continuation 15996393 · Jun 1, 2018
Related Publication 20220130390A1 · Apr 28, 2022