IP Library Granted Patent US 10,991,370
Granted Patent B2
US 10,991,370 · App. 16/385,017 · Granted Apr 27, 2021

Speech to text conversion engine for non-standard speech

Inventors: Anbumunee Ponniah (Bangalore, IN); Satheesh Kumar Thankappan Nair (Bangalore, IN); Nithin Mathew (Bangalore, IN); Ashish Rajoriya (Madhya Pradesh, IN); Ashish Malgawa (Madhya Pradesh, IN); Mansi Garg (Uttar Pradesh, IN)
Assignee: International Business Machines Corporation
G10L15/22G10L15/02G10L15/1815G10L15/1822G10L2015/027
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,991,370
App. No.
16/385,017
Granted
Apr 27, 2021
Kind
B2
Abstract

Using a computing device to convert verbal communications including non-standard speech to text. The computing device receives an audio recording of voice and generates a standard text log. A standard word dictionary is retrieved. Non-standard words not found in the word dictionary are determined. Portions of the audio recording corresponding to the non-standard words are retrieved. Portions of the audio recording corresponding to non-standard words into input into a natural language understanding model. The computing device utilizes the results of the natural language understanding model to determine a best-match non-standard dictionary. One or more portions of the audio recording are used to generate a non-standard text log. The standard text log and non-standard text log are merged.

Claims (57)

1. A method of using a computing device to convert verbal communications including non-standard speech to text, the method comprising:

receiving, by a computing device, an audio recording of voice and converting the audio recording to a computer-usable form usable by the computing device, wherein converting the audio recording to the computer-usable form comprises:

parsing the audio recording into one or more syllables; and

storing by the computing device the one or more syllables into one or more data structures to generate the computer-usable form;

analyzing by the computing device the computer-usable form of the audio recording to generate a standard text log for the audio recording;

retrieving a standard word dictionary;

comparing one or more words from the standard text log to the standard word dictionary to determine one or more non-standard words not found in the word dictionary;

retrieving one or more portions of the audio recording corresponding to the one or more non-standard words;

inputting the one or more portions of the audio recording corresponding to the one or more non-standard words into a natural language understanding model;

utilizing by the computing device results of the natural language understanding model to determine a best-match non-standard dictionary for interpreting the one or more non-standard words;

retrieving the best-match non-standard dictionary;

analyzing by the computing device the one or more portions of the audio recording corresponding to the one or more non-standard words utilizing the best-match non-standard dictionary to generate a non-standard text log; and

merging by the computing device the standard text log and the non-standard text log to generate a complete text log.

2. The method of claim 1 , wherein the non-standard dictionary is selected from the group consisting of a business dictionary, a technical dictionary, a medical dictionary, a sound dictionary, and a foreign language dictionary.

3. The method of claim 1 , wherein the analyzing of the computer-usable form of the audio recording comprises analyzing a wave form of the audio recording.

4. The method of claim 1 , further comprising displaying the complete text log to a user.

5. The method of claim 1 , wherein comparing one or more words from the standard text log to the standard word dictionary comprises utilizing domain-specific rules.

6. The method of claim 1 , wherein the natural language understanding model utilizes, at least in-part, domain-specific rules unique to each non-standard dictionary for interpreting the one or more non-standard words.

7. The method of claim 1 , further comprising utilizing by the computing device the natural language understanding model to analyze the standard text log and further determine one or more non-standard words in the standard text log.

8. A computer program product utilizing a computing device to convert verbal communications including non-standard speech to text, the computer program product comprising:

one or more non-transitory computer-readable storage media and program instructions stored on the one or more non-transitory computer-readable storage media, the program instructions, when executed by the computing device, cause the computing device to perform a method comprising:

receiving, by a computing device, an audio recording of voice and converting the audio recording to a computer-usable form usable by the computing device, wherein converting the audio recording to the computer-usable form comprises:

parsing the audio recording into one or more syllables; and

storing by the computing device the one or more syllables into one or more data structures to generate the computer-usable form;

analyzing by the computing device the computer-usable form of the audio recording to generate a standard text log for the audio recording;

retrieving a standard word dictionary;

comparing one or more words from the standard text log to the standard word dictionary to determine one or more non-standard words not found in the word dictionary;

retrieving one or more portions of the audio recording corresponding to the one or more non-standard words;

inputting the one or more portions of the audio recording corresponding to the one or more non-standard words into a natural language understanding model;

utilizing by the computing device results of the natural language understanding model to determine a best-match non-standard dictionary for interpreting the one or more non-standard words;

retrieving the best-match non-standard dictionary;

analyzing by the computing device the one or more portions of the audio recording corresponding to the one or more non-standard words utilizing the best-match non-standard dictionary to generate a non-standard text log; and

merging by the computing device the standard text log and the non-standard text log to generate a complete text log.

9. The computer program product of claim 8 , wherein the non-standard dictionary is selected from the group consisting of a business dictionary, a technical dictionary, a medical dictionary, a sound dictionary, and a foreign language dictionary.

10. The computer program product of claim 8 , wherein the analyzing of the computer-usable form of the audio recording comprises analyzing a wave form of the audio recording.

11. The computer program product of claim 8 , further comprising displaying the complete text log to a user.

12. The computer program product of claim 8 , wherein comparing the one or more words from the standard text log to the standard word dictionary comprises utilizing domain-specific rules.

13. The computer program product of claim 8 , wherein the natural language understanding model utilizes, at least in-part, domain-specific rules unique to each non-standard dictionary for interpreting the one or more non-standard words.

14. The computer program product of claim 8 , further comprising utilizing by the computing device the natural language understanding model to analyze the standard text log and further determine one or more non-standard words in the standard text log.

15. A computer system utilizing a computing device to convert verbal communications including non-standard speech to text, the computer system comprising:

one or more computer processors;

one or more computer-readable storage media;

program instructions stored on the computer-readable storage media for execution by at least one of the one or more processors, the program instructions comprising:

program instructions to receive, by a computing device, an audio recording of voice and convert the audio recording to a computer-usable form usable by the computing device, wherein converting the audio recording to the computer-usable form comprises program instructions to:

parse the audio recording into one or more syllables; and

store by the computing device the one or more syllables into one or more data structures to generate the computer-usable form;

program instructions to analyze by the computing device the computer-usable form of the audio recording to generate a standard text log for the audio recording;

program instructions to retrieve a standard word dictionary;

program instructions to compare one or more words from the standard text log to the standard word dictionary to determine one or more non-standard words not found in the word dictionary;

program instructions retrieve one or more portions of the audio recording corresponding to the one or more non-standard words;

program instructions to input the one or more portions of the audio recording corresponding to the one or more non-standard words into a natural language understanding model;

program instructions to utilize by the computing device results of the natural language understanding model to determine a best-match non-standard dictionary for interpreting the one or more non-standard words;

program instructions to retrieve the best-match non-standard dictionary;

program instructions to analyze by the computing device the one or more portions of the audio recording corresponding to the one or more non-standard words utilizing the best-match non-standard dictionary to generate a non-standard text log; and

program instructions to merge by the computing device the standard text log and the non-standard text log to generate a complete text log.

16. The computer system of claim 15 , wherein the non-standard dictionary is selected from the group consisting of a business dictionary, a technical dictionary, a medical dictionary, a sound dictionary, and a foreign language dictionary.

17. The computer system of claim 15 , wherein the computer system further displays the complete text log to the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2019
From: PONNIAH, ANBUMUNEE; THANKAPPAN NAIR, SATHEESH KUMAR; MATHEW, NITHIN; RAJORIYA, ASHISH; MALGAWA, ASHISH; GARG, MANSI
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 048891/0316 →
Continuity (1)
Related Publication 20200335099A1 · Oct 22, 2020
Cited By (1)
US 12,456,004