IP Library › Granted Patent US 10,770,069
Granted Patent B2
US 10,770,069 · App. 16/002,241 · Granted Sep 8, 2020

Speech processing and context-based language prompting

Inventors: Sripathi S. Mithra (Bangalore, IN); Sirisha Akella (Seethammadhara, IN); Venkata Alubelli (Visakhapatnam, IN); Saraswathi S. Perumalla (Visakhapatnam, IN)
Assignee: International Business Machines Corporation
G10L15/22G10L15/1815G10L25/78G10L2015/223G10L2015/227H04L12/1822
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,770,069
App. No.
16/002,241
Granted
Sep 8, 2020
Kind
B2
Abstract

A computer system processes speech. Speech of a user is received from an audio sensor. An interruption in the speech of the user is determined and the speech of the user is analyzed to determine a context of the speech. One or more language data sources are analyzed to generate a suggestion corresponding to the interruption and based on the context of the speech. The suggestion is presented to the user. Embodiments of the present invention further include a method and program product for prompting a user in substantially the same manner described above.

Claims (30)

1. A computer-implemented method of processing speech, the method comprising:

receiving speech of a user from an audio sensor;

determining an interruption in the speech of the user and analyzing the speech of the user to determine a context of the speech at a time of the interruption;

analyzing one or more language data sources to generate a suggestion corresponding to the interruption and based on the determined context of the speech, wherein generating the suggestion comprises determining one or more words to automatically prompt the user to complete the speech after the interruption, and wherein the one or more language data sources include one or more from a group of: a document written by the user, a speech history of the user, a social media history of the user, prior suggestions to the user, and brain data of the user; and

presenting the suggestion to the user.

2. The computer-implemented method of claim 1 , wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

3. The computer-implemented method of claim 1 , wherein the brain data comprises data collected from the user with an electroencephalography device.

4. The computer-implemented method of claim 1 , wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

5. The computer-implemented method of claim 1 , wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

6. A computer system for processing speech, the computer system comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising instructions to:

receive speech of a user from an audio sensor;

determine an interruption in the speech of the user and analyze the speech of the user to determine a context of the speech at a time of the interruption;

analyze one or more language data sources to generate a suggestion corresponding to the interruption and based on the determined context of the speech, wherein generating the suggestion comprises determining one or more words to automatically prompt the user to complete the speech after the interruption, and wherein the one or more language data sources include one or more from a group of: a document written by the user, a speech history of the user, a social media history of the user, prior suggestions to the user, and brain data of the user; and

present the suggestion to the user.

7. The computer system of claim 6 , wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

8. The computer system of claim 6 , wherein the brain data comprises data collected from the user with an electroencephalography device.

9. The computer system of claim 6 , wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

10. The computer system of claim 6 , wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

11. A computer program product for processing speech, the computer program product comprising one or more computer readable storage media collectively having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:

receive speech of a user from an audio sensor;

determine an interruption in the speech of the user and analyze the speech of the user to determine a context of the speech at a time of the interruption;

analyze one or more language data sources to generate a suggestion corresponding to the interruption and based on the context of the speech, wherein generating the suggestion comprises determining one or more words to automatically prompt the user to complete the speech after the interruption, and wherein the one or more language data sources include one or more from a group of: a document written by the user, a speech history of the user, a social media history of the user, prior suggestions to the user, and brain data of the user; and

present the suggestion to the user.

12. The computer program product of claim 11 , wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

13. The computer program product of claim 11 , wherein the brain data comprises data collected from the user with an electroencephalography device.

14. The computer program product of claim 11 , wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

15. The computer program product of claim 11 , wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2018
From: MITHRA, SRIPATHI S.; AKELLA, SIRISHA; ALUBELLI, VENKATA; PERUMALLA, SAILAJA S.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 046015/0659 →
Continuity (1)
Related Publication 20190378501A1 · Dec 12, 2019
Cited By (1)
US 12,598,256