IP Library › Granted Patent US 10,228,899
Granted Patent B2
US 10,228,899 · App. 15/629,160 · Granted Mar 12, 2019

Monitoring environmental noise and data packets to display a transcription of call audio

Inventors: Daniel C. Chisu (Franklin Park, IL); Si Chen (Chicago, IL)
Assignee: Motorola Mobility LLC
G06F3/165G01H11/06H04N21/234336
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,228,899
App. No.
15/629,160
Granted
Mar 12, 2019
Kind
B2
Abstract

Various embodiments provide a communication system that monitors environmental noise at a computing device. The communication system additionally monitors call audio received at the computing device. Based on the environmental noise and the received call audio, the communication system determines that a user of the computing device is unlikely to hear the received call audio when played back by the computing device. In response to determining that the user of the computing device is unlikely to hear the received call audio, the communication system visually displays a transcription of at least a portion of the received call audio.

Claims (46)

1. A computing device comprising:

one or more processors; and

one or more computer readable storage media storing computer-readable instructions which, when executed, perform operations comprising:

monitoring, using a communication system, environmental noise at the computing device;

monitoring, using the communication system, call audio received as a series of data packets at the computing device;

determining, using the communication system, that a level of the environmental noise satisfies an environmental noise level threshold;

visually displaying a transcription of at least a portion of the received call audio in response to determining that the level of the environmental noise satisfies the environmental noise level threshold;

continuing to display the transcription of at least the portion of the received call audio until determining that the level of the environmental noise no longer satisfies the environmental noise level threshold;

determining that a latency between two sequential data packets in the series of data packets satisfies a threshold level of data packet latency;

generating synthesized speech of call audio included in the two sequential data packets in response to determining that the latency between the two sequential data packets satisfies the threshold level of data packet latency; and

continuing to generate synthesized speech of call audio included in data packets received subsequent to the two sequential data packets until determining that a latency between subsequent data packets no longer satisfies the threshold level of data packet latency.

2. The computing device as recited in claim 1 , wherein determining that the level of the environmental noise no longer satisfies the environmental noise level threshold is performed in response to receiving user input at the computing device indicating that a user of the computing device can hear the call audio from the computing device.

3. The computing device as recited in claim 1 , wherein visually displaying the transcription of at least the portion of the received call audio is performed in real-time as the call audio is received at the computing device.

4. The computing device as recited in claim 1 , wherein the environmental noise level threshold is dependent on a decibel level of the call audio received at the computing device.

5. The computing device as recited in claim 1 , wherein visually displaying the transcription and generating the synthesized speech are performed simultaneously.

6. The computing device as recited in claim 1 , wherein monitoring the environmental noise is performed by monitoring background noise using a microphone of the computing device, the background noise being different from speech of a user of the computing device.

7. The computing device as recited in claim 1 , wherein the environmental noise level threshold is specified by a manufacturer of the computing device or a user of the computing device.

8. A method, comprising:

monitoring, using a communication system, environmental noise at a computing device;

monitoring, using the communication system, call audio received as a series of data packets at the computing device;

determining, using the communication system, that a level of the environmental noise satisfies an environmental noise level threshold;

responsive to determining that the level of the environmental noise satisfies the environmental noise level threshold, visually displaying a transcription of at least a portion of the received call audio;

continuing to display the transcription of at least the portion of the received call audio until determining that the level of the environmental noise no longer satisfies the environmental noise level threshold;

determining that a latency between two sequential data packets in the series of data packets satisfies a threshold level of data packet latency;

responsive to determining that the latency between the two sequential data packets satisfies the threshold level of data packet latency, generating synthesized speech of call audio included in the two sequential data packets; and

continuing to generate synthesized speech of call audio included in data packets received subsequent to the two sequential data packets until determining that a latency between subsequent data packets no longer satisfies the threshold level of data packet latency.

9. The method as recited in claim 8 , wherein determining that the level of the environmental noise no longer satisfies the environmental noise level threshold is performed in response to receiving user input at the computing device indicating that a user of the computing device can hear the call audio from the computing device.

10. The method as recited in claim 8 , wherein visually displaying the transcription of at least the portion of the received call audio is performed in real-time as the call audio is received at the computing device.

11. The method as recited in claim 8 , wherein the environmental noise level threshold is dependent on a decibel level of the call audio received at the computing device.

12. The method as recited in claim 8 , wherein visually displaying the transcription and generating the synthesized speech are performed simultaneously.

13. The method as recited in claim 8 , wherein monitoring the environmental noise is performed by monitoring background noise using a microphone of the computing device, the background noise being different from speech of a user of the computing device.

14. The method as recited in claim 8 , wherein the environmental noise level threshold is specified by a manufacturer of the computing device or a user of the computing device.

15. One or more computer readable storage media storing computer-readable instructions which, when executed, perform operations comprising:

monitoring environmental noise at a computing device;

monitoring call audio received as a series of data packets at the computing device;

determining that a level of the environmental noise satisfies an environmental noise level threshold;

responsive to determining that the level of the environmental noise satisfies the environmental noise level threshold, visually displaying a transcription of at least a portion of the received call audio;

continuing to display the transcription of at least the portion of the received call audio until determining that the level of the environmental noise no longer satisfies the environmental noise level threshold;

determining that a latency between two sequential data packets in the series of data packets satisfies a threshold level of data packet latency;

responsive to determining that the latency between the two sequential data packets satisfies the threshold level of data packet latency, generating synthesized speech of call audio included in the two sequential data packets; and

continuing to generate synthesized speech of call audio included in data packets received subsequent to the two sequential data packets until determining that a latency between subsequent data packets no longer satisfies the threshold level of data packet latency.

16. The one or more computer readable media as recited in claim 15 , wherein determining that the level of the environmental noise no longer satisfies the environmental noise level threshold is performed in response to receiving user input at the computing device indicating that a user of the computing device can hear the call audio from the computing device.

17. The one or more computer readable media as recited in claim 15 , wherein visually displaying the transcription of at least the portion of the received call audio is performed in real-time as the call audio is received at the computing device.

18. The one or more computer readable media as recited in claim 15 , wherein the environmental noise level threshold is dependent on a decibel level of the call audio received at the computing device.

19. The one or more computer readable media as recited in claim 15 , wherein visually displaying the transcription and generating the synthesized speech are performed simultaneously.

20. The one or more computer readable media as recited in claim 15 , wherein the environmental noise level threshold is specified by a manufacturer of the computing device or a user of the computing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2017
From: CHISU, DANIEL C.; CHEN, SI
To: MOTOROLA MOBILITY LLC
Reel/Frame 043083/0020 →
Continuity (1)
Related Publication 20180373488A1 · Dec 27, 2018