IP Library Granted Patent US 12,212,612
Granted Patent B2
US 12,212,612 · App. 17/709,786 · Granted Jan 28, 2025

Presentation of part of transcript based on detection of device not presenting corresponding audio

Inventors: Joshua Smith (Milton, FL); Inna Zolin (Morrisville, NC); Carl H. Seaver (Morrisville, NC); Matthew Fardig (Boonville, IN)
Assignee: Lenovo (Singapore) Pte. Ltd.
H04L65/403G10L13/02G10L15/22G10L15/26G10L15/30G10L25/57H04L65/1089H04L65/80H04M3/568H04M2201/39
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,612
App. No.
17/709,786
Granted
Jan 28, 2025
Kind
B2
Abstract

In one aspect, an apparatus may include at least one processor and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to receive a transcription of audio from a first client device. The audio may be detected at the first client device and may be streamed from the first client device as part of a video conference. The instructions may also be executable to determine that a second client device is not presenting a first part of the audio. Based on the determination, the instructions may be executable to send a first part of the transcription to the second client device and/or to present the first part the transcription at the second client device.

Claims (40)

1. An apparatus, comprising:

at least one processor; and

storage accessible to the at least one processor and comprising instructions executable by the at least one processor to:

receive, at a server and from a first client device, a first transcription of audio, the audio detected at the first client device, the audio streamed from the first client device as part of a video conference;

determine, at the server and based on a comparison of a first part of the first transcription to a first part of a second transcription, that a second client device is not presenting a first part of the audio, the first part of the second transcription being generated at the server; and

based on the determination, present the first part of the first transcription at the second client device in real time while the first part of the audio is to be presented at the second client device.

2. The apparatus of claim 1 , wherein the apparatus comprises the server.

3. The apparatus of claim 2 , wherein the apparatus comprises the second client device.

4. The apparatus of claim 1 , wherein the first part of the first transcription and the first part of the second transcription both relate to the first part of the audio, the first part of the second transcription being generated at the server based on the first part of the audio as received in an audio stream from the first client device.

5. The apparatus of claim 1 , wherein the instructions are executable to:

determine, based on user input to the second client device, that the second client device is not presenting the first part of the audio.

6. The apparatus of claim 1 , wherein the instructions are executable to:

determine, based on a vote of plural conferees of the video conference, that the second client device is not presenting the first part of the audio.

7. A method, comprising:

receiving, at a server and from a first client device, a first transcription of audio, the audio detected at the first client device, the audio streamed from the first client device as part of a video conference;

determining, at the server and based on a comparison of a first part of the first transcription to a first part of a second transcription, that a second client device is not presenting a first part of the audio, the first part of the second transcription being generated at the server; and

based on the determination, sending the first part the transcription to the second client device for presentation at the second client device in real time while the first part of the audio is to be presented at the second client device.

8. The method of claim 7 , wherein the first part of the first transcription and the first part of the second transcription both relate to the first part of the audio, the first part of the second transcription being generated based on the first part of the audio as received in an audio stream from the first client device.

9. The method of claim 7 , wherein the method comprises:

determining, based on a vote of plural conferees of the video conference, that the second client device is not presenting the first part of the audio.

10. The method of claim 7 , wherein the method comprises

determining, based on user input to the second client device, that the second client device is not presenting the first part of the audio.

11. At least one computer readable storage medium (CRSM) that is not a transitory signal, the at least one computer readable storage medium comprising instructions executable by at least one processor to:

receive, at a server and from a first client device, a first transcription of audio, the audio detected at the first client device;

determine, at the server and based on a comparison of a first part of the first transcription to a first part of a second transcription, that a second client device is not presenting a first part of the audio, the first part of the second transcription being generated at the server; and

based on the determination, send the first part the first transcription to the second client device for presentation at the second client device in real time while the first part of the audio is to be presented at the second client device.

12. The at least one CRSM of claim 11 , wherein the instructions are executable to:

control the second client device to present the first part of the first transcription at the second client device responsive to and during a pause in a user of the first client device speaking while the audio continues to be presented.

13. The at least one CRSM of claim 11 , wherein the instructions are executable to:

control the second client device to present the first part of the first transcription at the second client device responsive to and during a user-indicated break in a video conference, the audio forming part of the video conference.

14. The at least one CRSM of claim 13 , wherein the user-indicated break is a scheduled break in the video conference.

15. The at least one CRSM of claim 14 , wherein the scheduled break is identified from one or more of: an electronic calendar entry for the video conference, an agenda entry for the video conference.

16. The at least one CRSM of claim 13 , wherein the user-indicated break is announced in user speech as recognized by the at least one processor via natural language processing.

17. The at least one CRSM of claim 11 , wherein the instructions are executable to:

determine, based on a vote of plural conferees of a video conference, that the second client device is not presenting the first part of the audio.

18. The at least one CRSM of claim 11 , wherein the first part of the first transcription and the first part of the second transcription both relate to the first part of the audio, the first part of the second transcription being generated based on the first part of the audio as received in an audio stream from the first client device.

19. The at least one CRSM of claim 11 , wherein the instructions are executable to:

determine, based on user input to the second client device, that the second client device is not presenting the first part of the audio.

20. The at least one CRSM of claim 11 , wherein the instructions are executable to:

determine, based on a vote of one or more conferees of a video conference, that the second client device is not presenting the first part of the audio.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2022
From: LENOVO (UNITED STATES) INC.
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 061880/0110 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2022
From: SMITH, JOSHUA; ZOLIN, INNA; SEAVER, CARL H.; FARDIG, MATTHEW
To: LENOVO (UNITED STATES) INC.
Reel/Frame 059574/0658 →