IP Library Granted Patent US 12710909
Granted Patent B2
US 12710909 · App. 19/102,099 · Granted Aug 18, 2026

Transferring a visual representation of speech between devices

Inventors: Ruofei Du (San Francisco, CA); Volodymyr Kyryliuk (San Francisco, CA); Jason Mayes (San Francisco, CA); Na Li (Palo Alto, CA); Ping Yu (Mountain View, CA); Alex Olwal (Santa Cruz, CA)
Assignee: Google LLC
G06F3/1423
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12710909
App. No.
19/102,099
Granted
Aug 18, 2026
Kind
B2
Abstract

Methods and devices are provided to allow for the transfer of a display of a visual representation between a head mounted device and a computing device during the display of a video. A video is displayed on a computing device display of a computing device, a visual representation of a speech for an audio component of the video is received, the visual representation is displayed on the computing device display, and the display of the visual representation is transferred to the head mounted device to display on a head mounted device display upon determining that a head mounted device is in use.

Claims (45)

1 . A computer-implemented method, comprising:

displaying a video, and a visual representation of a speech component of the video, on a first display of a first device;

and

upon determining that a wearable device is in use, transferring display of the visual representation to the wearable device to display on a wearable display of the wearable device and ceasing the display of the visual representation on the first display while continuing the display of the video on the first display.

2 . The computer-implemented method of claim 1 , wherein determining that the wearable device is in use further comprises:

receiving an indication that a user is logged on to both the wearable device and the first device; and/or

receiving an indication that the user is looking at the first display through the wearable display; and/or

receiving an indication that a location and orientation of the wearable device indicate that the user is viewing the first display through the wearable display; and/or

determining that the user is viewing the first display via a camera in communication with the first device.

3 . The computer-implemented method of claim 1 , further comprising:

upon receiving an indication to transfer display of the visual representation back to the first device, displaying the visual representation on the first display.

4 . The computer-implemented method of claim 3 , wherein the indication is sent upon determining that a battery charge of the wearable device is below a threshold, or that a user is no longer using the wearable display.

5 . The computer-implemented method of claim 3 , wherein the video comprises a video conference, and the indication is sent upon determining that at least one user of a plurality of users watching the video on the first display is not displaying the visual representation with a respective wearable display of a respective wearable device.

6 . The computer-implemented method of claim 1 , wherein the computer-implemented method executes on a web browser extension, add-on, or plug-in.

7 . The computer-implemented method of claim 1 , wherein the visual representation comprises at least one of a transcription, a translation, a summarization of the speech component, an emoji, or a graphic of the speech component.

8 . A display device, comprising:

a first display; and

a processor configured with instructions to:

display a video, and a visual representation of a speech component of the video, on the first display;

and

upon determining that a wearable device is in use, transfer display of the visual representation to the wearable device to display on a wearable display of the wearable device and ceasing the display of the visual representation on the first display while continuing the display of the video on the first display.

9 . The display device of claim 8 , wherein determining that the wearable device is in use further comprises:

receiving an indication that a user is logged on to both the wearable device and the display device, and/or

receiving an indication that the user is looking at the first display through the wearable display, and/or

receiving an indication that a location and orientation of the wearable device indicate that the user is viewing the first display through the wearable display, and/or

determining that the user is viewing the first display via a camera in communication with the display device.

10 . The display device of claim 8 , wherein the processor is further configured with instructions to: display the visual representation on the first display upon receiving an indication to transfer display of the visual representation back to the display device.

11 . The display device of claim 10 , wherein the indication is sent upon determining that a battery charge of the wearable device is below a threshold, or that a user is no longer using the wearable display.

12 . The display device of claim 10 , wherein the video comprises a video conference, and the indication is sent upon determining that at least one user of a plurality of users watching the video on the first display is not displaying the visual representation with a respective wearable display of a respective wearable device.

13 . The display device of claim 8 , wherein the instructions execute on a web browser extension, add-on, or plug-in.

14 . The display device of claim 8 , wherein the visual representation comprises at least one of a transcription, a translation, a summarization of the speech component, an emoji, or a graphic of the speech component.

15 . A computer-implemented method, comprising:

determining that a video and a visual representation of a speech component of the video are being displayed on a first display of a first device;

receiving the visual representation of the speech component of the video from the first device; and

displaying the visual representation on a wearable display of a wearable device while the display of the visual representation on the first display is ceased and the display of the video on the first display continues.

16 . The computer-implemented method of claim 15 , further comprising:

upon receiving an indication to transfer display of the visual representation to the first device, ceasing to display the visual representation on the wearable display.

17 . The computer-implemented method of claim 15 , further comprising:

upon determining that a user is not viewing the first display, displaying both the video and the visual representation on the wearable display.

18 . The computer-implemented method of claim 15 , wherein determining that the video is being displayed on the first display of the first device further comprises:

receiving an indication that the first display is displaying the video; and/or

determining that the video displayed on the first display is in a field of view of a camera connected to the wearable display.

19 . The computer-implemented method of claim 15 , further comprising:

upon determining that a battery charge of the wearable device is below a threshold, transferring display of the visual representation to the first device for display on the first display.

20 . The computer-implemented method of claim 15 , wherein the visual representation is at least one of a transcription, a translation, a summarization of the speech component, an emoji, or a graphic of the speech component.