IP Library Granted Patent US 11,102,309
Granted Patent B2
US 11,102,309 · App. 16/860,706 · Granted Aug 24, 2021

Pairing a voice-enabled device with a display device

Inventors: Zaheed Sabur (Baar, CH); Andrea Terwisscha van Scheltinga (Zurich, CH); Mikhail Reutov (Zurich, CH); Lucas Mirelmann (Zurich, CH)
Assignee: GOOGLE LLC
H04L67/16G06F3/167H04W8/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,102,309
App. No.
16/860,706
Granted
Aug 24, 2021
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pairing a speech-enabled device with a display device. A determination may be made to pair a speech-enabled device with a display device of a particular type. A set of display devices that are associated with the speech-enabled device may be identified in response to determining to pair the speech-enabled device with the display device of the particular type. An instruction may be provided to each of the display devices. The instruction may cause the display device to determine (i) whether the display device is of the particular type and (ii) whether the display device and the speech-enabled device both share a local area network and display on the display device an indication regarding pairing with the speech-enabled device.

Claims (71)

1. A method implemented by one or more processors, comprising:

determining to pair a speech-enabled device with a display device;

in response to determining to pair the speech-enabled device with the display device:

identifying an identifier associated with the display device;

determining that the display device shares a local area network connection with the speech-enabled device; and

pairing the speech-enabled device with the display device based on the identified identifier and based on determining that the display device shares the local area network connection with the speech-enabled device; and subsequent to pairing the speech-enabled device and the display device:

receiving spoken input from a user of the speech-enabled device and the display device; and

in response to receiving the spoken input from the user:

causing the speech-enabled device to render audible responsive content that is responsive to the received spoken input, and

causing the display device to render visual responsive content that is also responsive to the received spoken input.

2. The method of claim 1 , wherein determining to pair the speech-enabled device with the display device comprises:

receiving, from the user, a request to pair the speech-enabled device with the display device; and

wherein determining to pair the speech-enabled device with the display device is responsive to receiving the request to pair the speech-enabled device with the display device.

3. The method of claim 2 , wherein the request to pair the speech-enabled device with the display device is a spoken request, and further comprising:

performing speech recognition on the spoken request to generate recognized text.

4. The method of claim 3 , wherein identifying the identifier associated with the display device comprises identifying the identifier based on the recognized text.

5. The method of claim 3 , further comprising:

performing voice identification on the spoken request to identify an account associated with the user that provided the spoken request; and

identifying, based on the identified account, a set of devices associated with the user, the set of devices including the display device.

6. The method of claim 5 , wherein identifying the identifier associated with the display device comprises:

identifying, from a set of identifiers associated with a corresponding device of the set of devices, the identifier based on the recognized text.

7. The method of claim 5 , wherein the speech-enabled device is associated with at least one additional account of a corresponding additional user, wherein the corresponding additional user is in addition to the user, and wherein the at least one additional account is in addition to the user.

8. The method of claim 1 , further comprising:

providing, for presentation to the user via the display device, a prompt for the user to confirm pairing of the speech-enabled device with the display device; and

wherein pairing the speech-enabled device with the display device is in response to receiving, from the user and responsive to the prompt, confirmation of pairing of the speech-enabled device with the display device.

9. The method of claim 1 ,

wherein the received spoken input includes a request for weather information for a particular geographic region,

wherein the audible responsive content that is responsive to the received spoken input includes audible weather information for the particular geographic region, and

wherein the visual responsive content that is response to the received spoken input includes one or both of: visual weather information for the particular geographic region. or a transcription of the received spoken input.

10. A system, comprising:

at least one processor; and

at least one memory storing instructions that, when executed, cause the at least one processor to:

determine to pair a speech-enabled device with a display device;

in response to determining to pair the speech-enabled device with the display device:

identify an identifier associated with the display device;

determine that the display device shares a local area network connection with the speech-enabled device; and

pair the speech-enabled device with the display device based on the identified identifier and based on determining that the display device shares the local area network connection with the speech-enabled device; and

subsequent to pairing the speech-enabled device and the display device:

receive spoken input from a user of the speech-enabled device and the display device; and

in response to receiving the spoken input from the user:

cause the speech-enabled device to render audible responsive content that is responsive to the received spoken input, and

cause the display device to render visual responsive content that is also response responsive to the received spoken input.

11. The system of claim 10 , wherein the instructions to determine to pair the speech-enabled device with the display device cause the at least one processor to:

receive, from the user, a request to pair the speech-enabled device with the display device; and

wherein determining to pair the speech-enabled device with the display device is responsive to receiving the request to pair the speech-enabled device with the display device.

12. The system of claim 11 , wherein the request to pair the speech-enabled device with the display device is a spoken request, and wherein the instructions further cause the at least one processor to:

perform speech recognition on the spoken request to generate recognized text.

13. The system of claim 12 , wherein the instructions to identify the identifier associated with the display device comprise instructions to identify the identifier based on the recognized text.

14. The system of claim 12 , wherein the instructions further cause the at least one processor to:

perform voice identification on the spoken request to identify an account associated with the user that provided the spoken request; and

identify, based on the identified account, a set of devices associated with the user, the set of devices including the display device.

15. The system of claim 14 , wherein the instructions to identify the identifier associated with the display device comprise instructions to:

identify, from a set of identifiers associated with a corresponding device of the set of devices, the identifier based on the recognized text.

16. The system of claim 14 , wherein the speech-enabled device is associated with at least one additional account of a corresponding additional user, wherein the corresponding additional user is in addition to the user, and wherein the at least one additional account is in addition to the user.

17. The system of claim 10 , wherein the instructions to identify the identifier associated with the display device comprise instructions to:

providing, for presentation to the user via the display device, a prompt for the user to confirm pairing of the speech-enabled device with the display device; and

wherein pairing the speech-enabled device with the display device is in response to receiving, from the user and responsive to the prompt, confirmation of pairing of the speech-enabled device with the display device.

18. A method implemented by one or more processors, comprising:

receiving a request to pair a speech-enabled device with a display device, wherein the request is a spoken request;

in response to receiving the request to pair the speech-enabled device with the display device:

performing voice identification on the spoken request to identify an account associated with a user that provided the spoken request;

identifying, based on the identified account, a set of devices associated with the user that provided the spoken request, the set of devices including the display device;

performing speech recognition on the spoken request to generate recognized text;

identifying from a set of identifiers associated with a corresponding device of the set of devices, an identifier associated with the display device based on the recognized text;

determining that the display device shares a local area network connection with the speech-enabled device; and

in response to determining that the display device shares the local area network connection with the speech-enabled device, pairing the speech-enabled device with the display device; and

subsequent to pairing the speech-enabled device and the display device:

receiving spoken input from a user of the speech-enabled device and the display device; and

in response to receiving the spoken input from the user:

causing the speech-enabled device to render audible responsive content that is responsive to the received spoken input, and

causing the display device to render visual responsive content that is also responsive to the received spoken input.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2020
From: SABUR, ZAHEED; VAN SCHELTINGA, ANDREA TERWISSCHA; REUTOV, MIKHAIL; MIRELMANN, LUCAS
To: GOOGLE INC.
Reel/Frame 052789/0371 →
CHANGE OF NAME Recorded May 29, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 052799/0840 →
Continuity (3)
Continuation 15953779 · Apr 16, 2018
Continuation 15699323 · Sep 8, 2017
Related Publication 20200259906A1 · Aug 13, 2020