Granted Patent B2

US 12,744,041 · App. 18/891,636 · Granted Sep 22, 2026

Inventors: Stacy Cronin (Berkeley, CA); Cliff Kuang (San Francisco, CA); Abraham Wallin (San Francisco, CA); Katrina Egert-Pecot (Sunnyvale, CA); Sean Joseph Klassen (Burlington, VT); Caleb Misclevitz (Portland, OR); Karan Patel (New York, NY); Ian Baker (San Francisco, CA); Simon Sok (Brooklyn, NY); Ryan Allen (Denver, CO)

Assignee: GOOGLE LLC

G10L15/22G06F3/0482G06F3/167G10L15/18G10L2015/223G10L2015/228

Abstract

Claims (75)

1 . A method implemented by one or more processors, the method comprising:

receiving, at a computing device, a request for an automated assistant to render content at a display interface of the computing device,

wherein the request is embodied in a spoken utterance that is provided by a user that is located a first distance from the display interface;

causing, in response to the request, the display interface of the computing device to render selectable content elements in a coupled arrangement that extends across the display interface,

wherein an input gesture receivable by the automated assistant causes multiple selectable content elements of the selectable content elements to simultaneously maneuver across the display interface;

determining, by the automated assistant, that the user has relocated from the first distance to a second distance from the display interface;

causing, based on the user relocating to the second distance from the display interface, the selectable content elements to be rendered in a stacked arrangement,

wherein, at the stacked arrangement, a foreground content element of the selectable content elements is rendered over other content elements of the selectable content elements;

receiving, by the automated assistant, another request for the automated assistant to reveal a particular content element of the other content elements,

wherein the particular content element is different from the foreground content element of the selectable content elements;

causing, in response to the other request, the foreground content element of the selectable content elements to be replaced, at an area of the display interface, by the particular content element of the other content elements.

2 . The method of claim 1 , further comprising:

causing, when the selectable content elements are rendered in the coupled arrangement, one or more assistant suggestions to be rendered at the display interface with the selectable content elements,

wherein the one or more assistant suggestions are based on particular content associated with the selectable content elements.

3 . The method of claim 2 , further comprising:

causing, when the selectable content elements are rendered in the stacked arrangement, one or more other assistant suggestions to be rendered at the display interface with the selectable content elements,

wherein the one or more other assistant suggestions are based on other particular content corresponding to the foreground content elements, and

wherein the one or more assistant suggestions are different than the one or more other assistant suggestions.

4 . The method of claim 3 , wherein the one or more assistant suggestions are omitted from the display interface when the one or more other assistant suggestions are being rendered at the display interface.

5 . The method of claim 2 , wherein the one or more assistant suggestions identify an operation that is initialized by the automated assistant at a separate computing device that is different than the computing device.

6 . The method of claim 2 ,

wherein the one or more assistant suggestions are based on historical interaction data accessible to the automated assistant, and

wherein the historical interaction data characterizes a prior interaction in which the user or another user caused the computing device or another computing device to perform an action while particular content was being rendered at the computing device or the other computing device.

7 . The method of claim 1 , wherein the input gesture, receivable by the automated assistant while the selectable content elements are rendered in the coupled arrangement, causes the multiple selectable content elements of the selectable content elements to simultaneously maneuver across the display interface in a carousel arrangement and reveal additional selectable content elements of the selectable content elements.

8 . A client device comprising:

a display interface;

an audio interface;

memory storing instructions;

one or more processors operable to execute the instructions to:

receive, at a computing device, a request for an automated assistant to render content at a display interface of the computing device,

wherein the request is embodied in a spoken utterance that is provided by a user that is located a first distance from the display interface;

cause, in response to the request, the display interface of the computing device to render selectable content elements in a coupled arrangement that extends across the display interface,

wherein an input gesture receivable by the automated assistant causes multiple selectable content elements of the selectable content elements to simultaneously maneuver across the display interface;

determine, by the automated assistant, that the user has relocated from the first distance to a second distance from the display interface;

cause, based on the user relocating to the second distance from the display interface, the selectable content elements to be rendered in a stacked arrangement,

wherein, at the stacked arrangement, a foreground content element of the selectable content elements is rendered over other content elements of the selectable content elements;

receive, by the automated assistant, another request for the automated assistant to reveal a particular content element of the other content elements,

wherein the particular content element is different from the foreground content element of the selectable content elements;

cause, in response to the other request, the foreground content element of the selectable content elements to be replaced, at an area of the display interface, by the particular content element of the other content elements.

9 . The client device of claim 8 , wherein the instructions further comprise:

cause, when the selectable content elements are rendered in the coupled arrangement, one or more assistant suggestions to be rendered at the display interface with the selectable content elements,

wherein the one or more assistant suggestions are based on particular content associated with the selectable content elements.

10 . The client device of claim 9 , wherein the instructions further comprise:

cause, when the selectable content elements are rendered in the stacked arrangement, one or more other assistant suggestions to be rendered at the display interface with the selectable content elements,

wherein the one or more other assistant suggestions are based on other particular content corresponding to the foreground content elements, and

wherein the one or more assistant suggestions are different than the one or more other assistant suggestions.

11 . The client device of claim 10 , wherein the one or more assistant suggestions are omitted from the display interface when the one or more other assistant suggestions are being rendered at the display interface.

12 . The client device of claim 9 , wherein the one or more assistant suggestions identify an operation that is initialized by the automated assistant at a separate computing device that is different than the computing device.

13 . The client device of claim 9 ,

wherein the one or more assistant suggestions are based on historical interaction data accessible to the automated assistant, and

wherein the historical interaction data characterizes a prior interaction in which the user or another user caused the computing device or another computing device to perform an action while particular content was being rendered at the computing device or the other computing device.

14 . The client device of claim 8 , wherein the input gesture, receivable by the automated assistant while the selectable content elements are rendered in the coupled arrangement, causes the multiple selectable content elements of the selectable content elements to simultaneously maneuver across the display interface in a carousel arrangement and reveal additional selectable content elements of the selectable content elements.

15 . A system comprising:

one or more storage devices storing instructions; and

one or more processors that are operable to execute the instruction to cause the one or more processors to:

receive, at a computing device, a request for an automated assistant to render content at a display interface of the computing device,

wherein the request is embodied in a spoken utterance that is provided by a user that is located a first distance from the display interface;

cause, in response to the request, the display interface of the computing device to render selectable content elements in a coupled arrangement that extends across the display interface,

wherein an input gesture receivable by the automated assistant causes multiple selectable content elements of the selectable content elements to simultaneously maneuver across the display interface;

determine, by the automated assistant, that the user has relocated from the first distance to a second distance from the display interface;

cause, based on the user relocating to the second distance from the display interface, the selectable content elements to be rendered in a stacked arrangement,

wherein, at the stacked arrangement, a foreground content element of the selectable content elements is rendered over other content elements of the selectable content elements;

receive, by the automated assistant, another request for the automated assistant to reveal a particular content element of the other content elements,

wherein the particular content element is different from the foreground content element of the selectable content elements;

cause, in response to the other request, the foreground content element of the selectable content elements to be replaced, at an area of the display interface, by the particular content element of the other content elements.

16 . The system of claim 15 , wherein the one or more processors are further to:

cause, when the selectable content elements are rendered in the coupled arrangement, one or more assistant suggestions to be rendered at the display interface with the selectable content elements,

wherein the one or more assistant suggestions are based on particular content associated with the selectable content elements.

17 . The system of claim 16 , wherein the one or more processors are further to:

cause, when the selectable content elements are rendered in the stacked arrangement, one or more other assistant suggestions to be rendered at the display interface with the selectable content elements,

wherein the one or more other assistant suggestions are based on other particular content corresponding to the foreground content elements, and

wherein the one or more assistant suggestions are different than the one or more other assistant suggestions.

18 . The system of claim 17 , wherein the one or more assistant suggestions are omitted from the display interface when the one or more other assistant suggestions are being rendered at the display interface.

19 . The system of claim 16 , wherein the one or more assistant suggestions identify an operation that is initialized by the automated assistant at a separate computing device that is different than the computing device.

20 . The system of claim 16 , wherein the one or more assistant suggestions are based on historical interaction data accessible to the automated assistant, and wherein the historical interaction data characterizes a prior interaction in which the user or another user caused the computing device or another computing device to perform an action while particular content was being rendered at the computing device or the other computing device.

Assignments (1)

Continuity (2)

References Cited (26)