IP Library › Granted Patent US 12,243,526
Granted Patent B2
US 12,243,526 · App. 18/238,898 · Granted Mar 4, 2025

Determining whether to automatically resume first automated assistant session upon cessation of interrupting second session

Inventors: Andrea Terwisscha van Scheltinga (Zurich, CH); Nicolo D'Ercole (Oberrieden, CH); Zaheed Sabur (Baar, CH); Bibo Xu (San Jose, CA); Megan Knight (Mountain View, CA); Alvin Abdagic (Zurich, CH); Jan Lamecki (Zurich, CH); Bo Zhang (Kilchberg, CH)
Assignee: GRAY ICE HIGDON
G10L15/22G06F3/167G10L15/083G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,526
App. No.
18/238,898
Granted
Mar 4, 2025
Kind
B2
Abstract

Determining whether, upon cessation of a second automated assistant session that interrupted and supplanted a prior first automated assistant session: (1) to automatically resume the prior first automated assistant session, or (2) to transition to an alternative automated assistant state in which the prior first session is not automatically resumed. Implementations further relate to selectively causing, based on the determining and upon cessation of the second automated assistant session, either the automatic resumption of the prior first automated assistant session that was interrupted, or the transition to the state in which the first session is not automatically resumed.

Claims (48)

1. A method implemented using one or more processors, the method comprising:

receiving, over multiple dialog turns of a first dialog session that is between a user and an automated assistant, spoken utterance data indicative of multiple spoken utterances of a user detected via one or more microphones of a client device;

identifying, based on the spoken utterance data, multiple instances of first content that are each responsive to a corresponding one of the multiple spoken utterances of the user;

causing the client device to render the first content during the first dialog session;

receiving interruption data during rendering of at least part of the first content by the client device during the first dialog session, the interruption data received in response to further user interface input of the user that is detected during rendering of the at least part of the first content during the first dialog session;

in response to receiving the interruption data:

storing session data, for the first dialog session, in local memory of the client device or in remote memory of a remote server in network communication with the client device,

wherein the session data indicates a state of the first dialog session when the interruption data was received;

causing the client device to render alternative content during a second dialog session that at least temporarily replaces the first dialog session, wherein the alternative content is different from the first content, and wherein causing the client device to render the alternative content during the second dialog session comprises causing the client device to render the alternative content in lieu of the first content;

determining whether to cause the client device to automatically resume the first dialog session;

in response to determining to cause the client device to automatically resume the first dialog session:

retrieving the stored session data for the first dialog session, and

automatically resuming the first dialog session in the state indicated by the session data; and

in response to determining to not cause the client device to resume the first dialog session:

causing the client device to transition to an alternative state in which the client device does not automatically resume the first session.

2. The method of claim 1 , wherein determining whether to cause the client device to resume the first dialog session is based on one or more properties of the first dialog session.

3. The method of claim 2 , wherein the one or more properties of the first dialog session comprise a classification assigned to the first content.

4. The method of claim 3 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

5. The method of claim 1 , wherein determining whether to cause the client device to resume the first dialog session is based on one or more properties of the first dialog session and is further based on one or more properties of the second dialog session.

6. The method of claim 1 , wherein storing the session data, for the first dialog session, comprises storing the session data in the local memory without storing the session data in the remote memory.

7. The method of claim 1 , wherein the alternative state in which the client device does not automatically resume the first dialog session comprises display of a home screen or an ambient screen.

8. The method of claim 7 , wherein the display of the home screen or the ambient screen lacks any reference to the first dialog session.

9. The method of claim 7 , wherein the display of the home screen or the ambient screen includes a selectable graphical interface element that can be selected to resume the first dialog session.

10. A system comprising:

one or more processors;

memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:

receive, over multiple dialog turns of a first dialog session that is between a user and an automated assistant, spoken utterance data indicative of multiple spoken utterances of a user detected via one or more microphones of a client device;

identify, based on the spoken utterance data, multiple instances of first content that are each responsive to a corresponding one of the multiple spoken utterances of the user;

cause the client device to render the first content during the first dialog session;

receive interruption data during rendering of at least part of the first content by the client device during the first dialog session, the interruption data received in response to further user interface input of the user that is detected during rendering of the at least part of the first content during the first dialog session;

in response to receiving the interruption data:

store session data, for the first dialog session, in local memory of the client device or in remote memory of a remote server in network communication with the client device,

wherein the session data indicates a state of the first dialog session when the interruption data was received;

cause the client device to render alternative content during a second dialog session that at least temporarily replaces the first dialog session, wherein the alternative content is different from the first content, and wherein in causing the client device to render the alternative content during the second dialog session one or more of the processors are to cause the client device to render the alternative content in lieu of the first content;

determine whether to cause the client device to automatically resume the first dialog session;

in response to determining to cause the client device to automatically resume the first dialog session:

retrieve the stored session data for the first dialog session, and

automatically resume the first dialog session in the state indicated by the session data; and

in response to determining to not cause the client device to resume the first dialog session:

cause the client device to transition to an alternative state in which the client device does not automatically resume the first session.

11. The system of claim 10 , wherein in determining whether to cause the client device to resume the first dialog session one or more of the processors are to determine whether to cause the client device to resume the first dialog session based on one or more properties of the first dialog session.

12. The system of claim 11 , wherein the one or more properties of the first dialog session comprise a classification assigned to the first content.

13. The system of claim 12 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

14. The system of claim 10 , wherein in determining whether to cause the client device to resume the first dialog session one or more of the processors are to determine whether to cause the client device to resume the first dialog session based on one or more properties of the first dialog session and further based on one or more properties of the second dialog session.

15. The system of claim 10 , wherein in storing the session data, for the first dialog session, one or more of the processors are to store the session data in the local memory without storing the session data in the remote memory.

16. The system of claim 10 , wherein the alternative state in which the client device does not automatically resume the first dialog session comprises display of a home screen or an ambient screen.

17. The system of claim 16 , wherein the display of the home screen or the ambient screen lacks any reference to the first dialog session.

18. The system of claim 16 , wherein the display of the home screen or the ambient screen includes a selectable graphical interface element that can be selected to resume the first dialog session.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2023
From: VAN SCHELTINGA, ANDREA TERWISSCHA; D'ERCOLE, NICOLO; SABUR, ZAHEED; XU, BIBO; KNIGHT, MEGAN; ABDAGIC, ALVIN; LAMECKI, JAN; ZHANG, BO
To: GOOGLE LLC
Reel/Frame 064735/0527 →
Continuity (4)
Continuation 17552887 · Dec 16, 2021
Continuation 16618920
Provisional Application 62668151 · May 7, 2018
Related Publication 20230402035A1 · Dec 14, 2023
References Cited (42)
US 8660849B2 · Gruber et al. · 2014 [cited by applicant]
US 9116952B1 · Heiler et al. · 2015 [cited by applicant]
US 9547690B2 · Nowak-Przygodzki et al. · 2017 [cited by applicant]
US 11217247B2 · van Scheltinga et al. · 2022 [cited by applicant]
US 20070211875A1 · Nurmi · 2007 [cited by applicant]
US 20130275164A1 · Gruber et al. · 2013 [cited by applicant]
US 20140046891A1 · Banas · 2014 [cited by applicant]
US 20140244712A1 · Walters et al. · 2014 [cited by applicant]
US 20160035352A1 · Furumoto · 2016 [cited by applicant]
US 20160260436A1 · Lemay et al. · 2016 [cited by applicant]
US 20160371207A1 · Doerr · 2016 [cited by examiner]
US 20190019504A1 · Hatambeiki · 2019 [cited by examiner]
US 20220108696A1 · Van Scheltinga et al. · 2022 [cited by applicant]
CN 105634760 · 2016 [cited by applicant]
CN 107957776 · 2018 [cited by applicant]
JP H10104003 · 1998 [cited by applicant]
JP 2003009207 · 2003 [cited by applicant]
JP 2004108908 · 2004 [cited by applicant]
JP 2008191074 · 2008 [cited by applicant]
KR 20170105581 · 2017 [cited by applicant]
KR 20170119715 · 2017 [cited by applicant]
KR 20180073493 · 2018 [cited by applicant]
WO 2007119383A1 · 2007 [cited by applicant]
WO 2012137933 · 2012 [cited by applicant]
European Patent Office; Communication issued in Application No. 22196579.1; 9 pages; dated Dec. 14, 2022. [cited by applicant]
Korean Intellectual Property Office; Notice of Allowance issued in Application Ser. No. KR10-2020-7034930; 5 pages; dated Dec. 14, 2022. [cited by applicant]
Japanese Patent Office; Notice of Allowance issued in app. No. 2020-562772, 3 pages, dated Aug. 1, 2022. [cited by applicant]
Korean Intellectual Property Office; Notice of Office Action issued in Application Ser. No. KR10-2020-7034930; 17 pages; dated May 30, 2022. [cited by applicant]
European Patent Office; Intention to Grant issued in Application No. 19724009.6, 56 pages, dated Jun. 30, 2022. [cited by applicant]
European Patent Office; Intention to Grant issued in Application No. 19724009.6, 49 pages, dated Feb. 4, 2022. [cited by applicant]
Japanese Patent Office; Notice of Reasons for Rejection issued in Application No. 2020-562772; 8 pages; dated Dec. 24, 2021. [cited by applicant]
Intellectual Property India; Examination Report issued in Application No. 202027052541; 6 pages; dated Jul. 16, 2021. [cited by applicant]
European Patent Office; Sumons to attend oral proceedings pursuant to Rule 115(1) EPC issued in Application No. 19724009.6; 9 pages; dated Apr. 1, 2021. [cited by applicant]
European Patent Office; Communication Pursuant to Article 94(3) for European Application No. 19724009.6; 6 pages; dated Jul. 23, 2020. [cited by applicant]
European Patent Office; International Search Report and Written Opinion of Ser. No. PCT/US2019/030271; 13 pages; dated Jul. 25, 2019. [cited by applicant]
Japanese Patent Office; Notice of Reasons for Rejection issued in Application No. 2022-136801; 9 pages; dated Jul. 18, 2023. [cited by applicant]
Intellectual Property India; Hearing Notice issued in Application No. 202027052541; 2 pages; dated Aug. 22, 2023. [cited by applicant]
Korean Intellectual Property Office; Notice of Office Action issued in Application Ser. No. KR10-2023-7007650; 23 pages; dated Sep. 21, 2023. [cited by applicant]
China National Intellectual Property Administration; Notification of First Office Action issued in Application No. 201980037325.8; 15 pages; dated Nov. 18, 2023. [cited by applicant]
China National Intellectual Property Administration; Notice of Grant issued in Application No. 201980037325.8; 5 pages; dated Jul. 12, 2024. [cited by applicant]
European Patent Office; Communication Pursuant to Article 94(3) for European Application No. 19724009.6; 10 pages; dated Aug. 12, 2024. [cited by applicant]
Intellectual Property India; Examination Report issued in Application No. 202328060983; 6 pages; dated Nov. 11, 2024. [cited by applicant]