IP Library Granted Patent US 12,394,299
Granted Patent B2
US 12,394,299 · App. 18/286,744 · Granted Aug 19, 2025

User suggestions based on engagement

Inventors: Shiraz Akmal (Playa Vista, CA); Aaron M. Burns (Sunnyvale, CA); Brad K. Herman (Culver City, CA); David A. Carson (San Francisco, CA)
Assignee: Apple Inc.
G08B21/182A61B5/16G06F1/163G06F3/016G06F3/167G06T19/006G16H50/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,394,299
App. No.
18/286,744
Filed
Oct 12, 2023
Granted
Aug 19, 2025
Kind
B2
Examiner
PHAM, QUANG
Art Unit
2685
USPC
340/540
Abstract

Systems and processes for operating a digital assistant are provided. An example method includes, at an electronic device having one or more processors and memory, receiving a biometric signature of a user, determining, based on the biometric signature, a wellness level associated with the user, in accordance with a determination that the wellness level associated with the user is below a predetermined threshold, providing a first output to the user to stop engaging with the first electronic device, wherein the first electronic device is capable of producing a virtual environment, and after a predetermined time, causing a second output to be provided to the user with a second electronic device to begin engaging with the first electronic device.

Claims (63)

1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device, the one or more programs including instructions for:

receiving a biometric signature of a user while the user is engaging with the first electronic device via one or more sensors associated with the first electronic device;

determining, based on the biometric signature and contextual data associated with the user, a wellness level associated with the user;

in accordance with a determination that the wellness level associated with the user is below a predetermined threshold, providing a first output to the user to stop engaging with the first electronic device, wherein the first electronic device is capable of producing a virtual environment; and

after a predetermined time, causing a second output to be provided to the user with a second electronic device, wherein the second output is related to re-engaging with the first electronic device.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the biometric signature includes an attention level of the user.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the wellness level includes a score based on the biometric signature received from the one or more sensors of the first electronic device.

4. The non-transitory computer-readable storage medium of claim 3 , wherein the score is based on one or more interactions between the user and the first electronic device.

5. The non-transitory computer-readable storage medium of claim 1 , wherein the contextual data associated with the user includes an amount of time the user has been engaged with the first electronic device.

6. The non-transitory computer-readable storage medium of claim 1 , wherein the contextual data associated with the user includes one or more scheduled events associated with the user.

7. The non-transitory computer-readable storage medium of claim 1 , wherein the wellness level associated with the user is based on the contextual data associated with the first electronic device.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the contextual data associated with the first electronic device includes one or more applications open on the first electronic device.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the contextual data associated with the first electronic device includes a location of the first electronic device.

10. The non-transitory computer-readable storage medium of claim 1 , wherein the wellness level associated with the user is based on whether the virtual environment is being provided by the first electronic device.

11. The non-transitory computer-readable storage medium of claim 1 , wherein the predetermined threshold is determined based on one or more baseline biometric signatures associated with the user.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the one or more baseline biometric signatures associated with the user are determined based on previous interaction between the user and the first electronic device.

13. The non-transitory computer-readable storage medium of claim 1 , wherein the predetermined threshold is determined based on default threshold values.

14. The non-transitory computer-readable storage medium of claim 1 , wherein the first output includes a visual prompt within the virtual environment.

15. The non-transitory computer-readable storage medium of claim 1 , wherein the first output includes haptic feedback.

16. The non-transitory computer-readable storage medium of claim 1 , wherein the first output is determined based on one or more user settings.

17. The non-transitory computer-readable storage medium of claim 1 , wherein the predetermined time is based on one or more user settings.

18. The non-transitory computer-readable storage medium of claim 1 , wherein the predetermined time is based on one or more default settings.

19. The non-transitory computer-readable storage medium of claim 1 , wherein the second electronic device is a wearable electronic device.

20. The non-transitory computer-readable storage medium of claim 1 , wherein the first electronic device and the second electronic device are both associated with a user profile for the user.

21. The non-transitory computer-readable storage medium of claim 1 , wherein the second output is an audio prompt.

22. A first electronic device comprising:

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a biometric signature of a user while the user is engaging with the first electronic device via one or more sensors associated with the first electronic device;

determining, based on the biometric signature and contextual data associated with the user, a wellness level associated with the user;

in accordance with a determination that the wellness level associated with the user is below a predetermined threshold, providing a first output to the user to stop engaging with the first electronic device, wherein the first electronic device is capable of producing a virtual environment; and

after a predetermined time, causing a second output to be provided to the user with a second electronic device, wherein the second output is related to re-engaging with the first electronic device.

23. The first electronic device of claim 22 , wherein the biometric signature includes an attention level of the user.

24. The first electronic device of claim 22 , wherein the wellness level includes a score based on the biometric signature received from the one or more sensors of the first electronic device.

25. The first electronic device of claim 22 , wherein the contextual data associated with the user includes an amount of time the user has been engaged with the first electronic device.

26. The first electronic device of claim 22 , wherein the contextual data associated with the user includes one or more scheduled events associated with the user.

27. The first electronic device of claim 22 , wherein the wellness level associated with the user is based on the contextual data associated with the first electronic device and wherein the contextual data associated with the first electronic device includes one or more applications open on the first electronic device and/or a location of the first electronic device.

28. The first electronic device of claim 22 , wherein the wellness level associated with the user is based on whether the virtual environment is being provided by the first electronic device.

29. The first electronic device of claim 22 , wherein the predetermined threshold is determined based on one or more baseline biometric signatures associated with the user.

30. The first electronic device of claim 22 , wherein the predetermined threshold is determined based on default threshold values.

31. The first electronic device of claim 22 , wherein the first output includes a visual prompt within the virtual environment and/or a haptic feedback and wherein the first output is determined based on one or more user settings.

32. The first electronic device of claim 22 , wherein the predetermined time is based on one or more user settings and/or one or more default settings.

33. The first electronic device of claim 22 , wherein the second electronic device is a wearable electronic device.

34. The first electronic device of claim 22 , wherein the first electronic device and the second electronic device are both associated with a user profile for the user.

35. A method, comprising:

at a first electronic device with one or more processors and memory:

receiving, by the first electronic device, a biometric signature of a user while the user is engaging with the first electronic device via one or more sensors associated with the first electronic device;

determining, by the first electronic device and based on the biometric signature and contextual data associated with the user, a wellness level associated with the user;

in accordance with a determination that the wellness level associated with the user is below a predetermined threshold, providing, by the first electronic device, a first output to the user to stop engaging with the first electronic device, wherein the first electronic device is capable of producing a virtual environment; and

after a predetermined time, causing, by the first electronic device, a second output to be provided to the user with a second electronic device, wherein the second output is related to re-engaging with the first electronic device.

36. The method of claim 35 , wherein the biometric signature includes an attention level of the user.

37. The method of claim 35 , wherein the wellness level includes a score based on the biometric signature received from the one or more sensors of the first electronic device.

38. The method of claim 35 , wherein the contextual data associated with the user includes an amount of time the user has been engaged with the first electronic device.

39. The method of claim 35 , wherein the contextual data associated with the user includes one or more scheduled events associated with the user.

40. The method of claim 35 , wherein the wellness level associated with the user is based on the contextual data associated with the first electronic device and wherein the contextual data associated with the first electronic device includes one or more applications open on the first electronic device and/or a location of the first electronic device.

41. The method of claim 35 , wherein the wellness level associated with the user is based on whether the virtual environment is being provided by the first electronic device.

42. The method of claim 35 , wherein the predetermined threshold is determined based on one or more baseline biometric signatures associated with the user.

43. The method of claim 35 , wherein the predetermined threshold is determined based on default threshold values.

44. The method of claim 35 , wherein the first output includes a visual prompt within the virtual environment and/or a haptic feedback and wherein the first output is determined based on one or more user settings.

45. The method of claim 35 , wherein the predetermined time is based on one or more user settings and/or one or more default settings.

46. The method of claim 35 , wherein the second electronic device is a wearable electronic device.

47. The method of claim 35 , wherein the first electronic device and the second electronic device are both associated with a user profile for the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2026
From: VETTER, JAMES W
To: TRANSMED7, LLC
Reel/Frame 075649/0730 →
Continuity (2)
Provisional Application 63174199 · Apr 13, 2021
Related Publication 20240194049A1 · Jun 13, 2024
References Cited (78)
US 6763379B1 · Shuster · 2004 [cited by examiner]
US 9141761B2 · Lee · 2015 [cited by examiner]
US 9378456B2 · White · 2016 [cited by examiner]
US 9628844B2 · Conrad · 2017 [cited by examiner]
US 9681005B2 · Wang · 2017 [cited by examiner]
US 9697822B1 · Naik · 2017 [cited by examiner]
US 10049663B2 · Orr · 2018 [cited by examiner]
US 10798438B2 · Conrad et al. · 2020 [cited by applicant]
US 10818288B2 · Garcia · 2020 [cited by examiner]
US 10825564B1 · Zhang · 2020 [cited by examiner]
US 10852905B1 · Guzman · 2020 [cited by examiner]
US 11080336B2 · Van Dusen · 2021 [cited by examiner]
US 11107580B1 · Felton · 2021 [cited by examiner]
US 11216093B2 · Matsubara · 2022 [cited by examiner]
US 11250844B2 · Mont-Reynaud · 2022 [cited by examiner]
US 20080090703A1 · Rosenberg · 2008 [cited by examiner]
US 20100082376A1 · Levitt · 2010 [cited by examiner]
US 20110083079A1 · Farrell · 2011 [cited by examiner]
US 20110106736A1 · Aharonson · 2011 [cited by examiner]
US 20130151339A1 · Kim · 2013 [cited by examiner]
US 20130346068A1 · Solem · 2013 [cited by examiner]
US 20140052680A1 · Nitz · 2014 [cited by examiner]
US 20140071069A1 · Anderson · 2014 [cited by examiner]
US 20140292638A1 · Lee · 2014 [cited by examiner]
US 20140310595A1 · Acharya · 2014 [cited by examiner]
US 20140340334A1 · Cho · 2014 [cited by examiner]
US 20140375551A1 · Oshita · 2014 [cited by examiner]
US 20150058720A1 · Smadja · 2015 [cited by examiner]
US 20150104043A1 · Takahashi · 2015 [cited by examiner]
US 20150128058A1 · Anajwala · 2015 [cited by examiner]
US 20150154291A1 · Shepherd · 2015 [cited by examiner]
US 20150248494A1 · Mital · 2015 [cited by examiner]
US 20150293592A1 · Cheong · 2015 [cited by examiner]
US 20150317310A1 · Glass · 2015 [cited by examiner]
US 20160170477A1 · Flack · 2016 [cited by examiner]
US 20160227897A1 · Jobling · 2016 [cited by examiner]
US 20160249864A1 · Kang · 2016 [cited by examiner]
US 20160379105A1 · Moore, Jr. · 2016 [cited by examiner]
US 20170000348A1 · Karsten · 2017 [cited by examiner]
US 20170010669A1 · Lim · 2017 [cited by examiner]
US 20170046052A1 · Lee · 2017 [cited by examiner]
US 20170075569A1 · Ward · 2017 [cited by examiner]
US 20180052909A1 · Sharifi · 2018 [cited by examiner]
US 20180109920A1 · Aggarwal · 2018 [cited by examiner]
US 20180211345A1 · Bean · 2018 [cited by examiner]
US 20180293866A1 · Chung · 2018 [cited by examiner]
US 20180367969A1 · Nanjappan · 2018 [cited by examiner]
US 20180369616A1 · Dobbing · 2018 [cited by examiner]
US 20190025906A1 · Strong · 2019 [cited by examiner]
US 20190065993A1 · Srinivasan · 2019 [cited by examiner]
US 20200068160A1 · Cho · 2020 [cited by examiner]
US 20200082735A1 · Nel · 2020 [cited by examiner]
US 20200379726A1 · Blatz et al. · 2020 [cited by applicant]
US 20200379727A1 · Blatz · 2020 [cited by examiner]
US 20200401222A1 · Wisbey · 2020 [cited by examiner]
US 20210073293A1 · Fenton · 2021 [cited by examiner]
US 20210096646A1 · Yildiz · 2021 [cited by examiner]
US 20210217533A1 · Heimerl · 2021 [cited by examiner]
US 20220015717A1 · Ogasawara · 2022 [cited by examiner]
US 20220225933A1 · Rehn · 2022 [cited by examiner]
DK 180129B1 · 2020 [cited by applicant]
EP 2729889A2 · 2014 [cited by applicant]
EP 2915021A2 · 2015 [cited by applicant]
JP 2015504619A · 2015 [cited by applicant]
WO 2009156978A1 · 2009 [cited by applicant]
WO 2010036605A1 · 2010 [cited by applicant]
WO 2012160567A1 · 2012 [cited by applicant]
WO 2013057153A1 · 2013 [cited by applicant]
WO 2016191737A2 · 2016 [cited by applicant]
Ask Alexa—Things That Are Smart Wiki, Available online at: <http://thingsthataresmart.wiki/index.php?title=Ask_Alexa&oldid=4283>, Jun. 8, 2016, pp. 1-31. [cited by applicant]
Dwork et al., “The Algorithmic Foundations of Differential Privacy”, Foundations and Trends in Theoretical Computer Science: vol. 9: No. 3-4, 211-407, 2014, 281 pages. [cited by applicant]
Hutsko et al., “iPhone All-in-One For Dummies”, 3rd Edition, Dec. 31, 2013, 98 pages. [cited by applicant]
Lin Luyuan, “An Assistive Handwashing System with Emotional Intelligence”, Using Emotional Intelligence in Cognitive Intelligent Assistant Systems, 2014, 101 pages. [cited by applicant]
Rowland et al., “Designing Connected Products: UX for the Consumer Internet of Things”, O'Reilly, May 31, 2015, 452 pages. [cited by applicant]
Sullivan Danny, “How Google Instant's Autocomplete Suggestions Work”, available at <http://searchengineland.com/how-google-instant-autocomplete-suggestions-work-62592>, Apr. 6, 2011, 12 pages. [cited by applicant]
Tur et al., “The CALO Meeting Assistant System”, IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, No. 6, Aug. 2010, pp. 1601-1611. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/024491, mailed on Oct. 26, 2023, 11 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/024491, mailed on Jul. 26, 2022, 15 pages. [cited by applicant]