IP Library Granted Patent US 12,518,872
Granted Patent B2
US 12,518,872 · App. 18/669,103 · Granted Jan 6, 2026

Personalized avatar responsive to user physical state and context

Inventor: Robert Louis Kaleal, III (Mayfield Village, OH)
Assignee: KC HOLDINGS I
G16H40/63A61B5/0205A61B5/02055A61B5/11A61B5/165A61B5/20A61B5/40A61B5/41A61B5/42A61B5/43A61B5/45A61B5/486A61B5/7264A61B5/744A61B5/7445G06F1/1626G06Q10/0639G06Q10/10G06Q50/01G06T13/40G06T19/00G09B5/02G09B5/06G09B19/00G09B19/0092G16H20/40G16H20/70A61B5/08A61B5/44A61B5/7246G06T2219/2012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,872
App. No.
18/669,103
Granted
Jan 6, 2026
Kind
B2
Abstract

Systems and methods are disclosed that facilitate providing guidance to a user during performance of a program or routine using a personalized avatar. In an aspect, a system includes a reception component configured to receive biochemical information about a physiological state or condition of a user, including information identifying a presence or a status of one or more biomarkers. The system further includes an analysis component configured to determine or infer one or more characteristics of the physiological state or condition of the user based on the information identifying the presence or the status of the one or more biomarkers, and a visualization component configured to adapt an appearance of an avatar presented to the user based on the one or more characteristics to reflect the one or more characteristics.

Claims (34)

1 . A system, comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:

monitoring user adherence to a defined program followed by a user based on feedback information associated with performance of the defined program by the user received over the course of the defined program, wherein the feedback information comprises physiological information regarding a physiological state of the user and context information regarding a context of the user; and

determining whether the user is deviating or is likely to deviate from a requirement of the defined program based on the feedback information in combination with a known schedule of the user and historical behavior information regarding one or more historical behaviors of the user or similar users associated with the physiological state and the context, wherein the determination comprises generating a deviation prediction using one or more classifiers trained on deviation likelihood data from multiple users grouped by health profile, age, and gender; and

wherein based on a determination that the user is deviating or is likely to deviate from the requirement of the defined program, the operations further comprise:

determining a reaction for performance by an avatar presented to the user via a device, wherein the reaction comprises at least one of a visual cue or verbal cue intended to stop or prevent the user from deviating from the requirement.

2 . The system of claim 1 , wherein the determining whether the user is deviating or is likely to deviate from the requirement comprises employing artificial intelligence using classifiers.

3 . The system of claim 1 , wherein the one or more historical behaviors comprise a first behavior known to deviate from the requirement and wherein the determining the reaction comprises determining the reaction based on a second behavior previously performed by the user, or one or more of the similar users, that has been determined to stop or prevent the user from performing the first behavior.

4 . The system of claim 1 , wherein the one or more similar users further comprises one or more users having a similar health profile, age, and gender as a current user.

5 . The system of claim 4 , wherein the context information further identifies one or more entities associated with the current location, or one or more events associated with the current location.

6 . The system of claim 1 , wherein the context information identifies a current time and date.

7 . The system of claim 1 , wherein the feedback information further comprises motion information regarding physical motion or movement of the user, and wherein the operations further comprise:

determining a current behavior being performed by the user based on the feedback information, and wherein the determining whether the user is deviating or is likely to deviate from the requirement is further based on the current behavior.

8 . The system of claim 1 , wherein the determining whether the user is deviating or is likely to deviate is further based on a known schedule of the user.

9 . A method comprising:

monitoring, by a system comprising a processor, user adherence to a defined program followed by a user based on feedback information associated with performance of the defined program by the user received over the course of the defined program, wherein the feedback information comprises physiological information regarding a physiological state of the user and context information regarding a context of the user; and

determining, by the system, whether the user is deviating or is likely to deviate from a requirement of the defined program based on the feedback information in combination with a known schedule of the user and historical behavior information regarding one or more historical behaviors of the user or similar users associated with the physiological state and the context wherein the determining comprises classifying a current user state into a deviation likelihood class based on comparison to clustered behavior trajectories from similar users; and

wherein based on a determination that the user is deviating or is likely to deviate from the requirement of the defined program, the operations further comprise:

determining a reaction for performance by an avatar presented to the user via a device, wherein the reaction comprises at least one of a visual cue or verbal cue intended to stop or prevent the user from deviating from the requirement.

10 . The method of claim 9 , wherein the determining whether the user is deviating or is likely to deviate from the requirement comprises employing artificial intelligence using classifiers.

11 . The method of claim 9 , wherein the one or more historical behaviors comprise a first behavior known to deviate from the requirement and wherein the determining the reaction comprises determining the reaction based on a second behavior previously performed by the user, or one or more of the similar users, that has been determined to stop or prevent the user from performing the first behavior.

12 . The method of claim 9 , wherein the one or more similar users further comprises one or more users having a similar health profile, age, and gender as a current user.

13 . The method of claim 12 , wherein the context information further identifies one or more entities associated with the current location, or one or more events associated with the current location.

14 . The method of claim 9 , wherein the context information identifies a current time and date.

15 . The method of claim 9 , wherein the feedback information further comprises motion information regarding physical motion or movement of the user, and wherein the method further comprises:

determining, by the system, a current behavior being performed by the user based on the feedback information, and wherein the determining whether the user is deviating or is likely to deviate from the requirement is further based on the current behavior.

16 . The method of claim 9 , wherein the determining whether the user is deviating or is likely to deviate is further based on a known schedule of the user.

17 . A machine-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

monitoring user adherence to a defined program followed by a user based on feedback information associated with performance of the defined program by the user received over the course of the defined program, wherein the feedback information comprises physiological information regarding a physiological state of the user and context information regarding a context of the user; and

determining whether the user is deviating or is likely to deviate from a requirement of the defined program based on the feedback information and a known schedule of the user, and historical behavior information regarding one or more historical behaviors of the user or similar users associated with the physiological state and the context, wherein the determining comprises applying a machine learning model trained to detect deviation risk based on physiological-contextual similarity to prior user cohorts; and

wherein based on a determination that the user is deviating or is likely to deviate from the requirement of the defined program, the operations further comprise:

determining a reaction for performance by an avatar presented to the user via a device, wherein the reaction comprises at least one of a visual cue or verbal cue intended to stop or prevent the user from deviating from the requirement.

18 . The machine-readable storage medium of claim 17 , wherein the similar users further comprise one or more users having a similar health profile, age, and gender as a current user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2024
From: KALEAL, ROBERT LOUIS, III
To: KC HOLDINGS I
Reel/Frame 067512/0540 →
Continuity (8)
Continuation 17389047 · Jul 29, 2021
Continuation 15978625 · May 14, 2018
Continuation 15474111 · Mar 30, 2017
Continuation 14945600 · Nov 19, 2015
Continuation In Part 14518844 · Oct 20, 2014
Continuation In Part 14049981 · Oct 9, 2013
Provisional Application 61711510 · Oct 9, 2012
Related Publication 20240312619A1 · Sep 19, 2024
References Cited (102)
US 8612363B2 · Karkanias et al. · 2013 [cited by applicant]
US 9199122B2 · Kaleal, III · 2015 [cited by examiner]
US 9409051B2 · Kaleal, III · 2016 [cited by examiner]
US 9913618B2 · Kaleal, III et al. · 2018 [cited by applicant]
US 9997082B2 · Kaleal · 2018 [cited by examiner]
US 10390769B2 · Kaleal, III et al. · 2019 [cited by applicant]
US 10768983B2 · Wang et al. · 2020 [cited by applicant]
US 11107579B2 · Kaleal, III · 2021 [cited by examiner]
US 11990233B2 · Kaleal, III · 2024 [cited by examiner]
US 20040002634A1 · Nihtila · 2004 [cited by applicant]
US 20040131227A1 · Bravomalo et al. · 2004 [cited by applicant]
US 20090047644A1 · Mensah et al. · 2009 [cited by applicant]
US 20100207877A1 · Woodard · 2010 [cited by applicant]
US 20100240458A1 · Gaiba et al. · 2010 [cited by applicant]
US 20110021317A1 · Lanfermann · 2011 [cited by applicant]
US 20110082010A1 · Dyer et al. · 2011 [cited by applicant]
US 20110212782A1 · Thompson et al. · 2011 [cited by applicant]
US 20120071771A1 · Behar · 2012 [cited by applicant]
US 20120095863A1 · Schiff et al. · 2012 [cited by applicant]
US 20120127157A1 · Adler et al. · 2012 [cited by applicant]
US 20120182431A1 · Asanov · 2012 [cited by applicant]
US 20120183940A1 · Aragones et al. · 2012 [cited by applicant]
US 20120232360A1 · Maueler · 2012 [cited by examiner]
US 20120271143A1 · Aragones · 2012 [cited by examiner]
US 20120290950A1 · Rapaport et al. · 2012 [cited by applicant]
US 20130178960A1 · Sheehan et al. · 2013 [cited by applicant]
US 20130252731A1 · Dugan et al. · 2013 [cited by applicant]
US 20140188009A1 · Lange · 2014 [cited by applicant]
US 20180117447A1 · Tran et al. · 2018 [cited by applicant]
US 20180211718A1 · Heath · 2018 [cited by applicant]
US 20180344215A1 · Ohnemus et al. · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20200211409A1 · Latorre et al. · 2020 [cited by applicant]
US 20200227160A1 · Youngblood et al. · 2020 [cited by applicant]
US 20200374104A1 · Heath · 2020 [cited by applicant]
US 20210248594A1 · Yantis et al. · 2021 [cited by applicant]
US 20210374861A1 · McClelland · 2021 [cited by applicant]
US 20220246299A1 · Gilvert · 2022 [cited by applicant]
US 20220270725A1 · Derosa-Grund · 2022 [cited by applicant]
US 20220384027A1 · Kaleal, III et al. · 2022 [cited by applicant]
US 20230245764A1 · Nova et al. · 2023 [cited by applicant]
US 20240013169A1 · Dershem · 2024 [cited by applicant]
US 20240029014A1 · Choura · 2024 [cited by applicant]
US 20240428306A1 · Sliwka et al. · 2024 [cited by applicant]
US 20250144472A1 · Ashby et al. · 2025 [cited by applicant]
WO 2017091730A2 · 2017 [cited by applicant]
WO 2023239390A1 · 2023 [cited by applicant]
Parisi, Anthony, “EA Sports Active Review”, http://www.1up.com/reviews/ea-sports-active, May 20, 2009, 3 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/049,981, dated Mar. 10, 2015, 17 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/518,808, dated Apr. 7, 2015, 22 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 14/049,981, dated Jun. 23, 2015, 18 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 14/049,981, dated Jul. 24, 2015, 18 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 14/518,808, dated Jul. 24, 2015, 20 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/593,603, dated Oct. 20, 2015, 27 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/593,603, dated Dec. 24, 2015, 15 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 14/593,603, dated Apr. 11, 2016, 19 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/945,600, dated May 4, 2016, 18 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/518,844, dated Oct. 19, 2015, 24 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/518,844, dated Dec. 22, 2015, 16 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/518,844, dated Apr. 4, 2016, 16 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 14/945,600, dated Oct. 14, 2016, 15 pages. [cited by applicant]
Office Action received for U.S. Appl. No. 15/208,455, dated Oct. 18, 2016, 20 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 14/945,600, dated Jan. 11, 2017, 16 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/208,455, dated Mar. 15, 2017, 16 Pages. [cited by applicant]
Non- Final Office Action received for U.S. Appl. No. 15/290,994, dated Feb. 6, 2017, 23 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/290,994, dated Jun. 1, 2017, 18 Pages. [cited by applicant]
Non- Final Office Action received for U.S. Appl. No. 15/474,111, dated Jun. 13, 2017, 16 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/208,455, dated Jun. 27, 2017, 18 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/208,455, dated Oct. 27, 2017, 32 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/290,994, dated Sep. 27, 2017, 15 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/474,111, dated Feb. 14, 2018, 19 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/474,111, dated Oct. 27, 2017, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/888,796, dated May 15, 2018, 26 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/888,796, dated Dec. 14, 2018, 10 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/978,625, dated Oct. 1, 2019, 29 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/978,625, dated Jan. 30, 2020, 12 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/858,215, dated Nov. 25, 2019, 28 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/858,215, dated Jun. 5, 2020, 18 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/978,625, dated Apr. 9, 2020, 16 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/858,215, dated Oct. 26, 2020, 16 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/978,625, dated Aug. 25, 2020, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/978,625, dated Jan. 4, 2021, 14 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/854,206, dated Dec. 8, 2021, 29 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/854,206, dated Apr. 18, 2022, 33 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/389,047, dated Apr. 6, 2023, 52 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/389,047, dated Sep. 15, 2023, 54 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/806,117, dated Oct. 25, 2023, 110 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/806,120, dated Nov. 8, 2023, 35 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/389,047, dated Jan. 17, 2024, 81 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/806,124, dated Dec. 21, 2023, 110 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/938,595, dated Feb. 27, 2024, 40 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application Serial No. PCT/US22/42473, dated Jan. 25, 2023, 13 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/806,117, dated Apr. 2, 2024, 193 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/806,120, dated Apr. 16, 2024, 40 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/806,124, dated Apr. 24, 2024, 185 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/806,117 dated Jul. 10, 2024, 26 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/806,120 dated Aug. 2, 2024, 66 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/806,124 dated Aug. 14, 2024, 187 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/806,124 dated Aug. 27, 2024, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/938,595 dated Aug. 2, 2024, 47 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/818,519 dated Feb. 11, 2025, 484 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/818,519 dated Sep. 17, 2025, 21 pages. [cited by applicant]