IP Library Granted Patent US 12,646,239
Granted Patent B2
US 12,646,239 · App. 18/237,492 · Granted Jun 2, 2026

Automated therapy compliance video with avatar explaining compliance data

Inventors: Jan Martijn Krans (Den Bosch, NL); Heereen Shim (Eindhoven, NL); Bas Luksenburg (Eindhoven, NL); Boris Emmanuel Rachmund De Ruyter (Peer, BE)
Assignee: KONINKLIJKE PHILIPS N.V.
G06T13/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,646,239
App. No.
18/237,492
Granted
Jun 2, 2026
Kind
B2
Abstract

Systems, apparatuses and methods provide technology for generating a video presentation, including determining a plurality of insights, each insight associated with a data presentation and, based on at least a portion of therapy compliance data for a patient, determining, for each insight, an insight location on a reporting dashboard and an avatar position for an avatar on the reporting dashboard, formulating a feedback message for each of the insights, and generating a video presentation based on the reporting dashboard, the video presentation including a display of the data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each insight, a display of the avatar at the respective avatar position, the avatar pointing to the insight location for the insight, and a synchronized audio signal representing the feedback message for the insight.

Claims (71)

1 . A computer-implemented method of generating a video presentation, comprising:

determining a plurality of insights, each insight associated with a respective one of a plurality of data presentations and based on at least a portion of therapy compliance data for a patient;

determining, for each of the plurality of insights:

an insight location for the respective insight on a reporting dashboard; and

an avatar position for an avatar on the reporting dashboard;

formulating a feedback message for each of the plurality of insights; and

generating a video presentation based on the reporting dashboard, the video presentation including a display of the plurality of data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each of the plurality of insights:

a display of the avatar at the respective avatar position,

the avatar pointing to the insight location for the respective insight, and

a synchronized audio signal representing the feedback message for the respective insight, and

wherein the avatar is positioned such that, when pointing to the data presentation, the relevant portion of the data presentation being discussed remains clear and unobstructed to a user;

wherein the video presentation further includes an embedded interactive dialog portion comprising:

providing a prompt to the user and

receiving a user response to the prompt,

wherein, in response to the user response, at least a remaining portion of the video presentation is automatically regenerated or modified in real time such that subsequent content, avatar actions, or feedback messages are dynamically updated based on the user's input.

2 . The method of claim 1 , wherein the respective avatar position is determined based on one or more of an avatar size, a type of the respective one of the plurality of data presentations, the insight location for the respective insight, an amount of free space in the reporting dashboard, or a location of free space in the reporting dashboard.

3 . The method of claim 1 , wherein determining each of the plurality of insights comprises:

retrieving a plurality of predetermined statements based on a type of the respective one of the plurality of data presentations;

determining, for each of the plurality of predetermined statements, a confidence score representing a probability that the respective statement is true based on the therapy compliance data; and

selecting the respective statement having the highest confidence score.

4 . The method of claim 1 , further comprising:

assigning a weight to each respective insight of the plurality of insights; and

determining an order of presentation in the animation sequence for the plurality of insights based on the weight assigned to each respective insight.

5 . The method of claim 4 , wherein the weight assigned to each respective insight of the plurality of insights is based on one or more of a condition of the patient, a change in the therapy compliance data for the patient, a relevance of the insight to the behavior of overall therapy.

6 . The method of claim 1 , wherein each respective feedback message is formulated based on one or more of a predetermined feedback message or natural language modeling applied to the insight.

7 . A computing system comprising:

a processor; and

a memory coupled to the processor, the memory comprising instructions which, when executed by the processor, cause the computing system to perform operations comprising:

determining a plurality of insights, each insight associated with a respective one of a plurality of data presentations and based on at least a portion of therapy compliance data for a patient;

determining, for each of the plurality of insights: an insight location for the respective insight on a reporting dashboard; and an avatar position for an avatar on the reporting dashboard;

formulating a feedback message for each of the plurality of insights; and

generating a video presentation based on the reporting dashboard, the video presentation including a display of the plurality of data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each of the plurality of insights:

a display of the avatar at the respective avatar position,

the avatar pointing to the insight location for the respective insight, and

a synchronized audio signal representing the feedback message for the respective insight, and

wherein the avatar is positioned such that, when pointing to the data presentation, the relevant portion of the data presentation being discussed remains clear and unobstructed to a user;

wherein the video presentation further includes an embedded interactive dialog portion comprising:

providing a prompt to the user and

receiving a user response to the prompt,

wherein, in response to the user response, at least a remaining portion of the video presentation is automatically regenerated or modified in real time such that subsequent content, avatar actions, or feedback messages are dynamically updated based on the user's input.

8 . The system of claim 7 , wherein the respective avatar position is determined based on one or more of an avatar size, a type of the respective one of the plurality of data presentations, the insight location for the respective insight, an amount of free space in the reporting dashboard, or a location of free space in the reporting dashboard.

9 . The system of claim 7 , wherein determining each of the plurality of insights comprises:

retrieving a plurality of predetermined statements based on a type of the respective one of the plurality of data presentations;

determining, for each of the plurality of predetermined statements, a confidence score representing a probability that the respective statement is true based on the therapy compliance data; and

selecting the respective statement having the highest confidence score.

10 . The system of claim 7 , wherein the instructions, when executed by the processor, cause the computing system to perform further operations comprising:

assigning a weight to each respective insight of the plurality of insights; and determining an order of presentation in the animation sequence for the plurality of insights based on the weight assigned to each respective insight,

wherein the weight assigned to each respective insight of the plurality of insights is based on one or more of a condition of the patient, a change in the therapy compliance data for the patient, a relevance of the insight to the behavior or overall therapy compliance data for the patient, whether the insight reflects a positive, neutral or negative report, or a confidence score for the insight,

wherein each respective feedback message is formulated based on one or more of a predetermined feedback message or natural language modeling applied to the insight.

11 . At least one non-transitory computer readable storage medium comprising instructions which, when executed by a computing system, cause the computing system to perform operations comprising:

determining a plurality of insights, each insight associated with a respective one of a plurality of data presentations and based on at least a portion of therapy compliance data for a patient;

determining, for each of the plurality of insights:

an insight location for the respective insight on a reporting dashboard, and

an avatar position for an avatar on the reporting dashboard;

formulating a feedback message for each of the plurality of insights; and

generating a video presentation based on the reporting dashboard, the video presentation including a display of the plurality of data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each of the plurality of insights:

a display of the avatar at the respective avatar position,

the avatar pointing to the insight location for the respective insight, and

a synchronized audio signal representing the feedback message for the respective insight, wherein the avatar is positioned such that, when pointing to the data presentation, the relevant portion of the data presentation being discussed remains clear and unobstructed to a user;

wherein the video presentation further includes an embedded interactive dialog portion comprising:

providing a prompt to the user and

receiving a user response to the prompt,

wherein, in response to the user response, at least a remaining portion of the video presentation is automatically regenerated or modified in real time such that subsequent content, avatar actions, or feedback messages are dynamically updated based on the user's input.

12 . The at least one non-transitory computer readable storage medium of claim 11 , wherein the respective avatar position is determined based on one or more of an avatar size, a type of the respective one of the plurality of data presentations, the insight location for the respective insight, an amount of free space in the reporting dashboard, or a location of free space in the reporting dashboard.

13 . The at least one non-transitory computer readable storage medium of claim 11 , wherein determining each of the plurality of insights comprises:

retrieving a plurality of predetermined statements based on a type of the respective one of the plurality of data presentations;

determining, for each of the plurality of predetermined statements, a confidence score representing a probability that the respective statement is true based on the therapy compliance data; and

selecting the respective statement having the highest confidence score.

14 . The at least one non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed by the processor, cause the computing system to perform further operations comprising:

assigning a weight to each respective insight of the plurality of insights; and determining an order of presentation in the animation sequence for the plurality of insights based on the weight assigned to each respective insight,

wherein the weight assigned to each respective insight of the plurality of insights is based on one or more of a condition of the patient, a change in the therapy compliance data for the patient, a relevance of the insight to the behavior or overall therapy compliance data for the patient, whether the insight reflects a positive, neutral or negative report, or a confidence score for the insight, wherein each respective feedback message is formulated based on one or more of a predetermined feedback message or natural language modeling applied to the insight.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2023
From: KRANS, JAN MARTIJN; SHIM, HEEREEN; LUKSENBURG, BAS; DE RUYTER, BORIS EMMANUEL RACHMUND
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 064691/0858 →
Priority Claims (1)
EP 22192450 · Aug 26, 2022 · regional
Continuity (1)
Related Publication 20240070952A1 · Feb 29, 2024
References Cited (14)
US 10586369B1 · Roche · 2020 [cited by examiner]
US 10943407B1 · Morgan · 2021 [cited by examiner]
US 11923058B2 · Dohrmann · 2024 [cited by examiner]
US 20150265209A1 · Zhang · 2015 [cited by examiner]
US 20160086500A1 · Kaleal, III · 2016 [cited by examiner]
US 20180166164A1 · Sysko · 2018 [cited by examiner]
US 20200335190A1 · Chung · 2020 [cited by examiner]
US 20210001174A1 · Kantorovich · 2021 [cited by examiner]
US 20210134426A1 · Mason · 2021 [cited by examiner]
US 20220367042A1 · Page · 2022 [cited by examiner]
US 20230172510A1 · Alford · 2023 [cited by examiner]
US 20240028106A1 · Elor · 2024 [cited by examiner]
WO 2021216881A1 · 2021 [cited by applicant]
WO 2022115040A1 · 2022 [cited by applicant]