IP Library Granted Patent US 12700162
Granted Patent B1
US 12700162 · App. 19/333,759 · Granted Aug 4, 2026

Systems and methods for creating interactive AI human avatars from multimodal data for legacy preservation, training, and entertainment

Inventor: Jacob Crowley (Clearwater, FL)
Assignee: MyAKH Inc
G06T13/40G06Q20/1235G06T13/205G10L13/00G10L19/0018G10L25/63G06Q2220/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12700162
App. No.
19/333,759
Granted
Aug 4, 2026
Kind
B1
Abstract

A system and method for generating interactive artificial intelligence (AI) avatars of real individuals using multimodal data. The invention includes a Data Ingestion Module that collects and processes user-specific data including photos, videos, audio recordings, written materials, and behavioral profiling. A Personality Modeling Engine uses this data to generate a dynamic personality model representing the individual's communication style, emotional tendencies, and decision-making behavior. A Voice & Likeness Synthesis Unit produces a voice model and photorealistic digital likeness, while an Interaction Module enables real-time communication with users through text, voice, video, or immersive environments. A Licensing & Usage Management System tracks avatar deployment and monetization, and a Rendering Engine animates the avatar in real time based on sentiment and contextual cues. The system enables applications in legacy preservation, education, entertainment, and commercial engagement while supporting privacy-first deployment and ethical licensing of digital likenesses.

Claims (46)

1 . A system for governing authorized creation, deployment, and use of an interactive artificial intelligence (AI) avatar of a real individual, the system comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the system to implement:

a Licensing & Usage Management System implemented by the one or more processors and configured to operate as an authorization and enforcement layer that, prior to any avatar synthesis, interaction, or the deployment, performs an identity-linked consent evaluation to determine whether a requesting entity is authorized to access or deploy the interactive artificial intelligence (AI) avatar of the real individual, the Licensing & Usage Management System comprising:

a consent registry storing one or more authorization records associated with the real individual or a designated rights holder, each authorization record specifying at least a permitted usage scope, permitted requesting entities, and temporal or conditional access constraints;

a license verification engine implemented by the one or more processors and configured to verify a license key and authenticate an identity of the requesting entity, prior to enabling any downstream avatar synthesis, interaction, or rendering operation;

an audit log implemented by the one or more processors and configured to persistently record each authorization determination, including the identity of the requesting entity, an authorization outcome, a timestamp, and a permitted or denied operation within the permitted usage scope, the audit log being queryable by the real individual or the designated rights holder;

a Data Ingestion Module implemented by the one or more processors and configured to receive and process multimodal data comprising one or more of photos, videos, audio recordings, written content, and behavioral profiling data, the Data Ingestion Module being operable only upon a prior positive authorization determination by the Licensing & Usage Management System;

a Personality Modeling Engine implemented by the one or more processors and configured to generate a personality model of the real individual based on the multimodal data, the personality model comprising personality traits, conversational style, decision-making patterns, and emotional tendencies;

a Voice & Likeness Synthesis Unit implemented by the one or more processors and configured to synthesize a digital voice and visual likeness of the real individual using the personality model and the multimodal data, the Voice & Likeness Synthesis Unit being operable only upon the prior positive authorization determination by the Licensing & Usage Management System;

an Interaction Module implemented by the one or more processors and configured to enable user interaction with the interactive artificial intelligence (AI) avatar via one or more interfaces selected from the group consisting of text-based interfaces, voice-based interfaces, video-based interfaces, and augmented or virtual reality environments, wherein each interaction session is initiated only after the Licensing & Usage Management System validates session-level authorization; and

a Rendering Engine implemented by the one or more processors and configured to animate the interactive artificial intelligence (AI) avatar in real time using sentiment-driven gestures, facial expressions, and synchronized speech output.

2 . The system of claim 1 , wherein the Data Ingestion Module further comprises preprocessing routines to normalize multimodal data for personality model training.

3 . The system of claim 1 , wherein the Personality Modeling Engine generates personality trait vectors based on psychological assessment frameworks including one or more Big Five personality dimensions or Myers-Briggs Type Indicators (MBTI).

4 . The system of claim 1 , wherein the Personality Modeling Engine applies trait injection algorithms to modify AI responses based on one or more personality trait vectors.

5 . The system of claim 1 , wherein the Voice & Likeness Synthesis Unit employs neural network-based voice cloning using the real individual's audio recordings.

6 . The system of claim 1 , wherein the Voice & Likeness Synthesis Unit generates a photorealistic avatar using green screen video footage and three-dimensional modeling.

7 . The system of claim 1 , wherein the Interaction Module includes a context memory engine configured to retrieve prior interactions for continuity in conversation.

8 . The system of claim 1 , wherein the Interaction Module includes a sentiment analysis engine that adjusts responses based on an emotional tone of a user.

9 . The system of claim 1 , wherein the Licensing & Usage Management System further comprises a blockchain-based smart contract layer configured to cryptographically enforce the authorization records stored in the consent registry, including automatic execution of compensation disbursement, license duration enforcement, and revocation upon detection of unauthorized access.

10 . The system of claim 1 , wherein the Licensing & Usage Management System supports monetization models selected from the group consisting of per-session access, subscription access, and non-fungible token-based (NFT) licensing, wherein each monetization model is conditioned on a prior positive authorization determination from the license verification engine and each transaction is recorded in the audit log.

11 . The system of claim 1 , wherein the Rendering Engine synchronizes lip movement of the AI avatar to the synthesized speech output.

12 . The system of claim 1 , wherein the Rendering Engine triggers avatar animations based on real-time analysis of user sentiment and conversational context.

13 . A method for creating and deploying an interactive artificial intelligence (AI) avatar of a real individual, the method comprising the steps of:

performing, by a Licensing & Usage Management System, an identity-linked consent evaluation prior to any avatar synthesis, interaction, or deployment, comprising: retrieving one or more authorization records from a consent registry associated with the real individual or a designated rights holder;

verifying a license key and authenticating an identity of a requesting entity against the authorization records to produce an authorization determination, including enforcing time-based access control constraints;

persistently recording the authorization determination in an audit log, an audit log entry comprising the identity of the requesting entity, an authorization outcome, a timestamp, and a permitted or denied operation within a permitted usage scope;

receiving, by a Data Ingestion Module, multimodal data associated with the real individual comprising photos, videos, audio recordings, written content, and behavioral profiling responses, only upon a prior positive authorization determination;

generating, by a Personality Modeling Engine, a personality model from the multimodal data, the personality model including quantified personality trait vectors;

synthesizing, by a Voice & Likeness Synthesis Unit, a voice model and a visual avatar representing the real individual based on the personality model, only upon the prior positive authorization determination;

enabling, by an Interaction Module, natural language interactions between users and the interactive artificial intelligence (AI) avatar via one or more supported platforms, wherein each interaction session is validated against the consent registry prior to initiation;

enforcing, by the Licensing & Usage Management System, ongoing compliance with the authorization records during each interaction session, including monitoring for usage scope violations and triggering revocation upon detection of unauthorized access; and

animating, by a Rendering Engine, the interactive artificial intelligence (AI) avatar using visual gestures, facial expressions, and synchronized voice responses based on sentiment analysis of an interaction.

14 . The method of claim 13 , further comprising the step of generating time- or milestone-triggered messages using the Interaction Module and storing them for conditional release, wherein the conditional release is governed by the authorization records in the consent registry.

15 . The method of claim 13 , wherein the Voice & Likeness Synthesis Unit uses three-dimensional photogrammetry to reconstruct the facial likeness of the real individual.

16 . The method of claim 13 , wherein the audit log is queryable through a rights holder dashboard that displays each authorization determination, session-level usage statistics, and enforcement outcomes including any revocations or access denials.

17 . The method of claim 13 , further comprising deploying an interactive artificial intelligence (AI) avatar system locally or in a cloud environment based on a privacy configuration.

18 . A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause an interactive artificial intelligence (AI) avatar system to:

perform an identity-linked consent evaluation via a Licensing & Usage Management System prior to any avatar synthesis, interaction, or deployment, including verifying a license key, authenticating an identity of a requesting entity against a consent registry storing authorization records associated with a real individual or a designated rights holder, enforcing time-based access control constraints, and

persistently recording each authorization determination, including the identity of the requesting entity, an authorization outcome, a timestamp, and a permitted or denied operation within a permitted usage scope, in a queryable audit log;

receive and normalize multimodal data via a Data Ingestion Module, only upon a prior positive authorization determination;

generate a behavioral personality model via a Personality Modeling Engine using at least one artificial intelligence algorithm;

synthesize a voice and likeness for the interactive artificial intelligence (AI) avatar via a Voice & Likeness Synthesis Unit using voice cloning and visual modeling, only upon the prior positive authorization determination;

present an interactive experience via an Interaction Module through one or more of text, audio, video, or virtual reality channels, wherein each interaction session is validated against the consent registry prior to initiation;

enforce ongoing compliance with the authorization records during each interaction session via the Licensing & Usage Management System, including monitoring for usage scope violations; and

render the interactive artificial intelligence (AI) avatar in real time via a Rendering Engine with adaptive visual and auditory outputs.

19 . The non-transitory computer-readable medium of claim 18 , wherein the instructions cause the Personality Modeling Engine to update the behavioral personality model continuously based on new user interactions, subject to ongoing positive authorization determinations.

20 . The non-transitory computer-readable medium of claim 18 , wherein the instructions cause the Rendering Engine to output visual content in formats compatible with augmented reality, virtual reality, and holographic displays.