Systems and methods for augmented reality (AR) artificial intelligence (AI)-constructed, interactive three-dimensional (3D) human body modeling
An Augmented Reality (AR) and Artificial Intelligence (AI)-constructed, interactive three-dimensional (3D) human body modeling system that analyzes data descriptive of medical records and generates an interactive 3D human body model output via AR. The 3D human body model may have body part-specific interactive medical record data embedded therein, permitting a user to quickly, easily, and intuitively navigate the model to identify relevant medical status for the modelled individual.
1 . A system for Artificial Intelligence (AI) construction of an interactive three-dimensional (3D) human body model, comprising:
a 3D human body model controller comprising a plurality of electronic processing devices;
an Augmented Realty (AR) device in communication with the 3D human body model controller, the AR device comprising an onboard processing device, an AR output device in communication with the onboard processing device, and an onboard non-transitory memory device in communication with the onboard processing device, the onboard non-transitory memory device storing a 3D human body model rendering program; and
a non-transitory data storage device in communication with the 3D human body model controller, the non-transitory data storage device storing a medical record Large Language Model (LLM);
and wherein at least one of the non-transitory memory device and the non-transitory data storage device store instructions that when executed by at least one of the 3D human body model controller and the AR device, result in:
identifying, by the 3D human body model controller, a set of medical records for an individual;
computing, by an execution of the medical record LLM by the 3D human body model controller, and by utilizing the set of medical records for the individual as input, a plurality of medical record data elements descriptive of discrete medical record events for the individual;
populating, by an execution of the medical record LLM by the 3D human body model controller, and utilizing the plurality of medical record data elements, a 3D human body model medical record data structure that maps each discrete medical record event to a specific portion of a body of the individual;
receiving, by the onboard processing device of the AR device, a request to generate a 3D human body model representing the individual;
generating, by an execution of the 3D human body model rendering program by the onboard processing device of the AR device, and utilizing the populated 3D human body model medical record data structure, a 3D human body model representing the individual;
outputting, via the AR output device, a representation of the 3D human body model disposed in an AR environment in a field of view of the AR device, wherein the outputting of the representation of the 3D human body model disposed in the AR environment in the field of view of the AR device, comprises:
(a) identifying, by an execution of the medical record LLM by the 3D human body model controller, and based on a first scaled medical image, a length and a width of the first body part of the individual;
(b) selecting, by the onboard processing device of the AR device, a default 3D human body model defining a default length and width for a 3D human body model body part corresponding to the first body part; and
(c) scaling, by an execution of the 3D human body model rendering program by the onboard processing device of the AR device and based on the length and the width of the first body part of the individual, the default length and width for the 3D human body model body part corresponding to the first body part;
outputting, via the AR output device and at an AR location corresponding to a first body part of the individual, a representation of a first one of the discrete medical record events for the individual;
receiving, by the onboard processing device of the AR device, an indication of a selection of the first body part of the individual; and
outputting, via the AR output device and in response to the receiving of the indication of the selection of the first body part of the individual, a representation of a first one of the plurality of medical record data elements corresponding to the first one of the discrete medical record events for the individual, wherein
(i) the first one of the plurality of medical record data elements corresponding to the first one of the discrete medical record events for the individual comprises a second scaled medical image of the first body part of the individual, and
(ii) the outputting of the representation of the first one of the plurality of medical record data elements corresponding to the first one of the discrete medical record events for the individual comprises superimposing the second scaled medical image on the 3D human body model at the AR location corresponding to the first body part of the individual and in place of a corresponding portion of a surface of the 3D human body model.
2 . The system of claim 1 , wherein the instructions, when executed by the at least one of the 3D human body model controller and the AR device, further result in:
outputting, via the AR output device, and at an AR location adjacent to the 3D human body model, a webpage interface.
3 . The system of claim 2 , wherein the webpage interface comprises an interface of an insurance claim evaluation tool.
4 . The system of claim 1 , wherein the representation of the 3D human body model disposed in the AR environment in the field of view of the AR device, comprises: (i) a 3D human body model height and, for each of a plurality of second body parts: (ii) a body part length and (iii) a body part width.
5 . The system of claim 4 , wherein the outputting of the 3D human body model disposed in the AR environment in the field of view of the AR device, comprises:
identifying, by the onboard processing device of the AR device, and based on data stored in the populated 3D human body model medical record data structure, a height and a weight of the individual;
selecting, by the onboard processing device of the AR device, a default 3D human body model defining a default body model height and a default body part length and body part width for each of the plurality of body parts; and
scaling, by an execution of the 3D human body model rendering program by the onboard processing device of the AR device and based on the height and weight of the individual, the default body model height and the default body part length and body part width for each of the plurality of second body parts.
6 . The system of claim 5 , wherein the plurality of second body parts comprises at least one arm, at least on leg, and a torso.
7 . The system of claim 1 , wherein the first one of the discrete medical record events for the individual occurred at a first time and the representation of the 3D human body model disposed in the AR environment in the field of view of the AR device comprises a representation of the body of the individual at the first time, wherein the instructions, when executed by the at least one of the 3D human body model controller and the AR device, further result in:
outputting, via the AR output device, and at an AR location adjacent to the 3D human body model, a timeline interface comprising representation of the first time and a second time;
receiving, by the onboard processing device of the AR device, an indication of a selection of the second time; and
outputting, via the AR output device and at an AR location corresponding to a second body part of the individual, a representation of a second one of the discrete medical record events for the individual that occurred at the second time.
8 . The system of claim 7 , wherein the outputting of the 3D human body model disposed in the AR environment in the field of view of the AR device, comprises:
identifying, by an execution of the medical record LLM by the 3D human body model controller, and based on data stored in the populated 3D human body model medical record data structure, a first length and a first width of the first body part of the individual at the first time;
outputting, via the AR output device and at an AR location corresponding to the first body part of the individual, a first representation of the first body part comprising the first length and the first width of the first body part of the individual at the first time;
identifying, by an execution of the medical record LLM by the 3D human body model controller, and based on data stored in the populated 3D human body model medical record data structure, a second length and a second width of the first body part of the individual at the second time;
modifying, by an execution of the 3D human body model rendering program by the onboard processing device of the AR device and based on the second length and the second width of the first body part of the individual at the second time, the first representation of the first body part; and
outputting, via the AR output device and at an AR location corresponding to the first body part of the individual and in response to the receiving of the indication of the selection of the second time, a second representation of the first body part comprising the second length and the second width of the first body part of the individual at the second time.
9 . The system of claim 1 , wherein the 3D human body model comprises a wireframe avatar representing the individual and wherein the AR device comprises an AR headset.
10 . The system of claim 1 , wherein the generating is conducted in response to the receiving of the request to generate the 3D human body model representing the individual.
11 . The system of claim 1 , wherein the non-transitory memory device and the non-transitory data storage device comprise different devices.
12 . The system of claim 1 , wherein the identifying comprises:
receiving, by the 3D human body model controller and from a user device, and indication of an identity of the individual.
13 . The system of claim 1 , wherein the set of medical records for the individual comprises a plurality of image, semi-structured data, and text files.
14 . The system of claim 13 , wherein the instructions, when executed by the at least one of the 3D human body model controller and the AR device, further result in:
converting, by the 3D human body model controller, the set of medical records for an individual into text format.
15 . The system of claim 14 , wherein the converting comprises executing an OCR algorithm.
16 . The system of claim 1 , wherein the medical record LLM comprises an LLM trained to recognize and categorize medical data represented in textual form.
17 . The system of claim 1 , wherein the medical record LLM comprises an LLM trained to recognize and categorize medical data represented in image form.
18 . The system of claim 1 , wherein the superimposing of the second scaled medical image on the 3D human body model at the AR location corresponding to the first body part of the individual comprises mapping the second scaled medical image to the 3D human body model in place of the corresponding portion of the surface of the 3D human body model.
19 . The system of claim 1 , wherein the superimposing of the second scaled medical image on the 3D human body model at the AR location corresponding to the first body part of the individual comprises stitching the second scaled medical image to the 3D human body model in place of the corresponding portion of the surface of the 3D human body model.