Granted Patent B2

US 12,333,659 · App. 18/184,396 · Granted Jun 17, 2025

Inventor: Gustav Lo (Petoskey, MI)

G06T19/006G06F3/14G06V10/761G06V20/20G16H30/40

Abstract

Claims (44)

1. A method comprising:

receiving, at a processor, a plurality of reference markers that characterize a target individual;

selecting a first reference image file and a second reference image file from a database of reference image files;

displaying, on a display, a first graphical representation of the first reference image file and a second graphical representation of the second reference image file over a visual representation of the target individual, wherein the first reference image file is associated with a first anatomical layer, and wherein the second reference image file is associated with a second anatomical layer that is different than the first anatomical layer;

modifying, by the processor, a reference marker of the plurality of reference markers by moving the reference marker from an initial location to a new location;

determining a difference between the initial location and the new location; and

in response to determining the difference between the initial location and the new location, displaying, on the display, a modified visual representation of the target individual.

2. The method of claim 1 , further comprising modifying, by the processor, the first reference image file based on the modified reference marker.

3. The method of claim 2 , wherein displaying, on the display, the first graphical representation of the first reference image file over the visual representation of the target individual includes displaying the modified first reference image.

4. The method of claim 1 , wherein the first reference image file corresponds to at least one inner anatomical feature.

5. The method of claim 4 , wherein the at least one inner anatomical feature includes a bone, an organ, or fat.

6. The method of claim 1 , wherein selecting the first reference image file and the second reference image file from the database of reference image files comprises:

determining a relationship among the plurality of reference markers; and

identifying that, from among the reference image files, at least one of the first reference image file or the second reference image file most closely matches the relationship.

7. The method of claim 1 , further comprising:

modifying, by the processor, the second graphical representation of the second reference image file; and

updating, on the display, the modified visual representation of the target individual based on the modified second graphical representation of the second reference image file.

8. The method of claim 1 , further comprising displaying, on the display, the first graphical representation of the first reference image file over the first graphical representation of the second reference image file.

9. The method of claim 8 , wherein displaying the first graphical representation of the first reference image file over the second graphical representation of the second reference image file further comprises determining that the first anatomical layer associated with the first reference image file is closer to an outer anatomical layer than the second anatomical layer associated with the second reference image file.

10. The method of claim 1 , wherein each of the first graphical representation of the first reference image file and the second graphical representation of the second reference image file are selectably removable and selectably insertable by a user while viewing the modified visual representation of the target individual on the display.

11. The method of claim 1 , wherein modifying the reference marker includes positioning the reference marker at the new location based on a gesture from a user captured within an environment of the target individual.

12. A system comprising:

a display;

data processing hardware in communication with the display; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations including:

receiving a plurality of reference markers that characterize a target individual;

selecting a first reference image file and a second reference image file from a database of reference image files;

displaying, on the display, a first graphical representation of the first reference image file and a second graphical representation of the second reference image file over a visual representation of the target individual, wherein the first reference image file is associated with a first anatomical layer, and wherein the second reference image file is associated with a second anatomical layer that is different than the first anatomical layer;

modifying a reference marker of the plurality of reference markers by moving the reference marker from an initial location to a new location;

determining a difference between the initial location and the new location; and

in response to determining the difference between the initial location and the new location, displaying, on the display, a modified visual representation of the target individual.

13. The system of claim 12 , wherein the operations further comprise modifying the first reference image file based on the modified reference marker.

14. The system of claim 13 , wherein displaying, on the display, the first graphical representation of the first reference image file over the visual representation of the target individual includes displaying the modified first reference image.

15. The system of claim 12 , wherein the first reference image file corresponds to at least one inner anatomical feature.

16. The system of claim 15 , wherein the at least one inner anatomical feature includes a bone, an organ, or fat.

17. The system of claim 12 , wherein selecting the first reference image file and the second reference image file from the database of reference image files comprises:

determining a relationship among the plurality of reference markers; and

identifying that, from among the reference image files, at least one of the first reference image file or the second reference image file most closely matches the relationship.

18. The system of claim 12 , wherein the operations further comprise:

modifying the second graphical representation of the second reference image file; and

updating, on the display, the modified visual representation of the target individual based on the modified second graphical representation of the second reference image file.

19. The system of claim 12 , wherein the operations further comprise displaying the first graphical representation of the first reference image file over the first graphical representation of the second reference image file.

20. The system of claim 19 , wherein displaying the first graphical representation of the first reference image file over the second graphical representation of the second reference image file further comprises determining that the first anatomical layer associated with the first reference image file is closer to an outer anatomical layer than the second anatomical layer associated with the second reference image file.

21. The system of claim 12 , wherein each of the first graphical representation of the first reference image file and the second graphical representation of the second reference image file are selectably removable and selectably insertable by a user while viewing the modified visual representation of the target individual on the display.

Continuity (2)

References Cited (15)