Granted Patent B2

US 12,321,562 · App. 18/359,222 · Granted Jun 3, 2025

Inventors: Kevan Spencer Barsky (Los Angeles, CA); Joseph Bogacz (Perth, CA)

Assignee: Illuscio, Inc.

G06F3/04815G06F3/04817G06F3/0487G06F9/451

Abstract

Claims (113)

1. A method comprising:

receiving a first three-dimensional (“3D”) mesh model and a second 3D mesh model, wherein the first 3D mesh model comprises a first plurality of meshes defined in a first 3D space, wherein the second 3D mesh model comprises a second plurality of meshes defined in a second 3D space, and wherein the first 3D space is separate from the second 3D space;

selecting a subset of meshes from the second plurality of meshes in response to a first user input;

associating a rule to the subset of meshes in response to a second user input, wherein associating the rule comprises defining an action that invokes the rule and defining a function that is performed in response to the rule being invoked;

setting a first render position in the first 3D space of the first 3D mesh model and a second render position in the second 3D space of the second 3D mesh model;

presenting a first 3D GUI element and a second 3D GUI element in a single 3D graphical user interface (“GUI”),

wherein presenting the first 3D GUI element comprises:

determining a first set of meshes from the first plurality of meshes that are in a field-of-view created at the first render position;

mapping the first set of meshes to a visible surface of the first 3D GUI element; and

rendering the first set of meshes on the visible surface of the first 3D GUI element; and

wherein presenting the second 3D GUI element comprises:

determining a second set of meshes from the second plurality of meshes that are in a field-of-view created at the second render position;

mapping the second set of meshes to a visible surface of the second 3D GUI element; and

rendering the second set of meshes on the visible surface of the second 3D GUI element;

detecting an input that is applied to the second GUI element;

mapping the input from the second GUI element to the second 3D space of the second 3D mesh model, wherein mapping the input comprises changing from the second render position to a third render position in the second 3D space without changing the first render position in the first 3D space based on a direction and magnitude with which the input is applied to the second GUI element;

mapping a third set of meshes from the second plurality of meshes on the visible surface of the second 3D GUI element in response to the third set of meshes coming into an updated field-of-view in the second 3D space as a result of moving from the second render position to the third render position; and

updating the second 3D GUI element based on a visualization that is created from rendering the third set of meshes that are mapped to the visible surface of the second 3D GUI element.

2. The method of claim 1 further comprising:

tracking a position or an orientation of a device that displays the 3D GUI;

determining that the device moves from a first position or a first orientation to a second position or a second orientation in response to said tracking;

changing a last render position in the first 3D space and the second 3D space according to the device moving from the first position or the first orientation to the second position or the second orientation;

updating a visualization of the first 3D GUI element and the second 3D GUI element based on different sets of meshes that come into view after changing the last render position in the first 3D space and the second 3D space.

3. The method of claim 1 further comprising:

tracking an eye gaze of a user; and

wherein detecting the input comprises:

determining that the eye gaze changes from a first position to a second position.

4. The method of claim 1 further comprising:

animating the first and second 3D GUI elements by presenting different sets of meshes that come into view in response to an input that changes a position from which to render the 3D GUI.

5. The method of claim 1 ,

wherein detecting the input comprises determining a change to a user line-of-sight; and

wherein updating the second 3D GUI element comprises aligning a visualization of the second 3D GUI element according to the change to the user line-of-sight.

6. The method of claim 1 further comprising:

detecting a first input that is applied to the second 3D GUI element when the second 3D GUI element is rendered with the second set of meshes from the second render position;

determining a first rule that is associated with the second set of meshes;

executing a first action based on the first rule that is associated with the second set of meshes and the first rule linking execution of the first action to an application of the first input on one or more of the second set of meshes.

7. The method of claim 6 further comprising:

detecting a second input that is applied to the second 3D GUI element when the second 3D GUI element is rendered with the third set of meshes;

selecting a second rule that is associated with the third set of meshes; and

executing a second action based on the second rule that is associated with the third set of meshes and the second rule linking execution of the second action to an application of the second input on one or more of the third set of meshes.

8. The method of claim 1 further comprising:

presenting the 3D GUI on a plurality of devices; and

synchronizing the 3D GUI across the plurality of devices in response to detecting the input from a single device of the plurality of devices, wherein synchronizing the 3D GUI comprises updating a visualization of the second 3D GUI element with the third set of meshes for each device of the plurality of devices.

9. The method of claim 1 further comprising:

performing the function in response to a second input being applied to one or more meshes of the third set of meshes presented by the second 3D GUI element and the one or more meshes corresponding to the subset of meshes that is associated with the rule that links the second input to the function; and

performing a different second function in response to a third input being applied to one or more meshes of the third set of meshes presented by the second 3D GUI element and the rule linking the third input to the second function.

10. The method of claim 1 further comprising:

presenting the 3D GUI on a plurality of devices;

detecting a second input from a particular device of the plurality of devices that rotates the first 3D GUI element; and

synchronizing the 3D GUI across the plurality of devices in response to detecting the second input, wherein synchronizing the 3D GUI comprises:

changing from the first render position to a fourth render position in the first 3D space of the first 3D mesh model; and

rotating the first 3D GUI element across the plurality of devices to present different meshes from the first plurality of meshes that come into view in response to changing from the first render position to the fourth render position.

11. The method of claim 1 further comprising:

receiving a notification from an application that is accessed using the first 3D GUI element; and

updating a visualization of the first 3D GUI element in response to receiving the notification by changing the first render position in the first 3D space to a fourth render position that brings a set of the first plurality of meshes associated with the notification into view.

12. A system comprising:

one or more hardware processors configured to:

receive a first three-dimensional (“3D”) mesh model, wherein the first 3D mesh model comprises a first plurality of meshes defined in a first 3D space, wherein the second 3D mesh model comprises a second plurality of meshes defined in a second 3D space, and wherein the first 3D space is separate from the second 3D space;

select a subset of meshes from the second plurality of meshes in response to a first user input;

associate a rule to the subset of meshes in response to a second user input, wherein associating the rule comprises defining an action that invokes the rule and defining a function that is performed in response to the rule being invoked;

set a first render position in the first 3D space of the first 3D mesh model and a second render position in the second 3D space of the second 3D mesh model;

present a first 3D GUI element and a second 3D GUI element in a single 3D graphical user interface (“GUI”),

wherein presenting the first 3D GUI element comprises:

determining a first set of meshes from the first plurality of meshes that are in a field-of-view created at the first render position;

mapping the first set of meshes to a visible surface of the first 3D GUI element; and

rendering the first set of meshes on the visible surface of the first 3D GUI element; and

wherein presenting the second 3D GUI element comprises:

determining a second set of meshes from the second plurality of meshes that are in a field-of-view created at the second render position;

mapping the second set of meshes to a visible surface of the second 3D GUI element; and

rendering the second set of meshes on the visible surface of the second 3D GUI element;

detect an input that is applied to the second GUI element;

map the input from the second GUI element to the second 3D space of the second 3D mesh model, wherein mapping the input comprises changing from the second render position to a third render position in the second 3D space without changing the first render position in the first 3D space based on a direction and magnitude with which the input is applied to the second GUI element;

map present the second 3D GUI element based on a third set of meshes from the second plurality of meshes on the visible surface of the second 3D GUI element in response to the third set of meshes coming into an updated field-of-view in the second 3D space as a result of moving from the second render position to the third render position; and

update the second 3D GUI element based on a visualization that is created from rendering the third set of meshes that are mapped to the visible surface of the second 3D GUI element.

13. The system of claim 12 , wherein the one or more hardware processors are configured to:

track a position or an orientation of a device that displays the 3D GUI;

determine that the device moves from a first position or a first orientation to a second position or a second orientation in response to said tracking;

change a last render position in the first 3D space and the second 3D space according to the device moving from the first position or the first orientation to the second position or the second orientation;

update a visualization of the first 3D GUI element and the second 3D GUI element based on different sets of meshes that come into view after changing the last render position in the first 3D space and the second 3D space.

14. The system of claim 12 , wherein the one or more hardware processors are configured to:

track an eye gaze of a user; and

wherein detecting the input comprises:

determining that the eye gaze changes from a first position to a second position.

15. The system of claim 12 ,

wherein detecting the input comprises determining a change to a user line-of-sight; and

wherein updating the second 3D GUI element comprises aligning a visualization of the second 3D GUI element according to the change to the user line-of-sight.

16. The system of claim 12 , wherein the one or more hardware processors are configured to:

present the 3D GUI on a plurality of devices;

detect a second input from a particular device of the plurality of devices that rotates the first 3D GUI element; and

synchronize the 3D GUI across the plurality of devices in response to detecting the second input, wherein synchronizing the 3D GUI comprises:

changing from the first render position to a fourth render position in the first 3D space of the first 3D mesh model; and

rotating the first 3D GUI element across the plurality of devices to present different meshes from the first plurality of meshes that come into view in response to changing from the first render position to the fourth render position.

17. The system of claim 12 , wherein the one or more hardware processors are configured to:

receive a notification from an application that is accessed using the first 3D GUI element; and

update a visualization of the first 3D GUI element in response to receiving the notification by changing the first render position in the first 3D space to a fourth render position that brings a set of the first plurality of meshes associated with the notification into view.

18. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a three-dimensional (“3D”) graphical user interface (“GUI”) system, cause the 3D GUI system to perform operations comprising:

receiving a first 3D mesh model and a second 3D mesh model, wherein the first 3D mesh model comprises a first plurality of meshes defined in a first 3D space, wherein the second 3D mesh model comprises a second plurality of meshes defined in a second 3D space, and wherein the first 3D space is separate from the second 3D space;

selecting a subset of meshes from the second plurality of meshes in response to a first user input;

associating a rule to the subset of meshes in response to a second user input, wherein associating the rule comprises defining an action that invokes the rule and defining a function that is performed in response to the rule being invoked;

setting a first render position in the first 3D space of the first 3D mesh model and a second render position in the second 3D space of the second 3D mesh model;

presenting a first 3D GUI element and a second 3D GUI element in a single 3D graphical user interface (“GUI”),

wherein presenting the first 3D GUI element comprises:

determining a first set of meshes from the first plurality of meshes that are in a field-of-view created at the first render position;

mapping the first set of meshes to a visible surface of the first 3D GUI element; and

rendering the first set of meshes on the visible surface of the first 3D GUI element; and

wherein presenting the second 3D GUI element comprises:

determining a second set of meshes from the second plurality of meshes that are in a field-of-view created at the second render position;

mapping the second set of meshes to a visible surface of the second 3D GUI element; and

rendering the second set of meshes on the visible surface of the second 3D GUI element;

detecting an input that is applied to the second GUI element;

mapping the input from the second GUI element to the second 3D space of the second 3D mesh model, wherein mapping the input comprises changing from the second render position to a third render position in the second 3D space without changing the first render position in the first 3D space based on a direction and magnitude with which the input is applied to the second GUI element;

mapping a third set of meshes from the second plurality of meshes on the visible surface of the second 3D GUI element in response to the third set of meshes coming into an updated field-of-view in the second 3D space as a result of moving from the second render position to the third render position; and

updating the second 3D GUI element based on a visualization that is created from rendering the third set of meshes that are mapped to the visible surface of the second 3D GUI element.

Assignments (2)

Continuity (3)

References Cited (80)