System and method for rendering in accordance with location of virtual objects in real-time

1. A method for persistent association of a graphic overlay with a first virtual object in a displayable environment, the method comprising:

receiving a first three-dimensional coordinate of the first virtual object in the displayable environment;

determining a three-dimensional coordinate of the graphic overlay in accordance with the first three-dimensional coordinate of the first virtual object, wherein the determining the three-dimensional coordinate of the graphic overlay applies positional rules so that the graphic overlay does not obscure both the first virtual object and one or more other objects in the displayable environment;

tracking a movement of the first virtual object in the displayable environment by receiving one or more second three-dimensional coordinates of the first virtual object from a remote virtual simulator;

modifying the three-dimensional coordinate of the graphic overlay in accordance with the one or more second three-dimensional coordinates of the first virtual object, wherein modifying the three-dimensional coordinate of the graphic overlay includes repositioning the graphic overlay to avoid obscuring the first virtual object and the one or more other objects in the displayable environment; and

rendering the graphic overlay and the displayable environment for displaying on a display.

2. The method of claim 1 further comprising:

receiving a first three-dimensional coordinate of a real object in the displayable environment further-modifying the three-dimensional coordinate of the graphic overlay in accordance with the first three-dimensional coordinate of the real object.

3. The method of claim 2 , wherein the real object is a static object, and the one or more other_objects are virtual objects.

4. The method of claim 1 further comprising:

receiving a first three-dimensional coordinate of a second virtual object in the displayable environment further modifying the three-dimensional coordinate of the graphic overlay in accordance with the first three-dimensional coordinate of the second virtual object.

5. The method of claim 1 , wherein the determining the three-dimensional coordinate of the graphic overlay further uses metadata of the first virtual object.

6. The method of claim 5 , wherein the metadata includes translation data.

7. The method of claim 5 , wherein the metadata includes motion data.

8. The method of claim 5 , wherein the metadata includes priority data.

9. The method of claim 1 , wherein the graphic overlay comprises text window.

10. The method of claim 1 , wherein the graphic overlay comprises a graphical arrow.

11. A rendering device for rendering a displayable environment with persistent association of a graphic overlay with a first virtual object, the rendering device comprising:

a processor configured to:

receive a first three-dimensional coordinate of the first virtual object in the displayable environment;

determine a three-dimensional coordinate of the graphic overlay in accordance with the first three-dimensional coordinate of the first virtual object, wherein the three-dimensional coordinate of the graphic overlay is determined using positional rules so that the graphic overlay does not obscure both the first virtual object and one or more other objects in the displayable environment;

track a movement of the first virtual object in the displayable environment by receiving one or more second three-dimensional coordinates of the first virtual object from a remote-virtual simulator;

modify the three-dimensional coordinate of the graphic overlay in accordance with the one or more second three-dimensional coordinates of the first virtual object, wherein modifying the three-dimensional coordinate of the graphic overlay includes repositioning the graphic overlay to avoid obscuring the first virtual object and the one or more other objects in the displayable environment; and

render the graphic overlay and displayable environment on a display.

12. The rendering device of claim 11 , wherein the processor is further configured to:

receive a first three-dimensional coordinate of a real object in the displayable environment further modifying the three-dimensional coordinate of the graphic overlay in accordance with the first three-dimensional coordinate of the real object.

13. The rendering device of claim 12 , wherein the real object is a static object, and the one or more other objects are virtual objects.

14. The rendering device of claim 11 , wherein the processor is further configured to:

receive a first three-dimensional coordinate of a second virtual object in the displayable environment further modifying the three-dimensional coordinate of the graphic overlay in accordance with the first three-dimensional coordinate of the second virtual object.

15. The rendering device of claim 11 , wherein the processor is further configured to determine the three-dimensional coordinate of the graphic overlay by using metadata of the first virtual object.

16. The rendering device of claim 15 , wherein the metadata includes translation data.

17. The rendering device of claim 15 , wherein the metadata includes motion data.

18. The rendering device of claim 15 , wherein the metadata includes priority data.

19. The rendering device of claim 11 , wherein the graphic overlay comprises a text window.

20. The rendering device of claim 11 , wherein the graphic overlay comprises a graphical arrow.