Visualization of camera location in a real-time synchronized 3D mesh

1. A method for representing a capturing device location within a 3D mesh, comprising:

receiving, at a receiving device, a video stream and augmented reality (AR) data correlated to the video stream from the capturing device, the video stream and AR data representing an environment around the capturing device;

generating incrementally, from the video stream and AR data, a 3D mesh representation of the environment;

determining, from the video stream and AR data, a 3D location and a spatial orientation of the capturing device within the environment;

indicating, on a display of the 3D mesh with a graphic widget, the 3D location and spatial orientation of the capturing device within the 3D mesh, the spatial orientation indicating the rotation and tilt of the capturing device on each of an X, Y, and Z axis; and

updating, iteratively, the 3D location and spatial orientation of the capturing device within the 3D mesh.

2. The method of claim 1 , wherein determining the 3D location of the capturing device within the environment comprises:

determining a reference point within the environment that is in view of the capturing device;

determining a distance from the capturing device from the reference point; and

determining, from the AR data, the spatial orientation of the capturing device.

3. The method of claim 2 , wherein determining the distance from the capturing device from the reference point comprises directly measuring the distance.

4. The method of claim 2 , wherein determining the distance from the capturing device to the reference point comprises:

determining, from a first frame of the video stream, a first position of the reference point within the first frame;

determining, from a second frame of the video stream, a second position of the reference point within the second frame;

determining, from the AR data, a change in the spatial orientation of the capturing device from a time the first frame is captured to a time the second frame is captured; and

determining, from the change in the spatial orientation and first and second positions of the reference point, the distance from the capturing device to the reference point.

5. The method of claim 1 , further comprising modifying the graphic widget indicating the 3D location and the spatial orientation of the capturing device within the 3D mesh to reflect an uncertainty in the 3D location and the spatial orientation.

6. A non-transitory computer readable medium (CRM) comprising instructions that, when executed by an apparatus, cause the apparatus to:

receive a video stream and augmented reality (AR) data correlated to the video stream from a capturing device, the video stream and AR data representing an environment around the capturing device;

generate incrementally, from the video stream and AR data, a 3D mesh representation of the environment;

determine and update iteratively, from the video stream and AR data, a 3D location and a spatial orientation of the capturing device within the environment; and

indicate and update iteratively, on a display of the 3D mesh with a graphic widget, the 3D location and spatial orientation of the capturing device within the 3D mesh, the spatial orientation indicating the rotation and tilt of the capturing device on each of an X, Y, and Z axis.

7. The non-transitory CRM of claim 6 , wherein the instructions determine the 3D location of the capturing device by further causing the apparatus to:

determine a reference point within the environment that is in view of the capturing device;

determine a distance from the capturing device from the reference point; and

determine, from the AR data, the spatial orientation of the capturing device.

8. The non-transitory CRM of claim 7 , wherein the distance from the capturing device to the reference point is determined by direct measurement.

9. The non-transitory CRM of claim 7 , wherein the instructions cause the apparatus to determine the distance by causing the apparatus to:

determine, from a first frame of the video stream, a first position of the reference point within the first frame;

determine, from a second frame of the video stream, a second position of the reference point within the second frame;

determine, from the AR data, a change in the spatial orientation of the capturing device from a time the first frame is captured to a time the second frame is captured; and

determine, from the change in the spatial orientation and the first and second positions of the reference point, the distance to the reference point.

10. The CRM of claim 6 , wherein the instructions are to further cause the apparatus to modify the graphic widget that indicates the 3D location and the spatial orientation of the capturing device within the 3D mesh to reflect an uncertainty in the 3D location and the spatial orientation.

11. A system for representing a capturing device within a 3D mesh, comprising:

a display; and

a processor, wherein the processor is configured to:

generate, from a video stream and AR data, a 3D mesh of an environment represented by the video stream and AR data,

determine and iteratively update, from the video stream and AR data, a 3D location and a spatial orientation of one or more sensors supplying the video stream and AR data, and

display and iteratively update, on the display with a graphic widget, the 3D mesh and the 3D location and spatial orientation of the one or more sensors within the 3D mesh, the spatial orientation indicating the rotation and tilt of the one or more sensors on each of an X, Y, and Z axis.

12. The system of claim 11 , wherein the display, the processor, and the one or more sensors comprise a single apparatus.

13. The system of claim 11 , wherein the display and the processor are remote from the one or more sensors.

14. The system of claim 13 , wherein the one or more sensors comprise a mobile device, and the mobile device is in communication with the processor over a network.

15. The system of claim 11 , wherein the processor is further configured to:

determine, from a first frame of the video stream, a first position of the reference point within the first frame;

determine, from a second frame of the video stream, a second position of the reference point within the second frame; and

determine, from the AR data, a change in the spatial orientation of the capturing device from a time the first frame is captured to a time the second frame is captured.

16. The apparatus of claim 11 , wherein the processor is further configured to modify the graphic widget that indicates the 3D location and the spatial orientation of the one or more sensors within the 3D mesh to reflect an uncertainty in the 3D location and the spatial orientation.