Methods and apparatus for augmented reality applications

1. A method of interaction using augmented reality, the method comprising:

capturing, by a local user, a live video image using an imaging device;

generating first augmented reality (AR) coordinates corresponding to the live video image;

generating, by the local user, first user-generated annotations;

registering the first user-generated annotations to the live video image;

selecting, by the local user, an expert among a plurality of experts as a remote user, each expert among the plurality of experts being associated with metadata describing one or more attributes of the respective expert;

transmitting, by the local user, the first AR coordinates, first user-generated annotations, and live video image to the remote user;

receiving, by the local user, second user-generated annotations and second AR coordinates from the remote user; and

viewing, by the local user, the generated first user-generated annotations and received second user-generated annotations registered to the live video image according to the second AR coordinates,

wherein the viewing is performed on a device chosen from a group including a tablet, a mobile phone, a laptop computer, a head-mounted display, and a virtual-reality display.

2. The method of claim 1 , wherein each step of the method is repeated for each task in a predefined workflow.

3. The method of claim 2 , further comprising:

analyzing the live video image to detect completion of a task in the predefined workflow; and

analyzing the live video image to detect a deviation from an expected state in the predefined workflow.

4. The method of claim 1 , further comprising recording metadata of the interaction.

5. The method of claim 4 , wherein the recorded metadata includes one or more of identities of the remote user and the local user, an elapsed time for completion of a task in the AR interaction, measurements of values related to the task in the AR interaction, check list items associated with the task in the AR interaction, and screenshots of the AR interaction.

6. The method of claim 1 , wherein the receiving and viewing operations are performed in real time or in near-real time.

7. The method of claim 1 , further comprising transmitting between the local user and the remote user audio, video, or other data.

8. The method of claim 1 , wherein the received second user-generated annotations are registered to a position in the live video image.

9. The method of claim 1 , wherein the remote user controls a level detail captured by the imaging device.

10. The method of claim 1 , further comprising:

transmitting, by the local user, the first AR coordinates, first user-generated annotations, and the live video image to a second remote user; and

receiving, by the local user, third user-generated annotations and third AR coordinates from the second remote user.

11. The method of claim 1 , further comprising:

receiving, from the remote user, an identification of an object depicted in the live video image, wherein the second user-generated annotations comprise information about the identified object.

12. The method of claim 1 , further comprising:

receiving, from the remote user, an indication of automatically detected changes in the scene depicted in the live video image, the automatically detected changes in the scene corresponding to predetermined conditions, wherein the automatically detected changes in the scene include one or more of: addition or removal of a portion of an assembly depicted in the live video image, damage to an object depicted in the live video image, one or more sensor values matching or deviating from predetermined expected values, or a completed assembly matching a predetermined configuration.

13. A method of interaction using augmented reality, the method comprising:

capturing, by a local user, a live video image using an imaging device;

generating augmented reality (AR) coordinates corresponding to the live video image;

updating a scene view according to the generated AR coordinates;

encoding the live video image;

loading first 3D object information from external storage;

combining the AR coordinates, first 3D object information and encoded live video image;

selecting, by the local user, an expert among a plurality of experts as a remote user, each expert among the plurality of experts being associated with metadata describing one or more attributes of the respective expert;

transmitting, by the local user, the combined data to the remote user;

receiving, from the remote user, updated combined data including second 3D object information; and

viewing, by the local user, the updated combined data on a device chosen from a group including a tablet, a mobile phone, a laptop computer, a head-mounted display, and a virtual-reality display.

14. The method of claim 13 wherein each step of the method is repeated for each task in a predefined workflow.

15. The method of claim 14 , further comprising

analyzing the live video image to detect completion of a task in the predefined workflow; and

analyzing the live video image to detect a deviation from an expected state in the predefined workflow.

16. The method of claim 13 , further comprising recording metadata of the interaction.

17. The method of claim 16 , wherein the recorded metadata includes one or more of identities of the remote user and the local user, an elapsed time for completion of a task in the AR interaction, measurements of values related to the task in the AR interaction, check list items associated with the task in the AR interaction, and screenshots of the AR interaction.

18. The method of claim 13 , further comprising transmitting between the local user and the remote user audio, video, or other data.

19. A method of interaction using augmented reality, the method comprising:

sending, to a remote user by a local user, metadata describing one or more attributes of the local user;

receiving, from the remote user, an indication that the local user is selected as an expert by the remote user;

receiving, by the local user, combined augmented reality (AR) coordinates, information of first 3D objects, and an encoded live video frame from the remote user;

updating a background image based on the encoded live video frame;

updating a scene view according to the AR coordinates;

updating positions and existence of the first 3D objects;

loading 3D content from external storage;

creating, by the local user, a first updated rendered view by combining the loaded 3D content and the background image;

viewing, by the local user, the updated rendered view on a device chosen from a group including a tablet, a mobile phone, a laptop computer, a head-mounted display, and a virtual-reality display;

generating, by the local user, second 3D object information;

creating, by the local user, a second updated rendered view by combining the second 3D object information and the background image; and

returning, by the local user, the second updated rendered view to the remote user.

20. The method of claim 19 , wherein each step of the method is repeated for each task in a predefined workflow.

21. The method of claim 20 , further comprising

analyzing the encoded live video frame to detect completion of a task in the predefined workflow; and

analyzing the encoded live video frame to detect a deviation from an expected state in the predefined workflow.

22. The method of claim 19 , further comprising recording metadata of the interaction.

23. The method of claim 22 , wherein the recorded metadata includes one or more of identities of the remote user and the local user, an elapsed time for completion of a task in the AR interaction, measurements of values related to the task in the AR interaction, check list items associated with the task in the AR interaction, and screenshots of the AR interaction.

24. The method of claim 19 , wherein the operations of the method are performed in real time or in near-real time.

25. The method of claim 19 , further comprising transmitting between the local user and the remote user audio, video, or other data.