Method and apparatus for providing collaboration between remote and on-site users of indirect augmented reality
View Patent ↗An apparatus for enabling provision of collaboration of remote and on-site users of indirect augmented reality may include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code may be configured, with the processor, to cause the apparatus to perform at least selecting a stored image including a virtual representation of a real world location based on position information and orientation information of a mobile terminal, causing provision of first visual content to be displayed at the mobile terminal based on the virtual representation, causing provision of second visual content to be displayed at a remote device based on the virtual representation, and enabling collaborative interaction between a user of the mobile terminal and a user of the remote device with respect to the first visual content and the second visual content. A corresponding method and computer program product are also provided.
1. An apparatus comprising at least one hardware processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus to at least:
select a stored image including a virtual representation of a real world location based on position information and orientation information of a mobile terminal;
cause provision of first visual content to be displayed at the mobile terminal based on the virtual representation;
cause provision of second visual content to be displayed at a remote device based on the virtual representation;
permit a view of one of the first or second visual content to be changed while causing a view of the other of the first or second visual content to remain unchanged such that the views of the first and second visual content that are displayed at the mobile terminal and the remote device, respectively, become different;
determine whether a threshold is satisfied, wherein the threshold relates to a change in orientation of one of the mobile terminal or the remote device upon which the view of the one of the first or second visual content is permitted to be changed while the view of the other of the first or second visual content has remained unchanged;
in an instance in which the threshold is satisfied, cause the view of the other of the first or second visual content to be updated; and
enable collaborative interaction between a user of the mobile terminal and a user of the remote device with respect to the first visual content and the second visual content.
2. The apparatus of claim 1 , wherein the memory and computer program code are configured to, with the processor, cause the apparatus to select the stored image based on position information and orientation information provided by the mobile terminal.
3. The apparatus of claim 1 , wherein the first visual content and the second visual content match.
4. The apparatus of claim 1 , wherein the first visual content and the second visual content share a common viewpoint, but have a different orientation.
5. The apparatus of claim 1 , wherein the first visual content has a different viewpoint than the second visual content.
6. The apparatus of claim 1 , wherein the memory and computer program code are further configured to, with the processor, cause the apparatus to enable provision of an annotation on the first visual content or the second visual content from the mobile terminal or the remote device.
7. The apparatus of claim 6 , wherein the memory and computer program code are configured to, with the processor, cause the apparatus to cause provision of the annotation by enabling provision of a virtual representation of the user of the remote device on a display of the mobile terminal or displaying a virtual representation of the user of the mobile terminal on a display of the remote device with the virtual representation of the user indicating the position and orientation of the user.
8. The apparatus of claim 1 , wherein the virtual representation is a panoramic view of the real world location.
9. The apparatus of claim 1 , wherein the apparatus is a mobile terminal and further comprises user interface circuitry configured to facilitate user control of at least some functions of the mobile terminal.
10. A method comprising:
selecting a stored image including a virtual representation of a real world location based on position information and orientation information of a mobile terminal indicative of a position and orientation, respectively, of the mobile terminal;
causing provision of first visual content to be displayed at the mobile terminal based on the virtual representation;
causing provision of second visual content to be displayed at a remote device based on the virtual representation;
permitting a view of one of the first or second visual content to be changed while causing a view of the other of the first or second visual content to remain unchanged such that the views of the first and second visual content that are displayed at the mobile terminal and the remote device, respectively, become different;
determining whether a threshold is satisfied, wherein the threshold relates to a change in orientation of one of the mobile terminal or the remote device upon which the view of the one of the first or second visual content is permitted to be changed while the view of the other of the first or second visual content has remained unchanged;
in an instance in which the threshold is satisfied, causing the view of the other of the first or second visual content to be updated; and
enabling collaborative interaction between a user of the mobile terminal and a user of the remote device with respect to the first visual content and the second visual content.
11. The method of claim 10 , wherein selecting the stored image comprises selecting the stored image based on position information and orientation information provided by the mobile terminal.
12. The method of claim 10 , wherein the first visual content and the second visual content match.
13. The method of claim 10 , wherein the first visual content and the second visual content share a common viewpoint, but have a different orientation.
14. The method of claim 10 , wherein the first visual content has a different viewpoint than the second visual content.
15. The method of claim 10 , wherein causing provision of the annotation comprises enabling provision of a virtual representation of the user of the remote device on a display of the mobile terminal or displaying a virtual representation of the user of the mobile terminal on a display of the remote device with the virtual representation of the user indicating the position and orientation of the user.
16. The method of claim 10 , wherein the virtual representation is a panoramic view of the real world location.
17. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instruction comprising program code instructions for:
selecting a stored image including a virtual representation of a real world location based on position information and orientation information of a mobile terminal indicative of a position and orientation, respectively, of the mobile terminal;
causing provision of first visual content to be displayed at the mobile terminal based on the virtual representation;
causing provision of second visual content to be displayed at a remote device based on the virtual representation;
permitting a view of one of the first or second visual content to be changed while causing a view of the other of the first or second visual content to remain unchanged such that the views of the first and second visual content that are displayed at the mobile terminal and the remote device, respectively, become different;
determining whether a threshold is satisfied, wherein the threshold relates to a change in orientation of one of the mobile terminal or the remote device upon which the view of the one of the first or second visual content is permitted to be changed while the view of the other of the first or second visual content has remained unchanged;
in an instance in which the threshold is satisfied, causing the view of the other of the first or second visual content to be updated; and
enabling collaborative interaction between a user of the mobile terminal and a user of the remote device with respect to the first visual content and the second visual content.
18. The computer program product of claim 17 , wherein the virtual representation is a panoramic view of the real world location.
19. The computer program product of claim 17 , wherein the first visual content and the second visual content match, wherein the first visual content and the second visual content share a common viewpoint, but have a different orientation, or wherein the first visual content has a different viewpoint than the second visual content.