Apparatus and method for supporting interactive augmented reality functionalities
Augmented reality (AR) telepresence systems and methods are disclosed for obtaining a 3D model of a physical location from a 3D-capture system comprising one or more 3D depth sensors disposed throughout the physical location, generating a truncated 3D model of the physical location, the truncated 3D model corresponding to the intersection of the generated 3D model and a field of view of a user terminal camera at the physical location, and transmitting the truncated 3D model to a remote location.
1. A method comprising:
obtaining a 3D model of a physical location associated with a first user;
generating, from the 3D model, a truncated 3D model of the physical location, the truncated 3D model corresponding to an intersection of the 3D model and a field of view of a camera of a moveable camera device at the physical location; and
using the truncated 3D model as a basis for a communication session between the first user and a second user at a remote location.
2. The method of claim 1 , wherein the 3D model of the physical location is obtained from one or more 3D sensors located at the physical location.
3. The method of claim 1 , further comprising transmitting the truncated 3D model to the remote location.
4. The method of claim 1 , wherein the 3D model of the physical location is obtained from a server.
5. The method of claim 1 , further comprising, before generating the truncated 3D model, repositioning the moveable camera device by the user.
6. The method of claim 5 , further comprising, during repositioning the moveable camera device, displaying video captured by the moveable camera device to the user.
7. The method of claim 1 , further comprising, in response to repositioning of the moveable camera device during the communication session:
generating, from the 3D model, an updated truncated 3D model of the physical location, the updated truncated 3D model corresponding to the intersection of the 3D model and an updated field of view of the camera of the repositioned moveable camera device.
8. The method of claim 1 , wherein the communication session includes placement of a virtual object in the truncated 3D model by at least one of the first user and the second user.
9. The method of claim 1 , wherein the communication session is a collaborative communication session.
10. An apparatus comprising a processor and a non-transitory computer-readable medium storing instructions operative to perform at least:
obtaining a 3D model of a physical location associated with a first user;
generating, from the 3D model, a truncated 3D model of the physical location, the truncated 3D model corresponding to an intersection of the 3D model and a field of view of a camera of a moveable camera device at the physical location; and
using the truncated 3D model as a basis for a communication session between the first user and a second user at a remote location.
11. The apparatus of claim 10 , wherein the 3D model of the physical location is obtained from one or more 3D sensors located at the physical location.
12. The apparatus of claim 10 , wherein the instructions are further operative to transmit the truncated 3D model to the remote location.
13. The apparatus of claim 10 , wherein the 3D model of the physical location is obtained from a server.
14. The apparatus of claim 10 , wherein the instructions are further operative to perform, before generating the truncated 3D model, repositioning the moveable camera device by the user.
15. The apparatus of claim 14 , wherein the instructions are further operative to perform, during repositioning the moveable camera device, displaying video captured by the moveable camera device to the user.
16. The apparatus of claim 10 , wherein the instructions are further operative to perform, in response to repositioning of the moveable camera device during the communication session:
generating, from the 3D model, an updated truncated 3D model of the physical location, the updated truncated 3D model corresponding to the intersection of the 3D model and an updated field of view of the camera of the repositioned moveable camera device.
17. The apparatus of claim 10 , wherein the communication session includes placement of a virtual object in the truncated 3D model by at least one of the first user and the second user.
18. The apparatus of claim 10 , wherein the communication session is a collaborative communication session.
19. A method comprising:
obtaining a 3D model of a physical location associated with a first user;
generating, from the 3D model, a truncated 3D model of the physical location, the truncated 3D model corresponding to an intersection of the 3D model and a field of view of a camera of a moveable camera device; and
transmitting the truncated 3D model to a remote location.
20. The method of claim 19 , further comprising, before generating the truncated 3D model:
repositioning the moveable camera device by the user; and
during repositioning the moveable camera device, displaying video captured by the moveable camera device to the user.