Generating and presenting third-party augmented reality content
An online system generates and stores virtual models of physical spaces. These virtual models represent physical objects within the physical spaces through 3D representations of those objects. A content development system can request a virtual model associated with a physical space and modify the virtual model to include virtual objects. The content development system transmits the modified virtual model to be stored by the online system. A client device requests the modified virtual model from the online system when the client device is posed near the physical space. The client device uses the modified virtual model to display a modified video feed that displays the virtual content generated by the content development system as an augmented reality experience.
1 . A computer-implemented method comprising:
receiving, at an online system from a third-party system, a request for a virtual model of a physical space, wherein the virtual model comprises:
an origin point; and
a three-dimensional representation of a physical object within the physical space, wherein the three-dimensional representation is located within the virtual model relative to the origin point;
transmitting, by the online system, the virtual model to the third-party system;
receiving, at the online system from the third-party system, a modified virtual model, wherein the modified virtual model comprises a virtual object added to the virtual model by the third-party system, wherein the virtual object is located within the virtual model relative to the origin point;
transmitting, by the online system, the modified virtual model to a client device;
receiving, at the client device from the online system, the modified virtual model;
obtaining pose data of the client device, wherein the pose data comprises sensor data describing a pose of the client device;
obtaining a video feed captured by a camera of the client device;
identifying a physical pose of the client device within the physical space based on the pose data and the video feed;
identifying a virtual pose within the modified virtual model of the client device corresponding to the physical pose, wherein the virtual pose is identified relative to the origin point of the modified virtual model;
modifying the video feed to include the virtual object provided by the third-party system based on the virtual pose and the modified virtual model; and
causing the modified video feed to be displayed by the client device.
2 . The method of claim 1 , wherein the origin point is a six-dimensional point that provides a reference location and orientation for the modified virtual model.
3 . The method of claim 1 , wherein the three-dimensional representation comprises a mesh of polygons.
4 . The method of claim 1 , wherein the modified virtual model further comprises animation instructions for the virtual object, and wherein displaying the modified video feed comprises:
displaying the virtual object in accordance with the animation instructions.
5 . The method of claim 1 , wherein the pose data comprises sensor data describing the physical space.
6 . The method of claim 5 , wherein the pose data comprises sensor data describing the physical object within the physical space.
7 . The method of claim 6 , wherein identifying the virtual pose of the client device comprises:
mapping the three-dimensional representation of the physical object onto the sensor data describing the physical object.
8 . The method of claim 1 , wherein identifying the virtual pose of the client device comprises:
mapping the origin point of the modified virtual model to a physical pose in the physical space.
9 . The method of claim 1 , wherein modifying the video feed comprises:
modifying the video feed to include the virtual object without modifying the video feed to include the three-dimensional representation of the physical object.
10 . The method of claim 1 , wherein modifying the video feed comprises:
modifying the video feed to include the three-dimensional representation of the physical object.
11 . A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
receiving, at an online system from a third-party system, a request for a virtual model of a physical space, wherein the virtual model comprises:
an origin point; and
a three-dimensional representation of a physical object within the physical space, wherein the three-dimensional representation is located within the virtual model relative to the origin point;
transmitting, by the online system, the virtual model to the third-party system;
receiving, at the online system from the third-party system, a modified virtual model, wherein the modified virtual model comprises a virtual object added to the virtual model by the third-party system, wherein the virtual object is located within the virtual model relative to the origin point;
transmitting, by the online system, the modified virtual model to a client device;
receiving, at the client device from the online system, the modified virtual model;
obtaining pose data of the client device, wherein the pose data comprises sensor data describing a pose of the client device;
obtaining a video feed captured by a camera of the client device;
identifying a physical pose of the client device within the physical space based on the pose data and the video feed;
identifying a virtual pose within the modified virtual model of the client device corresponding to the physical pose, wherein the virtual pose is identified relative to the origin point of the modified virtual model;
modifying the video feed to include the virtual object provided by the third-party system based on the virtual pose and the modified virtual model; and
causing the modified video feed to be displayed by the client device.
12 . The computer-readable medium of claim 11 , wherein the origin point is a six-dimensional point that provides a reference location and orientation for the modified virtual model.
13 . The computer-readable medium of claim 11 , wherein the three-dimensional representation comprises a mesh of polygons.
14 . The computer-readable medium of claim 11 , wherein the modified virtual model further comprises animation instructions for the virtual object, and wherein displaying the modified video feed comprises:
displaying the virtual object in accordance with the animation instructions.
15 . The computer-readable medium of claim 11 , wherein the pose data comprises sensor data describing the physical space.
16 . The computer-readable medium of claim 15 , wherein the pose data comprises sensor data describing the physical object within the physical space.
17 . The computer-readable medium of claim 16 , wherein identifying the virtual pose of the client device comprises:
mapping the three-dimensional representation of the physical object onto the sensor data describing the physical object.
18 . The computer-readable medium of claim 11 , wherein identifying the virtual pose of the client device comprises:
mapping the origin point of the modified virtual model to a physical pose in the physical space.
19 . The computer-readable medium of claim 11 , wherein modifying the video feed comprises:
modifying the video feed to include the virtual object without modifying the video feed to include the three-dimensional representation of the physical object.
20 . The computer-readable medium of claim 11 , wherein modifying the video feed comprises:
modifying the video feed to include the three-dimensional representation of the physical object.