Adjusting Virtual View in a Mirrored Virtual World
A method, system, and computer-readable storage medium are disclosed for displaying virtual elements (e.g., AR content) in a physical environment by a client device using a virtual camera pose that is different from the pose of the physical camera used to capture images of the physical environment. The client device uses a three-dimensional (3D) map (e.g., a topographical mesh) of the physical environment to determine a pose (a position and orientation) of the camera of the client device. The 3D map can include geometry, colors, textures, or any other suitable information describing the physical environment.
1 . A computer-implemented method of determining a virtual pose for view of content, the computer-implemented method comprising:
identifying a real-world environment of a client device;
obtaining a 3D map corresponding to the real-world environment;
obtaining a physical pose of a camera of the client device;
determining the virtual pose by applying an offset to the physical pose; and
causing display of a view generated from the 3D map using the virtual pose.
2 . The computer-implemented method of claim 1 , wherein obtaining the 3D map comprises generating the 3D map based on images captured by the camera of the client device.
3 . The computer-implemented method of claim 1 , wherein obtaining the physical pose of the camera comprises determining the physical pose of the camera by comparing an image captured by the camera of the client device to the 3D map.
4 . The computer-implemented method of claim 1 , wherein the 3D map is a topographical mesh of the real-world environment.
5 . The computer-implemented method of claim 1 , wherein the offset comprises at least one of a predetermined rotation or a predetermined translation.
6 . The computer-implemented method of claim 1 , wherein the offset is determined by a calibration process that comprises:
directing a user to position the client device is a desired position;
collecting sensor data while the client device is in the desired position; and
calculating at least one of a rotation or translation of the offset that converts the physical pose while the client device is in the desired position to a desired virtual pose.
7 . The computer-implemented method of claim 1 , wherein the desired virtual pose is equivalent to the camera being at eye level of the user pointing along an axis parallel to a ground plane.
8 . The computer-implemented method of claim 1 , wherein the offset is a function of an angle of the physical pose relative to a ground plane.
9 . The computer-implemented method of claim 8 , wherein the function is a function whose first derivative is continuous.
10 . The computer-implemented method of claim 1 , wherein the view generated from the 3D map includes a virtual item.
11 . A non-transitory computer-readable medium comprising instructions for determining a virtual pose for view of content, the instructions, when executed by a computing device, causing the computing device to perform operations including:
identifying a real-world environment of a client device;
obtaining a 3D map corresponding to the real-world environment;
obtaining a physical pose of a camera of the client device;
determining the virtual pose by applying an offset to the physical pose; and
causing display of a view generated from the 3D map using the virtual pose.
12 . The non-transitory computer-readable medium of claim 11 , wherein obtaining the 3D map comprises generating the 3D map based on images captured by the camera of the client device.
13 . The non-transitory computer-readable medium of claim 11 , wherein obtaining the physical pose of the camera comprises determining the physical pose of the camera by comparing an image captured by the camera of the client device to the 3D map.
14 . The non-transitory computer-readable medium of claim 11 , wherein the 3D map is a topographical mesh of the real-world environment.
15 . The non-transitory computer-readable medium of claim 11 , wherein the offset comprises at least one of a predetermined rotation or a predetermined translation.
16 . The non-transitory computer-readable medium of claim 11 , wherein the offset is determined by a calibration process that comprises:
directing a user to position the client device is a desired position;
collecting sensor data while the client device is in the desired position; and
calculating at least one of a rotation or translation of the offset that converts the physical pose while the client device is in the desired position to a desired virtual pose.
17 . The non-transitory computer-readable medium of claim 11 , wherein the desired virtual pose is equivalent to the camera being at eye level of the user pointing along an axis parallel to a ground plane.
18 . The non-transitory computer-readable medium of claim 11 , wherein the offset is a function of an angle of the physical pose relative to a ground plane.
19 . The non-transitory computer-readable medium of claim 18 , wherein the function is a function whose first derivative is continuous.
20 . The non-transitory computer-readable medium of claim 11 , wherein the view generated from the 3D map includes a virtual item.