Depth aware content rendering
An eXtended Reality (XR) system provides methodologies for clipping virtual content displayed to a user. The XR system generates an XR user interface with virtual content using an XR user interface model. The XR system generates clipped virtual content from the virtual content by clipping virtual content that is located outside of the user's stereoscopic field of view and provides the XR user interface containing the clipped virtual content to the user.
1 . A computer-implemented method comprising:
generating, by at least one processor, a 3D XR user interface comprising virtual content;
determining, by the at least one processor, using 3D coordinate data of the virtual content, one or more portions of the virtual content located outside of a stereoscopic field of view of a user;
determining, by the at least one processor, a near clipping plane at a first specified distance from a head-wearable apparatus worn by the user and a far clipping plane at a second specified distance from the head-wearable apparatus;
performing, by the at least one processor, a conic projection from the near clipping plane to the far clipping plane, the conic projection having an opening angle using a start angle and an end angle of the stereoscopic field of view;
generating, by the at least one processor, a clipping mask using the conic projection;
clipping, by the at least one processor, from the XR user interface, the one or more portions of the virtual content located outside of a stereoscopic field of view of the user using the clipping mask; and
providing, by the at least one processor, the XR user interface to the user.
2 . The computer-implemented method of claim 1 , wherein clipping the portion of virtual content comprises:
generating a clipping mask based on the stereoscopic field of view of the user; and
clipping the virtual content not located within the stereoscopic field of view of the user using the clipping mask.
3 . The computer-implemented method of claim 2 , wherein the clipping mask is a clipping volume.
4 . The computer-implemented method of claim 1 , wherein clipping the portion of the virtual content comprises generating a monoscopic view of the virtual content in a left monoscopic field of view by clipping the virtual content from a right virtual content rendered image of the virtual content.
5 . The computer-implemented method of claim 1 , wherein clipping the portion of the virtual content comprises generating a monoscopic view of the virtual content in a right monoscopic field of view by clipping the virtual content from a left virtual content rendered image of the virtual content.
6 . The computer-implemented method of claim 1 , wherein clipping the portion of the virtual content comprises clipping the virtual content from a left virtual content rendered image of the virtual content and a right virtual content rendered image of the virtual content.
7 . The computer-implemented method of claim 1 , wherein the XR user interface is provided to the user using a head-wearable apparatus.
8 . A machine comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
generating a 3D XR user interface comprising virtual content;
determining using 3D coordinate data of the virtual content, one or more portions of the virtual content located outside of a stereoscopic field of view of a user;
determining a near clipping plane at a first specified distance from a head-wearable apparatus worn by the user and a far clipping plane at a second specified distance from the head-wearable apparatus;
performing a conic projection from the near clipping plane to the far clipping plane the conic projection having an opening angle using a start angle and an end angle of the stereoscopic field of view;
generating a clipping mask using the conic projection;
clipping from the XR user interface, the one or more portions of the virtual content located outside of a stereoscopic field of view of the user using the clipping mask; and
providing the XR user interface to the user.
9 . The machine of claim 8 , wherein clipping the portion of virtual content comprises:
generating a clipping mask based on the stereoscopic field of view of the user; and
clipping the virtual content not located within the stereoscopic field of view of the user using the clipping mask.
10 . The machine of claim 9 , wherein the clipping mask is a clipping volume.
11 . The machine of claim 8 , wherein clipping the portion of the virtual content comprises generating a monoscopic view of the virtual content in a left monoscopic field of view by clipping the virtual content from a right virtual content rendered image of the virtual content.
12 . The machine of claim 8 , wherein clipping the portion of the virtual content comprises generating a monoscopic view of the virtual content in a right monoscopic field of view by clipping the virtual content from a left virtual content rendered image of the virtual content.
13 . The machine of claim 8 , wherein clipping the portion of the virtual content comprises clipping the virtual content from a left virtual content rendered image of the virtual content and a right virtual content rendered image of the virtual content.
14 . The machine of claim 8 , wherein the machine comprises a head-wearable apparatus.
15 . A non-transitory machine-readable storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
generating, by at least one processor, a 3D XR user interface comprising virtual content;
determining, by the at least one processor, using 3D coordinate data of the virtual content, one or more portions of the virtual content located outside of a stereoscopic field of view of a user;
determining a near clipping plane at a first specified distance from a head-wearable apparatus worn by the user and a far clipping plane at a second specified distance from the head-wearable apparatus;
performing a conic projection from the near clipping plane to the far clipping plane, the conic projection having an opening angle using a start angle and an end angle of the stereoscopic field of view;
generating a clipping mask using the conic projection;
clipping, by the at least one processor, from the XR user interface, the one or more portions of the virtual content located outside of a stereoscopic field of view of the user using the clipping mask; and
providing, by the at least one processor, the XR user interface to the user.
16 . The non-transitory machine-readable storage medium of claim 15 , wherein clipping the portion of virtual content comprises:
generating a clipping mask based on the stereoscopic field of view of the user; and
clipping the virtual content not located within the stereoscopic field of view of the user using the clipping mask.
17 . The non-transitory machine-readable storage medium of claim 15 , wherein clipping the portion of the virtual content comprises generating a monoscopic view of the virtual content in a left monoscopic field of view by clipping the virtual content from a right virtual content rendered image of the virtual content.
18 . The non-transitory machine-readable storage medium of claim 15 , wherein clipping the portion of the virtual content comprises generating a monoscopic view of the virtual content in a right monoscopic field of view by clipping the virtual content from a left virtual content rendered image of the virtual content.
19 . The non-transitory machine-readable storage medium of claim 15 , wherein clipping the portion of the virtual content comprises clipping the virtual content from a left virtual content rendered image of the virtual content and a right virtual content rendered image of the virtual content.
20 . The non-transitory machine-readable storage medium of claim 15 , wherein the XR user interface is provided to the user using a head-wearable apparatus.