Augmented call spawn configuration for digital human representations in an artificial reality environment
Aspects of the present disclosure are directed to spawning digital human representations (DHRs) for use in various types of augmented calls in an artificial reality (XR) environment. A DHR can include a two-dimensional (2D) image of a user, a video of the user, or an avatar of the user. A first call type can include a compact mode call used in situations requiring multitasking, such that a caller can interact with an XR environment while attending to tasks in the real-world. A second call type can include a spatial mode call that can fully immerse a caller within an XR environment. The XR environment can be a multitasking environment in which a user can interact with multiple XR experiences, virtual objects, and DHR(s) of other user(s). Spatial mode calling can provide more natural face-to-face interaction between callers.
1 . A method for spawning a digital human representation of a call receiver in an augmented call between a call sender and the call receiver, the method comprising:
initiating, by an artificial reality device of the call sender, the augmented call with an artificial reality device of the call receiver, wherein initiating the augmented call causes selection of a digital human representation type for the augmented call;
responsive to initiation of the augmented call, automatically rendering, by the artificial reality device of the call sender, the augmented call in a compact mode, wherein rendering the augmented call in the compact mode includes rendering the digital human representation of the call receiver, in the digital human representation type, body-leashed to the call sender, the digital human representation being rendered overlaid onto a view of a real-world environment of the call sender;
receiving, by the artificial reality device of the call sender, an indication to transition the augmented call to a spatial mode; and
responsive to receiving the indication, transitioning the augmented call into the spatial mode, wherein:
transitioning the augmented call into the spatial mode includes rendering the digital human representation of the call receiver, in the digital human representation type, world-locked relative to a spatial anchor established for the real-world environment; and
in the spatial mode, the digital human representation is rendered at a fixed vertical distance between the spatial anchor and the artificial reality device of the call sender.
2 . The method of claim 1 , wherein the digital human representation is scaled larger in the spatial mode than in the compact mode.
3 . The method of claim 1 , wherein the digital human representation is rendered as billboarded to the call sender and with rotation disabled relative to the call sender in the compact mode.
4 . The method of claim 1 , wherein the digital human representation type is a three-dimensional avatar, a video stream, or a two-dimensional image.
5 . The method of claim 1 , wherein the digital human representation is modifiable to be world-locked in the compact mode.
6 . The method of claim 1 , wherein the digital human representation type is selected automatically based on one or more determined capabilities of the artificial reality device of the call sender, the artificial reality device of the call receiver, or both.
7 . The method of claim 1 , wherein, in the spatial mode:
the digital human representation is rendered at a first location on a circumference of a spawning circle having a center at the spatial anchor,
the call sender has a second location on the circumference of the spawning circle, and
an orientation of the digital human representation toward the call sender is determined in accordance with the first location of the digital human representation relative to the second location of the call sender.
8 . The method of claim 7 , wherein a virtual object is rendered on the circumference of the spawning circle.
9 . The method of claim 8 , wherein a radius of the spawning circle is dynamic based on a size of the virtual object.
10 . The method of claim 1 , wherein the spatial anchor is shared between the artificial reality device of the call sender and the artificial reality device of the call receiver.
11 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for spawning a digital human representation of a call receiver in an augmented call between a call sender and the call receiver, the process comprising:
initiating, by an artificial reality device of the call sender, the augmented call with a device of the call receiver;
responsive to initiation of the augmented call, automatically rendering, by the artificial reality device of the call sender, the augmented call in a compact mode, wherein rendering the augmented call in the compact mode includes rendering the digital human representation of the call receiver body-leashed to the call sender, the digital human representation being rendered overlaid onto a view of a real-world environment of the call sender; and
responsive to receiving input, transitioning the augmented call into a spatial mode, wherein;
transitioning the augmented call into the spatial mode includes rendering the digital human representation of the call receiver world-locked relative to a spatial anchor established for the real-world environment; and
in the spatial mode, the digital human representation is rendered at a fixed vertical distance between the spatial anchor and the artificial reality device of the call sender.
12 . The non-transitory computer-readable storage medium of claim 11 ,
wherein initiating the augmented call causes selection of a digital human representation type for the augmented call, and
wherein the digital human representation of the call receiver is rendered in the digital human representation type.
13 . The non-transitory computer-readable storage medium of claim 11 ,
wherein initiating the augmented call causes selection of a digital human representation type for the call sender, and
wherein a digital human representation of the call sender, in the digital human representation type, is transmitted to the device of the call receiver.
14 . The non-transitory computer-readable storage medium of claim 13 , wherein the digital human representation type is selected automatically based on one or more determined capabilities of the artificial reality device of the call sender, the artificial reality device of the call receiver, or both.
15 . The non-transitory computer-readable storage medium of claim 11 , wherein the device of the call receiver is an artificial reality device.
16 . A computing system for spawning a digital human representation for a call receiver in an augmented call between a call sender and the call receiver, the computing system comprising:
one or more processors; and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:
initiating, by an artificial reality device of the call sender, the augmented call with a device of the call receiver;
responsive to initiation of the augmented call, automatically rendering, by the artificial reality device of the call sender, the augmented call in a compact mode, wherein rendering the augmented call in the compact mode includes rendering the digital human representation of the call receiver body-leashed to the call sender, the digital human representation being rendered overlaid onto a view of a real-world environment of the call sender; and
responsive to receiving input, transitioning the augmented call into a spatial mode, wherein;
transitioning the augmented call into the spatial mode includes rendering the digital human representation of the call receiver world-locked relative to a spatial anchor established for the real-world environment; and
in the spatial mode, the digital human representation is rendered at a fixed vertical distance between the spatial anchor and the artificial reality device of the call sender.
17 . The computing system of claim 16 ,
wherein initiating the augmented call causes selection of a digital human representation type for the augmented call,
wherein the digital human representation of the call receiver is rendered in the digital human representation type, and
wherein the device of the call receiver is an artificial reality device.
18 . The computing system of claim 17 , wherein, in the spatial mode:
the digital human representation is rendered at a first location on a circumference of a spawning circle having a center at the spatial anchor,
the call sender has a second location on the circumference of the spawning circle, and
an orientation of the digital human representation toward the call sender is determined in accordance with the first location of the digital human representation relative to the second location of the call sender.
19 . The computing system of claim 18 , wherein a virtual object is rendered on the circumference of the spawning circle.
20 . The computing system of claim 17 , wherein the digital human representation type is selected automatically based on one or more determined capabilities of the artificial reality device of the call sender, the artificial reality device of the call receiver, or both.