User Representations in Artificial Reality
The disclosed technology can execute rules for an ambient avatar to perform physical interactions based on a status of a represented user and/or a context of a viewing user. The disclosed technology can further evaluate and select movement points that support avatar movement in an artificial reality environment. The disclosed technology can yet further detect trigger conditions and transition a user presence in a shared communication session. And the disclosed technology can generate stylized 3D avatars from 2D images.
1 . A method for causing an ambient avatar to perform physical interactions, the method comprising:
obtaining a status of a first user represented by the ambient avatar and/or a context of a second user viewing the ambient avatar;
selecting one or more rules with parameters that match value types in the status and/or context; and
executing the selected one or more rules, which cause the ambient avatar to perform a corresponding physical action.
2 . A method for evaluating and selecting one or more sets of movements points for avatar movement, the method comprising:
generating sets of candidate movements points for one or more avatar body models;
evaluating the sets of candidate movements points according to an avatar movement fidelity and a predicted computing resource utilization, wherein the evaluating comprises generating one or more evaluation metrics for the sets of candidate movement points;
ranking the sets of candidate movement points according to the one or more evaluation metrics; and
selecting one or more sets of candidate movement points for production according to the ranking.
3 . The method of claim 2 , wherein sets of candidate movements points are generated for multiple avatar body models, at least one set of candidate movements points is selected for production for a first avatar body model, and at least one set of candidate movements points is selected for production for a second avatar body model.
4 . A method for triggering a transition of a user presence during a shared communication session, the method comprising:
receiving visual data of a first user captured by one or more cameras, wherein the first user is displayed using a first presence in relation to the visual data;
detecting a trigger condition for transitioning the display of the first user; and
in response to detecting the trigger condition, transitioning the display of the first user from the first user presence to a second user presence.
5 . The method of claim 4 , wherein the trigger condition is detected when: a) the first user is a threshold distance from the camera; b) a portion of the first user is out of a field of view of the camera; c) a location for a computing device that captures the user stream is within a predefined zone or zone type; d) resource utilization of the computing device meets a utilization criteria; e) the computing device's data network bandwidth meets a bandwidth criteria; f) a user activity matching a set of pre-determined activities is detected; or any combination thereof.
6 . The method of claim 4 , wherein the visual data is for a shared communication session which is a video call or artificial reality session.
7 . The method of claim 4 , wherein the first user presence comprises one or more of an avatar, a mini-avatar, a two-dimensional video, a hologram representation, a two-dimensional still image, or any combination thereof.