METHODS AND SYSTEMS FOR INTERPOLATION OF DISPARATE INPUTS
Systems and methods are provided for interpolation of disparate inputs. A radial basis function neural network (RBFNN) may be used to interpolate the pose of a digital character. Input parameters to the RBFNN may be separated by data type (e.g. angular vs. linear) and manipulated within the RBFNN by distance functions specific to the data type (e.g. use an angular distance function for the angular input data). A weight may be applied to each distance to compensate for input data representing different variables (e.g. clavicle vs. shoulder). The output parameters of the RBFNN may be a set of independent values, which may be combined into combination values (e.g. representing x, y, z, w angular value in SO(3) space).
1 . A method of training one or more neural networks (NNs), comprising:
receiving training data comprising training input data and training output data, wherein the training input data and the training output data represent one or more training poses, wherein at least one of the one or more training poses comprise an input angular component, an input linear component, an output angular component, and an output linear component;
grouping the input angular components from each of the one or more poses into an input angular component group;
grouping the input linear components from each of the one or more poses into an input linear component group; and
providing the training input data as input to train the one or more NNs, wherein the input angular component group is evaluated differently than the input linear component group, wherein the evaluation results in the output angular component and the output linear component.
2 . The method of claim 1 , wherein at least one of the one or more NNs is a radial basis function neural network (RBFNN).
3 . The method of claim 1 , wherein the angular output component is in special orthogonal group in three dimensions (SO(3)) space.
4 . The method of claim 1 , wherein at least one of the one or more NNs is a feed-forward neural network (FFNN).
5 . The method of claim 4 , wherein the FFNN is a fully connected network.
6 . The method of claim 4 , wherein the FFNN comprises a single hidden layer.
7 . The method of claim 6 , wherein the single hidden layer is a residual NN block.
8 . The method of claim 4 , wherein the FFNN comprises rectified linear unit activation functions.
9 . The method of claim 1 , wherein the training input data includes data that describes a pose of a digital character associated with an alternative reality (AR) or virtual reality (VR) system.
10 . The method of claim 1 , wherein the training input data includes data that represents a low-order skeleton of a digital character, and the training output data represents a high-order skeleton of a digital character associated with an alternative reality (AR) or virtual reality (VR) system.
11 . The method of claim 1 , wherein the output angular component and the output linear component includes data that describes a pose of a digital character associated with an alternative reality (AR) or virtual reality (VR) system.
12 . The method of claim 1 , wherein evaluation includes one or more components of motion.
13 . The method of claim 1 , wherein the output angular component describes a rotational motion and the output linear component describes a translational motion; and wherein the evaluation further includes a scale.
14 . The method of claim 1 , wherein the output angular component is in quaternion space.
15 . The method of claim 1 , wherein the output linear component is a Euclidean distance function.