METHOD FOR MODELING 2D AND 3D SCENES BY PERFORMING GAUSSIAN SPLATTING USING VARIATIONAL BAYES
A method for modeling 2D and 3D scenes by performing Gaussian splatting using variational Bayes to provide the benefit of continual learning from sequentially streamed data from multidimensional scenes.
1 . A method for modeling a 2D or 3D object through improved Gaussian splatting, comprising,
implementing in a generative model natural parameters of one or more distributions that are part of a family of distributions called the Exponential family, wherein the distribution represents one or more modalities of a multidimensional object,
estimating the one or more distributions by inferring their posterior distributions, using one or more iterative methods implemented in computer program,
generating a multidimensional scene by computing the expected value of the one or more modalities,
updating the natural parameters of the distributions that are part of the Exponential family implemented in the generative model by summing the prior parameter with the sum of multiple sufficient statistics of the one or more modalities data, and
assigning a mean of the modalities to a mean of data points that have the lowest Evidence Lower Bound (ELBO), for the modalities not yet represented in the prior or the generative model.
2 . A method of claim 1 , wherein the one or more iterative methods includes a variational inference method, wherein a variational posterior, denoted “q”, is introduced to calculate and maximize the Evidence Lower Bound (ELBO) for the one or more modalities' data.
3 . A method of claim 1 , wherein the computation of the expected value for the outputs of a 3D object requires one or more renders.