Subject segmentation for motion control and textured display

1. A method of motion control and textured display, comprising:

receiving an initial image;

extracting an initial mask of a subject of interest from the initial image;

segmenting the image into the initial mask and a background;

determining a color texture of the initial mask;

estimating motion of the initial mask to a new mask;

merging the new mask and the background into a merged image;

training the extraction of the initial mask based on a body loss and a component loss;

at least one of rotating, translating and scaling the initial mask to the new mask;

determining a minimum mean brightness difference between the initial mask and the new mask;

determining a minimum mean color difference between the initial mask and the new mask;

eroding the initial mask to an erosion mask;

dilating the initial mask to a dilation mask;

determining a background contour confidence based on the erosion mask and the dilation mask;

determining a subject contour confidence based on the erosion mask and the dilation mask;

determining a background color confidence based on the erosion mask and the dilation mask;

determining a subject color confidence based on the erosion mask and the dilation mask;

determining a background affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence;

determining a subject affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence; and

combining the background affinity and the subject affinity.

2. A method of motion control and textured display, comprising:

receiving an in image;

extracting an initial mask of a subject of interest from the initial image;

eroding the initial mask to an erosion mask;

dilating the initial mask to a dilation mask;

determining a background contour confidence lased on the erosion mask and the dilation mask;

determining a subject contour confidence based on the erosion mask and the dilation mask;

determining a background color confidence based on the erosion mask and the dilation mask;

determining a subject color confidence based on the erosion mask and the dilation mask;

determining a background affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence;

determining a subject affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence; and

combining the background affinity and the subject affinity.

3. A method of motion control and textured display, comprising:

receiving an initial image;

extracting an initial mask of a subject of interest from the initial image;

receiving a new image;

determining an overlapping area of the initial image and the new image;

determining an offset of the initial mask based on a minimum color difference and a minimum brightness difference within the overlapping area;

applying the determined offset to the initial mask to form a new mask; and

storing the new mask in a buffer.