Patch processing mechanism

1. An apparatus to facilitate processing video bit stream data, comprising:

one or more processors to decode texture data, depth data, occupancy map data and auxiliary patch information, generate a first three-dimensional (3D) point cloud including the decoded texture data and the decoded depth data, generate a patch point cloud including a 3D representation of patch identifiers associated with each of a plurality of patch video frames decoded from patch data included in the occupancy map data and auxiliary patch information, render a first viewport from the 3D point cloud, render a second viewport from the patch point cloud and examine the patch point cloud to perform subjective artifact reduction to detect a presence of one or more artifacts between patches, wherein the patch data comprises patch metadata associated with each patch video frame to indicate an originating angle and a relative position of a patch video frame; and

a memory communicatively coupled to the one or more processors.

2. The apparatus of claim 1 , wherein the one or more processors further to correct the one or more artifacts.

3. The apparatus of claim 2 , wherein examining the patch video frames comprises applying a filter across a patch boundary in the patch video frame.

4. The apparatus of claim 1 , wherein the one or more processors further to align patch orientation during motion prediction.

5. The apparatus of claim 4 , wherein the one or more processors further to receive a current patch and determine whether an orientation of the current patch is aligned with an orientation of a reference patch.

6. The apparatus of claim 5 , wherein the one or more processors further to perform motion prediction of the current patch from the reference patch based on the alignment.

7. The apparatus of claim 1 , wherein the one or more processors further to perform motion vector encoding using a reference patch and the patch metadata.

8. The apparatus of claim 7 , wherein the one or more processors further to generate an offset from the reference patch via coordinate information included in the patch metadata.

9. The apparatus of claim 1 , wherein the one or more processors further to perform patch boundary extrapolation during motion estimation encoding.

10. The apparatus of claim 9 , wherein the one or more processors further to determine an optimal motion vector that minimizes pixel error, subtract current pixels from reference pixels to obtain a residual of real patch pixels, set a background residual to zero for remaining background pixels of a current block and encode the current block.

11. The apparatus of claim 1 , wherein the one or more processors further to remove point cloud cracking in a reconstructed rendered surface.

12. The apparatus of claim 11 , wherein the one or more processors further to apply a grid to a decompressed point cloud data set, wherein the grid corresponds to an original sampling frequency of an original data set capture.

13. The apparatus of claim 12 , wherein the one or more processors further adjust points in a same block of the grid to co-located positions.

14. A computer generated method to facilitate processing video bit stream data, comprising:

decoding texture data, depth data, occupancy map data and auxiliary patch information;

generating a first three-dimensional (3D) point cloud including the decoded texture data and the decoded depth data;

generating a patch point cloud including a 3D representation of patch identifiers associated with each of a plurality of patch video frames decoded from patch data included in the occupancy map data and auxiliary patch information;

rendering a first viewport from the 3D point cloud;

rendering a second viewport from the patch point cloud; and

examining the patch point cloud to perform subjective artifact reduction to detect a presence of one or more artifacts between patches, wherein each patch video frame comprises associated patch metadata to indicate an originating angle and a relative position of a patch video frame.

15. The method of claim 14 , wherein examining the patch video frames comprises applying a filter across a patch boundary in the patch video frame.

16. The method of claim 14 , further comprising aligning patch orientation during motion prediction.

17. The method of claim 16 , wherein aligning patch orientation comprises:

receiving a current patch; and

determining whether an orientation of the current patch is aligned with an orientation of a reference patch.

18. The method of claim 17 , further comprising performing motion prediction of the current patch from the reference patch based on the alignment.

19. The method of claim 14 , further comprising performing motion vector encoding using a reference patch and the patch metadata.

20. The method of claim 19 , wherein performing the motion vector encoding comprises generating an offset from the reference patch via coordinate information included in the patch metadata.

21. The method of claim 14 , further comprising removing point cloud cracking in a reconstructed rendered surface, including:

applying a grid to a decompressed point cloud data set, wherein the grid corresponds to an original sampling frequency of an original data set capture; and

adjusting points in a same block of the grid to co-located positions.

22. At least one non-transitory computer readable medium having instructions stored thereon, which when executed by one or more processors, cause the processors to:

decode texture data, depth data, occupancy map data and auxiliary patch information;

generate a first three-dimensional (3D) point cloud including the decoded texture data and the decoded depth data;

generate a patch point cloud including a 3D representation of patch identifiers associated with each of a plurality of patch video frames decoded from patch data included in the occupancy map data and auxiliary patch information;

render a first viewport from the 3D point cloud;

render a second viewport from the patch point cloud; and

examine the patch point cloud to perform subjective artifact reduction to detect a presence of one or more artifacts between patches, wherein each patch video frame comprises associated patch metadata to indicate an originating angle and a relative position of a patch video frame.