Vertex motion vector predictor coding for vertex mesh (v-mesh)
An apparatus includes a communication interface configured to receive a compressed video bitstream and a processor operably coupled to the communication interface. The processor is configured to determine, for a vertex in the compressed video bitstream, one or more vertex neighbors based on a signaled limit to a number of the one or more vertex neighbors. The processor is also configured to identify, based on a vertex motion vector (VMV) identifier signaled in the compressed video bitstream, a VMV predictor from among a plurality of VMV predictors to use for the vertex. The processor is also configured to reconstruct a mesh frame based on the determined one or more vertex neighbors and the identified VMV predictor.
1 . An apparatus comprising:
a communication interface configured to receive a compressed video bitstream; and
a processor operably coupled to the communication interface, the processor configured to:
determine, for a vertex in the compressed video bitstream, one or more vertex neighbors based on a signaled limit to a number of the one or more vertex neighbors used for a calculation of a vertex motion vector (VMV) predictor;
identify, based on a VMV identifier signaled in the compressed video bitstream, the VMV predictor from among a plurality of VMV predictors to use for the vertex; and
reconstruct a mesh frame based on the determined one or more vertex neighbors and the identified VMV predictor.
2 . The apparatus of claim 1 , wherein, to determine the one or more vertex neighbors, the processor is further configured to identify a last vertex neighbor in a received sequence of neighbors associated with the vertex, and at least one additional vertex neighbor in the received sequence of neighbors corresponding to the number of the one or more vertex neighbors minus one.
3 . The apparatus of claim 1 , wherein the determined one or more vertex neighbors is associated with an intra mesh frame and the processor is further configured to reuse the determined one or more vertex neighbors for an inter mesh frame.
4 . The apparatus of claim 1 , wherein the processor is further configured to:
obtain a duplicate vertices data structure storing information relating to duplicate vertices of one or more mesh frames; and
determine, based on a flag signaled in the compressed video bitstream, that an inter mesh frame inherits the duplicate vertices data structure.
5 . The apparatus of claim 1 , wherein the processor is further configured to receive a delta difference between a VMV for the vertex and an associated predicted value of the VMV predictor.
6 . The apparatus of claim 5 , wherein the associated predicted value is a combination of the one or more vertex neighbors.
7 . The apparatus of claim 1 , wherein the signaled limit to the number of the one or more vertex neighbors is included in one of a sequence header, a frame header, a sub-mesh header, a slice header, a sub-frame header, or a tile header of the compressed video bitstream.
8 . A method comprising:
determining, for a vertex in a compressed video bitstream, one or more vertex neighbors based on a signaled limit to a number of the one or more vertex neighbors used for a calculation of a vertex motion vector (VMV) predictor;
identifying, based on a VMV identifier signaled in the compressed video bitstream, the VMV predictor from among a plurality of VMV predictors to use for the vertex; and
reconstructing a mesh frame based on the determined one or more vertex neighbors and the identified VMV predictor.
9 . The method of claim 8 , wherein determining the one or more vertex neighbors includes identifying a last vertex neighbor in a received sequence of neighbors associated with the vertex, and at least one additional vertex neighbor in the received sequence of neighbors corresponding to the number of the one or more vertex neighbors minus one.
10 . The method of claim 8 , wherein the determined one or more vertex neighbors is associated with an intra mesh frame, and the method further comprises reusing the determined one or more vertex neighbors for an inter mesh frame.
11 . The method of claim 8 , further comprising:
obtaining a duplicate vertices data structure storing information relating to duplicate vertices of one or more mesh frames; and
determining, based on a flag signaled in the compressed video bitstream, that an inter mesh frame inherits the duplicate vertices data structure.
12 . The method of claim 8 , further comprising receiving a delta difference between a VMV for the vertex and an associated predicted value of the VMV predictor.
13 . The method of claim 12 , wherein the associated predicted value is a combination of the one or more vertex neighbors.
14 . The method of claim 8 , wherein the signaled limit to the number of the one or more vertex neighbors is included in one of a sequence header, a frame header, a sub-mesh header, a slide header, a sub-frame header, or a tile header of the compressed video bitstream.
15 . An apparatus comprising:
a communication interface; and
a processor operably coupled to the communication interface, the processor configured to:
identify, for a vertex of a mesh frame, one or more vertex neighbors based on a set limit to a number of the one or more vertex neighbors used for a calculation of a vertex motion vector (VMV) predictor;
determine a plurality of VMV predictors for the vertex based on the identified one or more vertex neighbors;
map each of the plurality of VMV predictors to one of a plurality of VMV identifiers; and
encode a compressed video bitstream signaling the set limit to the number of the one or more vertex neighbors and signaling one of the plurality of VMV identifiers indicating the VMV predictor from among the plurality of VMV predictors to use for the vertex.
16 . The apparatus of claim 15 , wherein, to determine the one or more vertex neighbors, the processor is further configured to identify a last vertex neighbor in a sequence of neighbors associated with the vertex, and at least one additional vertex neighbor in the sequence of neighbors corresponding to the number of the one or more vertex neighbors minus one.
17 . The apparatus of claim 15 , wherein the identified one or more vertex neighbors is associated with an intra mesh frame and the processor is further configured to reuse the identified one or more vertex neighbors for an inter mesh frame.
18 . The apparatus of claim 15 , wherein the processor is further configured to:
generate a duplicate vertices data structure storing information relating to duplicate vertices of one or more mesh frames; and
set a flag in the compressed video bitstream signaling that an inter mesh frame inherits the duplicate vertices data structure.
19 . The apparatus of claim 15 , wherein the processor is further configured to cause transmission of a delta difference between a VMV for the vertex and an associated predicted value of the VMV predictor, and wherein the associated predicted value is a combination of the one or more vertex neighbors.
20 . The apparatus of claim 15 , wherein the processor is further configured to encode the set limit to the number of the one or more vertex neighbors in one of a sequence header, a frame header, a sub-mesh header, a slide header, a sub-frame header, or a tile header of the compressed video bitstream.