IP Library › Granted Patent US 12,457,369
Granted Patent B2
US 12,457,369 · App. 18/314,884 · Granted Oct 28, 2025

Mesh vertex displacements coding

Inventors: Chao Huang (Palo Alto, CA); Thuong Nguyen Canh (Palo Alto, CA); Xiaozhong Xu (State College, PA); Jun Tian (Palo Alto, CA); Xiang Zhang (Sunnyvale, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/91H04N19/119H04N19/136H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,457,369
App. No.
18/314,884
Filed
May 10, 2023
Granted
Oct 28, 2025
Kind
B2
Art Unit
2482
USPC
375/240.08
Abstract

A method and apparatus comprising computer code configured to cause a processor or processors to obtain an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content, derive a curve of a mesh sequence from the input mesh corresponding to volumetric data, the curve including a plurality of vertices of the input mesh of the mesh sequence, subdivide the derived curve of the mesh sequence by adding subdivided vertices, computing a displacement vector for each of the plurality of subdivided vertices; and entropy code the volumetric data based on the displacement vector from at least one of the subdivided vertices.

Claims (40)

1. A method for video encoding, the method performed by at least one processor and comprising:

obtaining an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content;

deriving a curve of a mesh sequence from the input mesh corresponding to the volumetric data, the curve comprising a plurality of vertices of the input mesh;

subdividing the derived curve of the mesh sequence by adding a plurality of subdivided vertices and by forming a decimated curve by decimating the derived curve and adding the plurality of subdivided vertices to the decimated curve;

computing a displacement vector for each of the plurality of subdivided vertices, the displacement vector from the at least one of the subdivided vertices is from a point on the decimated curve; and

entropy encoding the volumetric data based on the displacement vector from at least one of the subdivided vertices, determining that at least one of the plurality of subdivided vertices of the decimated curve is not displaced from the curve, and determining whether a tree structure is signaled, and entropy encoding the volumetric data comprises:

determining a percentage of zerotrees based on determining a proportion of zero coefficients that are roots of zerotrees among zero coefficients that are not descendants of zerotrees and are not at a particular level of detail (LOD); and

specifying a coding context for a plurality of LOD at least one of which being the particular LOD.

2. The method for video encoding according to claim 1 ,

wherein entropy encoding the volumetric data comprises determining to signal a coding context at a level of detail (LOD).

3. The method for video encoding according to claim 2 ,

wherein the coding context at the LOD indicates that at least one of coefficients of the displacement vector from the at least one of the subdivided vertices is zero.

4. The method for video encoding according to claim 3 ,

wherein entropy encoding the volumetric data comprises signaling a position of a non-zero coefficient of the displacement vector from the at least one of the subdivided vertices.

5. The method for video encoding according to claim 1 ,

wherein the particular LOD is one of an LOD 0 and a last LOD.

6. An apparatus for video encoding, the apparatus comprising:

at least one memory configured to store computer program code;

at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:

obtaining code configured to cause the at least one processor to obtain an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content;

deriving code configured to cause the at least one processor to derive a curve of a mesh sequence from the input mesh corresponding to the volumetric data, the curve comprising a plurality of vertices of the input mesh;

subdividing code configured to cause the at least one processor to subdivide the derived curve of the mesh sequence by adding a plurality of subdivided vertices and by forming a decimated curve by decimating the derived curve and adding the plurality of subdivided vertices to the decimated curve;

computing code configured to cause the at least one processor to compute a displacement vector for each of the plurality of subdivided vertices, the displacement vector from the at least one of the subdivided vertices is from a point on the decimated curve; and

entropy encoding code configured to cause the at least one processor to entropy encode the volumetric data based on the displacement vector from at least one of the subdivided vertices, determining that at least one of the plurality of subdivided vertices of the decimated curve is not displaced from the curve, and determining whether a tree structure is signaled, and entropy encoding the volumetric data comprises:

determining a percentage of zerotrees based on determining a proportion of zero coefficients that are roots of zerotrees among zero coefficients that are not descendants of zerotrees and are not at a particular level of detail (LOD); and

specifying a coding context for a plurality of LOD at least one of which being the particular LOD.

7. The apparatus for video encoding according to claim 6 ,

wherein entropy encoding the volumetric data comprises determining to signal a coding context at a level of detail (LOD).

8. The apparatus for video encoding according to claim 7 ,

wherein the coding context at the LOD indicates that at least one of coefficients of the displacement vector from the at least one of the subdivided vertices is zero.

9. The apparatus for video encoding according to claim 8 ,

wherein entropy encoding the volumetric data comprises signaling a position of a non-zero coefficient of the displacement vector from the at least one of the subdivided vertices.

10. A non-transitory computer readable medium storing a program causing a computer to:

obtain an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content;

derive a curve of a mesh sequence from the input mesh corresponding to the volumetric data, the curve comprising a plurality of vertices of the input mesh;

subdivide the derived curve of the mesh sequence by adding a plurality of subdivided vertices and by forming a decimated curve by decimating the derived curve and adding the plurality of subdivided vertices to the decimated curve;

compute a displacement vector for each of the plurality of subdivided vertices, the displacement vector from the at least one of the subdivided vertices is from a point on the decimated curve; and

entropy encode the volumetric data based on the displacement vector from at least one of the subdivided vertices, determining that at least one of the plurality of subdivided vertices of the decimated curve is not displaced from the curve, and determining whether a tree structure is signaled, and entropy encoding the volumetric data comprises:

determining a percentage of zerotrees based on determining a proportion of zero coefficients that are roots of zerotrees among zero coefficients that are not descendants of zerotrees and are not at a particular level of detail (LOD); and

specifying a coding context for a plurality of LOD at least one of which being the particular LOD.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: HUANG, CHAO; NGUYEN CANH, THUONG; XU, XIAOZHONG; TIAN, JUN; ZHANG, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 063593/0609 →
Continuity (2)
Provisional Application 63354088 · Jun 21, 2022
Related Publication 20230412849A1 · Dec 21, 2023
References Cited (17)
US 20050168460A1 · Razdan · 2005 [cited by examiner]
US 20210082184A1 · Claessen · 2021 [cited by examiner]
US 20230401755A1 · Mammou · 2023 [cited by examiner]
WO WO2019115867A1 · 2019 [cited by examiner]
WO 2023231872A1 · 2023 [cited by applicant]
International Search Report dated Aug. 4, 2023 in International Application No. PCT/US23/21907. [cited by applicant]
Written Opinion dated Aug. 4, 2023 in International Application No. PCT/US23/21907. [cited by applicant]
Bici et al., “Improved prediction methods for scalable predictive animated mesh compression”, Journal of Visual Communication and Image Representation, Oct. 2011, vol. 22, No. 7, pp. 577-589 (13 pages total). [cited by applicant]
Amir Said et al., “A New, Fast, and Efficient Image Codec Based on Set Partitioning in Hierarchical Trees”, IEEE Transactions on Circuits and Systems for Video Technology, Jun. 1996, pp. 243-250, vol. 6, No. 3. [cited by applicant]
Jerome M. Shapiro, “Embedded Image Coding Using Zerotrees of Wavelet Coefficients”, IEEE Transactions on Signal Processing, Dec. 1993, pp. 3445-3462 , vol. 41, No. 12. [cited by applicant]
Andrei Khodakovsky et al., “Progressive Geometry Compression”, SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, Jul. 2000, pp. 271-278. [cited by applicant]
Charles Teorell Loop, “Smooth Subdivision Surfaces Based on Triangles”, A thesis submitted to the faculty of the University of Utah in partial fulfillment of the requirements for the degree of Master of Science, Aug. 19… [cited by applicant]
Office Action issued Aug. 5, 2025 in JP Application No. 2024-544995. [cited by applicant]
So Toku Ouchi et al., Shape Modeling Based on Directional Displacement from Subdivision Curved Surface of Base Mesh, Journal of the Institute of Electronics, Information and Communication Engineers, vol. J86-D-11, No. A… [cited by applicant]
EP Search Report issued Aug. 11, 2025 in EP Application No. 23827674.5. [cited by applicant]
Preda, “MPEG-4 Animation Framework extension (AFX) VM 13.0”, SNHC, International Organisation for Standardisation, ISO/IEC JTC1/SC29/WG11, Dec. 2003, Hawaii, 284 pp. [cited by applicant]
Mammou, et al., “[V-CG] Apple's Dynamic Mesh Coding CfP Response”, Apple Inc., International Organisation for Standardisation, ISO/IEC JTC 1/SC 29/WG7, online Apr. 2022, 21 pages. [cited by applicant]