IP Library › Granted Patent US 12,067,753
Granted Patent B2
US 12,067,753 · App. 17/887,918 · Granted Aug 20, 2024

2D UV atlas sampling based methods for dynamic mesh compression

Inventors: Xiang Zhang (Sunnyvale, CA); Chao Huang (Palo Alto, CA); Xiaozhong Xu (State College, PA); Jun Tian (Palo Alto, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
G06T9/001H04N19/119H04N19/132H04N19/14H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,067,753
App. No.
17/887,918
Granted
Aug 20, 2024
Kind
B2
Abstract

Method, apparatus, and system for sampling-based dynamic mesh compression are provided. The process may include determining one or more sample positions associated with an input mesh based on one or more sampling rates, and an occupancy status associated respectively with each of the one or more sample positions indicating whether each of the one or more sample positions is within boundaries of one or more polygons defined by the input mesh is determined. The process may include generating a sample-based occupancy map based on the occupancy status associated respectively with each of the one or more sample positions.

Claims (50)

1. A method for sampling-based dynamic mesh compression, the method being executed by at least one processor, the method comprising:

determining one or more sample positions associated with an input mesh based on one or more sampling rate;

determining whether each of the one or more sample positions are within boundaries of one or more polygons that make up the input mesh;

determining an occupancy status associated respectively with each of the one or more sample positions based on determining that each of the one or more sample positions are within boundaries of one or more polygons that make up the input mesh;

generating a sample-based occupancy map based on the occupancy status associated respectively with each of the one or more sample positions; and

compressing the sample-based occupancy map using a video codec into a plurality of single-channel or multiple-channel images.

2. The method of claim 1 , wherein the one or more sampling rate is based on a first sampling rate for a first axis and a second sampling rate for a second axis.

3. The method of claim 1 , wherein the input mesh is divided into one or more regions, and wherein the one or more sampling rate is based on one or more respective sampling rate for each of the one or more regions.

4. The method of claim 1 , wherein the one or more sampling rate is signaled in a high-level syntax.

5. The method of claim 3 , wherein the one or more respective sampling rate for each of the one or more regions is based on a respective characteristic of the one or more regions.

6. The method of claim 5 , wherein the respective characteristic is at least one of:

a texture of a region;

an activity of the region; and

a smoothness of the region.

7. The method of claim 1 , wherein the one or more sampling rate is be based on a sampling rate of a neighboring region.

8. The method of claim 1 , wherein the one or more sampling rate is based on a previous one or more sampling rate of one or more already coded mesh frames.

9. The method of claim 1 , wherein the method further comprises:

determining 3D geometry coordinates associated respectively with each of the one or more sample positions based on vertices of the one or more polygons defined by the input mesh; and

generating a sample-based geometry map based on the 3D geometry coordinates associated respectively with each of the one or more sample positions.

10. The method of claim 9 , wherein the sample-based geometry map comprises three single-channel geometry maps, and wherein a first map of the three single-channel geometry maps indicates x-axis positions associated with each of the one or more sample positions, a second map of the three single-channel geometry maps indicates y-axis positions associated with each of the one or more sample positions, and a third map of the three single-channel geometry maps indicates z-axis positions associated with each of the one or more sample positions.

11. The method of claim 1 , wherein the method further comprises:

determining attribute values associated respectively with each of the one or more sample positions based on vertices of the one or more polygons defined by the input mesh; and

generating a sample-based attribute map based on the attribute values associated respectively with each of the one or more sample positions.

12. The method of claim 11 , wherein the sample-based attribute map is one of an n-channel attribute map or n single-channel attribute maps.

13. The method of claim 1 , wherein the method further comprises:

generating connectivity information associated respectively with each of the one or more sample positions based on the occupancy status associated with one or more neighboring sample positions.

14. A device for sampling-based dynamic mesh compression, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

first determining code configured to cause the at least one processor to determine one or more sample positions associated with an input mesh based on one or more sampling rate;

second determining code configured to cause the at least one processor to determine whether each of the one or more sample positions are within boundaries of one or ore polygons that make up the input mesh;

third determining code configured to cause the at least one processor to determine an occupancy status associated respectively with each of the one or more sample positions based on determining that each of the one or more sample positions are within boundaries of one or more polygons that make up the input mesh;

first generating code configured to cause the at least one processor to generate a sample-based occupancy map based on the occupancy status associated respectively with each of the one or more sample positions; and

compression code configured to cause the at least one processor to compress the sample-based occupancy map using a video codec into a plurality of single-channel or multiple-channel images.

15. The device of claim 14 , wherein the program code further comprises:

third determining code configured to cause the at least one processor to determine 3D geometry coordinates associated respectively with each of the one or more sample positions based on vertices of the one or more polygons defined by the input mesh; and

second generating code configured to cause the at least one processor to generate a sample-based geometry map based on the 3D geometry coordinates associated respectively with each of the one or more sample positions.

16. The device of claim 14 , wherein the program code further comprises:

forth determining code configured to cause the at least one processor to determine attribute values associated respectively with each of the one or more sample positions based on vertices of the one or more polygons defined by the input mesh; and

third generating code configured to cause the at least one processor to generate a sample-based attribute map based on the attribute values associated respectively with each of the one or more sample positions.

17. The device of claim 14 , wherein the program code further comprises:

forth generating code configured to cause the at least one processor to generate connectivity information associated respectively with each of the one or more sample positions based on the occupancy status associated with one or more neighboring sample positions.

18. The device of claim 14 , wherein the input mesh is divided into one or more regions, and wherein the one or more sampling rate is based on one or more respective sampling rate for each of the one or more regions.

19. The device of claim 18 , wherein the one or more respective sampling rate for each of the one or more regions is based on a respective characteristic of the one or more regions.

20. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for sampling-based dynamic mesh compression, cause the one or more processors to:

determine one or more sample positions associated with an input mesh based on one or more sampling rate;

determine whether each of the one or more sample positions are within boundaries of one or more polygons that make up the input mesh;

determine an occupancy status associated respectively with each of the one or more sample positions based on determining that each of the one or more sample positions are within boundaries of one or more polygons that make up the input mesh;

generate a sample-based occupancy map based on the occupancy status associated respectively with each of the one or more sample positions; and

compress the sample-based occupancy map using a video codec into a plurality of single-channel or multiple-channel images.

Continuity (2)
Provisional Application 63233475 · Aug 16, 2021
Related Publication 20230048897A1 · Feb 16, 2023
Cited By (1)
US 12,524,917