IP Library Granted Patent US 12,212,759
Granted Patent B2
US 12,212,759 · App. 17/985,664 · Granted Jan 28, 2025

Point cloud encoding and decoding method and apparatus, computer-readable medium, and electronic device

Inventor: Ying Hu (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H04N19/154H04N19/172H04N19/463H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,759
App. No.
17/985,664
Granted
Jan 28, 2025
Kind
B2
Abstract

A point cloud decoding method includes: receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; parsing file encapsulation information of the at least one point cloud media track, to obtain quality indication information carried in the file encapsulation information, the quality indication information being used for representing point cloud quality of the at least one point cloud media track; and selecting and decoding a point cloud media track with designated point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

Claims (57)

1. A point cloud decoding method, comprising:

receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track and encapsulating an alternative group corresponding to different point cloud media tracks, wherein point cloud media tracks having a same point cloud content and having different point cloud qualities are arranged in the same alternative group; when using a single-track mode for encapsulation of the point cloud file, tracks of point cloud content with different qualities belong to the same alternative group; when using a multi-track mode for encapsulation, geometry component tracks of the point cloud content with different qualities belong to the same alternative group, and attribute component tracks of the point cloud content are associated with the geometry component tracks;

parsing file encapsulation information of the at least one point cloud media track, to obtain quality indication information carried in the file encapsulation information, the quality indication information being used for representing point cloud quality of the at least one point cloud media track; and

selecting and decoding a point cloud media track with designated point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

2. The point cloud decoding method according to claim 1 , wherein receiving the point cloud file comprises:

receiving streaming media signaling that is transmitted by the data source and that is used for transmitting point cloud data;

parsing the streaming media signaling, to obtain at least two pieces of selectable quality indication information carried in the streaming media signaling;

transmitting a data transmission request to the data source according to quality indication information selected from the at least two pieces of quality indication information; and

receiving the point cloud file that is transmitted by the data source and that corresponds to the data transmission request.

3. The point cloud decoding method according to claim 2 , wherein transmitting the data transmission request to the data source comprises

determining a network bandwidth of performing data transmission with the data source;

performing matching detection on the network bandwidth and the at least two pieces of quality indication information carried in the streaming media signaling, to select target point cloud quality matching the network bandwidth; and

transmitting the data transmission request generated according to the target point cloud quality to the data source.

4. The point cloud decoding method according to claim 1 , wherein parsing the file encapsulation information comprises:

parsing the file encapsulation information of the at least one point cloud media track, to determine at least one quality indication field related to a quality parameter of the point cloud media track; and

determining the quality indication information of the point cloud file according to a value of the at least one quality indication field.

5. The point cloud decoding method according to claim 4 , wherein

the quality indication field represents a frame rate of a point cloud bitstream, and a value of the quality indication field is an unsigned integer whose length is 8 bytes.

6. The point cloud decoding method according to claim 4 , wherein the quality indication information includes at least one of a true quality value, an equivalent quality value, and a quality scale, wherein the true quality value is a parameter value of the quality parameter, the equivalent quality value is the number of unit quality parameters that is obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality scale is scale information used for representing a parameter value range of the quality parameter.

7. The point cloud decoding method according to claim 4 , wherein the quality indication field represents a bitrate of a point cloud bitstream, and a value of the quality indication field is an unsigned integer whose length is 32 bytes.

8. A point cloud decoding apparatus, comprising: a memory storing computer program instructions; and a processor coupled to the memory and configured to execute the computer program instructions and perform:

receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track and encapsulating an alternative group corresponding to different point cloud media tracks, wherein point cloud media tracks having a same point cloud content and having different point cloud qualities are arranged in the same alternative group; when using a single-track mode for encapsulation of the point cloud file, tracks of point cloud content with different qualities belong to the same alternative group; when using a multi-track mode for encapsulation, geometry component tracks of the point cloud content with different qualities belong to the same alternative group, and attribute component tracks of the point cloud content are associated with the geometry component tracks;

parsing file encapsulation information of the at least one point cloud media track, to obtain quality indication information carried in the file encapsulation information, the quality indication information being used for representing point cloud quality of the at least one point cloud media track; and

selecting and decoding a point cloud media track with designated point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

9. The point cloud decoding apparatus according to claim 8 , wherein receiving the point cloud file includes:

receiving streaming media signaling that is transmitted by the data source and that is used for transmitting point cloud data;

parsing the streaming media signaling, to obtain at least two pieces of selectable quality indication information carried in the streaming media signaling;

transmitting a data transmission request to the data source according to quality indication information selected from the at least two pieces of quality indication information; and

receiving the point cloud file that is transmitted by the data source and that corresponds to the data transmission request.

10. The point cloud decoding apparatus according to claim 9 , wherein transmitting the data transmission request to the data source includes:

determining a network bandwidth of performing data transmission with the data source;

performing matching detection on the network bandwidth and the at least two pieces of quality indication information carried in the streaming media signaling, to select target point cloud quality matching the network bandwidth; and

transmitting the data transmission request generated according to the target point cloud quality to the data source.

11. The point cloud decoding apparatus according to claim 8 , wherein parsing the file encapsulation information includes:

parsing the file encapsulation information of the at least one point cloud media track, to determine at least one quality indication field related to a quality parameter of the point cloud media track; and

determining the quality indication information of the point cloud file according to a value of the at least one quality indication field.

12. The point cloud decoding apparatus according to claim 11 , wherein the quality indication field represents a frame rate of a point cloud bitstream, and a value of the quality indication field is an unsigned integer whose length is 8 bytes.

13. The point cloud decoding apparatus according to claim 11 , wherein the quality indication information includes at least one of a true quality value, an equivalent quality value, and a quality scale, wherein the true quality value is a parameter value of the quality parameter, the equivalent quality value is the number of unit quality parameters that is obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality scale is scale information used for representing a parameter value range of the quality parameter.

14. The point cloud decoding apparatus according to claim 11 , wherein the quality indication field represents a bitrate of a point cloud bitstream, and a value of the quality indication field is an unsigned integer whose length is 32 bytes.

15. A non-transitory computer-readable storage medium storing computer program instructions executable by at least one processor to perform:

receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track and encapsulating an alternative group corresponding to different point cloud media tracks, wherein point cloud media tracks having a same point cloud content and having different point cloud qualities are arranged in the same alternative group; when using a single-track mode for encapsulation of the point cloud file, tracks of point cloud content with different qualities belong to the same alternative group; when using a multi-track mode for encapsulation, geometry component tracks of the point cloud content with different qualities belong to the same alternative group, and attribute component tracks of the point cloud content are associated with the geometry component tracks;

parsing file encapsulation information of the at least one point cloud media track, to obtain quality indication information carried in the file encapsulation information, the quality indication information being used for representing point cloud quality of the at least one point cloud media track; and

selecting and decoding a point cloud media track with designated point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

16. The non-transitory computer-readable storage medium according to claim 15 , wherein receiving the point cloud file includes:

receiving streaming media signaling that is transmitted by the data source and that is used for transmitting point cloud data;

parsing the streaming media signaling, to obtain at least two pieces of selectable quality indication information carried in the streaming media signaling;

transmitting a data transmission request to the data source according to quality indication information selected from the at least two pieces of quality indication information; and

receiving the point cloud file that is transmitted by the data source and that corresponds to the data transmission request.

17. The non-transitory computer-readable storage medium according to claim 16 , wherein transmitting the data transmission request to the data source includes:

determining a network bandwidth of performing data transmission with the data source;

performing matching detection on the network bandwidth and the at least two pieces of quality indication information carried in the streaming media signaling, to select target point cloud quality matching the network bandwidth; and

transmitting the data transmission request generated according to the target point cloud quality to the data source.

18. The non-transitory computer-readable storage medium according to claim 15 , wherein parsing the file encapsulation information includes:

parsing the file encapsulation information of the at least one point cloud media track, to determine at least one quality indication field related to a quality parameter of the point cloud media track; and

determining the quality indication information of the point cloud file according to a value of the at least one quality indication field.

19. The non-transitory computer-readable storage medium according to claim 18 , wherein the quality indication field represents a frame rate of a point cloud bitstream, and a value of the quality indication field is an unsigned integer whose length is 8 bytes.

20. The non-transitory computer-readable storage medium according to claim 18 , wherein the quality indication information includes at least one of a true quality value, an equivalent quality value, and a quality scale, wherein the true quality value is a parameter value of the quality parameter, the equivalent quality value is the number of unit quality parameters that is obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality scale is scale information used for representing a parameter value range of the quality parameter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2022
From: HU, YING
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 061743/0150 →
Priority Claims (1)
CN 202110351657.2 · Mar 31, 2021 · national
Continuity (2)
Continuation PCTCN2022076405 · Feb 16, 2022
Related Publication 20230082784A1 · Mar 16, 2023
References Cited (38)
US 10404411B2 · Chen et al. · 2019 [cited by applicant]
US 10542297B2 · Chen et al. · 2020 [cited by applicant]
US 10623635B2 · Wang et al. · 2020 [cited by applicant]
US 10742999B2 · Wang et al. · 2020 [cited by applicant]
US 10805620B2 · Wang et al. · 2020 [cited by applicant]
US 10820025B2 · Wang-Lin et al. · 2020 [cited by applicant]
US 10924820B2 · Chen et al. · 2021 [cited by applicant]
US 10951874B2 · Chen et al. · 2021 [cited by applicant]
US 11139000B2 · Wang et al. · 2021 [cited by applicant]
US 11197040B2 · Wang et al. · 2021 [cited by applicant]
US 20180075576A1 · Liu et al. · 2018 [cited by applicant]
US 20190019218A1 · Thompson et al. · 2019 [cited by applicant]
US 20200020133A1 · Najaf-Zadeh · 2020 [cited by examiner]
US 20200382764A1 · Oyman et al. · 2020 [cited by applicant]
US 20210019936A1 · Oyman · 2021 [cited by applicant]
US 20210264641A1 · Iguchi · 2021 [cited by examiner]
US 20220036593A1 · Takahashi et al. · 2022 [cited by applicant]
US 20230061573A1 · Hu · 2023 [cited by examiner]
US 20230082784A1 · Hu · 2023 [cited by examiner]
CN 112153391A · 2020 [cited by applicant]
CN 112492385A · 2021 [cited by applicant]
CN 112583803A · 2021 [cited by applicant]
CN 113709093A · 2021 [cited by applicant]
WO 2020137642A1 · 2020 [cited by applicant]
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2022/076405 Apr. 19, 2022 7 Pages (including translation). [cited by applicant]
Shuai Zhao et al., “Study of User QoE Improvement for Dynamic Adaptive Streaming Over HTTP (MPEG-DASH)”,2017, pp. 566-570. International Conference on Networking and Communications (ICNC). [cited by applicant]
Xiang Zhang et al., “Linear Model based Geometry Coding for Lidar Acquired Point Clouds”, 2020, pp. 406-406. 2020 Data Compression Conference (DCC), Snowbird, UT, USA. [cited by applicant]
Min Zhang et al., “PointHop: An Explainable Machine Learning Method for Point Cloud Classification”, 2000, IEEE TMM. [cited by applicant]
Li Li et al., “Occupancy-Map-Based Rate Distortion Optimization for Video-Based Point Cloud Compression”, 2019, ICIP. [cited by applicant]
Li Li et al., “Occupancy-map-based Rate Distortion Optimization and Partition for Video-based Point Cloud Compression”, 2020, IEEE TCSVT. [cited by applicant]
Li Li et al., “Video-based compression for plenoptic point clouds”, arXiv:1911.01355. [cited by applicant]
Li Li et al., “λ-domain Perceptual Rate Control for 360-degree Video Compression”, 2020, IEEE Journal on Selected Topics in Signal Processing. [cited by applicant]
Li Li et al., “Rate Control for Video-based Point Cloud Compression”, 2020, IEEE TIP. [cited by applicant]
Li Li et al., “Efficient Projected Frame Padding for Video-based Point Cloud Compression”, 2019, IEEE TMM. [cited by applicant]
Min Zhang et al., “Unsupervised Feedforward Feature (UFF) Learning for Point Cloud Classification and Segmentation”, Dec. 1-4, 2020, 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP… [cited by applicant]
Pranav Kadam et al., “Unsupervised Point Cloud Registration via Salient Points Analysis (SPA)”, Dec. 1-4, 2020, 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP), Macau. [cited by applicant]
Sejin Oh et al., “Draft text of ISO/IEC FDIS 23090-18 Carriage of Geometry-based Point Cloud Compression Data”, ISO/IEC JTC 1/SC 29/WG 03 N0311. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 12: ISO base media file format”, Sep. 2022, ISO/IEC JTC 1/SC 29/WG 11. [cited by applicant]