IP Library Granted Patent US 12,197,850
Granted Patent B2
US 12,197,850 · App. 18/079,229 · Granted Jan 14, 2025

Method and apparatus for presenting point cloud viewport, computer-readable medium, and electronic device

Inventor: Ying Hu (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G06F40/177G06F40/205G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,197,850
App. No.
18/079,229
Granted
Jan 14, 2025
Kind
B2
Abstract

A method for presenting a point cloud viewport includes: acquiring a point cloud file, the point cloud file including information of a point cloud viewport and auxiliary information associated with the point cloud viewport, the auxiliary information corresponding to a type of the point cloud viewport; parsing the point cloud file to obtain the information of the point cloud viewport and the auxiliary information; and presenting the point cloud viewport according to the information of the point cloud viewport, and presenting corresponding description content in the point cloud viewport according to the auxiliary information.

Claims (36)

1. A method for presenting a point cloud viewport, implemented by an electronic device, the method comprising:

acquiring a point cloud file, the point cloud file including information of a point cloud viewport and auxiliary information associated with the point cloud viewport, the auxiliary information corresponding to a type of the point cloud viewport;

parsing the point cloud file to obtain the information of the point cloud viewport and the auxiliary information; and

presenting the point cloud viewport according to the information of the point cloud viewport, and presenting corresponding description content in the point cloud viewport according to the auxiliary information,

wherein the auxiliary information includes a type filed indicating a type of the auxiliary information associated with the point cloud viewport, and values of the type field correspond to a plurality of types of the auxiliary information, the plurality of types include a subtitle type indicated by a first value of the type field, a marker type indicated by a second value of the type field, and an annotation type indicated by a third value of the type field.

2. The method according to claim 1 , wherein the point cloud file includes a first field, and a value of the first field is used for indicating the number of the auxiliary information associated with the point cloud viewport.

3. The method according to claim 1 , wherein the auxiliary information includes a third field, the third field is used for indicating an identifier of the auxiliary information, and the identifier is used for uniquely identifying the auxiliary information.

4. The method according to claim 1 , wherein the auxiliary information includes a fourth field, and the fourth field is used for indicating the description content of the auxiliary information.

5. The method according to claim 1 , wherein the auxiliary information includes a fifth field, and the fifth field is used for indicating that the auxiliary information is associated with the whole area of the point cloud viewport when a value of the fifth field is a first value, and for indicating that the auxiliary information is associated with a partial area of the point cloud viewport when a value of the fifth field is a second value.

6. The method according to claim 1 , wherein the auxiliary information includes a sixth field, the sixth field is used for indicating a distance between a planar area associated with the auxiliary information and the central position in the point cloud viewport, and the planar area is used for displaying the description content of the auxiliary information.

7. The method according to claim 6 , wherein attribute information of the planar area is matched with attribute information of the point cloud viewport, and the attribute information includes at least one of position information, rotation information, and plane type information.

8. The method according to claim 1 , wherein the point cloud file includes a seventh field, and the seventh field is used for indicating the number of point cloud viewports associated with auxiliary information.

9. The method according to claim 1 , wherein the point cloud file includes an eighth field, the eighth field is used for indicating an identifier of the point cloud viewport associated with the auxiliary information, and the identifier is used for uniquely identifying the point cloud viewport.

10. The method according to claim 1 , wherein presenting corresponding description content comprises:

acquiring description content to be displayed in the point cloud viewport according to values of the fields comprised in the auxiliary information, and determining a presentation position of the description content; and

displaying the description content at the presentation position in the point cloud viewport.

11. The method according to claim 1 , wherein:

the point cloud file having the auxiliary information of the subtitle type is corresponded to a film.

12. The method according to claim 1 , wherein:

the point cloud file having the auxiliary information of the marker type is corresponded to a map.

13. The method according to claim 1 , wherein:

the point cloud file having the auxiliary information of the annotation type is corresponded to a video communication.

14. An apparatus for presenting a point cloud viewport, comprising: a memory storing computer program instructions; and a processor coupled to the memory and configured to execute the computer program instructions and perform:

acquiring a point cloud file, the point cloud file including information of a point cloud viewport and auxiliary information associated with the point cloud viewport, the auxiliary information corresponding to a type of the point cloud viewport;

parsing the point cloud file to obtain the information of the point cloud viewport and the auxiliary information; and

presenting the point cloud viewport according to the information of the point cloud viewport, and presenting corresponding description content in the point cloud viewport according to the auxiliary information,

wherein the auxiliary information includes a type filed indicating a type of the auxiliary information associated with the point cloud viewport, and values of the type field correspond to a plurality of types of the auxiliary information, the plurality of types include a subtitle type indicated by a first value of the type field, a marker type indicated by a second value of the type field, and an annotation type indicated by a third value of the type field.

15. The apparatus according to claim 14 , wherein the point cloud file includes a first field, and a value of the first field is used for indicating the number of the auxiliary information associated with the point cloud viewport.

16. The apparatus according to claim 14 , wherein the auxiliary information includes a third field, the third field is used for indicating an identifier of the auxiliary information, and the identifier is used for uniquely identifying the auxiliary information.

17. The apparatus according to claim 14 , wherein the auxiliary information includes a fourth field, and the fourth field is used for indicating the description content of the auxiliary information.

18. The apparatus according to claim 14 , wherein the auxiliary information includes a fifth field, and the fifth field is used for indicating that the auxiliary information is associated with the whole area of the point cloud viewport when a value of the fifth field is a first value, and for indicating that the auxiliary information is associated with a partial area of the point cloud viewport when a value of the fifth field is a second value.

19. A non-transitory computer-readable storage medium storing computer program instructions executable by at least one processor to perform:

acquiring a point cloud file, the point cloud file including information of a point cloud viewport and auxiliary information associated with the point cloud viewport, the auxiliary information corresponding to a type of the point cloud viewport;

parsing the point cloud file to obtain the information of the point cloud viewport and the auxiliary information; and

presenting the point cloud viewport according to the information of the point cloud viewport, and presenting corresponding description content in the point cloud viewport according to the auxiliary information,

wherein the auxiliary information includes a type filed indicating a type of the auxiliary information associated with the point cloud viewport, and values of the type field correspond to a plurality of types of the auxiliary information, the plurality of types include a subtitle type indicated by a first value of the type field, a marker type indicated by a second value of the type field, and an annotation type indicated by a third value of the type field.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2022
From: HU, YING
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 062053/0783 →
Priority Claims (1)
CN 202011528441.0 · Dec 22, 2020 · national
Continuity (2)
Continuation PCTCN2021131349 · Nov 18, 2021
Related Publication 20230103794A1 · Apr 6, 2023
References Cited (34)
US 10404411B2 · Chen et al. · 2019 [cited by applicant]
US 10542297B2 · Chen et al. · 2020 [cited by applicant]
US 10623635B2 · Wang et al. · 2020 [cited by applicant]
US 10742999B2 · Wang et al. · 2020 [cited by applicant]
US 10805620B2 · Wang et al. · 2020 [cited by applicant]
US 10820025B2 · Lai et al. · 2020 [cited by applicant]
US 10924820B2 · Chen et al. · 2021 [cited by applicant]
US 10951874B2 · Chen et al. · 2021 [cited by applicant]
US 11139000B2 · Wang et al. · 2021 [cited by applicant]
US 11197040B2 · Wang et al. · 2021 [cited by applicant]
US 11200700B2 · Wang · 2021 [cited by examiner]
US 20180041820A1 · Xu et al. · 2018 [cited by applicant]
US 20180075576A1 · Liu et al. · 2018 [cited by applicant]
US 20210360219A1 · Wang · 2021 [cited by examiner]
US 20230281882A1 · Nishi · 2023 [cited by examiner]
CN 104394478A · 2015 [cited by applicant]
CN 106791926A · 2017 [cited by applicant]
CN 106844610A · 2017 [cited by applicant]
CN 112017300A · 2020 [cited by applicant]
CN 112037314A · 2020 [cited by applicant]
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2021/131349 Feb. 15, 2022 8 Pages (including translation). [cited by applicant]
Shuai Zhao et al., “Study of User QoE Improvement for Dynamic Adaptive Streaming Over HTTP (MPEG-DASH)” ,2017, pp. 566-570. International Conference on Networking and Communications (ICNC). [cited by applicant]
Xiang Zhang et al., “Linear Model based Geometry Coding for Lidar Acquired Point Clouds”, 2020, pp. 406-406. 2020 Data Compression Conference (DCC), Snowbird, UT, USA. [cited by applicant]
Min Zhang et al., “PointHop: An Explainable Machine Learning Method for Point Cloud Classification”, 2000, IEEE TMM. [cited by applicant]
Li Li et al., “Occupancy-Map-Based Rate Distortion Optimization for Video-Based Point Cloud Compression”, 2019, ICIP. [cited by applicant]
Li Li et al., “Occupancy-map-based Rate Distortion Optimization and Partition for Video-based Point Cloud Compression ”, 2020, IEEE TCSVT. [cited by applicant]
Li Li et al., “Video-based compression for plenoptic point clouds”, arXiv:1911.01355. [cited by applicant]
Li Li et al ., “λ-domain Perceptual Rate Control for 360-degree Video Compression”, 2020, IEEE Journal on Selected Topics in Signal Processing. [cited by applicant]
Li Li et al ., “Rate Control for Video-based Point Cloud Compression”, 2020, IEEE TIP. [cited by applicant]
Li Li et al., “Efficient Projected Frame Padding for Video-based Point Cloud Compression”, 2019, IEEE TMM. [cited by applicant]
Min Zhang et al., “Unsupervised Feedforward Feature (UFF) Learning for Point Cloud Classification and Segmentation”, Dec. 1-4, 2020, 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP… [cited by applicant]
Pranav Kadam et al., “Unsupervised Point Cloud Registration Via Salient Points Analysis (SPA)”, Dec. 1-4, 2020, 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP), Macau. [cited by applicant]
Sejin Oh et al., “Draft text of ISO/IEC FDIS 23090-18 Carriage of Geometry-based Point Cloud Compression Data”, ISO/IEC JTC 1/SC 29/WG 03 N0311. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 12: ISO base media file format”, Sep. 2022, ISO/IEC JTC 1/SC 29/WG 11. [cited by applicant]