Point cloud encoding method and apparatus, point cloud decoding method and apparatus, and storage medium
This application discloses a point cloud encoding method and apparatus, a point cloud decoding method and apparatus, and a storage medium for point cloud encoding and/or decoding, and belongs to a data processing field. The method includes: first obtaining auxiliary information of a to-be-encoded patch, and then encoding the auxiliary information and a first index of the to-be-encoded patch into a bitstream. Values of the first index may be a first value, a second value, and a third value. Different values indicate different types of patches. Therefore, different types of patches can be distinguished by using the first index. For different types of patches, their corresponding auxiliary information encoded into a bitstream may comprise different contents. This can simplify a format of information encoded into the bitstream, reduce bit overheads of the bitstream, and improve encoding efficiency.
1. A point cloud encoding method, comprising:
obtaining auxiliary information of a to-be-encoded patch of a point cloud; and
encoding the auxiliary information of the to-be-encoded patch and a syntax element of the to-be-encoded patch into a bitstream, wherein the syntax element comprises a first syntax element, wherein,
when the first syntax element indicates that the to-be-encoded patch has a reference patch, the encoding the auxiliary information of the to-be-encoded patch and a syntax element of the to-be-encoded patch into a bitstream comprises:
encoding the auxiliary information and the syntax element of the to-be-encoded patch comprising the first syntax element and a second syntax element into the bitstream, wherein a value of the second syntax element being true indicates that two-dimensional information of the to-be-encoded patch is encoded into the bitstream but three-dimensional information of the to-be-encoded patch is not encoded into the bitstream, and the auxiliary information of the to-be-encoded patch comprises the two-dimensional information; or
encoding the auxiliary information and the of the syntax element of the to-be-encoded patch comprising the first syntax element, a second syntax element and a third syntax element into the bitstream, wherein a value of the second syntax element being false and a value of the third syntax element being true indicate that two-dimensional information of the to-be-encoded patch is not encoded into the bitstream but three-dimensional information of the to-be-encoded patch is encoded into the bitstream, and the auxiliary information of the to-be-encoded patch comprises the three-dimensional information; or
encoding the auxiliary information and the syntax element of the to-be-encoded patch comprising the first syntax element, a second syntax element and a third syntax element, wherein a value of the second syntax element being false and a value of the third syntax element being false indicate that two-dimensional information of the to-be-encoded patch is not encoded into the bitstream and three-dimensional information of the to-be-encoded patch is not encoded into the bitstream.
2. The point cloud encoding method according to claim 1 , wherein, when the first syntax element indicates that the to-be-encoded patch does not have a reference patch, the auxiliary information of the to-be-encoded patch comprises the two-dimensional information, the three-dimensional information, rotation transformation information, and normal axis information.
3. The point cloud encoding method according to claim 1 , wherein, when the first syntax element indicates that the to-be-encoded patch does not have a reference patch, and the to-be-encoded patch is a first patch in a current point cloud frame to which the to-be-encoded patch belongs, the current point cloud frame is a first point cloud frame.
4. The point cloud encoding method according to claim 1 , wherein the reference patch of the to-be-encoded patch is comprised in a reference frame of a current point cloud frame.
5. The point cloud encoding method according to claim 4 , wherein a location of the to-be-encoded patch in the current point cloud frame is the same as a location of the reference patch of the to-be-encoded patch in the reference frame of the current point cloud frame.
6. A point cloud decoding method, comprising:
parsing a first syntax element of a to-be-decoded patch of a point cloud from a bitstream;
parsing a second syntax element of the to-be-decoded patch from the bitstream or parsing the second syntax element and a third syntax element of the to-be-decoded patch from the bitstream, when the first syntax element indicates that the to-be-decoded patch has a reference patch;
upon determination that a value of the second syntax element is true, parsing two-dimensional information of the to-be-decoded patch from the bitstream and obtaining three-dimensional information of the to-be-decoded patch based on three-dimensional information of the reference patch of the to-be-decoded patch, or
upon determination that a value of the second syntax element is false and a value of the third syntax element is true, parsing three-dimensional information of the to-be-decoded patch from the bitstream and obtaining two-dimensional information of the to-be-decoded patch based on two-dimensional information of the reference patch of the to-be-decoded patch, or
upon determination that a value of the second syntax element is false and a value of the third syntax element is false, obtaining two-dimensional information of the to-be-decoded patch based on two-dimensional information of the reference patch of the to-be-decoded patch and obtaining three-dimensional information of the to-be-decoded patch based on three-dimensional information of the reference patch of the to-be-decoded patch; and
reconstructing the to-be-decoded patch based on auxiliary information of the to-be-decoded patch, wherein the auxiliary information of the to-be-decoded patch comprises the two-dimensional information of the to-be-decoded patch and the three-dimensional information of the to-be-decoded patch.
7. The point cloud decoding method according to claim 6 , further comprising:
parsing the auxiliary information of the to-be-decoded patch from the bitstream when the first syntax element indicates that the to-be-decoded patch does not have a reference patch, wherein the auxiliary information of the to-be-decoded patch comprises the two-dimensional information, the three-dimensional information, rotation transformation information, and normal axis information.
8. The point cloud decoding method according to claim 6 , further comprising:
when the to-be-decoded patch is a first patch and the first syntax element indicates that the to-be-decoded patch does not have a reference patch, determining that a current point cloud frame to which the to-be-decoded patch belongs is a first point cloud frame.
9. The point cloud decoding method according to claim 6 , wherein the parsing a first syntax element of a to-be-decoded point cloud patch from a bitstream comprises:
parsing the first syntax element of the to-be-decoded patch from the bitstream when the to-be-decoded patch is a first patch in a current point cloud frame; or
parsing a plurality of first syntax elements of a plurality of patches comprised in the current point cloud frame from the bitstream when the to-be-decoded patch is a first patch in a current point cloud frame, wherein the plurality of parsed first syntax elements comprise the first syntax element of the to-be-decoded patch.
10. The point cloud decoding method according to claim 6 , wherein the reference patch of the to-be-decoded patch is comprised in a reference frame of a current point cloud frame.
11. The point cloud decoding method according to claim 10 , wherein a location of the to-be-decoded patch in the current point cloud frame is the same as a location of the reference patch of the to-be-decoded patch in the reference frame of the current point cloud frame.
12. A point cloud encoding apparatus, comprising:
one or more electronic circuits or processors configured to:
obtain auxiliary information of a to-be-encoded patch of a point cloud; and
encode the auxiliary information of the to-be-encoded patch and a syntax element of the to-be-encoded patch into a bitstream, wherein the syntax element comprises a first syntax element, wherein,
when the first syntax element indicates that the to-be-encoded patch has a reference patch, the encoding of the auxiliary information of the to-be-encoded patch and the syntax element of the to-be-encoded patch into the bitstream comprises:
encoding the auxiliary information and the syntax element of the to-be-coded patch comprising the first syntax element and a second syntax element into the bitstream, wherein a value of the second syntax element being true indicates that two-dimensional information of the to-be-encoded patch is encoded into the bitstream but three-dimensional information of the to-be-encoded patch is not encoded into the bitstream, and the auxiliary information of the to-be-encoded patch comprises the two-dimensional information; or
encoding the auxiliary information and the syntax element of the to-be-encoded patch comprising the first syntax element, a second syntax element and a third syntax element into the bitstream, wherein a value of the second syntax element being false and a value of the third syntax element being true indicate that two-dimensional information of the to-be-encoded patch is not encoded into the bitstream but three-dimensional information of the to-be-encoded patch is encoded into the bitstream, and the auxiliary information of the to-be-encoded patch comprises the three-dimensional information; or
encoding the auxiliary information and the tax element of the to-be-encoded patch comprising the first syntax element, a second syntax element and a third syntax element into the bitstream, wherein a value of the second syntax element being false and a value of the third syntax element being false indicate that two-dimensional information of the to-be-encoded patch is not encoded into the bitstream and three-dimensional information of the to-be-encoded patch is not encoded into the bitstream.
13. The point cloud encoding apparatus according to claim 12 , wherein, when the first syntax element indicates that the to-be-encoded patch does not have a reference patch, the auxiliary information of the to-be-encoded patch comprises the two-dimensional information, the three-dimensional information, rotation transformation information, and normal axis information.
14. The point cloud encoding apparatus according to claim 12 , wherein, when the first syntax element indicates that the to-be-encoded patch does not have a reference patch and the to-be-encoded patch is a first patch in a current point cloud frame to which the to-be-encoded patch belongs, the current point cloud frame is a first point cloud frame.
15. The point cloud encoding apparatus according to claim 12 , wherein the reference patch of the to-be-encoded patch is comprised in a reference frame of a current point cloud frame.
16. The point cloud encoding apparatus according to claim 15 , wherein a location of the to-be-encoded patch in the current point cloud frame is the same as a location of the reference patch of the to-be-encoded patch in the reference frame of the current point cloud frame.
17. A point cloud decoding apparatus, comprising:
one or more electronic circuits or processors configured to:
parse a first syntax element of a to-be-decoded patch of a point cloud from a bitstream;
parse a second syntax element of the to-be-decoded patch from the bitstream or parse the second syntax element and a third syntax element of the to-be-decoded patch from the bitstream, when the first syntax element indicates that the to-be-decoded patch has a reference patch;
upon determination that a value of the second syntax element is true, parse two-dimensional information of the to-be-decoded patch from the bitstream and obtain three-dimensional information of the to-be-decoded patch based on three-dimensional information of the reference patch of the to-be-decoded patch, or
upon determination that a value of the second syntax element is false and a value of the third syntax element is true, parse three-dimensional information of the to-be-decoded patch from the bitstream and obtain two-dimensional information of the to-be-decoded patch based on two-dimensional information of the reference patch of the to-be-decoded patch, or
upon determination that a value of the second syntax element is false and a value of the third syntax element is false, obtain two-dimensional information of the to-be-decoded patch based on two-dimensional information of the reference patch of the to-be-decoded patch; and obtain three-dimensional information of the to-be-decoded patch based on three-dimensional information of the reference patch of the to-be-decoded patch; and
reconstruct the to-be-decoded patch based on auxiliary information of the to-be-decoded patch, wherein the auxiliary information of the to-be-decoded patch comprises the two-dimensional information of the to-be-decoded patch and the three-dimensional information of the to-be-decoded patch.
18. The point cloud decoding apparatus according to claim 17 , wherein the one or more electronic circuits or processors are further configured to:
parse the auxiliary information of the to-be-decoded patch from the bitstream when the first syntax element indicates that the to-be-decoded patch does not have a reference patch, wherein the auxiliary information of the to-be-decoded patch comprises the two-dimensional information, the three-dimensional information, rotation transformation information, and normal axis information.
19. The point cloud decoding apparatus according to claim 17 , wherein the one or more electronic circuits or processors are further configured to:
when the to-be-decoded patch is a first patch, and the first syntax element indicates that the to-be-decoded patch does not have a reference patch, determine that a current point cloud frame to which the to-be-decoded patch belongs is a first point cloud frame.
20. The point cloud decoding apparatus according to claim 17 , wherein the one or more electronic circuits or processors are further configured to:
parse the first syntax element of the to-be-decoded patch from the bitstream when the to-be-decoded patch is a first patch in a current point cloud frame; or
parse a plurality of first syntax elements of a plurality of patches comprised in a current point cloud frame from the bitstream when the to-be-decoded patch is a first patch in the current point cloud frame, wherein the plurality of parsed first syntax elements comprise the first syntax element of the to-be-decoded patch.
21. The point cloud decoding apparatus according to claim 17 , wherein the reference patch of the to-be-decoded patch is comprised in a reference frame of a current point cloud frame.
22. The point cloud decoding apparatus according to claim 21 , wherein a location of the to-be-decoded patch in the current point cloud frame is the same as a location of the reference patch of the to-be-decoded patch in the reference frame of the current point cloud frame.
23. A non-transitory computer readable storage medium storing computer instructions, for performing a point cloud encoding method, that when executed by one or more processors, cause the one or more processors to perform operations comprising:
obtaining auxiliary information of a to-be-encoded patch of a point cloud; and
encoding the auxiliary information of the to-be-encoded patch and a syntax element of the to-be-encoded patch into a bitstream, wherein the syntax element comprises a first syntax element, wherein:
when the first syntax element indicates that the to-be-encoded patch has a reference patch,
the syntax element encoded into the bitstream further comprises a second syntax element, wherein a value of the second syntax element being true indicates that two-dimensional information of the to-be-encoded patch is encoded into the bitstream but three-dimensional information of the to-be-encoded patch is not encoded into the bitstream, and the auxiliary information of the to-be-encoded patch comprises the two-dimensional information; or
the syntax element encoded into the bitstream further comprises a second syntax element and a third syntax element, wherein a value of the second syntax element being false and a value of the third syntax element being true indicate that two-dimensional information of the to-be-encoded patch is not encoded into the bitstream but three-dimensional information of the to-be-encoded patch is encoded into the bitstream, and the auxiliary information of the to-be-encoded patch comprises the three-dimensional information; or
the syntax element encoded into the bitstream further comprises a second syntax element and a third syntax element, wherein a value of the second syntax element being false and a value of the third syntax element being false indicate that two-dimensional information of the to-be-encoded patch is not encoded into the bitstream and three-dimensional information of the to-be-encoded patch is not encoded into the bitstream.
24. A non-transitory computer readable storage medium storing computer instructions for performing a point cloud decoding method, that when executed by one or more processors, cause the one or more processors to perform operations comprising:
parsing a first syntax element of a to-be-decoded patch of a point cloud from a bitstream;
parsing a second syntax element of the to-be-decoded patch from the bitstream or parsing the second syntax element and a third syntax element of the to-be-decoded patch from the bitstream, when the first syntax element indicates that the to-be-decoded patch has a reference patch;
upon determination that a value of the second syntax element is true, parsing two-dimensional information of the to-be-decoded patch from the bitstream, and obtaining three-dimensional information of the to-be-decoded patch based on three-dimensional information of the reference patch of the to-be-decoded patch; or
upon determination that a value of the second syntax element is false and a value of the third syntax element is true, parsing three-dimensional information of the to-be-decoded patch from the bitstream, and obtaining two-dimensional information of the to-be-decoded patch based on two-dimensional information of the reference patch of the to-be-decoded patch; or
upon determination that a value of the second syntax element is false and a value of the third syntax element is false, obtaining two-dimensional information of the to-be-decoded patch based on two-dimensional information of the reference patch of the to-be-decoded patch, and obtaining three-dimensional information of the to-be-decoded patch based on three-dimensional information of the reference patch of the to-be-decoded patch; and
reconstructing the to-be-decoded patch based on auxiliary information of the to-be-decoded patch, wherein the auxiliary information of the to-be-decoded patch comprises the two-dimensional information of the to-be-decoded patch and the three-dimensional information of the to-be-decoded patch.