IP Library › Granted Patent US 12,231,684
Granted Patent B2
US 12,231,684 · App. 17/790,393 · Granted Feb 18, 2025

Information processing device and method

Inventors: Tsuyoshi Kato (Kanagawa, JP); Satoru Kuma (Tokyo, JP); Ohji Nakagami (Tokyo, JP); Hiroyuki Yasuda (Saitama, JP); Koji Yano (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/597H04N19/30H04N19/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,684
App. No.
17/790,393
Granted
Feb 18, 2025
Kind
B2
Abstract

There is provided an information processing device and method capable of suppressing a reduction in encoding efficiency. When performing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchization of the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point, the reference point is set on the basis of a centroid of points. The present disclosure can be applied to, for example, an information processing device, an image processing device, an encoding device, a decoding device, an electronic device, an information processing method, a program, and the like.

Claims (51)

1. An information processing device comprising:

a hierarchization unit configured to, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchize the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point,

wherein the hierarchization unit is further configured to set the reference point on a basis of a centroid of points, and

wherein the hierarchization unit is implemented via at least one processor.

2. The information processing device according to claim 1 ,

wherein the hierarchization unit sets, as the reference point, a point closer to the centroid among candidate points.

3. The information processing device according to claim 1 ,

wherein the hierarchization unit sets the reference point on a basis of a centroid of points located within a predetermined range.

4. The information processing device according to claim 1 ,

wherein the hierarchization unit sets the reference point on a basis of a predetermined search order from among a plurality of candidates under a substantially same condition with respect to the centroid.

5. An information processing method comprising:

when performing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchization of the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point, setting the reference point on a basis of a centroid of points.

6. An information processing device comprising:

a hierarchization unit configured to, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchize the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point,

wherein the hierarchization unit is further configured to set the reference point on a basis of a distribution mode of points,

wherein the hierarchization unit sets the reference point on a basis of table information designating a point close to a centroid of points for each distribution mode of the points, and

wherein the hierarchization unit is implemented via at least one processor.

7. The information processing device according to claim 1 ,

wherein the hierarchization unit sets the reference point on a basis of table information designating a predetermined point for each distribution mode of the points.

8. The information processing device according to claim 7 , further comprising:

an encoding unit configured to encode information regarding the table information,

wherein the encoding unit is implemented via at least one processor.

9. An information processing method comprising:

when performing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchization of the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point, setting the reference point on a basis of a distribution mode of points,

wherein the reference point is set on a basis of table information designating a point close to a centroid of points for each distribution mode of the points.

10. An information processing device comprising:

a hierarchization unit configured to, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchize the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point; and

an encoding unit that encodes information regarding setting of the reference point by the hierarchization unit,

wherein the hierarchization unit sets the reference point on a basis of table information designating a point close to a centroid of points for each distribution mode of the points, and

wherein the hierarchization unit and the encoding unit are each implemented via at least one processor.

11. The information processing device according to claim 10 ,

wherein the encoding unit encodes information regarding setting of the reference points for all points.

12. The information processing device according to claim 10 ,

wherein the encoding unit encodes information regarding setting of the reference points for points of a part of hierarchies.

13. The information processing device according to claim 12 ,

wherein the encoding unit further encodes information regarding setting of the reference point for a point that satisfies a predetermined condition.

14. An information processing method comprising:

hierarchizing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point; and

encoding information regarding setting of the reference point,

wherein the reference point is set on a basis of table information designating a point close to a centroid of points for each distribution mode of the points.

15. An information processing device comprising:

a hierarchization unit configured to, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchize the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point,

wherein the hierarchization unit is further configured to alternately select, as the reference point, a point closer to a center of a bounding box and a point farther from the center of the bounding box among candidates for the reference point for each hierarchy.

16. The information processing device according to claim 15 ,

wherein the hierarchization unit selects the point closer to the center of the bounding box and the point farther from the center of the bounding box among the candidates on a basis of a search order according to a position in the bounding box.

17. The information processing device according to claim 16 ,

wherein the search order is an order of distance from the center of the bounding box.

18. The information processing device according to claim 16 ,

wherein the search order is set for each region obtained by dividing the bounding box into eight regions.

19. An information processing method comprising:

when performing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchization of the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point, alternately selecting, as the reference point, a point closer to a center of a bounding box and a point farther from the center of the bounding box among candidates for the reference point for each hierarchy.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2022
From: KATO, TSUYOSHI; KUMA, SATORU; NAKAGAMI, OHJI; YASUDA, HIROYUKI; YANO, KOJI
To: SONY GROUP CORPORATION
Reel/Frame 060594/0807 →
Priority Claims (1)
JP 2020-000679 · Jan 7, 2020 · national
Continuity (1)
Related Publication 20230023219A1 · Jan 26, 2023
References Cited (13)
US 11212519B2 · Sugio · 2021 [cited by examiner]
US 20220188578A1 · Hu · 2022 [cited by examiner]
US 20230273976A1 · Hu · 2023 [cited by examiner]
WO WO2019055772A1 · 2019 [cited by applicant]
WO WO2019065298A1 · 2019 [cited by applicant]
WO WO2019240286A1 · 2019 [cited by applicant]
WO WO2019244931A · 2019 [cited by applicant]
Hur et al., [G-PCC][New Proposal] on improved spatial scalable lifting, International Organisation for Standardisation Coding of Moving Pictures and Audio, ISO/IEC JTC1/SC29/WG11, Oct. 2019, pp. 1-7, Geneva, CH. [cited by applicant]
Mammou et al., Lifting Scheme for Lossy Attribute Encoding in TMC1, International Organisation for Standardisation Coding of Moving Pictures and Audio, ISO/IEC JTC1/SC29/WG11, Apr. 2018, pp. 1-9, San Diego. [cited by applicant]
Nakagami et al., [G-PCC] Spatial scalability support for G-PCC, International Organisation for Standardisation Coding of Moving Pictures and Audio, ISO/IEC JTC1/SC29/WG11, Mar. 2019, pp. 1-15, Geneva, CH. [cited by applicant]
Mekuria et al., Design, Implementation and Evaluation of a Point Cloud Codec for Tele-Immersive Video, IEEE Transactions on Circuits and Systems for Video Technology, Jan. 2016, pp. 1-14. [cited by applicant]
Satoru Kuma (Sony) et al: “[G-PCC](New Proposal) CE13.15 Related on improved LoD generation for spatial scalability”, 129. MPEG Meeting; Jan. 13, 2020-Jan. 17, 2020; Jan. 8, 2020 (Jan. 8, 2020), (Motion Picture Expert G… [cited by applicant]
“G-PCC codec description”, 128. MPEG Meeting; Oct. 7, 2019-Oct. 11, 2019; Geneva; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), Dec. 18, 2019 (Dec. 18, 2019), 1-15 No. n18891, XP030225589. [cited by applicant]