IP Library Granted Patent US 12,367,689
Granted Patent B2
US 12,367,689 · App. 17/306,764 · Granted Jul 22, 2025

Information processing apparatus, information processing method, and recording medium

Inventors: Ayato Imai (Tokyo, JP); Masakazu Fujiki (Kanagawa, JP)
Assignee: Canon Kabushiki Kaisha
G06V20/64G06T7/73G06V20/56G06T2207/10028G06T2207/20081G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,689
App. No.
17/306,764
Granted
Jul 22, 2025
Kind
B2
Abstract

An information processing apparatus includes an acquisition unit configured to acquire a feature point cloud indicating a three-dimensional shape of an environment where a moving object travels, and an output unit configured to output a two-dimensional map indicating positions of feature points on a two-dimensional plane excluding feature points that represent a feature of a ceiling in the environment or a travel surface of the moving object from the feature point cloud.

Claims (30)

1. An information processing apparatus comprising:

one or more processors; and

at least one memory storing executable instructions, which when executed by the one or more processors, cause the information processing apparatus to:

acquire a feature point cloud indicating a three-dimensional shape of an environment including a ceiling where a moving object moves;

exclude, from the feature point cloud of the environment, feature points of the ceiling based on a peak, in a height direction, detected from a distribution of feature points in the height direction; and

output a two-dimensional map indicating positions of feature points on a two-dimensional plane excluding the feature points of the ceiling.

2. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to output a position of the moving object to the two-dimensional map.

3. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to acquire a three-dimensional position in the feature point cloud based on image data on the environment around the moving object that is captured by an image capturing apparatus.

4. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to acquire a three-dimensional position in the feature point cloud based on three-dimensional point cloud data acquired by measuring the environment around the moving object using a range sensor.

5. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to:

store a three-dimensional map indicating the positions of the feature points in the environment; and

acquire the positions of the feature points based on the three-dimensional map.

6. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to display the two-dimensional map on a display apparatus.

7. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to receive a designation of a travel route of the moving object with respect to the two-dimensional map.

8. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to:

recognize a predetermined object based on the feature point cloud indicating the three-dimensional shape of the environment where the moving object travels; and

output a position of the recognized object to the two-dimensional map.

9. The information processing apparatus according to claim 8 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to:

recognize a door as the predetermined object; and

indicate a position of the recognized door on the two-dimensional map.

10. The information processing apparatus according to claim 8 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to:

recognize a transparent object as the predetermined object; and

output a position of an edge portion of the transparent object to the two-dimensional map.

11. The information processing apparatus according to claim 8 , wherein the information processing apparatus includes a learning model to detect the predetermined object from the feature point cloud indicating the three-dimensional shape of the environment where the moving object travels.

12. An information processing method comprising:

acquiring a feature point cloud indicating a three-dimensional shape of an environment including a ceiling where a moving object travels;

excluding, from the feature point cloud of the environment, feature points of the ceiling based on a peak, in a height direction, detected from a distribution of feature points in the height direction; and

outputting a two-dimensional map indicating positions of feature points on a two-dimensional plane excluding the feature points of the ceiling.

13. A non-transitory computer-readable storage medium storing a computer-executable program for causing a computer to perform the method according to claim 12 .

14. The information processing apparatus according to claim 1 , wherein the executable instructions, when executed by the one or more processors, cause the information processing apparatus to acquire a height distribution of three-dimensional feature points, detect peaks from the height distribution, acquire data other than the three-dimensional feature points at a peak with a highest height value among the detected peaks as data for conversion, and project the acquired data onto a horizontal plane to generate projection data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2021
From: IMAI, AYATO; FUJIKI, MASAKAZU
To: CANON KABUSHIKI KAISHA
Reel/Frame 056410/0166 →
Priority Claims (1)
JP 2020-082424 · May 8, 2020 · national
Continuity (1)
Related Publication 20210348927A1 · Nov 11, 2021
References Cited (35)
US 7003136B1 · Harville · 2006 [cited by examiner]
US 8294754B2 · Jung · 2012 [cited by examiner]
US 9285805B1 · Pollock · 2016 [cited by examiner]
US 9323999B2 · Akimoto · 2016 [cited by examiner]
US 10657691B2 · Zweigle · 2020 [cited by examiner]
US 10769421B2 · Hua · 2020 [cited by examiner]
US 10809073B2 · He · 2020 [cited by examiner]
US 10846511B2 · Ozkucur · 2020 [cited by examiner]
US 10930000B2 · Liu · 2021 [cited by examiner]
US 11217012B2 · Urtasun · 2022 [cited by examiner]
US 11314262B2 · Zhang · 2022 [cited by examiner]
US 11481920B2 · Otani · 2022 [cited by examiner]
US 11494985B2 · Coddington · 2022 [cited by examiner]
US 11580663B2 · Kanetake · 2023 [cited by examiner]
US 20130202197A1 · Reeler · 2013 [cited by examiner]
US 20150063683A1 · Fu · 2015 [cited by examiner]
US 20160203387A1 · Lee · 2016 [cited by examiner]
US 20200286282A1 · Grant · 2020 [cited by examiner]
US 20210326614A1 · Zhao · 2021 [cited by examiner]
US 20220009552A1 · Sakai · 2022 [cited by examiner]
US 20220076453A1 · Sakano · 2022 [cited by examiner]
US 20220148138A1 · Nakayama · 2022 [cited by examiner]
JP 2013200604A · 2013 [cited by applicant]
JP 2014191796A · 2014 [cited by examiner]
JP 6080462B2 · 2017 [cited by examiner]
JP 6335389B2 · 2018 [cited by applicant]
JP 2019125345A · 2019 [cited by applicant]
JP 2019179495A · 2019 [cited by examiner]
JP 2020030466A · 2020 [cited by examiner]
KR 20040100411A · 2004 [cited by examiner]
WO WO2016130719A2 · 2016 [cited by examiner]
WO 2017188292A1 · 2017 [cited by applicant]
Tian, Pengju, et al. “Robust segmentation of building planar features from unorganized point cloud.” IEEE Access 8 (2020): 30873-30884. (Year: 2020). [cited by examiner]
Yuhua et al. “A new reduction algorithm of scattered point cloud data.” 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE). vol. 6. IEEE, 2010. (Year: 2010). [cited by examiner]
Rusu, Radu Bogdan, et al. “Towards 3D point cloud based object maps for household environments.” Robotics and Autonomous Systems 56.11 (2008): 927-941. (Year: 2008). [cited by examiner]