IP Library Granted Patent US 12,469,306
Granted Patent B2
US 12,469,306 · App. 18/174,845 · Granted Nov 11, 2025

Management system, map generation system, and non-transitory computer-readable recording medium

Inventors: Satoko Tofukuji (Tokyo-to, JP); Daisuke Akihisa (Shizuoka-ken, JP); Ken Shinozaki (Tokyo-to, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
G06V20/58G01C21/3837G06T17/00G06V20/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,469,306
App. No.
18/174,845
Granted
Nov 11, 2025
Kind
B2
Abstract

A management system manages an environment of a predetermined area. In the predetermined area, there are a recognition sensor configured to recognize a surrounding situation and a recognition target to be recognized by the recognition sensor present at a specific position. Three-dimensional map data of the predetermined area include specific space information indicating a specific space that is a space between the specific position and the recognition target. Recognition result information indicates a result of recognition by the recognition sensor present at the specific position. The management system determines whether an object not included in the specific space in the three-dimensional map data is included in the specific space in the recognition result information. The management system detects, as a removal target, the object not included in the specific space in the three-dimensional map data but is included in the specific space in the recognition result information.

Claims (57)

1 . A management system for managing an environment of a predetermined area,

the management system comprising:

one or more processors; and

one or more memory devices configured to store three-dimensional map data of the predetermined area, wherein

in the predetermined area, there is a recognition sensor present at a specific position configured to recognize a surrounding situation and a recognition target to be recognized by the recognition sensor present at the specific position,

the three-dimensional map data include specific space information indicating a specific space that is a space between the specific position and the recognition target, and

the one or more processors are configured to:

acquire recognition result information indicating a result of recognition by the recognition sensor present at the specific position;

determine whether or not an object that is not included in the specific space in the three-dimensional map data is included in the specific space in the recognition result information; and

detect, as a removal target, the object that is not included in the specific space in the three-dimensional map data but is included in the specific space in the recognition result information.

2 . The management system according to claim 1 , wherein

the one or more processors are further configured to prohibit detection of an object present outside the specific space as the removal target.

3 . The management system according to claim 1 , wherein

the one or more processors are further configured to notify an administrator of recommendation information that recommends removal of the removal target detected.

4 . The management system according to claim 3 , wherein

the recognition sensor includes a camera,

the recognition result information includes an image captured by the camera, and

the recommendation information includes the image.

5 . The management system according to claim 1 , wherein

the three-dimensional map data further include specific surrounding space information indicating a specific surrounding space around the specific space, and

the one or more processors are further configured to:

determine whether or not an object that is not included in the specific surrounding space in the three-dimensional map data is included in the specific surrounding space in the recognition result information; and

detect, as a removal target candidate, the object that is not included in the specific surrounding space in the three-dimensional map data but is included in the specific surrounding space in the recognition result information.

6 . The management system according to claim 5 , wherein

the one or more processors are further configured to create a schedule for removing the detected removal target candidate at a different timing than the detected removal target or suggest creation of the schedule to an administrator.

7 . The management system according to claim 1 , wherein

the one or more memory devices are further configured to store semantic model information indicating attribute information of each of components constituting the predetermined area, and

the one or more processors are further configured to:

define the recognition target as one of the components in the semantic model information;

define the specific position as one of the components in the semantic model information;

define the specific space as one of the components in the semantic model information based on the recognition target and the specific position; and

generate the three-dimensional map data including the specific space information based on the semantic model information in which the specific space is defined.

8 . The management system according to claim 1 , wherein

the recognition sensor is mounted on a moving body that moves in the predetermined area.

9 . A map generation system for generating three-dimensional map data of a predetermined area,

the map generation system comprising:

one or more processors; and

one or more memory devices configured to store semantic model information indicating attribute information of each of components constituting the predetermined area, wherein

in the predetermined area, there is a recognition sensor present at a specific position configured to recognize a surrounding situation and a recognition target to be recognized by the recognition sensor present at the specific position, and

the one or more processors are configured to:

define the recognition target as one of the components in the semantic model information;

define the specific position as one of the components in the semantic model information;

define a specific space, which is a space between the specific position and the recognition target, as one of the components in the semantic model information based on the recognition target and the specific position; and

generate the three-dimensional map data including specific space information indicating the specific space based on the semantic model information in which the specific space is defined.

10 . The map generation system according to claim 9 , wherein

when a position of the recognition target in the predetermined area is changed, the one or more processors are configured to update definitions of the recognition target, the specific position, and the specific space in the semantic model information, thereby updating the three-dimensional map data.

11 . The map generation system according to claim 9 , wherein

the one or more processors are further configured to:

define a field of view of the recognition sensor present at the specific position as one of the components in the semantic model information; and

when at least a part of the specific space deviates from the field of view of the recognition sensor present at the specific position, add warning information indicating a shortage of the field of view to the specific space information or notify an administrator of the warning information.

12 . A non-transitory computer-readable recording medium on which three-dimensional map data of a predetermined area are recorded, wherein

in the predetermined area, there is a recognition sensor present at a specific position configured to recognize a surrounding situation and a recognition target to be recognized by the recognition sensor present at the specific position,

the three-dimensional map data have a data structure including specific space information indicating a specific space that is a space between the specific position and the recognition target,

recognition result information indicates a result of recognition by the recognition sensor present at the specific position,

the three-dimensional map data are read by a management system that manages an environment of the predetermined area,

whether or not an object that is not included in the specific space in the three-dimensional map data is included in the specific space in the recognition result information is determined by the management system, and

the object that is not included in the specific space in the three-dimensional map data but is included in the specific space in the recognition result information is detected as a removal target by the management system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2023
From: TOFUKUJI, SATOKO; AKIHISA, DAISUKE; SHINOZAKI, KEN
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 062811/0995 →
Priority Claims (1)
JP 2022-054014 · Mar 29, 2022 · national
Continuity (1)
Related Publication 20230316774A1 · Oct 5, 2023
References Cited (16)
US 10458810B2 · Fasola · 2019 [cited by examiner]
US 11597404B2 · Fish · 2023 [cited by examiner]
US 20120327238A1 · Satoh · 2012 [cited by examiner]
US 20160305785A1 · Nishijima · 2016 [cited by examiner]
US 20170323179A1 · Vallespi-Gonzalez · 2017 [cited by examiner]
US 20180218227A1 · Takaki · 2018 [cited by examiner]
US 20200333789A1 · Suzuki · 2020 [cited by examiner]
US 20210078173A1 · Zhou · 2021 [cited by examiner]
US 20210191397A1 · Lin · 2021 [cited by examiner]
US 20210233286A1 · Yasukawa · 2021 [cited by examiner]
US 20210318121A1 · Laroche · 2021 [cited by examiner]
US 20210341930A1 · Lin · 2021 [cited by examiner]
US 20230069475A1 · Porter · 2023 [cited by examiner]
JP 2003337040A · 2003 [cited by applicant]
JP 2005044224A · 2005 [cited by applicant]
JP 2012208111A · 2012 [cited by applicant]