IP Library › Granted Patent US 12,367,627
Granted Patent B2
US 12,367,627 · App. 18/023,093 · Granted Jul 22, 2025

Equipment management method, equipment management device, equipment management program, and recording medium

Inventor: Akihiko Yamanaka (Tokyo, JP)
Assignee: PACIFIC CONSULTANTS CO., LTD.
G06T13/20G06Q10/20G06T15/20G06T19/006G06T19/20G06T2200/24G06T2210/56G06T2219/004G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,627
App. No.
18/023,093
Granted
Jul 22, 2025
Kind
B2
Abstract

To provide a system that can obtain moving images for equipment maintenance and management using point cloud data, with an inexpensive configuration. A program according to the present invention makes a processor of a computer execute steps including: a first step of receiving input of point cloud data that is acquired by measuring a space including a management object with a three-dimensional point cloud scanner; a second step of selecting a plurality of pieces of point data, which are part of the point cloud data that is acquired, so as to determine point cloud data to be animated; and a third step of animating the point cloud data, which is composed of the plurality of pieces of point data that are selected in the second step, so as to generate a management moving image in which the management object is represented as three-dimensional data in a virtual space.

Claims (65)

1. An equipment management method in which a processor of a computer executes, the equipment management method comprising:

receiving input of point cloud data that is acquired by measuring a space including a management object with a three-dimensional point cloud scanner;

selecting a plurality of pieces of point data, the plurality of pieces of point data being part of the point cloud data that is acquired, so as to determine point cloud data to be animated;

animating the point cloud data, the point cloud data being composed of the plurality of pieces of point data that are selected, so as to generate a management moving image in which the management object is represented as three-dimensional data in a three-dimensional virtual space; and

linking nameplate data, the nameplate data being arranged by a user and fixed on a coordinate position in the three-dimensional virtual space so as to overlap with the management object on the management moving image, to the management object represented on the management moving image, wherein

in the management moving image, an image of the point cloud data is changed in response to a viewpoint moving operation performed by the user, and

an orientation of the nameplate data is set so that the nameplate data faces in a direction from the coordinate position toward the viewpoint.

2. The equipment management method according to claim 1 , wherein

in the selecting the plurality of pieces of point data so as to determine point cloud data to be animated,

processing for selecting part of the point cloud data, the point cloud data being acquired, is executed by defining a positional interval between mutually-adjacent pieces of point data in the point cloud data.

3. The equipment management method according to claim 1 , wherein

in the selecting the plurality of pieces of point data so as to determine point cloud data to be animated,

processing for selecting part of the point cloud data, the point cloud data being acquired, is executed by coarsening point cloud data located outside a predetermined range from a viewpoint of the management moving image.

4. The equipment management method according to claim 1 , wherein

in the selecting the plurality of pieces of point data so as to determine point cloud data to be animated,

processing for selecting part of the point cloud data, the point cloud data being acquired, is executed so that the point cloud data has preset density in a process of changing a viewpoint of the management moving image.

5. The equipment management method according to claim 1 , wherein

management data to be used for management of the management object is linked to the nameplate data.

6. The equipment management method according to claim 5 , wherein

the management data is a management ledger for the management object.

7. The equipment management method according to claim 5 , wherein

the management data is data captured by a web camera, the web camera capturing a condition of the management object in real time.

8. The equipment management method according to claim 5 , wherein

the management data is a manual moving image obtained by capturing a work content of a maintenance and inspection work performed with respect to the management object and providing explanation of the work content.

9. The equipment management method according to claim 1 , wherein

processing for adjusting a display form of the nameplate data is executed in the linking the nameplate data so as to overlap with the management object on the management moving image.

10. An equipment management device comprising:

a data acquisition processor that receives input of point cloud data that is acquired by measuring a space including a management object with a three-dimensional point cloud scanner;

a selection processor that selects a plurality of pieces of point data, the plurality of pieces of point data being part of the point cloud data that is acquired, so as to determine point cloud data to be animated;

a moving image generation processor that animates the point cloud data, the point cloud data being composed of the plurality of pieces of point data that are selected by the selection processor, so as to generate a management moving image in which the management object is represented as three-dimensional data in a three-dimensional virtual space; and

a moving image editing processor that links nameplate data, the nameplate data being arranged by a user and fixed on a coordinate position in the three-dimensional virtual space so as to overlap with the management object on the management moving image, to the management object represented on the management moving image, wherein

in the management moving image, an image of the point cloud data is changed in response to a viewpoint moving operation performed by the user, and

an orientation of the nameplate data is set so that the nameplate data faces in a direction from the coordinate position toward the viewpoint.

11. A non-transitory computer-readable recording medium in which an equipment management program making a computer execute the equipment management method according to claim 1 is recorded.

12. The equipment management method according to claim 1 , wherein

in the linking the nameplate data so as to overlap with the management object on the management moving image,

the name plate being arranged by the user includes selecting and clicking point data constituting the management object, and

the linking of the nameplate data includes making the coordinate information of point data, which is located at the closest position from the viewpoint of the management moving image at the time of the clicking into the coordinate information of the nameplate data.

13. An equipment management method in which a processor of a computer executes, the equipment management method comprising:

receiving input of point cloud data that is acquired by measuring a space including a management object with a three-dimensional point cloud scanner;

selecting a plurality of pieces of point data, the plurality of pieces of point data being part of the point cloud data that is acquired, so as to determine point cloud data to be animated;

animating the point cloud data, the point cloud data being composed of the plurality of pieces of point data that are selected, so as to generate a management moving image in which the management object is represented as three-dimensional data in a three-dimensional virtual space; and

attaching nameplate data which identify management objects to the management object in a moving image and fixing the nameplate on a coordinate position in the three-dimensional virtual space, wherein

in the management moving image, an image of the point cloud data is changed in response to a viewpoint moving operation performed by the user, and

an orientation of the nameplate data is set so that the nameplate data faces in a direction from the coordinate position toward the viewpoint.

14. The equipment management method according to claim 13 , wherein

the coordinate position of the nameplate data is set on the basis of point data constituting the management object.

15. The equipment management method according to claim 13 , wherein

the nameplate data is fixed on the coordinate position, which is indicated by coordinate information included in corresponding point data constituting the management object, in the three-dimensional virtual space.

16. The equipment management device according to claim 10 , wherein

in the moving image editing processor linking the nameplate data so as to overlap with the management object on the management moving image,

the nameplate data being arranged by the user includes selecting and clicking point data constituting the management object, and

the linking of the nameplate data includes making the coordinate information of point data, which is located at the closest position from the viewpoint of the management moving image at the time of the clicking into the coordinate information of the nameplate data.

17. An equipment management device comprising:

a data acquisition processor that receives input of point cloud data that is acquired by measuring a space including a management object with a three-dimensional point cloud scanner;

a selection processor that selects a plurality of pieces of point data, the plurality of pieces of point data being part of the point cloud data that is acquired, so as to determine point cloud data to be animated;

a moving image generation processor that animates the point cloud data, the point cloud data being composed of the plurality of pieces of point data that are selected by the selection processor, so as to generate a management moving image in which the management object is represented as three-dimensional data in a three-dimensional virtual space; and

a moving image editing processor that attaches nameplate data which identify management objects to the management object in a moving image and fixes the nameplate on a coordinate position in the three-dimensional virtual space, wherein

in the management moving image, an image of the point cloud data is changed in response to a viewpoint moving operation performed by the user, and

an orientation of the nameplate data is set so that the nameplate data faces in a direction from the coordinate position toward the viewpoint.

18. The equipment management device according to claim 17 , wherein

the position of the nameplate data is set on the basis of point data constituting the management object.

19. The equipment management device according to claim 17 , wherein

the nameplate data is fixed on the coordinate position, which is indicated by coordinate information included in corresponding point data constituting the management object, in the three-dimensional virtual space.

20. A non-transitory computer-readable recording medium in which an equipment management program making a computer execute the equipment management method according to claim 13 is recorded.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2023
From: YAMANAKA, AKIHIKO
To: PACIFIC CONSULTANTS CO., LTD.
Reel/Frame 062794/0964 →
Priority Claims (1)
JP 2020-143468 · Aug 27, 2020 · national
Continuity (1)
Related Publication 20230298241A1 · Sep 21, 2023
References Cited (31)
US 10210669B1 · Cox · 2019 [cited by examiner]
US 20100316280A1 · Lancaster · 2010 [cited by examiner]
US 20120246166A1 · Krishnaswamy · 2012 [cited by examiner]
US 20130278631A1 · Border · 2013 [cited by examiner]
US 20140267723A1 · Davidson, Jr. · 2014 [cited by examiner]
US 20160187654A1 · Border · 2016 [cited by examiner]
US 20160364917A1 · Zhang · 2016 [cited by examiner]
US 20180240281A1 · Vincelette · 2018 [cited by examiner]
US 20190213755A1 · Bassa · 2019 [cited by examiner]
US 20200160601A1 · Shreve · 2020 [cited by examiner]
US 20200202578A1 · Ebert · 2020 [cited by examiner]
US 20200348662A1 · Cella · 2020 [cited by examiner]
US 20200379467A1 · Schwiesow · 2020 [cited by examiner]
US 20200394844A1 · Koshiba · 2020 [cited by examiner]
US 20210089040A1 · Ebrahimi Afrouzi · 2021 [cited by examiner]
US 20210097768A1 · Malia · 2021 [cited by examiner]
US 20220027654A1 · Iwami · 2022 [cited by examiner]
US 20220139094A1 · Yoshimi · 2022 [cited by examiner]
US 20220366673A1 · Iwami · 2022 [cited by examiner]
US 20230011921A1 · Iwami · 2023 [cited by examiner]
US 20230281350A1 · O'Keeffe · 2023 [cited by examiner]
US 20230298241A1 · Yamanaka · 2023 [cited by examiner]
CN 109508579 · 2019 [cited by applicant]
JP 2002279449A · 2002 [cited by applicant]
JP 2015158772A · 2015 [cited by applicant]
JP 2017054468A · 2017 [cited by applicant]
JP 2018106309A · 2018 [cited by applicant]
JP 2019148946A · 2019 [cited by applicant]
WO WO2017163384A1 · 2017 [cited by applicant]
International Search Report issued in International Patent Application No. PCT/JP2021/029101, issued Aug. 31, 2021, with English translation. [cited by applicant]
Office Action dated Jun. 17, 2025 issued in Chinese Patent Application No. 202180052736.1 along with an English translation. [cited by applicant]