IP Library › Granted Patent US 11,956,532
Granted Patent B2
US 11,956,532 · App. 17/462,630 · Granted Apr 9, 2024

Displacement detection method, image-capturing instruction method, displacement detection device, and image-capturing instruction device

Inventors: Satoshi Yoshikawa (Hyogo, JP); Toshiyasu Sugio (Osaka, JP); Toru Matsunobu (Osaka, JP); Masaki Fukuda (Osaka, JP); Kensho Teranishi (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
H04N23/64G06F3/04842G06T7/344G06T19/20H04N23/631H04N23/633G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,956,532
App. No.
17/462,630
Granted
Apr 9, 2024
Kind
B2
Abstract

A displacement detection method, performed by a computer, includes: obtaining (i) a first three-dimensional (3D) model representing a region at a first timing by 3D points and including first objects and (ii) a second three-dimensional model representing the region at a second timing by 3D points and including second objects, the second timing being different from the first timing; detecting, by use of attribute information of the first objects and the second objects, (i) first 3D points included in the first 3D model and (ii) second 3D points included in the second 3D model and associated with the respective first 3D points; performing alignment of the first 3D model and the second 3D model by use of the first 3D points and the second 3D points; and detecting displacement between the first 3D model and the second 3D model after the alignment.

Claims (41)

1. A displacement detection method, performed by a computer, comprising:

obtaining a first three-dimensional (3D) model and a second three-dimensional (3D) model,

the first 3D model representing a region at a first timing by 3D points, the second 3D model representing the region at a second timing by 3D points, the second timing being different from the first timing,

the first 3D model including first objects, the second 3D model including second objects;

detecting, by use of attribute information of the first objects and the second objects, (i) first 3D points included in the first 3D model and (ii) second 3D points included in the second 3D model and associated with the respective first 3D points;

performing alignment of the first 3D model and the second 3D model; and

detecting displacement between the first 3D model and the second 3D model after the alignment, wherein

the detecting of the first 3D points and the second 3D points includes detecting first artificial-object 3D points among the first 3D points and second artificial-object 3D points among the second 3D points associated with the respective first artificial-object 3D points, the first artificial-object 3D points being included in a first artificial object among the first objects, the second artificial-object 3D points being included in a second artificial object among the second objects, and

the alignment is performed by use of the first artificial-object 3D points and the second artificial-object 3D points.

2. The displacement detection method according to claim 1 , wherein

the detecting of the first 3D points and the second 3D points includes detecting first natural-object 3D points among the first 3D points and second natural-object 3D points among the second 3D points associated with the respective first natural-object 3D points, the first natural-object 3D points being included in a first natural object among the first objects, the second natural-object 3D points being included in a second natural object among the second objects, and

the detecting of the first artificial-object 3D points and the second artificial-object 3D points is performed preferentially to the detecting of the first natural-object 3D points and the second natural-object 3D points.

3. The displacement detection method according to claim 1 , wherein

the detecting of the first 3D points and the second 3D points includes:

selecting a first selected object from among the first objects based on a user operation;

selecting, from among the second objects, a second selected object having same attribute information as attribute information of the first selected object; and

detecting the first 3D points and the second 3D points by use of the first selected object and the second selected object.

4. The displacement detection method according to claim 3 , wherein

the selecting of the second selected object includes:

displaying a user interface for a user to select the second selected object from among the second objects; and

selecting the second selected object from among the second objects based on a user operation via the user interface, and

among the second objects, only a second object having the same attribute information as the attribute information of the first selected object is selectable on the user interface.

5. The displacement detection method according to claim 3 , wherein

the selecting of the second selected object includes:

displaying a user interface for a user to select the second selected object from among the second objects;

selecting the second selected object from among the second objects based on a user operation via the user interface; and

emphasizing, among the second objects, a second object having same attribute information as the attribute information of the first selected object more than a second object having attribute information different from the attribute information of the first selected object on the user interface.

6. The displacement detection method according to claim 1 , wherein

the attribute information has a hierarchical structure.

7. A displacement detection device, comprising:

a processor; and

a memory, wherein

the processor, by use of the memory:

obtains a first three-dimensional (3D) model and a second three-dimensional (3D) model,

the first 3D model representing a region at a first timing by 3D points, the second 3D model representing the region at a second timing by 3D points, the second timing being different from the first timing,

the first 3D model including first objects, the second 3D model including second objects;

detects, by use of attribute information of the first objects and the second objects, (i) first 3D points included in the first 3D model and (ii) second 3D points included in the second 3D model and associated with the respective first 3D points;

performs alignment between the first 3D model and the second 3D model; and

detects displacement between the first 3D model and the second 3D model after the alignment, wherein

the detecting of the first 3D points and the second 3D points includes detecting first artificial-object 3D points among the first 3D points and second artificial-object 3D points among the second 3D points associated with the respective first artificial-object 3D points, the first artificial-object 3D points being included in a first artificial object among the first objects, the second artificial-object 3D points being included in a second artificial object among the second objects, and

the alignment is performed by use of the first artificial-object 3D points and the second artificial-object 3D points.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2022
From: YOSHIKAWA, SATOSHI; SUGIO, TOSHIYASU; MATSUNOBU, TORU; FUKUDA, MASAKI; TERANISHI, KENSHO
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 058674/0112 →
Continuity (3)
Continuation PCTJP2020006393 · Feb 19, 2020
Provisional Application 62814046 · Mar 5, 2019
Related Publication 20210400189A1 · Dec 23, 2021