IP Library › Granted Patent US 12,363,424
Granted Patent B2
US 12,363,424 · App. 18/413,807 · Granted Jul 15, 2025

Displacement detection method, image-capturing instruction method, displacement detection device, and image-capturing instruction device

Inventors: Satoshi Yoshikawa (Hyogo, JP); Toshiyasu Sugio (Osaka, JP); Toru Matsunobu (Osaka, JP); Masaki Fukuda (Osaka, JP); Kensho Teranishi (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
H04N23/64G06F3/04842G06T7/344G06T19/20H04N23/631H04N23/633G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,363,424
App. No.
18/413,807
Filed
Jan 16, 2024
Granted
Jul 15, 2025
Kind
B2
Art Unit
2612
USPC
348/207.1
Abstract

A displacement detection method, performed by a computer, includes: obtaining (i) a first three-dimensional (3D) model representing a region at a first timing by 3D points and including first objects and (ii) a second three-dimensional model representing the region at a second timing by 3D points and including second objects, the second timing being different from the first timing; detecting, by use of attribute information of the first objects and the second objects, (i) first 3D points included in the first 3D model and (ii) second 3D points included in the second 3D model and associated with the respective first 3D points; performing alignment of the first 3D model and the second 3D model by use of the first 3D points and the second 3D points; and detecting displacement between the first 3D model and the second 3D model after the alignment.

Claims (26)

1. An image-capturing instruction method comprising:

specifying a region of a first three-dimensional model where points are sparse, the first three-dimensional model being generated by using a captured first image; and

displaying, on a display, a route for a user to travel along to capture a second image in the region specified, the second image being for use in generating a second three-dimensional model, wherein

movement of the user instructed with the route includes movement in a direction other than an image depth direction.

2. The image-capturing instruction method according to claim 1 , wherein

the displaying includes displaying the route on a bird's-eye view of the three-dimensional model.

3. The image-capturing instruction method according to claim 2 , wherein

the displaying includes displaying an image-capturing direction at an image-capturing point in the route on the bird's-eye view.

4. An image-capturing instruction method comprising:

specifying a region of a first three-dimensional model where image-recapturing is required, the first three-dimensional model being generated by using a captured first image; and

displaying, on a display, a route for a user to travel along to capture a second image in the region specified, the second image being for use in generating a second three-dimensional model, wherein

movement of the user instructed with the route includes movement in a direction other than an image depth direction.

5. An image-capturing instruction device comprising:

a processor; and

a memory, wherein

the processor, by use of the memory:

specifies a region of a first three-dimensional model where points are sparse, the first three-dimensional model being generated by using a captured first image; and

displays, on a display, a route for a user to travel along to capture a second image in the region specified, the second image being for use in generating a second three-dimensional model, wherein

movement of the user instructed with the route includes movement in a direction other than an image depth direction.

6. An image-capturing instruction device comprising:

a processor; and

a memory, wherein

the processor, by use of the memory:

specifies a region of a first three-dimensional model where image-recapturing is required, the first three-dimensional model being generated by using a captured first image; and

displays, on a display, a route for a user to travel along to capture a second image in the region specified, the second image being for use in generating a second three-dimensional model, wherein

movement of the user instructed with the route includes movement in a direction other than an image depth direction.

Continuity (4)
Division 17462630 · Aug 31, 2021
Continuation PCTJP2020006393 · Feb 19, 2020
Provisional Application 62814046 · Mar 5, 2019
Related Publication 20240155224A1 · May 9, 2024
References Cited (25)
US 7668406B2 · Schnee · 2010 [cited by examiner]
US 9876993B2 · Sablak · 2018 [cited by examiner]
US 10848731B2 · Simek · 2020 [cited by examiner]
US 11677920B2 · Simek · 2023 [cited by examiner]
US 20030098352A1 · Schnee · 2003 [cited by examiner]
US 20040100563A1 · Sablak · 2004 [cited by examiner]
US 20100318929A1 · Hilton · 2010 [cited by examiner]
US 20170270386A1 · Trouve · 2017 [cited by examiner]
US 20190174109A1 · Yoshikawa et al. · 2019 [cited by applicant]
US 20190191146A1 · Koyama et al. · 2019 [cited by applicant]
US 20190258225A1 · Link · 2019 [cited by examiner]
US 20210333979A1 · Rockel · 2021 [cited by examiner]
US 20230269353A1 · Simek · 2023 [cited by examiner]
EP 2911090 · 2015 [cited by applicant]
JP 2002328021 · 2002 [cited by applicant]
JP 2005114744 · 2005 [cited by applicant]
JP 201784004 · 2017 [cited by applicant]
JP 2017227608 · 2017 [cited by applicant]
JP 22018129682 · 2018 [cited by applicant]
JP 2018129682A · 2018 [cited by examiner]
JP 2019118136 · 2019 [cited by applicant]
WO 2018030206 · 2018 [cited by applicant]
WO 2018043225 · 2018 [cited by applicant]
International Search Report (ISR) issued on May 26, 2020 in International (PCT) Application No PCT/JP2020/006393. [cited by applicant]
Extended European Search Report issued Apr. 4, 2022 in corresponding European Patent Application No. 20766301.4. [cited by applicant]