IP Library › Granted Patent US 11,895,396
Granted Patent B2
US 11,895,396 · App. 18/054,476 · Granted Feb 6, 2024

Imaging plan presentation apparatus and method for updating and re-generating an imaging plan

Inventor: Shuhei Horita (Tokyo, JP)
Assignee: FUJIFILM Corporation
H04N23/64H04N23/698
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,895,396
App. No.
18/054,476
Granted
Feb 6, 2024
Kind
B2
Abstract

Provided are an imaging plan presentation apparatus and method capable of presenting an imaging plan to a user in accordance with conditions of images necessary for checking and an imaging range in a captured image. After an imaging unit ( 14 ) completes imaging, an imaging plan update unit ( 15 ) determines whether an uncaptured area has been identified by an uncaptured-area identification unit ( 151 ). If Yes is obtained, the imaging plan update unit ( 15 ) updates the imaging plan on the basis of the uncaptured imaging range, and re-generates an imaging plan corresponding to the uncaptured imaging range. Then, an imaging plan presentation unit ( 13 ) presents an imaging range to be captured next to a user on the basis of the re-generated imaging plan.

Claims (60)

1. An imaging plan presentation apparatus comprising at least one processor configured to:

acquire an imaging condition necessary for detection of damage to a structure;

generate an imaging plan for an entire check point for the structure on the basis of the imaging condition;

present the imaging plan to a user;

update the imaging plan on the basis of an actual imaging result of the check point for the structure;

identify an uncaptured area of the check point for the structure on the basis of the actual imaging result of the check point;

re-generate an imaging plan corresponding to the uncaptured area of the check point for the structure; and

present the re-generated imaging plan to the user,

wherein the actual imaging result includes a plurality of captured images, each of which is an image of a portion of the check point, and

the uncaptured area is identified by comparing the actual imaging result with an actual size of the check point or a full-view image of the check point.

2. The imaging plan presentation apparatus according to claim 1 , wherein the at least one processor is configured to present to the user, an imaging range to be captured next on the basis of the re-generated imaging plan.

3. The imaging plan presentation apparatus according to claim 1 , wherein

the at least one processor is configured to generate an imaging plan such that the number of times imaging is to be performed to cover the entire check point for the structure is minimum.

4. The imaging plan presentation apparatus according to claim 1 , wherein

the at least one processor is configured to generate an imaging plan such that a moving distance of an imaging device to perform imaging to cover the entire check point for the structure is shortest.

5. The imaging plan presentation apparatus according to claim 1 , wherein

the imaging condition includes a size of the structure, the number of pixels of a captured image, a resolution, and an overlap rate between different images.

6. The imaging plan presentation apparatus according to claim 5 , wherein

the imaging plan is an imaging range corresponding to sub-areas obtained by dividing a surface of the check point for the structure into a plurality of areas, and wherein

the at least one processor is configured to:

calculate an actual imaging size of each captured image from the resolution and the number of pixels, and

generate, as an imaging plan, an imaging range that covers the surface of the check point for the structure at the overlap rate or greater.

7. The imaging plan presentation apparatus according to claim 6 , wherein

the imaging plan includes an imaging order of the sub-areas, and

the at least one processor is configured to generate an imaging plan such that a moving distance of an imaging device to perform imaging in the imaging order is shortest.

8. The imaging plan presentation apparatus according to claim 6 , wherein

the at least one processor is configured to present the imaging range in such a manner that the imaging range is superimposed on a drawing of the structure.

9. The imaging plan presentation apparatus according to claim 6 , wherein

the at least one processor is configured to present the imaging range in such a manner that the imaging range is superimposed on a drawing of the structure displayed on a display.

10. The imaging plan presentation apparatus according to claim 6 , wherein

the at least one processor is configured to present the imaging range in such a manner that the imaging range is superimposed on the check point for the structure by using a projector.

11. The imaging plan presentation apparatus according to claim 6 , wherein

the at least one processor is configured to present the imaging range in such a manner that the imaging range is superimposed on a captured image of the check point for the structure by using an augmented reality device.

12. The imaging plan presentation apparatus according to claim 6 , wherein

the at least one processor is configured to guide the user to an imaging position on the basis of position information of an imaging device or distance measurement information from the imaging device to the structure.

13. The imaging plan presentation apparatus according to claim 1 , wherein

the at least one processor is configured to combine the plurality of captured images to create a panoramic image,

the uncaptured area is identified on the basis of the actual size of the check point and the panoramic image, and

the at least one processor is configured to re-generate an imaging plan corresponding to the identified uncaptured area.

14. The imaging plan presentation apparatus according to claim 1 , wherein

the plurality of captured images is a plurality of sub-images,

the uncaptured area is identified by checking the plurality of sub-images against the full-view image, and

the at least one processor is configured to re-generate an imaging plan corresponding to the identified uncaptured area.

15. The imaging plan presentation apparatus according to claim 1 , wherein

the at least one processor is configured to acquire an actual imaging condition including at least one of an imaging position of an actually captured image of the check point for the structure, an imaging direction, an imaging distance, a focal length, or a sensor size,

the uncaptured area is identified on the basis of the actual imaging condition, and

the at least one processor is configured to re-generate an imaging plan corresponding to the identified uncaptured area.

16. An imaging plan presentation method performed by a computer, comprising:

acquiring an imaging condition necessary for detection of damage to a structure;

generating an imaging plan for an entire check point for the structure on the basis of the imaging condition;

presenting the imaging plan to a user;

updating the imaging plan on the basis of an actual imaging result of the check point for the structure;

identifying an uncaptured area of the check point for the structure on the basis of the actual imaging result of the check point;

re-generating an imaging plan corresponding to the uncaptured area of the check point for the structure; and

presenting the re-generated imaging plan to the user,

wherein the actual imaging result includes a plurality of captured images, each of which is an image of a portion of the check point, and

the uncaptured area is identified by comparing the actual imaging result with an actual size of the check point or a full-view image of the check point.

17. The imaging plan presentation method according to claim 16 , wherein

presenting the re-generated imaging plan to the user includes presenting an imaging range to be captured next to the user on the basis of the re-generated imaging plan.

18. A non-transitory computer-readable recording medium for causing a computer to perform the imaging plan presentation method according to claim 16 when instructions stored in the recording medium are read by the computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2022
From: HORITA, SHUHEI
To: FUJIFILM CORPORATION
Reel/Frame 061725/0744 →
Priority Claims (1)
JP 2018-126941 · Jul 3, 2018 · national
Continuity (3)
Continuation 17115188 · Dec 8, 2020
Continuation PCTJP2019025340 · Jun 26, 2019
Related Publication 20230072448A1 · Mar 9, 2023