IP Library Granted Patent US 10,846,806
Granted Patent B2
US 10,846,806 · App. 16/277,083 · Granted Nov 24, 2020

System and method for annotation of construction site images

Inventors: Michael Sasson (Petah Tikva, IL); Ron Zass (Kiryat Tivon, IL); Shalom Bellaish (Tel Mond, IL); Moshe Nachman (Tel-Aviv, IL)
Assignee: CONSTRU LTD
G06Q50/08G06F16/2379G06F16/583G06K9/00624G06K9/00637G06K9/00671G06K9/623G06K9/6215G06K9/6256G06K9/78G06N20/00G06Q10/06311G06Q40/025G06Q40/08G06Q40/12G06T7/001G06T7/0004G06T7/70G06T2200/24G06T2207/20092G06T2207/30132G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,846,806
App. No.
16/277,083
Granted
Nov 24, 2020
Kind
B2
Abstract

Systems and methods for annotation of construction site images are provided. For example, image data captured from a construction site using at least one image sensor may be obtained. Further, at least one construction plan associated with the construction site and including information related to an object may be obtained. The at least one construction plan may be analyzed to identify a first region of the image data corresponding to the object. The at least one display device may be used to present at least part of the image data to a user with an indication of the identified first region of the image data corresponding to the object. Further, the at least one display device may be used to present to the user a query related to the object. A response to the query may be received from the user. The response may be used to update information associated with the object in at least one electronic record associated with the construction site.

Claims (85)

1. A system for annotation of construction site images, the system comprising:

at least one display device;

at least one image sensor configured to capture image data from a construction site; and

at least one processor configured to:

obtain at least one construction plan associated with the construction site and including information related to an object;

analyze the at least one construction plan to identify a first region of the image data corresponding to the object;

use the at least one display device to present at least part of the image data to a user with an indication of the identified first region of the image data corresponding to the object;

use the at least one display device to present to the user a query related to the object;

receive from the user a response to the query; and

use the response to update information associated with the object in at least one electronic record associated with the construction site.

2. The system of claim 1 , wherein the at least one processor is further configured to:

in response to an indication received from the user that the object is depicted in the identified first region of the image data, make a first update to the at least one electronic record associated with the construction site;

analyze the at least one construction plan to identify a second region of the image data corresponding to the object;

in response to an indication received from the user that the object is not depicted in the identified first region of the image data, use the at least one display device to present at least part of the image data to a user with an indication of the identified second region of the image data corresponding to the object;

use the at least one display device to present to the user a second query of whether the object is depicted in the identified second region of the image data;

receive from the user in response to the second query an indication that the object is depicted in the identified second region of the image data; and

in response to the indication that the object is not depicted in the identified first region of the image data and the indication that the object is depicted in the identified second region of the image data, make a second update to the at least one electronic record associated with the construction site, the second update differs from the first update.

3. A method for annotation of construction site images, the method comprising:

obtaining image data captured from a construction site using at least one image sensor;

obtaining at least one construction plan associated with the construction site and including information related to an object;

analyzing the at least one construction plan to identify a first region of the image data corresponding to the object;

presenting at least part of the image data to a user with an indication of the identified first region of the image data corresponding to the object;

presenting to the user a query related to the object;

receiving from the user a response to the query; and

using the response to update information associated with the object in at least one electronic record associated with the construction site.

4. The method of claim 3 , further comprising:

presenting to the user a query of whether the object is depicted in the identified first region of the image data;

receiving from the user an indication of whether the object is depicted in the identified first region of the image data in response to the query; and

using the received indication of whether the object is depicted in the identified first region of the image data to update at least one electronic as-built model associated with the construction site.

5. The method of claim 3 , further comprising:

receiving from the user an indication of at least one location corresponding to the object within the identified first region of the image data; and

using the received indication of at least one location corresponding to the object to update at least one electronic as-built model associated with the construction site.

6. The method of claim 3 , further comprising:

presenting to the user a query of a construction stage associated with the object;

receiving from the user an indication of the construction stage associated with the object in response to the query; and

using the received construction stage associated with the object to update at least one electronic progress record associated with the construction site.

7. The method of claim 3 , further comprising:

presenting to the user a query of a construction stage associated with the object;

receiving from the user an indication of the construction stage associated with the object in response to the query; and

using the received construction stage associated with the object to update at least one time indication associated with a future task in at least one electronic project schedule associated with the construction site.

8. The method of claim 3 , further comprising:

presenting to the user a query of a quantity associated with the object;

receiving from the user an indication of quantity associated with the object in response to the query; and

using the received indication of quantity associated with the object to update at least one electronic financial record associated with the construction site.

9. The method of claim 3 , further comprising:

presenting to the user a query of a state associated with the object;

receiving from the user an indication of the state associated with the object in response to the query;

using the received indication of the state associated with the object to identify at least one construction error associated with the object; and

using the identified at least one construction error associated with the object to update the at least one electronic record associated with the construction site.

10. The method of claim 3 , further comprising:

presenting to the user a query of a state associated with the object;

receiving from the user an indication of the state associated with the object in response to the query;

using the received indication of the state associated with the object to identify at least one safety issue associated with the object; and

using the identified at least one safety issue associated with the object to update the at least one electronic record associated with the construction site.

11. The method of claim 3 , further comprising:

in response to an indication received from the user that the object is depicted in the identified first region of the image data, making a first update to the at least one electronic record associated with the construction site;

analyzing the at least one construction plan to identify a second region of the image data corresponding to the object;

in response to an indication received from the user that the object is not depicted in the identified first region of the image data, presenting at least part of the image data to a user with an indication of the identified second region of the image data corresponding to the object;

presenting to the user a second query of whether the object is depicted in the identified second region of the image data;

receiving from the user in response to the second query an indication that the object is depicted in the identified second region of the image data; and

in response to the indication that the object is not depicted in the identified first region of the image data and the indication that the object is depicted in the identified second region of the image data, making a second update to the at least one electronic record associated with the construction site, the second update differs from the first update.

12. The method of claim 3 , wherein the at least one construction plan associated with the construction site includes information related to a plurality of alternative objects, and wherein the method further comprises analyzing at least one electronic project schedule associated with the construction site to select the object of the plurality of alternative objects.

13. The method of claim 3 , wherein the information related to the object includes a planned location for the object, and wherein the identified first region of the image data includes a region of the image data corresponding to the planned location for the object.

14. The method of claim 3 , further comprising analyzing the image data and the at least one construction plan to identify the first region of the image data corresponding to the object.

15. The method of claim 3 , further comprising using information based on an analysis of second image data captured from the construction site at least one day before the capturing of the image data from the construction site and the at least one construction plan to identify the first region of the image data corresponding to the object.

16. The method of claim 3 , wherein the at least one construction plan associated with the construction site further includes information related to a second object, and wherein the method further comprises:

analyzing the at least one construction plan to identify a second region of the image data corresponding to the second object; and

presenting at least part of the image data to a user with an indication of the identified second region of the image data corresponding to the second object.

17. The method of claim 16 , wherein the presentation of the indication of the identified region of the image data corresponding to the object and the presentation of the indication of the identified second region of the image data corresponding to the second object are at least partially concurrent.

18. The method of claim 3 , further comprising, in response to an indication received from the user that the object is not depicted in the identified first region of the image data, causing capturing of additional image data from the construction site.

19. A non-transitory computer readable medium storing data and computer implementable instructions for carrying out a method for annotation of construction site images, the method comprising:

obtaining image data captured from a construction site using at least one image sensor;

obtaining at least one construction plan associated with the construction site and including information related to an object;

analyzing the at least one construction plan to identify a first region of the image data corresponding to the object;

presenting at least part of the image data to a user with an indication of the identified first region of the image data corresponding to the object;

presenting to the user a query related to the object;

receiving from the user a response to the query; and

using the response to update information associated with the object in at least one electronic record associated with the construction site.

20. The non-transitory computer readable medium of claim 19 , wherein the method further comprises:

in response to an indication received from the user that the object is depicted in the identified first region of the image data, making a first update to the at least one electronic record associated with the construction site;

analyzing the at least one construction plan to identify a second region of the image data corresponding to the object;

in response to an indication received from the user that the object is not depicted in the identified first region of the image data, presenting at least part of the image data to a user with an indication of the identified second region of the image data corresponding to the object;

presenting to the user a second query of whether the object is depicted in the identified second region of the image data;

receiving from the user in response to the second query an indication that the object is depicted in the identified second region of the image data; and

in response to the indication that the object is not depicted in the identified first region of the image data and the indication that the object is depicted in the identified second region of the image data, making a second update to the at least one electronic record associated with the construction site, the second update differs from the first update.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2019
From: SASSON, MICHAEL; ZASS, RON; BELLAISH, SHALOM; NACHMAN, MOSHE
To: CONSTRU LTD
Reel/Frame 049258/0833 →
Continuity (4)
Provisional Application 62631757 · Feb 17, 2018
Provisional Application 62666152 · May 3, 2018
Provisional Application 62791841 · Jan 13, 2019
Related Publication 20190180433A1 · Jun 13, 2019