IP Library › Granted Patent US 11,270,524
Granted Patent B2
US 11,270,524 · App. 16/781,389 · Granted Mar 8, 2022

Computer system and method for documenting items identified while at a construction site

Inventors: Florian Winterstein (Rolling Hills Est, CA); Raf Colasante (Santa Barbara, CA)
Assignee: Procore Technologies, Inc.
G06V20/20G06F40/205G06F40/295G06T7/0004G06V20/35G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,270,524
App. No.
16/781,389
Granted
Mar 8, 2022
Kind
B2
Abstract

In order to improve a user's task of documenting items that are identified by the user while at a construction site, a computing system may be configured to (i) analyze media content captured at a construction site (e.g., an audio or audiovisual recording) that is descriptive of at least one given on-site item identified by a user while at the construction site, (ii) extract, from the captured media content, a set of information for the given on-site item, (iii) based on the extracted set of information for the given on-site item, generate a data record for the given on-site item, and (iv) cause the generated data record for the given on-site item to be presented to the user for review.

Claims (47)

1. A computing system comprising:

a communication interface that is configured to facilitate communication via one or more communication networks;

at least one processor;

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing system is capable of:

analyzing media content captured at a construction site that is descriptive of at least one given on-site item identified by a user while at the construction site;

based on the analyzing, extracting, from the captured media content, a set of information for the given on-site item;

based on the extracted set of information for the given on-site item, generating an editable data record for the given on-site item, wherein the editable data record includes data representing at least a portion of the extracted set of information; and

causing the editable data record for the given on-site item to be presented to the user for review.

2. The computing system of claim 1 , further comprising program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing system is capable of:

after causing the editable data record for the given on-site item to be presented to the user for review, receiving user input related to the editable data record; and

updating the editable data record in accordance with the received user input.

3. The computing system of claim 2 , wherein the received user input related to the editable data record comprises one or both of a requested edit to the editable data record or an indication that the user has approved the editable data record.

4. The computing system of claim 1 , wherein the captured media content comprises one of an audio recording or an audiovisual recording that is descriptive of the given on-site item.

5. The computing system of claim 1 , wherein analyzing the captured media content comprises:

translating the captured media content into text that describes the given on-site item; and

performing an analysis of the text translation.

6. The computing system of claim 5 , wherein translating the captured media content into text that describes the given on-site item comprises one or both of (i) using speech recognition to transcribe audio data included in the captured media content into text that describes the given on-site item or (ii) using image recognition to identify one or more objects within video data included in the captured media content and then generating text that describes the identified one or more objects.

7. The computing system of claim 5 , wherein the analysis of the text translation comprises one or more of dependency parsing, text summarization, name recognition, or text classification.

8. The computing system of claim 1 , wherein the extracted set of information for the given on-site item comprises one or more of a description of the given on-site item, a title of the given on-site item, a categorization of the given on-site item, an individual responsible for the given on-site item, or a location of the given on-site item.

9. The computing system of claim 1 , wherein the captured media content is supplemented with location information for the given on-site item.

10. The computing system of claim 1 , wherein causing the editable data record for the given on-site item to be presented to the user for review comprises:

transmitting the editable data record to a client station via a communication network and thereby causing the client station to present the editable data record to the user.

11. A non-transitory computer-readable medium, wherein the non-transitory computer-readable medium is provisioned with program instructions that are executable by at least one processor of a computing system such that the computing system is capable of:

analyzing media content captured at a construction site that is descriptive of at least one given on-site item identified by a user while at the construction site;

based on the analyzing, extracting, from the captured media content, a set of information for the given on-site item;

based on the extracted set of information for the given on-site item, generating an editable data record for the given on-site item, wherein the editable data record includes data representing at least a portion of the extracted set of information; and

causing the editable data record for the given on-site item to be presented to the user for review.

12. The non-transitory computer-readable medium of claim 11 , wherein the non-transitory computer-readable medium is further provisioned with program instructions that are executable by the at least one processor of the computing system such that the computing system is capable of:

after causing the editable data record for the given on-site item to be presented to the user for review, receiving user input related to the editable data record; and

updating the editable data record in accordance with the received user input.

13. The non-transitory computer-readable medium of claim 12 , wherein the received user input related to the editable data record comprises one or both of a requested edit to the editable data record or an indication that the user has approved the editable data record.

14. The non-transitory computer-readable medium of claim 11 , wherein the captured media content comprises one of an audio recording or an audiovisual recording that is descriptive of the given on-site item.

15. The non-transitory computer-readable medium of claim 11 , wherein analyzing the captured media content comprises:

translating the captured media content into text that describes the given on-site item; and

performing an analysis of the text translation.

16. The non-transitory computer-readable medium of claim 15 , wherein translating the captured media content into text that describes the given on-site item comprises one or both of (i) using speech recognition to transcribe audio data included in the captured media content into text that describes the given on-site item or (ii) using image recognition to identify one or more objects within video data included in the captured media content and then generating text that describes the identified one or more objects.

17. The non-transitory computer-readable medium of claim 11 , wherein the extracted set of information for the given on-site item comprises one or more of a description of the given on-site item, a title of the given on-site item, a categorization of the given on-site item, an individual responsible for the given on-site item, or a location of the given on-site item.

18. A computer-implemented method comprising:

analyzing media content captured at a construction site that is descriptive of at least one given on-site item identified by a user while at the construction site;

based on the analyzing, extracting, from the captured media content, a set of information for the given on-site item;

based on the extracted set of information for the given on-site item, generating an editable data record for the given on-site item, wherein the editable data record includes data representing at least a portion of the extracted set of information; and

causing the editable data record for the given on-site item to be presented to the user for review.

19. The computer-implemented method of claim 18 , further comprising:

after causing the editable data record for the given on-site item to be presented to the user for review, receiving user input related to the editable data record; and

updating the editable data record in accordance with the received user input.

20. The computer-implemented method of claim 18 , wherein the captured media content comprises one of an audio recording or an audiovisual recording that is descriptive of the given on-site item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: WINTERSTEIN, FLORIAN; COLASANTE, RAF
To: PROCORE TECHNOLOGIES, INC.
Reel/Frame 051746/0858 →
Continuity (1)
Related Publication 20210240987A1 · Aug 5, 2021
Cited By (1)
US 12,488,407