IP Library Granted Patent US 12,282,897
Granted Patent B1
US 12,282,897 · App. 18/419,807 · Granted Apr 22, 2025

System and method for establishing contextual links between data in a construction environment

Inventor: Senthil Manickavasagam Kumar (Dublin, CA)
Assignee: Slate Technologies Inc.
G06Q10/103G06F40/30G06N5/02G06Q10/06312G06Q50/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,897
App. No.
18/419,807
Granted
Apr 22, 2025
Kind
B1
Abstract

A method for establishing and generating contextual links between data from a plurality of data sources is described. The method includes receiving data and decomposing the received data into a decomposed data set; parsing and analyzing the decomposed data set based on a set of attribute analyzers to associate one or more attributes to the decomposed data set; determining an intent of data from the decomposed data set; generating a semantic graph of the decomposed data set based on the intent of data to evaluate data relatability between the decomposed data set; generating atomic knowledge units (AMUs) based on the parsed decomposed data set and the semantic graph; analyzing the AMUs corresponding to the received data by applying trained machine learning models to generate links between the AMUs and processing the generated links by a model ensemble to establish contextual links between data.

Claims (68)

1. A method for generating one or more insights related to a building construction project having one or more construction objectives by establishing and generating associative contextual links between data from a plurality of data sources in a computing environment, the method comprising:

obtaining, via a network, the data from the plurality of data sources based on a request received from a client computer for the one or more insights associated with the building construction project, wherein the plurality of data sources corresponds to disparate systems generating unlinked data;

generating a decomposed data set comprising a relevant data set from the obtained data;

parsing and analyzing the decomposed data set based on a set of attribute analyzers to associate one or more attributes to the decomposed data set;

determining an intent of data from the decomposed data set associated with each of the plurality of data sources by applying a natural language parser;

generating a semantic graph of the decomposed data set based on the intent of data to evaluate data relatability between the decomposed data set;

generating atomic knowledge units corresponding to the data based on the parsed decomposed data set and the semantic graph, wherein the atomic knowledge units represent the data in an organized data format;

training one or more machine learning models using training data, wherein the training data includes data relating to the building construction project and one or more user inputs;

analyzing the atomic knowledge units corresponding to the data by applying the one or more trained machine learning models to generate links between the atomic knowledge units based on the one or more attributes;

processing the generated links by a model ensemble implementing an ensemble learning to establish contextual links between the data from the plurality of data sources;

generating a linked data set based on an analysis of the contextual links; and

generating the one or more insights related to the building construction project based on the linked data set and the one or more construction objectives, wherein the construction objectives comprise at least one of schedule optimization of the building construction project, cost optimization of the building construction project and carbon footprint optimization of the building construction project, and the one or more insights identify building construction project actions that contribute to achievement of at least one of the construction objectives.

2. The method of claim 1 , further comprising:

analyzing the linked data set based on the one or more construction objectives,

wherein the generated one or more insights correspond to situational and contextual insights related to the building construction project and are based on the analysis of the linked data set in view of the one or more construction objectives.

3. The method of claim 1 , wherein applying the one or more trained machine learning models further comprising:

applying attribute-based machine learning models on the atomic knowledge units; and

applying non-attribute-based machine learning models trained on construction data on the atomic knowledge units to generate links between the atomic knowledge units.

4. The method of claim 1 , wherein decomposing the received data into the decomposed data set further comprising:

breaking down the received data into smaller units of relevant data and irrelevant data; and

removing the irrelevant data from the decomposed data set.

5. The method of claim 1 , wherein parsing and analyzing the decomposed data set based on the set of attribute analyzers comprises analyzing the decomposed data set based on one or more of a semantic analyzer, a temporal analyzer, a resource analyzer, an intent analyzer, and a location parser.

6. The method of claim 1 , further comprising storing the atomic knowledge units in a multi-dimensional data format including one or more of a multi-dimensional cube representation, a vector representation, word embeddings, a semantic representation, and a linked graph structure data representation.

7. The method of claim 1 , wherein analyzing the atomic knowledge units to generate links between the atomic knowledge units further comprising processing, by a Natural Language Processing (NLP) module, the atomic knowledge units to perform a semantic feature analysis of the atomic knowledge units.

8. The method of claim 7 , further comprising:

analyzing, by a NLP classifier, the processed atomic knowledge units to perform text classification by assigning a set of tags to one or more portions of the atomic knowledge units; and

generating links between atomic knowledge units based on a relatability of the set of tags.

9. The method of claim 1 , wherein processing the generated links by the model ensemble further comprising:

determining a score associated with each generated link; and

correlating the generated links based on the score and one or more construction objectives to establish the contextual links between data from the plurality of data sources.

10. A system for generating one or more insights related to a building construction project having one or more construction objectives by establishing and generating associative contextual links between data from a plurality of data sources in a computing environment, said system comprising:

an Autolink Module having a controller configured to:

obtain, via a network, the data from the plurality of data sources based on a request received from a client computer for the one or more insights associated with the building construction project, wherein the plurality of data sources corresponds to disparate systems generating unlinked data;

generate a decomposed data set comprising a relevant data set from the obtained data;

parse and analyze the decomposed data set based on a set of attribute analyzers to associate one or more attributes to the decomposed data set;

determine an intent of data from the decomposed data set associated with each of the plurality of data sources by applying a natural language parser;

generate a semantic graph of the decomposed data set based on the intent of data to evaluate data relatability between the decomposed data set;

generate atomic knowledge units corresponding to the data based on the parsed decomposed data set and the semantic graph, wherein the atomic knowledge units represent the data in an organized data format;

train one or more machine learning models using training data, wherein the training data includes data relating to the building construction project and one or more user inputs;

analyze the atomic knowledge units corresponding to the received data by applying one or more trained machine learning models to generate links between the atomic knowledge units based on the one or more attributes;

process the generated links by a model ensemble implementing an ensemble learning to establish contextual links between the data from the plurality of data sources;

generate a linked data set based on an analysis of the contextual links; and

generate the one or more insights related to the building construction project based on the linked data set and the one or more construction objectives, wherein the construction objectives comprise at least one of schedule optimization of the building construction project, cost optimization of the building construction project and carbon footprint optimization of the building construction project, and the one or more insights identify building construction project actions that contribute to achievement of at least one of the construction objectives.

11. The system of claim 10 , further comprising an Insights Module configured to:

analyze the linked data set based on the one or more construction objectives,

wherein the generated one or more insights correspond to situational and contextual insights related to the building construction project and are based on the analysis of the linked data set in view of the one or more construction objectives.

12. The system of claim 10 , wherein the controller is further configured to:

apply attribute-based machine learning models on the atomic knowledge units; and

apply non-attribute-based machine learning models trained on construction data on the atomic knowledge units to generate links between the atomic knowledge units.

13. The system of claim 10 , the controller is further configured to:

break down the received data into smaller units of relevant data and irrelevant data; and

remove the irrelevant data from the received data to generate the decomposed data set.

14. The system of claim 10 , further comprising an Atomic Knowledge Units Generator configured to parse and analyze the decomposed data set, the Atomic Knowledge Units Generator comprises a semantic analyzer, a temporal analyzer, a resource analyzer, an intent analyzer, and a location parser.

15. The system of claim 10 , further comprising a Multi-dimensional Data Module configured to store the atomic knowledge units in a multi-dimensional data format including one or more of a multi-dimensional cube representation, a vector representation, word embeddings, a semantic representation, and a linked graph structure data representation.

16. The system of claim 10 , further comprising a Natural Language Processing (NLP) Module configured to perform a semantic feature analysis of the atomic knowledge units.

17. The system of claim 16 , further comprising an NLP Classifier configured to perform text classification on processed atomic knowledge units by assigning a set of tags to one or more portions of the atomic knowledge units, wherein the links between atomic knowledge units are generated based on the set of tags.

18. A non-transitory computer-readable storage medium, having stored thereon a computer-executable program for generating one or more insights related to a building construction project having one or more construction objectives, which, when executed by at least one processor, causes the at least one processor to:

obtain, via a network, data from a plurality of data sources based on a request received from a client computer for the one or more insights associated with the building construction project, wherein the plurality of data sources corresponds to disparate systems generating unlinked data;

generate a decomposed data set comprising a relevant data set from the obtained data;

parse and analyze the decomposed data set based on a set of attribute analyzers to associate one or more attributes to the decomposed data set;

determine an intent of data from the decomposed data set associated with each of the plurality of data sources by applying a natural language parser;

generate a semantic graph of the decomposed data set based on the intent of data to evaluate data relatability between the decomposed data set;

generate atomic knowledge units corresponding to the data based on the parsed decomposed data set and the semantic graph, wherein the atomic knowledge units represent the data in an organized data format;

train one or more machine learning models using training data, wherein the training data includes data relating to the building construction project and one or more user inputs;

analyze the atomic knowledge units corresponding to the received data by applying one or more trained machine learning models to generate links between the atomic knowledge units based on the one or more attributes;

process the generated links by a model ensemble implementing an ensemble learning to establish contextual links between the data from the plurality of data sources;

generate a linked data set based on an analysis of the contextual links; and

generate the one or more insights related to the building construction project based on the linked data set and the one or more construction objectives, wherein the construction objectives comprise at least one of schedule optimization of the building construction project, cost optimization of the building construction project and carbon footprint optimization of the building construction project, and the one or more insights identify building construction project actions that contribute to achievement of at least one of the construction objectives.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2024
From: KUMAR, SENTHIL MANICKAVASAGAM
To: SLATE TECHNOLOGIES INC.
Reel/Frame 066212/0041 →
References Cited (135)
US 2052346A · Garrett · 1936 [cited by applicant]
US 7113915B1 · Montemayor · 2006 [cited by applicant]
US 7283975B2 · Broughton · 2007 [cited by applicant]
US 8204619B2 · Heil · 2012 [cited by applicant]
US 8260648B2 · Elazouni et al. · 2012 [cited by applicant]
US 8775229B1 · Danskin · 2014 [cited by applicant]
US 9070216B2 · Golparvar-Fard et al. · 2015 [cited by applicant]
US 9189571B2 · Loberg · 2015 [cited by applicant]
US 9507885B2 · Yu et al. · 2016 [cited by applicant]
US 9996810B2 · Augenstein et al. · 2018 [cited by applicant]
US 10311529B1 · Noel et al. · 2019 [cited by applicant]
US 10452790B2 · Kim et al. · 2019 [cited by applicant]
US 10460173B2 · Sasson et al. · 2019 [cited by applicant]
US 10572848B2 · Sen · 2020 [cited by applicant]
US 10713607B2 · Pettersson et al. · 2020 [cited by applicant]
US 10846640B2 · Goel et al. · 2020 [cited by applicant]
US 10970796B2 · Sasson et al. · 2021 [cited by applicant]
US 11017335B1 · Ponce de Leon · 2021 [cited by applicant]
US 11100663B2 · Nemoto et al. · 2021 [cited by applicant]
US 11176495B1 · Ron et al. · 2021 [cited by applicant]
US 11208807B1 · Lopes · 2021 [cited by applicant]
US 11263371B2 · Bowen et al. · 2022 [cited by applicant]
US 11263557B2 · Yellin · 2022 [cited by applicant]
US 11381726B2 · Zass · 2022 [cited by applicant]
US 11416958B1 · Reichert et al. · 2022 [cited by applicant]
US 11481853B2 · Bellaish et al. · 2022 [cited by applicant]
US 11531943B1 · Kumar · 2022 [cited by applicant]
US 20020156668A1 · Morrow et al. · 2002 [cited by applicant]
US 20030018507A1 · Flanagan · 2003 [cited by applicant]
US 20030200062A1 · Dessureault et al. · 2003 [cited by applicant]
US 20040236547A1 · Rappaport et al. · 2004 [cited by applicant]
US 20060059838A1 · Pimental · 2006 [cited by applicant]
US 20060075718A1 · Borne et al. · 2006 [cited by applicant]
US 20060190391A1 · Cullen, III et al. · 2006 [cited by applicant]
US 20060228962A1 · Souther et al. · 2006 [cited by applicant]
US 20070245300A1 · Chan et al. · 2007 [cited by applicant]
US 20070265724A1 · Mifsud et al. · 2007 [cited by applicant]
US 20070271073A1 · Mifsud et al. · 2007 [cited by applicant]
US 20080005079A1 · Flake et al. · 2008 [cited by applicant]
US 20080015823A1 · Arnold et al. · 2008 [cited by applicant]
US 20080040264A1 · Allin et al. · 2008 [cited by applicant]
US 20080077364A1 · Wakelam et al. · 2008 [cited by applicant]
US 20080109330A1 · Torres · 2008 [cited by applicant]
US 20080313110A1 · Kreamer · 2008 [cited by applicant]
US 20100010883A1 · Neilsen et al. · 2010 [cited by applicant]
US 20100153280A1 · Fox et al. · 2010 [cited by applicant]
US 20100235206A1 · Miller et al. · 2010 [cited by applicant]
US 20100325196A1 · Beckman et al. · 2010 [cited by applicant]
US 20100325578A1 · Mital et al. · 2010 [cited by applicant]
US 20110181589A1 · Quan et al. · 2011 [cited by applicant]
US 20120066019A1 · Hinshaw et al. · 2012 [cited by applicant]
US 20120131878A1 · Ivanov · 2012 [cited by applicant]
US 20120166177A1 · Beld et al. · 2012 [cited by applicant]
US 20130155058A1 · Golparvar-fard et al. · 2013 [cited by applicant]
US 20140122143A1 · Fletcher · 2014 [cited by applicant]
US 20150193561A1 · Lindberg et al. · 2015 [cited by applicant]
US 20150310135A1 · Forsyth et al. · 2015 [cited by applicant]
US 20160292306A1 · Migneault et al. · 2016 [cited by applicant]
US 20160350973A1 · Shapira et al. · 2016 [cited by applicant]
US 20160378861A1 · Eledath et al. · 2016 [cited by applicant]
US 20170337261A1 · Wang · 2017 [cited by applicant]
US 20180276319A1 · Tierney et al. · 2018 [cited by applicant]
US 20180330258A1 · Harris · 2018 [cited by applicant]
US 20190012605A1 · Rajagopal et al. · 2019 [cited by applicant]
US 20190138667A1 · Benesh et al. · 2019 [cited by applicant]
US 20190200169A1 · Bapna et al. · 2019 [cited by applicant]
US 20190286985A1 · Hirvijarri · 2019 [cited by applicant]
US 20190294673A1 · Sapugay et al. · 2019 [cited by applicant]
US 20190303512A1 · Davies et al. · 2019 [cited by applicant]
US 20190317805A1 · Metsch et al. · 2019 [cited by applicant]
US 20200042915A1 · Samson · 2020 [cited by applicant]
US 20200057811A1 · Seegan et al. · 2020 [cited by applicant]
US 20200412926A1 · Zass et al. · 2020 [cited by applicant]
US 20200413011A1 · Zass et al. · 2020 [cited by applicant]
US 20210073694A1 · Yellin et al. · 2021 [cited by applicant]
US 20210081819A1 · Polleri et al. · 2021 [cited by applicant]
US 20210081859A1 · Goel · 2021 [cited by applicant]
US 20210104100A1 · Whitney et al. · 2021 [cited by applicant]
US 20210120206A1 · Liu et al. · 2021 [cited by applicant]
US 20210125124A1 · Meharwade et al. · 2021 [cited by applicant]
US 20210192099A1 · Benromano et al. · 2021 [cited by applicant]
US 20210287177A1 · Musialek et al. · 2021 [cited by applicant]
US 20210316457A1 · Kang et al. · 2021 [cited by applicant]
US 20210316459A1 · Kang et al. · 2021 [cited by applicant]
US 20210350310A1 · Tashkin · 2021 [cited by applicant]
US 20210383033A1 · Glenn et al. · 2021 [cited by applicant]
US 20220066456A1 · Ebrahimi Afrouzi et al. · 2022 [cited by applicant]
US 20220084140A1 · Daczko et al. · 2022 [cited by applicant]
US 20220130145A1 · Connary et al. · 2022 [cited by applicant]
US 20220215135A1 · Shortridge · 2022 [cited by applicant]
US 20220245353A1 · Turkkan et al. · 2022 [cited by applicant]
US 20220284366A1 · Kelly et al. · 2022 [cited by applicant]
US 20220318936A1 · Copley et al. · 2022 [cited by applicant]
US 20220343155A1 · Mitra · 2022 [cited by applicant]
US 20220358259A1 · Manish et al. · 2022 [cited by applicant]
US 20220405436A1 · Jung et al. · 2022 [cited by applicant]
US 20230185978A1 · Danon et al. · 2023 [cited by applicant]
US 20230251631A1 · Pederson et al. · 2023 [cited by applicant]
US 20240144373A1 · Wu · 2024 [cited by applicant]
CN 114723402A · 2022 [cited by applicant]
KR 102496584B1 · 2023 [cited by applicant]
WO 2019216825A1 · 2019 [cited by applicant]
WO 2020113305A1 · 2020 [cited by applicant]
WO 2022026520A1 · 2022 [cited by applicant]
Malakar, et al., Proceedings of the 30th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering. AIP Conference Proceedings, vol. 1305. AIP Conference Proceedings, vol. 1305,… [cited by examiner]
Cedeno-Mieles, et al., Networked Experiments and Modeling for Producing Collective Identity in a Group of Human Subjects Using an Iterative Abduction Framework, Social Network Analysis and Mining, 10:11, Jan. 7, 2020, p… [cited by examiner]
Castano, et al., Thematic Clustering and Exploration of Linked Data, Lecture Notes in Computer Science (LNCS) 7538, pp. 157-175, 2012 (Year: 2012). [cited by examiner]
Zhou, et al., Contextual Ensemble Network for Semantic Segmentation, Pattern Recognition, vol. 122, Feb. 2022, 108290, pp. 1-11 (Year: 2022). [cited by examiner]
Calikus, et al., Wisdom of the Contexts: Active Ensemble Learning for Contextual Anomaly Detection, arXiv:2101.11560v4 [cs.LG] pp. 1-46, Oct. 4, 2022 (Year: 2022). [cited by examiner]
Gao, et al., ComFact: A Benchmark for Linking Contextual Commonsense Knowledge, Findings of the Association for Computational Linguistics: EMNLP 2022, pp. 1656-1675, Dec. 11, 2022 (Year: 2022). [cited by examiner]
Jun Yang et al., Construction Performance Monitoring Via Still Images, Time-Lapse Photos and Video Streams; Now, Tomorrow, and The Future , Advance Engineering Informatics, vol. 29, Issue 2, 2015, pp. 211-224, ISSN 1474… [cited by applicant]
Venkatasubramanian, Karthik, “Using AI and Machine Learning to Predict Construction Schedule Delays”, Oracle Construction and Engineering Blog, Jul. 1, 2021, pp. 1-5. [cited by applicant]
Fitzsimmons, John et al., “Improving Construction Project Schedules Before Execution”, 37th International Symposium on Automation and Robotics in Construction (ISARC 2020), pp. 1-8. [cited by applicant]
Yang et al., (“Adopting Building Information Modeling (BIM) for the Development of Smart Buildings: A Review of Enabling Applications and Challenges”, Hindawi Advances in Civil Engineering, 2010, pp. 1-26) (Year 2010). [cited by applicant]
Valdes et al. (“Applying Systems Modeling Approaches to Building Construction”, ISARC 2016, pp. 1-9 (Year 2016). [cited by applicant]
Bortolini et al. (“Site logistics planning and control for engineer-to-order prefabricated building systems using BIM 4D modelling”, Automation in Construction 98 (2019) 248-264) (Year 2019). [cited by applicant]
International Searching Authority, “International Search Report and Written Opinion” in application No. PCT/US2023/012778, dated May 16, 2023, 18 pages. [cited by applicant]
International Searching Authority, “International Search Report and Written Opinion” in application No. PCT/US2023/014257, dated Jun. 2, 2023, 14 pages. [cited by applicant]
ChatGPT in Real Estate: Enhancing Property Search and Customer Queries, Open AI, Sep. 29, 2023, 10 pages, https://dasha.ai/en-us/blog/chatgpt-in-real-estate-enhancing-property-search-and-customer-queries. [cited by applicant]
6 Types of Agents in AI (Artificial Intelligence) for your Business, Tanisha Verma, Aug. 16, 2023, 24 pages, https://www.rezo.ai/our-blogs/types-of-agents-in-ai. [cited by applicant]
CrewAI Unleashed: Future of AI Agent Teams, Joao Moura, Dec. 21, 2023, 10 pages, https://blog.langchain.dev/crewai-unleashed-future-of-ai-agent-teams/. [cited by applicant]
International Searching Authority, “International Search Report” and Written Opinion in application No. PCT/US2022/047823, dated Dec. 7, 2022, 10 pages. [cited by applicant]
Taiwan Patent Office, “Office Action”, in application No. 111143737, dated Apr. 17, 2023, 8 pages. [cited by applicant]
International Searching Authority, “International Search Report” and “Written Opinion” in application No. PCT/US2023/015098, dated Apr. 17, 2023, 7 pages. [cited by applicant]
International Searching Authority, “International Search Report” and “Written Opinion” in application No. PCT/US2023/016515, dated Jun. 22, 2023, 8 pages. [cited by applicant]
International Searching Authority, “International Search Report” and “Written Opinion” in application No. PCT/US2023/016521, dated Jul. 12, 2023, 18 pages. [cited by applicant]
Notification Concerning Transmittal of International Preliminary Report on Patentability for PCT Patent Application No. PCT/US2023/012778 dated Sep. 19, 2024. [cited by applicant]
Notification Concerning Transmittal of International Preliminary Report on Patentability for PCT Patent Application No. PCT/US2023/014257 dated Sep. 19, 2024. [cited by applicant]
Notification Concerning Transmittal of International Preliminary Report on Patentability for PCT Patent Application No. PCT/US2023/016515 dated Oct. 10, 2024. [cited by applicant]
Notification Concerning Transmittal of International Preliminary Report on Patentability for PCT Patent Application No. PCT/US2023/016521dated Oct. 10, 2024. [cited by applicant]
Mishra et al., Context Driven Proactive Decision Support for Hybrid Teams, Fall 2019, Association for the Advancement of Artificial Intelligence, pp. 41-57 (Year:2019). [cited by applicant]
Li et al.: Collaborative Filtering Algorithm with Social Information and Dynamic Windows, 2022, Applied Intelligence, Springer, pp. 5261-5272 (Year: 2022). [cited by applicant]
Notification Concerning Transmittal of International Preliminary Report on Patentability for PCT Patent Application No. PCT/US2023/015098 dated Oct. 10, 2024. [cited by applicant]
International Preliminary Report on Patentability, International Application No. PCT/US2022/047823, mailed May 30, 2024. [cited by applicant]
The Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority of the Declaration from International Application No. PCT/US24/30726, dated Aug. 7, 202… [cited by applicant]
Cited By (1)
US 12,579,369