IP Library Granted Patent US 11,762,358
Granted Patent B2
US 11,762,358 · App. 17/745,520 · Granted Sep 19, 2023

Building system with semantic modeling based searching

Inventor: Siddharth Goyal (Germantown, WI)
Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
G05B19/0426G05B13/0265G06F3/0482G06F3/0484G06F3/04817G06F9/451G06F16/242G06F16/248G06F30/13G06F40/30G05B2219/23008G05B2219/25011G06F3/0481G06F2111/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,762,358
App. No.
17/745,520
Granted
Sep 19, 2023
Kind
B2
Abstract

A building system including one or more memory devices configured to store instructions thereon, wherein the instructions, when executed by one or more processors, cause the one or more processors to cause a user interface of a user device to display a plurality of nodes of a semantic building model and a plurality of relationships between the plurality of nodes of the semantic building model. The instructions cause the one or more processors to receive a search input from the user device, generate a search result based on the search input, wherein the search result comprises an indication of a portion of nodes of the plurality of nodes and a portion of relationships of the plurality of relationships, and cause the user interface to display the portion of nodes of the plurality of nodes and the portion of relationships of the plurality of relationships.

Claims (71)

1. A building system, comprising:

one or more memory devices configured to store instructions thereon, that, when executed by one or more processors, cause the one or more processors to:

cause a user device to display a graphic interface including a first element including a plurality of nodes of a building graph and a plurality of relationships between the plurality of nodes of the building graph and a second element configured to receive a text based input from the user device;

receive, via the second element of the graphic interface, the text based input from the user device, the text based input identifying a first node type, a relationship type, and a second node type;

generate a result based on the text based input by identifying a first node of the plurality of nodes of the first node type related by a relationship of the plurality of relationships of the relationship type to a second node of the plurality of nodes of the second node type; and

modify the first element of the graphic interface to indicate the first node, the second node, and the relationship, wherein the first node and the second node are visually connected to represent the relationship.

2. The building system of claim 1 , wherein the text based input defines a query in a query language;

wherein the instructions cause the one or more processors to:

generate the query based on the text based input; and

perform the query on the building graph to generate the result.

3. The building system of claim 1 , wherein the instructions cause the one or more processors to:

modify the first element of the graphic interface by zooming from a first view of the building graph to a second view of a portion of the building graph comprising the first node, the second node, and the relationship.

4. The building system of claim 1 , wherein the instructions cause the one or more processors to:

modify the first element of the graphic interface by removing nodes and relationships of the building graph other than the first node, the second node, and the relationship from the first element.

5. The building system of claim 1 , wherein the instructions cause the one or more processors to:

receive, via the user device, a selection of a portion of nodes of the plurality of nodes and a portion of relationships of the plurality of relationships; and

generate an application based on an application definition and the portion of nodes and the portion of relationships.

6. The building system of claim 1 , wherein the text based input is a natural language input defined by a user of the user device; and

wherein the instructions cause the one or more processors to:

generate a query based on the natural language input; and

perform the query on the building graph to generate the result.

7. The building system of claim 1 , wherein the instructions cause the one or more processors to:

determine whether the plurality of nodes include a plurality of first nodes of the first node type related by a plurality of particular relationships of the relationship type to a plurality of second nodes of the second node type; and

modify the first element of the graphic interface to indicate the plurality of first nodes, the plurality of second nodes, and the plurality of particular relationships responsive to a determination that the plurality of first nodes of the first node type are related by the plurality of particular relationships of the relationship type to the plurality of second nodes of the second node type.

8. The building system of claim 1 , wherein the instructions cause the one or more processors to:

receive a shape drawn by a user on the graphic interface around a portion of nodes of the plurality of nodes and a portion of relationships of the plurality of relationships; and

modify the first element of the graphic interface to indicate the portion of nodes and the portion of relationships.

9. The building system of claim 1 , wherein the instructions cause the one or more processors to:

receive historical user input indicating feedback of a user to previous search results;

store the historical user input in the one or more memory devices; and

generate the result based on a learning model and the historical user input.

10. The building system of claim 1 , wherein the instructions cause the one or more processors to:

receive historical user input indicating feedback of a user to previous search results;

store the historical user input in the one or more memory devices;

receive, one or more interactions with the graphic interface causing the graphic interface to display one or more nodes of the plurality of nodes and one or more relationships of the plurality of relationships; and

update the historical user input to include the one or more interactions.

11. A method, comprising:

causing, by one or more processing circuits, a user device to display a graphic interface including a first element including a plurality of nodes of a building graph and a plurality of relationships between the plurality of nodes of the building graph and a second element configured to receive a text based input from the user device;

receiving, by the one or more processing circuits, via the second element of the graphic interface, the text based input from the user device, the text based input identifying a first node type, a relationship type, and a second node type;

generating, by the one or more processing circuits, a result based on the text based input by identifying a first node of the plurality of nodes of the first node type related by a relationship of the plurality of relationships of the relationship type to a second node of the plurality of nodes of the second node type; and

modifying, by the one or more processing circuits, the first element of the graphic interface to indicate the first node, the second node, and the relationship, wherein the first node and the second node are visually connected to represent the relationship.

12. The method of claim 11 , wherein the text based input defines a query in a query language; and

wherein the method comprising:

generating, by the one or more processing circuits, the query based on the text based input; and

performing, by the one or more processing circuits, the query on the building graph to generate the result.

13. The method of claim 11 , comprising:

modifying, by the one or more processing circuits, the first element of the graphic interface by zooming from a first view of the building graph to a second view of a portion of the building graph comprising the first node, the second node, and the relationship.

14. The method of claim 11 , comprising:

modifying, by the one or more processing circuits, the first element of the graphic interface by removing nodes and relationships of the building graph other than the first node, the second node, and the relationship from the first element.

15. The method of claim 11 , comprising:

receiving, by the one or more processing circuits, via the user device, a selection of a portion of nodes of the plurality of nodes and a portion of relationships of the plurality of relationships; and

generating, by the one or more processing circuits, an application based on an application definition and the portion of nodes and the portion of relationships.

16. The method of claim 11 , wherein the text based input is a natural language input defined by a user of the user device; and

wherein the method includes:

generating, by the one or more processing circuits, a query based on the natural language input; and

performing, by the one or more processing circuits, the query on the building graph to generate the result.

17. The method of claim 11 , comprising:

determining, by the one or more processing circuits, whether the plurality of nodes include a plurality of first nodes of the first node type related by a plurality of particular relationships of the relationship type to a plurality of second nodes of the second node type; and

modifying, by the one or more processing circuits, the first element of the graphic interface to indicate the plurality of first nodes, the plurality of second nodes, and the plurality of particular relationships responsive to a determination that the plurality of first nodes of the first node type are related by the plurality of particular relationships of the relationship type to the plurality of second nodes of the second node type.

18. The method of claim 11 , comprising:

receiving, by the one or more processing circuits, a shape drawn by a user on the graphic interface around a portion of nodes of the plurality of nodes and a portion of relationships of the plurality of relationships; and

modifying, by the one or more processing circuits, the first element of the graphic interface to indicate the portion of nodes and the portion of relationships.

19. The method of claim 11 , comprising:

receiving, by the one or more processing circuits, historical user input indicating feedback of a user to previous search results;

storing, by the one or more processing circuits, the historical user input in one or more memory devices; and

generating, by the one or more processing circuits, the result based on a learning model and the historical user input.

20. One or more non-transitory storage media configured to store instructions thereon, wherein one or more processors execute the instructions to:

cause a user device to display a graphic interface including a first element including a plurality of nodes of a building graph and a plurality of relationships between the plurality of nodes of the building graph and a second element configured to receive a text based input from the user device;

receive, via the second element of the graphic interface, the text based input from the user device, the text based input identifying a first node type, a relationship type, and a second node type;

generate a result based on the text based input by identifying a first node of the plurality of nodes of the first node type related by a relationship of the plurality of relationships of the relationship type to a second node of the plurality of nodes of the second node type; and

modify the first element of the graphic interface to indicate the first node, the second node, and the relationship, wherein the first node and the second node are visually connected to represent the relationship.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2024
From: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
To: TYCO FIRE & SECURITY GMBH
Reel/Frame 067056/0552 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2023
From: GOYAL, SIDDHARTH
To: JOHNSON CONTROLS TECHNOLOGY COMPANY
Reel/Frame 062732/0623 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2023
From: JOHNSON CONTROLS TECHNOLOGY COMPANY
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 062732/0661 →
Continuity (4)
Continuation 16379661 · Apr 9, 2019
Provisional Application 62791991 · Jan 14, 2019
Provisional Application 62769447 · Nov 19, 2018
Related Publication 20220350301A1 · Nov 3, 2022