IP Library Granted Patent US 11,948,052
Granted Patent B2
US 11,948,052 · App. 16/934,646 · Granted Apr 2, 2024

Method, electronic device, and computer program product for monitoring field device

Inventors: Danqing Sha (Shanghai, CN); Pedro Fernandez Orellana (Shanghai, CN); Zhen Jia (Shanghai, CN); Xuwei Tang (Nanjing, CN)
Assignee: EMC IP Holding Company LLC
G06N20/00G06Q10/0631G05B2219/39449
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,948,052
App. No.
16/934,646
Granted
Apr 2, 2024
Kind
B2
Abstract

The present disclosure relates to a method, an electronic device, and a computer program product for monitoring a field device. For example, a method for monitoring a field device is provided. The method may include receiving facility information data associated with locations of a group of field devices and a sensing data set acquired by a sensing apparatus arranged near the group of field devices. The method may further include determining, according to a determination that sensing data associated with at least one field device in the group of field devices in the sensing data set is abnormal, a target location of the at least one field device based on the facility information data. In addition, the method may further include generating navigation information from a source location where a user is located to the target location.

Claims (69)

1. A method for monitoring a field device, comprising:

receiving facility information data associated with locations of a group of field devices and a sensing data set acquired by a sensing apparatus arranged near the group of field devices;

determining, according to a determination that sensing data associated with at least one field device in the group of field devices in the sensing data set is abnormal, a target location of the at least one field device based on the facility information data; and

generating navigation information from a source location where a user is located to the target location;

wherein the sensing data comprises a hardware image of the at least one field device, and the method further comprises:

determining, based on the hardware image, hardware data corresponding to an abnormal image portion; and

applying the hardware data to an abnormality solving model to generate suggestion information for solving the abnormality.

2. The method of claim 1 , wherein

the abnormality solving model is obtained by training with reference hardware data as an input and reference suggestion information as an output.

3. The method of claim 1 , wherein the sensing data comprises environmental sensing data of the at least one field device, and the method further comprises:

generating alarm information according to a determination that the environmental sensing data is abnormal.

4. The method of claim 1 , wherein generating the navigation information comprises:

applying the facility information data, the source location, and the target location to a navigation model to generate the navigation information, the navigation model being obtained by training with reference facility information data, a reference source location, and a reference target location as inputs and reference navigation information as an output.

5. The method of claim 1 , wherein the sensing apparatus comprises at least one of the following:

a temperature sensor configured to acquire temperature information of the at least one field device as environmental sensing data of the at least one field device;

a smoke sensor configured to acquire smoke information of the at least one field device as the environmental sensing data; and

a camera configured to acquire a hardware image of the at least one field device.

6. A method for monitoring a field device, comprising:

receiving facility information data associated with locations of a group of field devices and a sensing data set acquired by a sensing apparatus arranged near the group of field devices; and

determining, according to a determination that sensing data associated with at least one field device in the group of field devices in the sensing data set is abnormal, a target location of the at least one field device based on the facility information data;

wherein the facility information data comprises three-dimensional data of a building information model, and the method further comprises:

performing data fusion on the three-dimensional data and the sensing data set to generate a three-dimensional virtual scenario; and

providing the three-dimensional virtual scenario to a user by using a display device, for at least displaying the at least one field device.

7. The method of claim 6 , wherein the display device comprises augmented reality glasses.

8. An electronic device, comprising:

at least one processing unit; and

at least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions configured to be executed by the at least one processing unit, wherein when executed by the at least one processing unit, the instructions cause the electronic device to perform actions comprising:

receiving facility information data associated with locations of a group of field devices and a sensing data set acquired by a sensing apparatus arranged near the group of field devices;

determining, according to a determination that sensing data associated with at least one field device in the group of field devices in the sensing data set is abnormal, a target location of the at least one field device based on the facility information data; and

generating navigation information from a source location where a user is located to the target location;

wherein the sensing data comprises a hardware image of the at least one field device, and the actions further comprise:

determining, based on the hardware image, hardware data corresponding to an abnormal image portion; and

applying the hardware data to an abnormality solving model to generate suggestion information for solving the abnormality.

9. The electronic device of claim 8 , wherein

the abnormality solving model is obtained by training with reference hardware data as an input and reference suggestion information as an output.

10. The electronic device of claim 8 , wherein the sensing data comprises environmental sensing data of the at least one field device, and the actions further comprise:

generating alarm information according to a determination that the environmental sensing data is abnormal.

11. The electronic device of claim 8 , wherein generating the navigation information comprises:

applying the facility information data, the source location, and the target location to a navigation model to generate the navigation information, the navigation model being obtained by training with reference facility information data, a reference source location, and a reference target location as inputs and reference navigation information as an output.

12. The electronic device of claim 8 , wherein the sensing apparatus comprises at least one of the following:

a temperature sensor configured to acquire temperature information of the at least one field device as environmental sensing data of the at least one field device;

a smoke sensor configured to acquire smoke information of the at least one field device as the environmental sensing data; and

a camera configured to acquire a hardware image of the at least one field device.

13. An electronic device, comprising:

at least one processing unit; and

at least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions configured to be executed by the at least one processing unit, wherein when executed by the at least one processing unit, the instructions cause the electronic device to perform actions comprising:

receiving facility information data associated with locations of a group of field devices and a sensing data set acquired by a sensing apparatus arranged near the group of field devices; and

determining, according to a determination that sensing data associated with at least one field device in the group of field devices in the sensing data set is abnormal, a target location of the at least one field device based on the facility information data;

wherein the facility information data comprises three-dimensional data of a building information model, and the actions further comprise:

performing data fusion on the three-dimensional data and the sensing data set to generate a three-dimensional virtual scenario; and

providing the three-dimensional virtual scenario to a user by using a display device, for at least displaying the at least one field device.

14. The electronic device of claim 13 , wherein the display device comprises augmented reality glasses.

15. A computer program product being tangibly stored in a non-transitory computer storage medium and comprising machine-executable instructions, wherein when executed by a device, the machine-executable instructions cause the device to perform a method for monitoring a field device, the method comprising:

receiving facility information data associated with locations of a group of field devices and a sensing data set acquired by a sensing apparatus arranged near the group of field devices;

determining, according to a determination that sensing data associated with at least one field device in the group of field devices in the sensing data set is abnormal, a target location of the at least one field device based on the facility information data; and

generating navigation information from a source location where a user is located to the target location;

wherein the sensing data comprises a hardware image of the at least one field device, and the method further comprises:

determining, based on the hardware image, hardware data corresponding to an abnormal image portion; and

applying the hardware data to an abnormality solving model to generate suggestion information for solving the abnormality.

16. The computer program product of claim 15 , wherein

the abnormality solving model is obtained by training with reference hardware data as an input and reference suggestion information as an output.

17. The computer program product of claim 15 , wherein the sensing data comprises environmental sensing data of the at least one field device, and the method further comprises:

generating alarm information according to a determination that the environmental sensing data is abnormal.

18. The computer program product of claim 15 , wherein the facility information data comprises three-dimensional data of a building information model, and the method further comprises:

performing data fusion on the three-dimensional data and the sensing data set to generate a three-dimensional virtual scenario; and

providing the three-dimensional virtual scenario to the user by using a display device, for at least displaying the at least one field device.

19. The computer program product of claim 18 , wherein the display device comprises augmented reality glasses.

20. The computer program product of claim 15 , wherein generating the navigation information comprises:

applying the facility information data, the source location, and the target location to a navigation model to generate the navigation information, the navigation model being obtained by training with reference facility information data, a reference source location, and a reference target location as inputs and reference navigation information as an output.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053578/0183) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060332/0864 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053574/0221) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060333/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053573/0535) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060333/0106 →
RELEASE OF SECURITY INTEREST AT REEL 053531 FRAME 0108 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0371 →
SECURITY INTEREST Recorded Aug 21, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 053578/0183 →
SECURITY INTEREST Recorded Aug 21, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 053573/0535 →
SECURITY INTEREST Recorded Aug 21, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 053574/0221 →
SECURITY AGREEMENT Recorded Aug 18, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 053531/0108 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2020
From: SHA, DANQING; FERNANDEZ ORELLANA, PEDRO; JIA, ZHEN; TANG, XUWEI
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 053268/0512 →