System and method for generating HMI graphics

1. A computer-implemented method for generating human machine interface, HMI, graphics associated with an industrial automation system implementing machine learning, the method being performed by a graphic object detection model, the method comprising:

receiving a migrated HMI graphics, wherein said migrated HMI graphics being obtained from a legacy HMI graphics and wherein said migrated HMI graphics comprises a plurality of industrial objects;

identifying at least one missing industrial object in said migrated HMI graphics using a historical HMI labelled dataset of the at least one industrial object, wherein the at least one industrial object comprises a graphical object and a data object;

correcting the migrated HMI graphics to include said at least one missing industrial object;

generating a corrected HMI graphics comprising said at least one missing industrial object; and

transmitting a notification indicating the corrected HMI graphics to a computing device.

2. The computer-implemented method according to claim 1 , wherein identifying said at least one missing industrial object in said migrated HMI graphics comprises:

identifying said at least one industrial object in said migrated HMI graphics and legacy HMI graphics using an object recognition technique;

determining differences between said identified industrial object in the legacy HMI graphics and said identified industrial object in the migrated HMI graphics; and

identifying said at least one missing industrial object in the migrated HMI graphics based on said determined differences and using the historical HMI labelled dataset of the at least one industrial object.

3. The computer-implemented method according to claim 1 , wherein identifying said at least one missing industrial object in said migrated HMI graphics comprises:

obtaining at least one placeholder in the migrated HMI graphics;

detecting location of said at least one missing industrial object in the migrated HMI graphics based on said at least one place holder; and

creating at least one bounding box around at the at least one identified placeholder.

4. The computer-implemented method according to claim 3 , wherein said at least one bounding box is created using a template matching and an image processing.

5. The computer-implemented method according to claim 1 , further comprising:

evaluating said at least one identified missing industrial object using a one-to-one mapping between said plurality of industrial objects; and

including the at least one missing industrial object on the at least one respective placeholder of the migrated HMI graphics.

6. The computer-implemented method according to claim 1 , wherein a scene-text recognition technique is used to identify the missing industrial object.

7. The computer-implemented method according to claim 1 , wherein said notification comprises at least one of text notification, sound notification, and a graphical notification and wherein said historical HMI labelled dataset comprises a plurality of HMI labelled images of the at least one industrial objects.

8. The computer-implemented method according to claim 1 , wherein said at least one missing industrial object indicates that at least one industrial object is missed in a scene of the migrated HMI graphics.

9. An industrial automation system implementing machine learning for generating human machine interface, HMI, graphics, wherein the industrial automation system comprising:

a processing unit;

a memory communicatively coupled to the processing unit; and

a graphic object detection model communicatively coupled to the processing unit and the memory, the graphic object detection model configured to:

receive a migrated HMI graphics, wherein said migrated HMI graphics being obtained from a legacy HMI graphics and wherein said migrated HMI graphics comprises at least one industrial object,

identify at least one missing industrial object in said migrated HMI graphics using a historical HMI labelled dataset of the at least one industrial object, wherein the at least one industrial object comprises a graphical object and a data object,

correct the migrated HMI graphics to include said at least one missing industrial object,

generate a corrected HMI graphics comprising said at least one missing industrial object, and

transmit a notification indicating the corrected HMI graphics to a computing device.

10. The industrial automation system according to claim 9 , wherein the graphic object detection model configured to identify said at least one missing industrial object in said migrated HMI graphics comprises:

identifying said at least one industrial object in said migrated HMI graphics and legacy HMI graphics using an object recognition technique;

determining differences between said identified industrial object in the legacy HMI graphics and said identified industrial object in the migrated HMI graphics; and

identifying said at least one missing industrial object in the migrated HMI graphics based on said determined differences and using the historical HMI labelled dataset of the at least one industrial object.

11. The industrial automation system according to claim 9 , wherein the graphic object detection model configured to identifying said at least one missing industrial object in said migrated HMI graphics comprises:

obtaining at least one placeholder in the migrated HMI graphics;

detecting location of said at least one missing industrial object in the migrated HMI graphics based on said at least one place holder; and

creating at least one bounding box around at the at least one identified place holder.

12. The industrial automation system according to claim 9 , wherein the graphic object detection model is further configured to:

evaluate said at least one identified missing industrial object using a one-to-one mapping; and

include the at least one missing industrial object on the at least one respective placeholder of the migrated HMI graphics.

13. The industrial automation system according to claim 12 , wherein a scene-text recognition technique is used to identify the missing industrial object.

14. The industrial automation system according to claim 9 , wherein said notification comprises at least one of text notification, sound notification, and a graphical notification and wherein said historical HMI labelled dataset comprises a plurality of HMI labelled images of the at least one industrial objects.

15. A computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions, the computer program being loadable into a graphic object detection model and configured to cause execution of a method when the computer program is run by the graphic object detection model, the method being caused to be executed comprising:

receiving a migrated HMI graphics, wherein said migrated HMI graphics being obtained from a legacy HMI graphics and wherein said migrated HMI graphics comprises a plurality of industrial objects;

identifying at least one missing industrial object in said migrated HMI graphics using a historical HMI labelled dataset of the at least one industrial object, wherein the at least one industrial object comprises a graphical object and a data object;

correcting the migrated HMI graphics to include said at least one missing industrial object;

generating a corrected HMI graphics comprising said at least one missing industrial object; and

transmitting a notification indicating the corrected HMI graphics to a computing device.