Transparent display-based work assistance method and device for construction machinery

1 . A transparent display-based work assistance method for construction machinery performed by at least one processor, the method comprising:

receiving an image obtained by capturing a surrounding of the construction machinery from at least one image sensor;

activating a transparent display panel in a partial area or the entire area of a glass of the construction machinery;

displaying the captured image or a content associated with work of the construction machinery on the activated transparent display panel;

acquiring user information including information on a visibility of a worker of the construction machinery; and

converting an image corrected to correspond to the visibility of the worker according to the user information into a virtual image for displaying on the transparent display panel.

2 . The transparent display-based work assistance method for construction machinery of claim 1 , wherein the receiving of the captured image includes

receiving an image captured through at least one image sensor installed at one side of a boom of the construction machinery, and

wherein the displaying of the captured image or the content associated with work of the construction machinery on the activated transparent display panel includes

displaying the received image in the partial area or the entire area of the transparent display panel based on a motion of the boom.

3 . The method of claim 1 , further comprising:

detecting an object included in the image by using a predetermined moving object detection (MOD) algorithm; and

displaying information on the detected object on the transparent display panel jointly with the image.

4 . The method of claim 3 , further comprising:

calculating a distance between the detected object and the construction machinery; and

displaying information related to the calculated distance on the transparent display panel jointly with the image.

5 . The method of claim 3 , further comprising:

displaying a warning icon on the transparent display panel jointly with the image when the detected object exists within a predetermined distance from the construction machinery.

6 . The method of claim 2 , further comprising:

displaying an image representing a shape of a boom of the construction machinery jointly with the image when the received image is displayed on the transparent display panel.

7 . The method of claim 2 , further comprising:

determining an area where the visibility of the worker of the construction machinery is blocked by a motion of the construction machinery in an area of the transparent display panel,

wherein the displaying of the received image in the partial area or the entire area of the transparent display panel based on the motion of the boom includes

displaying the received image on the determined area of the transparent display panel.

8 . The method of claim 1 , further comprising:

judging whether there is an obstacle blocking the visibility of the worker of the construction machinery,

wherein the activating of the transparent display panel in the partial area or the entire area of the glass of the construction machinery includes

activating the transparent display panel according to whether there is the obstacle.

9 . Construction machinery including a cabin where a worker is located, the construction machinery comprising:

a glass placed on at least one side of the cabin;

a transparent display panel replacing at least a partial area of the glass;

an image sensor configured to capture a surrounding image of the construction machinery; and

a control unit configured to activate the transparent display panel based on work information or a worker signal of the construction machinery,

wherein the transparent display panel is configured to display the captured image or a content associated with work of the construction machinery, and

wherein the control unit is configured to acquire user information including information on a visibility of a worker of the construction machinery and to convert an image corrected to correspond to the visibility of the worker according to the user information into a virtual image for displaying on the transparent display panel.

10 . The construction machinery of claim 9 , wherein the control unit is configured to detect an object included in the image by using a predetermined MOD algorithm, and to display information on the detected object on the transparent display panel jointly with the image.

11 . The construction machinery of claim 9 , wherein the control unit is configured to detect an object included in the image by using a predetermined MOD algorithm, and to display a warning icon on the transparent display panel when the detected object exists within a predetermined distance from the construction machinery.

12 . The construction machinery of claim 9 , wherein the control unit is configured to detect an object included in the image by using a predetermined MOD algorithm, and to display the information on the detected object on the transparent display panel without outputting the image.

13 . The construction machinery of claim 9 , wherein the transparent display panel is placed on a side of the cabin,

the construction machinery includes an excavator, and

a work machine of the excavator is placed on a front part of the transparent display panel.

14 . The construction machinery of claim 13 , wherein the control unit is configured to activate or deactivate the transparent display panel based on a motion of swinging left or right by the work machine of the excavator.

15 . The construction machinery of claim 9 , wherein the transparent display panel includes a partial or entire activation area.

16 . The construction machinery of claim 9 , wherein the transparent display panel includes

an auxiliary image configured to be changed based on the image output to the transparent display panel, and

an icon image or text image configured to be changed independently of the image output to the transparent display panel.

17 . The construction machinery of claim 9 , wherein the image sensor is placed away from the construction machinery.