Work instruction system and work instruction method

1 . A work instruction system comprising:

an imaging device, capturing an image including a portion of an operator and a target to be assembled;

a wearable display device, worn by the operator; and

an information processing device, comprising a processor that is configured to:

identify a process to be performed to assemble the target, wherein the process comprises a plurality of element tasks;

acquire the captured image including the portion of the operator and the target from the imaging device;

detect a position of the target and a position of the portion of the operator in the captured image;

determine a distance between the position of the target and the position of the operator based on the position of the target and the position of the portion of the operator in the captured image;

determine a completion of a current element task among the plurality of element tasks when the distance between the position of the target and the position of the operator is within a predetermined distance;

identify among the plurality of element tasks an element task to be performed next in response to determining that the current element task has been completed; and

control the wearable display device to display the plurality of element tasks of the process at a same time on the wearable display device and to highlight the element task to be performed next on the wearable display device,

wherein the wearable display device is a glasses-style head mount device, which display the plurality of element tasks that overlaps a field of view of the operator.

2 . The work instruction system according to claim 1 , wherein

each of the plurality of element tasks is a collection of a series of operations having a same purpose.

3 . The work instruction system according to claim 1 , wherein

each of the plurality of element tasks is a collection of a series of operations using a same tool with respect to the target.

4 . The work instruction system according to claim 1 , wherein

each of the plurality of element tasks is a collection of a series of operations in which a same member is attached to or removed from the target.

5 . A work instruction method comprising:

capturing an image including a position of an operator and a target to be assembled by an imaging device;

identifying a process to be performed to assemble the target, wherein the process comprises a plurality of element tasks;

acquiring the captured image including the portion of the operator and the target from the imaging device;

detecting a position of the target and a position of the portion of the operator in the captured image;

determining a distance between the position of the target and the position of the operator based on the position of the target and the position of the portion of the operator in the captured image;

determining a completion of a current element task among the plurality of element tasks when the distance between the position of the target and the position of the operator is within a predetermined distance;

identifying among the plurality of element tasks an element task to be performed next in response to determining that the current element task has been completed; and

control a wearable display device worn by the operator to display the plurality of element tasks of the single process at a same time and highlight the element task to be performed next,

wherein the wearable display device is a glasses-style head mount device, which display the plurality of element tasks that overlaps a field of view of the operator.

6 . The work instruction system according to claim 1 , wherein the plurality of element tasks of the process are displayed in a list on the wearable display device, and the element task to be performed next among the plurality of the element tasks in the list, and

wherein the processor is further configured to further illustrate, on the wearable display device, an operation of the element task to be performed next by highlighting an area corresponding to the operation in the field of view of the operator along with an instruction for performing the operation.