Component assembly work support system and component assembly method
The system includes imaging unit which images a work space at a viewpoint position in a visual line direction of a worker together with an other component to which one component is to be installed, a position attitude information obtaining unit which obtains position attitude information which indicates relative position attitude relation between viewpoint of the worker and other component in the work space, a virtual image generating unit which generates virtual image of an actual shape of the one component at the viewpoint position in the visual line direction of the worker based on position attitude information, an image composing unit which generates composite image by superimposing virtual image on a real image in the work space imaged by the imaging unit, and display unit which displays composite image. According to the system, efficiency of component assembly work can be considerably improved by using mixed reality technology.
1. A component assembly work support system for supporting a component assembly work, comprising:
an imaging unit configured to image a work space at a viewpoint position in a visual line direction of a worker together with an other component to which one component is to be installed;
a position attitude information obtaining unit configured to obtain position attitude information that indicates a relative position attitude relation between a viewpoint of the worker and the other component in the work space;
a virtual image generating unit configured to generate a virtual image based on data obtained by a unit that measures an actual shape of the one component at the viewpoint position in the visual line direction of the worker based on the position attitude information;
an image composing unit configured to generate a composite image by superimposing the virtual image on a real image of the other component in the work space imaged by the imaging unit to determine whether the one component and the other component fit together, based on whether there is an error in how the one component and the other component fit together before the one component and the other component are assembled without requiring the presence of both components in the same place,
wherein the error is based on whether the actual shape of the virtual image of the one component deviates from an ideal shape of the one component; and
a display unit configured to display the composite image.
2. The component assembly work support system according to claim 1 , wherein the virtual image generating unit generates the virtual image based on three-dimensional actual shape data of the one component obtained by a three-dimensional scanner.
3. The component assembly work support system according to claim 1 , wherein the position attitude information obtaining unit has a marker for mixed reality installed temporarily in a predetermined relative position with respect to a reference point on the other component.
4. The component assembly work support system according to claim 1 , wherein the position attitude information obtaining unit has a position direction measuring device configured to measure the viewpoint position and the visual line direction of the worker and a position of the workpiece.
5. The component assembly work support system according to claim 1 , further comprising: an assembly procedure information generating portion configured to generate assembly procedure information regarding a component assembly procedure, the assembly procedure information generated in the assembly procedure information generating portion being incorporated into the composite image generated by the image composing unit.
6. The component assembly work support system according to claim 1 , wherein the actual shape of the virtual image of the one component deviates from the ideal shape of the one component when at least one of a machining error, a mounting error, distortion, deformation, and processing of the one component causes the shape of the one component to deviate from the ideal shape.
7. A component assembly method using a component assembly work support system for supporting a component assembly work, comprising:
an imaging step that images a work space at a viewpoint position in a visual line direction of a worker together with an other component to which one component is to be installed;
a position attitude information obtaining step that obtains position attitude information indicating a relative position attitude relation between a viewpoint of the worker and the other component in the work space;
a virtual image generating step that generates a virtual image based on data obtained by a unit that measures an actual shape of the one component at the viewpoint position in the visual line direction of the worker based on the position attitude information;
an image composing step that generates a composite image by superimposing the virtual image on a real image of the other component in the work space imaged in the imaging step to determine whether the one component and the other component fit together, based on whether there is an error in how the one component and the other component fit together before the one component and the other component are assembled without requiring the presence of both components in the same place,
wherein the error is based on whether the actual shape of the virtual image of the one component deviates from an ideal shape of the one component; and
a display step that displays the composite image.
8. The component assembly method according to claim 7 , wherein the position attitude information obtaining step includes a marker installing step that temporarily installs a marker for mixed reality in a predetermined relative position with respect to a reference point on the other component.
9. The component assembly method according to claim 7 , wherein the virtual image based on data obtained by the unit that measures the actual shape of the one component is fitted to a real image of the other component in the composite image projected in the display step in order to determine a quality of assembly of the one component and the other component.
10. The component assembly method according to claim 7 , further comprising: an assembly procedure information generating step that generates assembly procedure information regarding a component assembly procedure, the assembly procedure information generated in the assembly procedure information generating step being incorporated into the composite image generated in the image composing step.