Virtual spatially registered video overlay display
A method of identifying an accurate assembly of a component onto a workpiece to an operator includes the use of a laser projector and a headset or goggles. The laser projector projects laser images relative to the workpiece. The headset or goggles includes an imaging device and a display element. A location of the laser projector, the imaging device and the display element is registered in a common coordinate system relative to the workpiece. The imaging device generates an image of a view of the workpiece appearing in the display element when viewed by the operator though the display element. A computer generated image of the component is overlaid upon the image of the workpiece being disposed in a geometrically accurate location on the image of the workpiece. The image of the workpiece appearing in the display element is registered to the three dimensional coordinate system defined relative to the workpiece.
1. A method of identifying an accurate assembly of a component onto a workpiece to an operator, comprising the steps of:
providing a laser projector for projecting laser images relative to the workpiece;
providing a headset for the operator with said headset including an imaging device and a display element;
registering a location of said laser projector, said imaging device and said display element in a three dimensional coordinate system relative to the workpiece by said imaging device detecting the laser images;
said imaging device generating a virtual image of a view of the workpiece appearing in said display element when viewed by the operator though the display element;
overlaying a computer generated image of the component upon the virtual image of the view of the workpiece generated by the imaging device with the computer generated image of the component being disposed in a geometrically accurate location on the image of the workpiece;
registering the image of the workpiece appearing in the display element to the three dimensional coordinate system defined relative to the workpiece.
2. The method set forth in claim 1 , including a step of generating an image of the view of the workpiece at a location disposed between the workpiece and the display element.
3. The method set forth in claim 1 , further including a step of providing said headset with an environmental tracking feature.
4. The method set forth in claim 3 , further including a step of said environmental tracking feature signaling said laser projector with a position and view of said imaging device of said headset.
5. The method set forth in claim 1 , registering a location of said laser projector, said imaging device and said display element in a three dimensional coordinate system relative to the workpiece is further defined by said laser projector projecting laser images toward said workpiece and said imaging device detecting a pattern of the laser images.
6. The method set forth in claim 1 , further including a step of updating the image of the workpiece displayed by said display element in real time thereby maintaining the overlay of the computer generated image of the component in a dimensionally accurate geometrical location relative to the workpiece.
7. The method set forth in claim 1 , further including a step of cropping and scaling the image of the view appearing in the display element to match the operator's geometric view of the workpiece.
8. The method set forth in claim 1 , further including a step of said display element generating a video overlay of the component on the workpiece at preliminary location prior to aligning the computer generate image of the component on a geometrically accurate location on the image of the workpiece.
9. The method set forth in claim 1 , further including a step of verifying correct placement of the component on the workpiece by comparing a placement of the component on the workpiece with computer generated image of the component disposed in a geometrically accurate location of the image of the workpiece.
10. The method set forth in claim 9 , wherein said step of verifying correct placement of the component on the workpiece is further defined by aligning an image of the component placed upon the workpiece with the computer generated image of the component overlaid on the image of the workpiece.
11. A method of identifying an accurate assembly of a component onto a workpiece to an operator, comprising the steps of:
providing a laser projector for projecting laser images relative to the workpiece;
providing a headset for the operator with said headset including an imaging device, an environmental tracking feature and a display element;
registering a location of said laser projector, said imaging device and said display element in a three dimensional coordinate system relative to the workpiece by said imaging device detecting the laser images;
said environmental tracking feature signally said laser projector with a position and view of said imaging device of said headset;
said imaging device generating an image of a view of the workpiece appearing in said display element when viewed by the operator though the display element;
overlaying a computer generated image of the component upon the with the computer generated image of the component being disposed in a geometrically accurate location on the image of the workpiece;
registering the image of the workpiece appearing in the display element to the three dimensional coordinate system defined relative to the workpiece.
12. The method set forth in claim 1 , including a step of generating an image of the view of the workpiece at a location disposed between the workpiece and the display element.
13. The method set forth in claim 1 , registering a location of said laser projector, said imaging device and said display element in a three dimensional coordinate system relative to the workpiece is further defined by said laser projector projecting laser images toward said workpiece and said imaging device detecting a pattern of the laser images.
14. The method set forth in claim 1 , further including a step of updating the image of the workpiece displayed by said display element in real time thereby maintaining the overlay of the computer generated image of the component in a dimensionally accurate geometrical location relative to the workpiece.
15. The method set forth in claim 1 , further including a step of cropping and scaling the image of the view appearing in the display element to match the operator's geometric view of the workpiece.
16. The method set forth in claim 1 , further including a step of said display element generating a video overlay of the component on the workpiece at preliminary location prior to aligning the computer generate image of the component on a geometrically accurate location on the image of the workpiece.
17. The method set forth in claim 1 , further including a step of verifying correct placement of the component on the workpiece by comparing a placement of the component on the workpiece with computer generated image of the component disposed in a geometrically accurate location of the image of the workpiece.
18. The method set forth in claim 9 , wherein said step of verifying correct placement of the component on the workpiece is further defined by aligning an image of the component placed upon the workpiece with the computer generated image of the component overlaid on the image of the workpiece.