Method and system for fixtureless assembly of a vehicle platform

1. A system for assembling a vehicle platform, the system comprising:

a robotic assembly system including at least two robotic arms operable to locate components of the vehicle platform, wherein:

each of the at least two robotic arms includes an end-effector and a force sensor configured to provide force feedback, and

the at least two robotic arms includes a first robotic arm configured to locate a first component and a second robotic arm configured to locate the second component, wherein the components of the vehicle platform include the first component and the second component;

a vision system including one or more multidimensional imaging devices configured to capture images of one or more assembly frames at which the components of the vehicle platform are to be located; and

a control system configured to control the robotic assembly system to assemble the vehicle platform based on the images from the vision system, the force feedback from the at least two robotic arms, and a component location model:

the control system includes a processor and a nontransitory computer-readable medium storing instructions that are executable by the processor, and

the instructions include:

identifying one or more assembly features of the first component and the second component from the images from the vision system;

operating the first robotic arm and the second robotic arm to orient the first component and the second component to respective nominal positions, respectively, based on the images from the vision system and the component location model, wherein the component location model is configured to determine a positional offset for each of the first component and the second component, wherein the positional offset is employed to move the first component and the second component to the respective nominal positions; and

operating the first robotic arm and the second robotic arm to assemble the first component to the second component based on the force feedback.

2. The system of claim 1 , wherein the component location model is a trained model configured to provide desired robotic arm positions for the first robotic arm and the second robotic arm based on current positions of the components.

3. The system of claim 1 , wherein, to assemble the first component to the second component, the instructions of the control system further include:

determining whether the force feedback from the force sensors is above a defined setpoint; and

instructing the robotic assembly system to end assembly of the first component and the second component in response to the force feedback being above the defined setpoint.

4. The system of claim 1 , wherein at least one of the one or more multidimensional imaging devices of the vision system is secured to the robotic assembly system.

5. The system of claim 1 , wherein at least one of the one or more multidimensional imaging devices of the vision system is external to the robotic assembly system.

6. The system of claim 1 , wherein to orient the first component and the second component to the respective nominal positions, the instructions of the control system further include:

determining current positions of the first component and the second component based on the assembly features identified in the images;

calculating, by the component location model, the positional offsets for the first component and the second component based on the current positions and the nominal positions; and

operating the first robotic arm and the second robotic arm based on the positional offsets to provide the first component and the second component at respective nominal position.

7. The system of claim 1 , wherein:

the one or more imagining devices are configured to associate the images of the one or more assembly frames to a vision system coordinate system, and

the instructions of the control system further includes converting the images of the one or more assembly frames from the vision system coordinate system to a robotic coordinate system associated with the robotic assembly system.

8. The system of claim 1 further comprising:

a robotic joining system configured to fixedly secure the first component to the second component as part of a securing process,

wherein the instructions of the control system further include operating the robotic joining system to fixedly secure the first component and the second component that are assembled.

9. The system of claim 8 , wherein the robotic joining system includes one or more end-effector tools configured to fixedly secure the first component to the second component via welding, adhesive bonding, mechanical fastening or a combination thereof.

10. The system of claim 8 , wherein the robotic assembly system is configured to control position of the first component and the second component during the securing process by the robotic joining system.

11. A method of assembling a vehicle platform, the method comprising:

locating, by a robotic assembly system, a first component and a second component of the vehicle platform, wherein the robotic assembly system includes at least two robotic arms, each of the at least two robotic arms includes an end-effector and a force sensor configured to provide force feedback, and the at least two robotic arms includes a first robotic arm configured to locate the first component and a second robotic arm configured to locate the second component;

capturing, by a vision system, images of one or more assembly frames at which the first component and the second component of the vehicle platform are to be located, wherein the vision system includes one or more multidimensional imaging devices;

identifying, by a control system, one or more assembly features of the first component and the second component from the images from the vision system;

operating, by the control system, the first robotic arm and the second robotic arm to orient the first component and the second component to respective nominal positions based on the images from the vision system and a component location model, wherein the component location model is configured to determine a positional offset for each of the first component and the second component, wherein the positional offsets are employed to move the first component and the second component to the respective nominal positions; and

operating, by the control system, the first robotic arm and the second robotic arm to assemble the first component to the second component based on the force feedback from the force sensors.

12. The method of claim 11 , wherein the component location model is a trained model configured to provide desired robotic arm positions for the first robotic arm and the second robotic arm based on current positions of the first component and the second component, respectively.

13. The method of claim 11 further comprising, to assemble the first component to the second component:

determining, by the control system, whether the force feedback is above a defined setpoint; and

instructing, by the control system, the robotic assembly system to end assembly of the first component to the second component in response to the force feedback being above the defined setpoint.

14. The method of claim 11 further comprising, to orient the first component and the second component to the respective nominal positions:

determining, by the control system, current positions of the first component and the second component based on the assembly features identified from the images;

calculating, by the control system via the component location model, the positional offsets for the first component and the second component based on the current positions and the nominal positions; and

operating, by the control system, the first robotic arm and the second robotic arm based on the positional offsets to provide the first component and the second component at respective nominal position.

15. The method of claim 11 further comprising:

associating, by the vision system, the images of the one or more assembly frames to a vision system coordinate system; and

converting, by the control system, the images of the one or more assembly frames from the vision system coordinate system to a robotic coordinate system associated with the robotic assembly system.

16. The method of claim 11 further comprising operating, by the control system, a robotic joining system to fixedly secure the first component and the second component that are assembled during a securing process.

17. The method of claim 16 , wherein the robotic joining system includes one or more end-effector tools configured to fixedly secure the first component to the second component via welding, adhesive bonding, mechanical fastening or a combination thereof.

18. The method of claim 16 further comprising controlling, by the robotic assembly system, position of the first component and the second component during the securing process by the robotic joining system.

19. A system for assembling a vehicle platform, the system comprising:

a robotic assembly system including at least two robotic arms operable to locate components of the vehicle platform, wherein:

each of the at least two robotic arms includes an end-effector and a force sensor configured to provide force feedback, and

the at least two robotic arms includes a first robotic arm configured to locate a first component and a second robotic arm configured to locate the second component, wherein the components of the vehicle platform include the first component and the second component;

a vision system including one or more multidimensional imaging devices configured to capture images of one or more assembly frames at which the components of the vehicle platform are to be located; and

a control system configured to control the robotic assembly system to assemble the vehicle platform based on the images from the vision system, the force feedback from the at least two robotic arms, and a component location model:

the control system includes a processor and a nontransitory computer-readable medium storing instructions that are executable by the processor, and

the instructions include:

identifying the assembly features of the first component and the second component from the images from the vision system;

determining current positions of the first component and the second component based on the assembly features identified;

calculating, by the component location model, positional offsets for the first component and the second component based on the current positions and nominal positions for the first component and the second component;

operating the first robotic arm and the second robotic arm based on the positional offsets to provide the first component and the second component at respective nominal position;

operating the first robotic arm and the second robotic arm to assemble the first component to the second component based on the force feedback;

determining whether the force feedback from the force sensors is above a defined setpoint; and

instructing the robotic assembly system to end assembly of the first component and the second component in response to the force feedback being above the defined setpoint.

20. The system of claim 19 further comprising:

a robotic joining system configured to fixedly secure the first component to the second component as part of a securing process,

wherein the instructions of the control system further include operating the robotic joining system to fixedly secure the first component to the second component that are assembled.