IP Library Granted Patent US 12,347,340
Granted Patent B2
US 12,347,340 · App. 16/978,128 · Granted Jul 1, 2025

Systems and methods to simulate robotic joining operations

Inventors: Pedro Gerardo Marquinez Torrecilla (Annapolis, MD); Francisco Jose Diaz Cano (Huelva, ES)
Assignee: SEABERY NORTH AMERICA, INC.
G09B9/00G09B19/24G09B25/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,347,340
App. No.
16/978,128
Granted
Jul 1, 2025
Kind
B2
Abstract

Systems and methods to simulate robotic joining operations are disclosed. An example system to simulate a robotic application includes: an image sensor configured to capture images of a physical simulation workpiece and a physical simulation welding torch manipulated by a robotic arm during welder during a simulated operation; and a simulator configured to: calculate a simulated result based on the captured images and based on communications output by the robotic arm; and output a visual representation of the simulated result.

Claims (24)

1. A system to output a simulated welding result from a robotic welding operation, the system comprising:

a robot;

a physical welding implement connected to the robot;

a physical workpiece; and

a simulator configured to calculate a simulated welding result on the physical workpiece based on a communications output by the robot during a performance of the robotic welding operation with the physical welding implement, the simulated welding result comprising a simulated weld bead or a simulated weld joint;

wherein the simulator is configured to evaluate the performance of the robotic welding operation, based on the simulated welding result, during the performance of the robotic welding operation; and

wherein the robot and the simulator are configured to exchange command data in a bidirectional communication during the performance of the robotic welding operation, based on the evaluation of the simulator, wherein said command data is at least one instruction selected from a group of instructions comprising: starting or stopping welding with the physical welding implement, and starting or stopping a simulated flow of welding power, gas or electrode.

2. The system as defined in claim 1 , wherein the simulator is configured to determine one or more weld parameters based on the communications output by the robot.

3. The system as defined in claim 1 , further comprising a robot interpreter configured to convert communications from the robot to a simulator communication format.

4. The system as defined in claim 3 , wherein the communications from the robot comprise a standardized field bus format.

5. The system as defined in claim 1 , further comprising a robot controller configured to program the robot to execute the robotic welding operation.

6. The system as defined in claim 1 , wherein the simulator is configured to calculate the simulated welding result for discrete slices of a simulation domain, the discrete slices comprising respective cross-sections of the physical workpiece.

7. The system as defined in claim 1 , wherein the simulator is coupled to the robot using a welding power supply interface of the robot.

8. The system as defined in claim 1 , wherein the simulator is configured to generate a visualization of the physical workpiece and the simulated weld bead or the simulated weld joint on the physical workpiece, at least one of during the simulated operation in a mixed reality environment or after the simulated operation in a fully digitalized environment.

9. The system as defined in claim 8 , wherein the simulator is configured to transmit the simulated welding result to a remote device configured to provide a different perspective of the physical workpiece and the simulated weld bead or the simulated weld joint based on the simulated welding result.

10. The system as defined in claim 1 , wherein the robot comprises a robotic arm.

11. The system as defined in claim 1 , wherein the command data exchanged between the robot and the simulator further comprise one or more of the following instructions: starting and/or stopping a hardware driver; opening or closing a communication channel between the robot and the simulator; starting or stopping the robotic operation; data reading and/or code writing in the robot or the simulator; receiving or transmitting status information about the robot, the simulator or a simulated power supply.

12. The system as defined in claim 1 , further comprising a robot interface configured to exchange the command data between the simulator and the robot.

13. The system as defined in claim 1 , wherein the robot and the simulator are configured to mutually exchange the command data, and wherein the command data further comprise start data, stop data and code-writing data to, respectively, start, stop and modify the program routine of the hardware driver of the robot.

14. The system as defined in claim 1 , further comprising:

an image sensor configured to capture images of the physical workpiece and the physical welding implement during the simulated operation; and wherein the simulator is further configured to calculate the simulated welding result based on the captured images.

15. The system as defined in claim 14 , wherein the simulator is configured to determine one or more parameters of the simulated welding result based on interpreting visual markers in the captured images, and to calculate the simulated welding result based on the one or more parameters.

16. The system as defined in claim 14 , wherein the simulator is configured to determine one or more parameters of the simulated welding result based on interpreting key points in the captured images, and to calculate the simulated welding result based on the one or more parameters.

17. The system as defined in claim 1 , wherein the physical welding implement comprises a welding torch.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2022
From: TORRECILLA, PEDRO GERARDO MARQUINEZ; DIAZ CANO, FRANCISCO JOSE
To: SEABERY NORTH AMERICA, INC.
Reel/Frame 061079/0296 →
Priority Claims (2)
EP 18382147 · Mar 7, 2018 · regional
EP 18382152 · Mar 8, 2018 · regional
Continuity (1)
Related Publication 20210012678A1 · Jan 14, 2021
References Cited (29)
US 5621672A · Kobayashi · 1997 [cited by examiner]
US 9811074B1 · Aichele · 2017 [cited by examiner]
US 20020120921A1 · Coburn · 2002 [cited by examiner]
US 20110108536A1 · Inada · 2011 [cited by examiner]
US 20110183304A1 · Wallace · 2011 [cited by examiner]
US 20130040270A1 · Albrecht · 2013 [cited by examiner]
US 20130183645A1 · Wallace et al. · 2013 [cited by applicant]
US 20140017642A1 · Postlethwaite · 2014 [cited by applicant]
US 20150206341A1 · Loper · 2015 [cited by applicant]
US 20160078683A1 · Sudol · 2016 [cited by applicant]
US 20160214200A1 · Beeson · 2016 [cited by examiner]
US 20160267806A1 · Hsu · 2016 [cited by examiner]
US 20170200395A1 · Albrecht · 2017 [cited by examiner]
US 20180095640A1 · Albright · 2018 [cited by examiner]
US 20190375101A1 · Miyata · 2019 [cited by examiner]
EP 2863376 · 2015 [cited by applicant]
KR 20170049990 · 2017 [cited by examiner]
SE 531104 · 2002 [cited by examiner]
International Search Report and Written Opinion corresponding to International Patent Application No. PCT/IB2019/000265, mailed Jul. 12, 2019. [cited by applicant]
Anonymous: “AugmentedArc (TM) Augmented Reality Welding System”, May 30, 2017, pp. 1-4, XP055501429. [cited by applicant]
H.C. Fang et al.: “Robot Path and End-Effector Orientation Planning Using Augmented Reality”, Procedia Cirp, vol. 3, Jan. 1, 2012, pp. 191-196, XP055503026. [cited by applicant]
Anonymous: “Polygon mesh—Wikipedia”, Sep. 24, 2017, pp. 1-10, XP055502156. [cited by applicant]
White, SA, Prachyabrued, M., Chambers, T. L. et al. Low-cost simulated MIG welding for advancement in technical training. Virtual Reality 15, 69-81 (2011). https://doi.org/10.1007/s10055-010-0162-x (Year: 2011). [cited by applicant]
A. Schilling, Jens Basanow, A. Zipf, Vector based Mapping of Polygons on Irregular Terrain Meshes for Web 3D Map Services, Published in WEBIST 2007 (Year: 2007). [cited by applicant]
European Search Report Appln No. 18382150 dated Aug. 27, 2018. [cited by applicant]
Juihuei Yao et al., “Concept of creation of an improved artificial intelligence system and computerized trainer for virtual welding”, The Paton Welding Journal, vol. 2017, No. 6, Jun. 28, 2017, pp. 19-26, XP055501436. [cited by applicant]
Wang et al. “AprilTag 2: Efficient and robust fiducial detection” 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Daejeon Convention Center Oct. 9-14, 2016, Daejeon, Korea (Year: 2016). [cited by applicant]
Non-Final Office Action U.S. Appl. No. 16/978,132 dated Aug. 3, 2021. [cited by applicant]
Non-Final Office Action U.S. Appl. No. 16/978,131 dated Feb. 16, 2022. [cited by applicant]