IP Library › Granted Patent US 12,191,619
Granted Patent B2
US 12,191,619 · App. 17/660,320 · Granted Jan 7, 2025

Method, system, and computer program product for wire connector assembly

Inventors: Lars E. Blacken (Bothell, WA); Heiko Hoffmann (Simi Valley, CA); Damien O. Martin (Everett, WA); Jeffrey McCaskey (Chicago, IL); Bradley J. Mitchell (Snohomish, WA)
Assignee: The Boeing Company
H01R43/20B25J9/1687G05B19/4155G05B2219/50391
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,191,619
App. No.
17/660,320
Granted
Jan 7, 2025
Kind
B2
Abstract

A method, system and computer program product are provided for automated insertion of a wire contact into an insertion hole of a connector. Methods include: controlling a robot having an end-effector to position a wire contact proximate to a connector using a wire gripper and a separator device of the end-effector; controlling the robot to advance the separator device between two or more wires previously connected to the connector; controlling the robot to align the wire contact with a insertion hole of the connector; controlling the robot to advance the wire contact toward the insertion hole of the connector and at least partially insert the wire contact into the insertion hole; controlling the robot to release the wire contact from the wire gripper; and controlling the robot to withdraw the wire gripper and the separator device from between the two or more wires previously connected to the connector.

Claims (62)

1. A system for automated insertion of a wire contact into a designated wire contact insertion hole of a connector, the system comprising:

a robot having an end-effector, wherein the end-effector comprises a wire gripper holding the wire contact and a separator device; and

a computing device, wherein the computing device is configured to:

control the robot to advance the separator device past one in a first direction between two or more wires previously connected to the connector;

control the robot to advance the separator device between the two or more wires previously connected to the connector in a second direction different from the first direction away from the connector, wherein the first direction is not coaxial with the second direction;

control the robot to align the wire contact with the designated wire contact insertion hole of the connector;

control the robot to advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole;

control the robot to release the wire contact from the wire gripper; and

control the robot to withdraw the wire gripper and the separator device from between the two or more wires previously connected to the connector.

2. The system of claim 1 , wherein the computing device configured to control the robot to advance the separator device in a first direction between two or more wires previously connected to the connector is further configured to:

control the robot to advance the separator device from a first position relative to the wire gripper to a second position relative to the wire gripper, wherein the first position is further from the connector than the wire gripper, and wherein the second position is closer to the connector than the wire gripper; and

control the robot to drive the separator device between the two or more wires in a position between the wire gripper and the connector.

3. The system of claim 2 , wherein the computing device configured to control the robot to advance the separator device between the two or more wires previously connected to the connector is further configured to:

control the robot to move the separator device from the second position relative to the wire gripper to the first position relative to the wire gripper with the separator device engaged with the two or more wires previously connected to the connector.

4. The system of claim 3 , wherein the computing device configured to control the robot to advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole further comprises causing the robot to:

advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole unobstructed by the two or more wires previously connected to the connector.

5. The system of claim 1 , wherein the computing device is further configured to:

determine positions of occupied wire contact insertion holes of the connector, wherein occupied wire contact insertion holes are occupied with the two or more wires previously connected to the connector; and

identify a path to an insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis.

6. The system of claim 5 , wherein the computing device configured to identify the path to the insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis, is further configured to:

identify the path to the insertion axis of the designated wire contact insertion hole of the connector based on a maximum distance between the path and at least one of the occupied wire contact insertion holes of the connector.

7. The system of claim 6 , wherein the computing device configured to identify the path to the insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis is further configured to:

identify an angle of the path to the insertion axis of the designated wire contact insertion hole of the connector relative to a vertical axis, and

control the robot to rotate to the angle of the path relative to the connector.

8. The system of claim 1 , wherein the separator device comprises a first separator element and a second separator element, wherein the computing device configured to control the robot to advance the separator device between the two or more wires previously connected to the connector comprises the computing device configured to drive a point at which the first separator element meets the second separator element between the two or more wires previously connected to the connector along a path to an insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis.

9. A method for automated insertion of a wire contact into a designated wire contact insertion hole of a connector, the method comprising:

controlling a robot to advance a separator device in a first direction between two or more wires previously connected to the connector;

controlling the robot to advance the separator device between the two or more wires previously connected to the connector in a second direction different from the first direction away from the connector, wherein the first direction is not coaxial with the second direction;

controlling the robot to align the wire contact with the designated wire contact insertion hole of the connector using a wire gripper;

controlling the robot to advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole;

controlling the robot to release the wire contact from the wire gripper; and

controlling the robot to withdraw the wire gripper and the separator device from between the two or more wires previously connected to the connector.

10. The method of claim 9 , wherein controlling the robot to advance the separator device between the two or more wires previously connected to the connector comprises:

controlling the robot to advance the separator device from a first position relative to the wire gripper to a second position relative to the wire gripper, wherein the first position is further from the connector than the wire gripper, and wherein the second position is closer to the connector than the wire gripper; and

controlling the robot to drive the separator device between the two or more wires in a position between the wire gripper and the connector.

11. The method of claim 10 , wherein controlling the robot to advance the separator device between the two or more wires previously connected to the connector further comprises:

controlling the robot to move the separator device from the second position relative to the wire gripper to the first position relative to the wire gripper with the separator device engaged between the two or more wires previously connected to the connector.

12. The method of claim 11 , wherein controlling the robot to advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole further comprises:

advancing the wire contact toward the designated wire contact insertion hole of the connector and at least partially inserting the wire contact into the designated wire contact insertion hole between the two or more wires previously connected to the connector.

13. The method of claim 9 , further comprising:

determining positions of occupied wire contact insertion holes of the connector, wherein occupied wire contact insertion holes are occupied with the two or more wires previously connected to the connector; and

identifying a path to an insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis.

14. The method of claim 13 , wherein identifying the path to the insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis, further comprises:

identifying the path to the insertion axis of the designated wire contact insertion hole of the connector based on a maximum distance between the path and at least one of the occupied wire contact insertion holes of the connector.

15. The method of claim 14 , wherein identifying the path to the insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis, further comprises:

identifying an angle of the path to the insertion axis of the designated wire contact insertion hole of the connector relative to a vertical axis, and

controlling the robot to rotate to the angle of the path relative to the connector.

16. The method of claim 9 , wherein the separator device comprises a first separator element and a second separator element, wherein controlling the robot to advance the separator device between two or more wires previously connected to the connector comprises driving a point at which the first separator element meets the second separator element between the two or more wires previously connected to the connector along a path to an insertion axis of the designated wire contact insertion hole of the connector, wherein the path is perpendicular to the insertion axis.

17. An apparatus comprising at least one processor and at least one non-transitory memory including computer program code, the at least one non-transitory memory and computer program code configured to, with the processor, cause the apparatus to at least:

control a robot to advance a separator device in a first direction between two or more wires previously connected to a connector;

control the robot to advance the separator device between the two or more wires previously connected to the connector in a second direction different from the first direction away from the connector, wherein the first direction is not coaxial with the second direction;

control the robot to align a wire contact with a designated wire contact insertion hole of the connector using a wire gripper;

control the robot to advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole;

control the robot to release the wire contact from the wire gripper; and

control the robot to withdraw the wire gripper and the separator device from between the two or more wires previously connected to the connector.

18. The apparatus of claim 17 , wherein causing the apparatus to control the robot to advance the separator device between the two or more wires previously connected to the connector comprises causing the apparatus to:

control the robot to advance the separator device from a first position relative to the wire gripper to a second position relative to the wire gripper, wherein the first position is further from the connector than the wire gripper, and wherein the second position is closer to the connector than the wire gripper; and

control the robot to drive the separator device between the two or more wires in a position between the wire gripper and the connector.

19. The apparatus of claim 18 , wherein causing the apparatus to control the robot to advance the separator device between the two or more wires previously connected to the connector further comprises causing the apparatus to:

control the robot to move the separator device from the second position relative to the wire gripper to the first position relative to the wire gripper with the separator device engaged between the two or more wires previously connected to the connector.

20. The apparatus of claim 19 , wherein causing the apparatus to control the robot to advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole further comprises causing the apparatus to:

advance the wire contact toward the designated wire contact insertion hole of the connector and at least partially insert the wire contact into the designated wire contact insertion hole between the two or more wires previously connected to the connector.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2022
From: BLACKEN, LARS E.; HOFFMANN, HEIKO; MARTIN, DAMIEN O.; MCCASKEY, JEFFREY; MITCHELL, BRADLEY J.
To: THE BOEING COMPANY
Reel/Frame 059683/0699 →
Continuity (1)
Related Publication 20230344185A1 · Oct 26, 2023
References Cited (78)
US 4567610A · McConnell · 1986 [cited by applicant]
US 4787138A · Eaton · 1988 [cited by examiner]
US 5459924A · Ohsumi · 1995 [cited by examiner]
US 5537741A · Peterson · 1996 [cited by examiner]
US 5598628A · Maejima · 1997 [cited by examiner]
US 5737500A · Seraji et al. · 1998 [cited by applicant]
US 6711293B1 · Lowe · 2004 [cited by applicant]
US 8494304B2 · Venable et al. · 2013 [cited by applicant]
US 8670619B2 · Funayama et al. · 2014 [cited by applicant]
US 9555549B2 · Motoyoshi et al. · 2017 [cited by applicant]
US 10288410B2 · Hoffman · 2019 [cited by applicant]
US 10825259B2 · Kim et al. · 2020 [cited by applicant]
US 11151405B1 · Hoffmann · 2021 [cited by applicant]
US 11171459B2 · Hoffmann · 2021 [cited by applicant]
US 11374374B2 · Graber-Tilton et al. · 2022 [cited by applicant]
US 20050254699A1 · Sano et al. · 2005 [cited by applicant]
US 20070019868A1 · Takai et al. · 2007 [cited by applicant]
US 20150120047A1 · Motoyoshi et al. · 2015 [cited by applicant]
US 20160064888A1 · Katou · 2016 [cited by examiner]
US 20160073584A1 · Davidson · 2016 [cited by examiner]
US 20170140539A1 · Wang · 2017 [cited by examiner]
US 20170151673A1 · Kobayashi et al. · 2017 [cited by applicant]
US 20170160077A1 · Featherstone et al. · 2017 [cited by applicant]
US 20170243357A1 · Peng et al. · 2017 [cited by applicant]
US 20170320213A1 · Helmick et al. · 2017 [cited by applicant]
US 20180108458A1 · Maki et al. · 2018 [cited by applicant]
US 20180130218A1 · Hoffman · 2018 [cited by applicant]
US 20190184570A1 · Yung · 2019 [cited by examiner]
US 20200180157A1 · Ueda · 2020 [cited by examiner]
US 20200306993A1 · Smith et al. · 2020 [cited by applicant]
US 20200346349A1 · Chung et al. · 2020 [cited by applicant]
US 20210016438A1 · Pivac · 2021 [cited by applicant]
US 20210370510A1 · Mao · 2021 [cited by examiner]
US 20210399470A1 · Hoffmann · 2021 [cited by applicant]
US 20220234208A1 · Hoffman et al. · 2022 [cited by applicant]
EP 0182951A2 · 1986 [cited by applicant]
EP 2783802A2 · 2014 [cited by applicant]
JP H0562757A · 1993 [cited by applicant]
JP 2004119046A · 2004 [cited by applicant]
JP 2016058320A · 2016 [cited by applicant]
WO WO2015124756A1 · 2015 [cited by applicant]
WO WO2015156793A1 · 2015 [cited by applicant]
“Eroding and Dilating,” OpenCV Tutorials, (2019). [<URL: https://docs.opencv.org/2.4/doc/tutorials/imgproc/erosion_dilatation/erosion_dilatation.html>]. [cited by applicant]
“Feature Matching + Homography to find Objects,” OpenCV-Python Tutorials, (2013). [<URL: https://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_feature_homography.html#feature-homography>]. [cited by applicant]
Borgefors, G., “Distance Transformations in Digital Images,” Comput. Vision Graph. Image Process., 34(3): 344-371, (1986). [cited by applicant]
Canny, J., “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, 8(6):679-698, (1986). [cited by applicant]
Choe, Y. et al., “Vision-Based Estimation of Bolt-Hole Location using Circular Hough Transform,” ICCAS-SICE 2009—ICROS-SICE International Joint Conference 2009, Proceedings, art. No. 5334375, pp. 4821-4826, (2009). [cited by applicant]
Cui, M. et al., U.S. Appl. No. 17/660,327 for “Method and System for Machine Determining Wire Contact Insertion”, filed Apr. 22, 2022. [cited by applicant]
Davies, E.R. et al., “An Analysis of Hole Detection Schemes,” Proc. British Machine Vision Assoc. Conf., Oxford (Sep. 24-27), pp. 285-290, (1990). [cited by applicant]
Duda, R.O. et al., “Use of the Hough Transformation to Detect Lines and Curves in Pictures,” Comm. ACM, 15(1): 11-15, (1972). [cited by applicant]
Fitzgibbon, A.W. et al., “A Buyer's Guide to Conic Fitting,” Proc. 5th British Machine Vision Conference, Birmingham, pp. 513-522, (1995). [cited by applicant]
Girshick, R., et al., “Rich feature hierarchies for accurate object detection and semantic segmentation,” In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14). (IEEE Computer … [cited by applicant]
Girshick, R., “Fast R-CNN,” In proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV) (ICCV '15), (IEEE Computer Society, Washington, DC, USA), 1440-1448, (2015). [cited by applicant]
Hu, M-K., “Visual Pattern Recognition by Moment Invariants,” IRE Transactions on Information Theory, 8(2):179-187. (1962). [cited by applicant]
Komax Zeta Wire Bundle Assembly Machine, Zeta 640/650 Harness Manufacturing, Komax Group, 12 pages. [cited by applicant]
Laursen, J.S. et al., “Automatic Error Recovery in Robot Assembly Operations Using Reverse Execution,” 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, pp. 1785-1792, (2015). [cited by applicant]
Liao, S. et al., “Learning Multi-Scale Block Local Binary Patterns for Face Recognition,” International Conference on Biometrics (ICB), pp. 828-837, (2007). [cited by applicant]
Lienhart, R. et al., “An Extended Set of Haar-like Features for Rapid Object Detection,” IEEE ICIP, pp. 1-900-1-903, (2002). [cited by applicant]
Lindeberg, T., “Detecting Salient Blob-Like Image Structures and Their Scales with a Scale-Space Primal Sketch: a Method for Focus-of-Attention,” International Journal of Computer Vision, 11(3):283-318, (1993). [cited by applicant]
Liu, W. et al., “SSD: Single Shot Multibox Detector,” In European conference on computer vision. 21-37, (2016). [cited by applicant]
Loborg, P., “Error Recovery in Automation—an Overview,” AAAI Technical Report SS-94-04, pp. 94-100, (1994). [cited by applicant]
Lowe, D., “Distinctive Image Features from Scale-Invariant Keypoints,” Int. J. Computer Vision, 60(2):91-110, (2004). [cited by applicant]
Meyer, F., “Color Image Segmentation,” In IEEE Fourth International Conference on Image Processing and its Applications, pp. 303-306, (1992). [cited by applicant]
Penate-Sanchez, A. et al., “Exhaustive Linearization for Robust Camera Pose and Focal Length Estimation,” In IEEE Trans. on Pattern Analysis and Machine Intelligence, pp. 1-14, (2013). [cited by applicant]
Press, W.H., et al., “Minimization or Maximization of Functions [excerpt],” Numerical Recipes in C: The Art of Scientific Computing, Cambridge University Press, UK, pp. 412-420, (1993). [cited by applicant]
Redmon, J. et al., “You Only Look Once: Unified, Real-Time Object Detection,” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, pp. 779-788, (2016). [cited by applicant]
Shi, J. et al., “Good Features to Track,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, (Jun. 1994). [cited by applicant]
Sklansky, J., “Finding the Convex Hull of a Simple Polygon,” Pattern Recognition Letters, 1(2): 79-83, (1982). [cited by applicant]
Song, H. et al., “USB assembly strategy based on visual servoing and impedance control,” 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Goyang, pp. 114-117, (2015). [cited by applicant]
Suárez-Ruiz, F. et al., “A Framework for Fine Robotic Assembly,” arXiv, (2015). [<URL:https://arxiv.org/abs/1509.04806>]. [cited by applicant]
Suzuki, S. et al., “Topological Structural Analysis of Digitized Binary Images by Border Following,” CVGIP, 30(1):32-46, (1985). [cited by applicant]
Tipping, M.E. et al., “Mixtures of probabilistic principal component analyzers,” Neural Computation, 11:443-482, (1999). [cited by applicant]
Viola, P., et al. “Rapid Object Detection using a Boosted Cascade of Simple Features,” Computer Vision and Pattern Recognition (CVPR), pp. 511-518, (2001). [cited by applicant]
Viola, P., et al., “Robust real-time face detection,” International Journal of Computer Vision, 57(2):137-154, (2004). [cited by applicant]
Yuen, H.K. et al., “A Comparative Study of Hough Transform Methods for Circle Finding,” Image Vision Comput., 8(1):71-77, (1990). [cited by applicant]
European Application No. 20186225.7, Extended European Search Report mailed Jan. 13, 2021. [cited by applicant]
European Application No. 20186226.5, Extended European Search Report mailed Jan. 14, 2021. [cited by applicant]
European Application No. 23153547.7, Extended European Search Report mailed Aug. 30, 2023. [cited by applicant]