US 20210390452A1
· Kohata et al.
· 2021
[cited by applicant]
US 20220172107A1
· Butterfoss et al.
· 2022
[cited by applicant]
US 20220382246A1
· Heiden et al.
· 2022
[cited by applicant]
US 20230410404A1
· Barsan et al.
· 2023
[cited by applicant]
Abeyruwan et al., “i-Sim2Real: Reinforcement Learning of Robotic Policies in Tight Human-Robot Interaction Loops”, 6th Conference on Robot Learning, arXiv:2207.06572, Nov. 22, 2022, pp. 1-32.
[cited by applicant]
Akkaya et al., “Solving Rubik's Cube with A Robot Hand”, arXiv:1910.07113, Oct. 16, 2019, pp. 1-51.
[cited by applicant]
Allshire et al., “Transferring Dexterous Manipulation from GPU Simulation to a Remote Real-World TriFinger”, arXiv:2108.09779, Oct. 20, 2022, 8 pages.
[cited by applicant]
Andrews et al., “Contact and Friction Simulation for Computer Graphics”, SIGGRAPH Courses, https://doi.org/10.1145/3532720.3535640, Aug. 7-11, 2022, pp. 1-172.
[cited by applicant]
Andrychowicz et al., “Learning Dexterous In-Hand Manipulation”, The International Journal of Robotics Research, DOI: 10.1177/0278364919887447, vol. 39, 2020, pp. 3-20.
[cited by applicant]
Apolinarska et al., “Robotic Assembly of Timber Joints Using Reinforcement Learning”, Automation in Construction, https://doi.org/10.1016/j.autcon.2021.103569, vol. 125, No. 103569, Feb. 27, 2021, pp. 1-8.
[cited by applicant]
Beltran-Hernandez et al., “Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep-Reinforcement-Learning Approach”, Applied Sciences, doi: 10.3390/app10196923, vol. 10, No. 6923, Oct. 2, 2020, pp. 1-17.
[cited by applicant]
Bengio et al., “Curriculum Learning”, Proceedings of the 26th International Conference on Machine Learning, 2009, pp. 41-48.
[cited by applicant]
Chen et al., “Visual Dexterity: In-hand Dexterous Manipulation from Depth”, arXiv:2211.11744, Nov. 21, 2022, pp. 1-61.
[cited by applicant]
Chen et al., “Midas: A Multi-Joint Robotics Simulator with Intersection-Free Frictional Contact”, arXiv:2210.00130, Sep. 30, 2022, 6 pages.
[cited by applicant]
Davchev et al., “Residual Learning from Demonstration: Adapting DMPs for Contact-rich Manipulation”, arXiv:2008.07682, Sep. 14, 2021, 8 pages.
[cited by applicant]
Drake, Samuel Hunt, “Using Compliance In Lieu of Sensory Feedback for Automatic Assembly”, 1978, 173 pages.
[cited by applicant]
Fan et al., “A Learning Framework for High Precision Industrial Assembly”, International Conference on Robotics and Automation (ICRA), IEEE, May 20-24, 2019, pp. 811-817.
[cited by applicant]
Ferguson et al., “Intersection-free Rigid Body Dynamics”, ACM Transactions on Graphics, https://doi.org/10.1145/3450626.3459802, vol. 40, No. 4, Article 183, Aug. 2021, pp. 183:1-183:16.
[cited by applicant]
Fu et al., “Safely Learning Visuo-Tactile Feedback Policies in Real For Industrial Insertion”, arXiv:2210.01340, Oct. 4, 2022, 7 pages.
[cited by applicant]
Gaz et al., “Dynamic Identification of the Franka Emika Panda Robot With Retrieval of Feasible Parameters Using Penalty-Based Optimization”, IEEE Robotics and Automation Letters, Doi 10.1109/LRA.2019.2931248, vol. 4, No…
[cited by applicant]
Handa et al., “DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality”, arXiv:2210.13702, Oct. 25, 2022, pp. 1-28.
[cited by applicant]
He et al., “Mask R-CNN”, IEEE International Conference on Computer Vision (ICCV), 2017, pp. 2961-2969.
[cited by applicant]
Hebecker et al., “Towards Real-World Force-Sensitive Robotic Assembly through Deep Reinforcement Learning in Simulations”, IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2021, pp. 1045-1051.
[cited by applicant]
Hou et al., “Data-efficient Hierarchical Reinforcement Learning for Robotic Assembly Control Applications”, IEEE Transactions on Industrial Electronics, DOI 10.1109/TIE.2020.3038072, 2020, 11 pages.
[cited by applicant]
Huang et al., “Fast Peg-and-Hole Alignment Using Visual Compliance”, International Conference on Intelligent Robots and Systems (IROS), Nov. 3-7, 2013, pp. 286-292.
[cited by applicant]
Inoue et al., “Deep Reinforcement Learning for High Precision Assembly Tasks”, International Conference on Intelligent Robots and Systems (IROS), Sep. 24-28, 2017, pp. 819-825.
[cited by applicant]
Johannink et al., “Residual Reinforcement Learning for Robot Control”, International Conference on Robotics and Automation (ICRA), May 20-24, 2019, pp. 6023-6029.
[cited by applicant]
Kimble et al., “Benchmarking Protocols for Evaluating Small Parts Robotic Assembly Systems”, IEEE Robotics and Automation Letters, vol. 5, No. 2, Apr. 2020, pp. 883-889.
[cited by applicant]
Kimble et al., “Performance Measures to Benchmark the Grasping, Manipulation, and Assembly of Deformable Objects Typical to Manufacturing Applications”, Frontiers in Robotics and AI, DOI 10.3389/frobt.2022.999348, Nov. …
[cited by applicant]
Lambeta et al., “DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor With Application to In-Hand Manipulation”, IEEE Robotics and Automation Letters, vol. 5, No. 3, Jul. 2020, pp. 3838-3845.
[cited by applicant]
Lan et al., “Affine Body Dynamics: Fast, Stable and Intersection-free Simulation of Stiff Materials”, arXiv:2201.10022, Jan. 31, 2022, pp. 1-14.
[cited by applicant]
Lee et al., “Learning Quadrupedal Locomotion Over Challenging Terrain”, Science Robotics, DOI: 10.1126/scirobotics.abc5986, vol. 5, Oct. 21, 2020, pp. 1-13.
[cited by applicant]
Lee et al., “Guided Uncertainty-Aware Policy Optimization: Combining Learning and Model-Based Strategies for Sample-Efficient Policy Learning”, IEEE International Conference on Robotics and Automation (ICRA), May 31-Aug…
[cited by applicant]
Lin et al., “Microsoft COCO: Common Objects in Context”, arXiv:1405.0312, May 1, 2014, pp. 1-14.
[cited by applicant]
Lozano-Perez et al., “Automatic Synthesis of Fine-Motion Strategies for Robots”, The International Journal of Robotics Research, vol. 3, No. 1, 1984, pp. 3-24.
[cited by applicant]
Luo et al., “Reinforcement Learning on Variable Impedance Controller for High-Precision Robotic Assembly”, International Conference on Robotics and Automation (ICRA), May 20-24, 2019, pp. 3080-3087.
[cited by applicant]
Luo et al., “Robust Multi-Modal Policies for Industrial Assembly via Reinforcement Learning and Demonstrations: A Large-Scale Study”, arXiv:2103.11512, Jul. 31, 2021, 10 pages.
[cited by applicant]
Luo et al., “Dynamic Experience Replay”, 3rd Conference on Robot Learning, 2019, pp. 1-10.
[cited by applicant]
Luo et al., “A Learning Approach to Robot-Agnostic Force-Guided High Precision Assembly”, arXiv:2010.08052, Aug. 2, 2021, 7 pages.
[cited by applicant]
Macklin, Miles, “Nvidia Warp: A High-performance Python Framework for GPU Simulation and Graphics”, Retrieved from https://github.com/nvidia/warp, Mar. 2022, 9 pages.
[cited by applicant]
Macklin et al., “Local Optimization for Robust Signed Distance Field Collision”, Proceedings of the ACM on Computer Graphics and Interactive Techniques, https://doi.org/10.1145/3384538, vol. 3, No. 1, Article 8, May 202…
[cited by applicant]
Makoviichuk et al., “RL Games: A High performance RL Library”, RL Implementations, https://github.com/Denys88/rl_games, May 2022, 18 pages.
[cited by applicant]
Makoviychuk et al., “Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning”, arXiv:2108.10470, Aug. 25, 2021, pp. 1-32.
[cited by applicant]
Margolis et al., “Rapid Locomotion via Reinforcement Learning”, arXiv:2205.02824, May 5, 2022, 12 pages.
[cited by applicant]
Morgan et al., “Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks” arXiv:2106.14070, Jun. 26, 2021, 13 pages.
[cited by applicant]
Muratore et al., “Assessing Transferability from Simulation to Reality for Reinforcement Learning”, IEEE Transactions on Pattern Analysis and Machine Intelligence, DOI 10.1109/TPAMI.2019.2952353, Oct. 2, 2019, pp. 1-12.
[cited by applicant]
Narang et al., “Factory: Fast Contact for Robotic Assembly”, arXiv:2205.03532, May 7, 2022, 21 pages.
[cited by applicant]
Peng et al., “Sim-to-Real Transfer of Robotic Control with Dynamics Randomization”, IEEE International Conference on Robotics and Automation (ICRA), May 21-25, 2018, pp. 3803-3810.
[cited by applicant]
Pinto et al., “Asymmetric Actor Critic for Image-Based Robot Learning”, arXiv:1710.06542, Oct. 18, 2017, 8 pages.
[cited by applicant]
Rudin et al., “Learning toWalk in Minutes Using Massively Parallel Deep Reinforcement Learning”, 5th Conference on Robot Learning, 2021, pp. 1-10.
[cited by applicant]
Schoettler et al., “Meta-Reinforcement Learning for Robotic Industrial Insertion Tasks”, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), DOI: 10.1109/IROS45743.2020.9340848, Oct. 25-29, 2020,…
[cited by applicant]
Schulman et al., “Proximal Policy Optimization Algorithms”, arXiv:1707.06347, Aug. 28, 2017, pp. 1-12.
[cited by applicant]
Shao et al., “Learning to Scaffold the Development of Robotic Manipulation Skills”, IEEE International Conference on Robotics and Automation (ICRA), May 31-Aug. 31, 2020, pp. 5671-5677.
[cited by applicant]
Si et al., “Taxim: An Example-based Simulation Model for GelSight Tactile Sensors”, arXiv:2109.04027, Dec. 14, 2021, 8 pages.
[cited by applicant]
Son et al., “Sim-to-Real Transfer of Bolting Tasks with Tight Tolerance”, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), DOI: 10.1109/IROS45743.2020.9341644, Oct. 25-29, 2020, pp. 9056-9063.
[cited by applicant]
Spector et al., “InsertionNet—A Scalable Solution for Insertion”, IEEE Robotics and Automation Letters, 2021, pp. 2-9.
[cited by applicant]
Spector et al., “Deep Reinforcement Learning for Contact-Rich Skills Using Compliant Movement Primitives”, arXiv:2008.13223, Oct. 25, 2020, pp. 1-27.
[cited by applicant]
Spector et al., “InsertionNet 2.0: Minimal Contact Multi-Step Insertion Using Multimodal Multiview Sensory Input”, arXiv:2203.01153, Mar. 2, 2022, 7 pages.
[cited by applicant]
Tang et al., “Autonomous Alignment of Peg and Hole by Force/Torque Measurement for Robotic Assembly”, IEEE International Conference on Automation Science and Engineering (CASE), Aug. 21-24, 2016, pp. 162-167.
[cited by applicant]
Thomas et al., “Learning Robotic Assembly from Cad”, IEEE International Conference on Robotics and Automation (ICRA), May 21-25, 2018, pp. 3524-3531.
[cited by applicant]
Tian et al., “Assemble Them All: Physics-Based Planning for Generalizable Assembly by Disassembly”, ACM Transactions on Graphics, https://doi.org/10.1145/3550454.3555525, vol. 41, No. 6, Article 278, Dec. 2022, pp. 278:…
[cited by applicant]
Tsai et al., “A New Technique for Fully Autonomous and Efficient 3D Robotics Hand/Eye Calibration”, IEEE Transactions on Robotics and Automation, vol. 5, No. 3, Jun. 1989, pp. 345-358.
[cited by applicant]
Vecerik et al., “Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards”, arXiv:1707.08817, Oct. 8, 2018, pp. 1-10.
[cited by applicant]
Vecerik et al., “A Practical Approach to Insertion with Variable Socket Position Using Deep Reinforcement Learning”, International Conference on Robotics and Automation (ICRA), May 20-24, 2019, pp. 754-760.
[cited by applicant]
Drigalski et al., “Robots Assembling Machines: Learning from the World Robot Summit 2018 Assembly Challenge”, Advanced Robotics, arXiv:1911.05884, vol. 1, No. 1, Jan. 2020, pp. 1-18.
[cited by applicant]
Vuong et al., “Learning Sequences of Manipulation Primitives for Robotic Assembly”, arXiv:2011.00778, Mar. 26, 2021, 7 pages.
[cited by applicant]
Wang et al., “TACTO: A Fast, Flexible, and Open-source Simulator for High-Resolution Vision-based Tactile Sensors”, IEEE Robotics and Automation Letters, DOI: 10.1109/LRA.2022.3146945, Feb. 10, 2022, pp. 1-8.
[cited by applicant]
Wen et al., “You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstration”, arXiv:2201.12716, May 6, 2022, 22 pages.
[cited by applicant]
Whitney, D. E., “Quasi-Static Assembly of Compliantly Supported Rigid Parts”, Journal of Dynamic Systems, Measurement, and Control, vol. 104, Mar. 1982, pp. 65-77.
[cited by applicant]
Wu et al., “Learning Dense Rewards for Contact-Rich Manipulation Tasks”, arXiv:2011.08458, Nov. 17, 2020, 8 pages.
[cited by applicant]
Xia et al., “Dynamic Analysis for Peg-In-Hole Assembly With Contact Deformation”, The International Journal of Advanced Manufacturing Technology, vol. 30, DOI 10.1007/s00170-005-0047-4, 2006, pp. 118-128.
[cited by applicant]
Xu et al., “Efficient Tactile Simulation with Differentiability for Robotic Manipulation”, 6th Conference on Robot Learning, 2022, pp. 1-11.
[cited by applicant]
Xu et al., “Compare Contact Model-based Control and Contact Model-free Learning: A Survey of Robotic Peg-in-hole Assembly Strategies”, IEEE, arXiv:1904.05240, Mar. 2019, pp. 1-15.
[cited by applicant]
Yoon et al., “Fast and Accurate Data-Driven Simulation Framework for Contact-Intensive Tight-Tolerance Robotic Assembly Tasks”, arXiv:2202.13098, Feb. 26, 2022, pp. 1-16.
[cited by applicant]
Yuan et al., “GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force”, Sensors, vol. 17, No. 2762, doi:10.3390/s17122762, Nov. 29, 2017, pp. 1-21.
[cited by applicant]
Zhang et al., “A Modular Robotic Arm Control Stack for Research: Franka-Interface and FrankaPy” arXiv:2011.02398, Nov. 4, 2020, pp. 1-7.
[cited by applicant]
Zhang et al., “Learning Insertion Primitives with Discrete-Continuous Hybrid Action Space for Robotic Assembly Tasks”, arXiv:2110.12618, Oct. 25, 2021, 7 pages.
[cited by applicant]
Zhao et al., “Offline Meta-Reinforcement Learning for Industrial Insertion”, arXiv:2110.04276, Sep. 1, 2022, 8 pages.
[cited by applicant]
Lee et al., “Making sense of vision and touch: Learning multimodal representations for contact-rich tasks”, arXiv:2305.17110v1, Jul. 28, 2019, 14 pages.
[cited by applicant]
Non Final Office Action received for U.S. Appl. No. 18/489,789, dated Jun. 6, 2025, 46 pages.
[cited by applicant]
Lee et al., “Online Continuous Mapping using Gaussian Process Implicit Surfaces”, International Conference on Robotics and Automation, doi:10.1109/ICRA.2019.8794324, May 20-24, 2019, pp. 6884-6890.
[cited by applicant]
Oliff et al., “Reinforcement Learning for Facilitating Human-Robot-Interaction in Manufacturing”, Journal of Manufacturing Systems, vol. 56, https://doi.org/10.1016/j.jmsy.2020.06.018, Jul. 4, 2020, pp. 326-340.
[cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/489,789, dated Oct. 16, 2025, 14 pages.
[cited by applicant]