IP Library Granted Patent US 12,440,974
Granted Patent B2
US 12,440,974 · App. 18/648,116 · Granted Oct 14, 2025

Method and system for autonomous object manipulation

Inventors: David N. Walsh (Brooklyn, NY); Eric A. Litman (Brooklyn, NY); Charles Paul Pace (Manchester Center, VT); Matthew DiCicco (Brooklyn, NY)
Assignee: Aescape, Inc.
B25J9/1633B25J9/106B25J9/1664
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,440,974
App. No.
18/648,116
Granted
Oct 14, 2025
Kind
B2
Abstract

A system, method, and apparatus for a robot system that manipulates the surface of an object effect programmed manipulation goals such as reaching specific locations on the surface of the object, displacing the surface of the object, applying a predetermined force and torque to the surface of the object, dynamically changing the contact point between the robot and the object, and applying force to structures below the surface of the object. The system and method determine the state of the object through a sensing method that includes, without limitation: torque and force measurement, visible light sensors, range and depth sensors, ultrasound sensors, thermographic sensors, and worktable force measurement.

Claims (36)

1. A system, comprising:

a robotic manipulator including an end effector; and

one or more processors configured to:

cause the end effector to contact a deformable surface of an object at a first location on the deformable surface and apply a predefined amount of force to the deformable surface;

sense force data based at least in part on interaction of the end effector and the object; and

generate a manipulation plan based at least in part on the sensed force data to manage progression of the end effector from the first location on the deformable surface to a second location on the deformable surface while maintaining contact with the deformable surface.

2. The system recited in claim 1 , wherein the one or more processors are further configured to:

detect, while the end effector progresses from the first location on the deformable surface to the second location on the deformable surface, that a generated torque command would exceed a joint torque limit associated with a joint; and

in response to detecting that the generated torque command would exceed the joint torque limit, modify a stored representation of the generated torque command to be at or below the joint torque limit while maintaining a desired trajectory.

3. The system recited in claim 1 , wherein at least one of the first location or the second location is defined based on a contact frame that is different from a reference frame of the end effector.

4. The system recited in claim 3 , wherein the one or more processors are further configured to:

dynamically modify the contact frame in response to the sensed force data.

5. The system recited in claim 1 , wherein the predefined amount of force applied to the deformable surface comprises a predefined goal from a plurality of manipulation goals, and wherein the one or more processors are further configured to modify a gain parameter associated with a controller of the robotic manipulator based at least in part on the plurality of manipulation goals.

6. The system recited in claim 1 , wherein the one or more processors are further configured to:

modify a gain parameter associated with a controller of the robotic manipulator based at least in part on an orientation of the deformable surface.

7. A method, comprising:

causing an end effector associated with a robotic manipulator to contact a deformable surface of an object at a first location on the deformable surface and apply a predefined amount of force to the deformable surface;

sensing force data based at least in part on interaction of the end effector and the object; and

generating a manipulation plan based at least in part on the sensed force data to manage progression of the end effector from the first location on the deformable surface to a second location on the deformable surface while maintaining contact with the deformable surface.

8. The method of claim 7 , further comprising:

detecting, while the end effector progresses from the first location on the deformable surface to the second location on the deformable surface, that a generated torque command would exceed a joint torque limit associated with a joint; and

in response to detecting that the generated torque command would exceed the joint torque limit, modifying a stored representation of the generated torque command to be at or below the joint torque limit while maintaining a desired trajectory.

9. The method of claim 7 , wherein at least one of the first location or the second location is defined based on a contact frame that is different from a reference frame of the end effector.

10. The method of claim 9 , further comprising:

dynamically modifying the contact frame in response to the sensed force data.

11. The method of claim 7 , wherein the predefined amount of force applied to the deformable surface comprises a predefined goal from a plurality of manipulation goals, and further comprising modifying a gain parameter associated with a controller of the robotic manipulator based at least in part on the plurality of manipulation goals.

12. The method of claim 7 , further comprising:

modifying a gain parameter associated with a controller of the robotic manipulator based at least in part on an orientation of the deformable surface.

13. The system of claim 1 , wherein the one or more processors are further configured to determine at least one of a structure or a state of the object based at least in part on the sensed force data.

14. The system of claim 13 , wherein the one or more processors are configured to generate the manipulation plan based at least in part on the state of the object that is determined based at least in part on the sensed force data.

15. The system of claim 1 , wherein the one or more processors are further configured to attribute the sensed force data to at least one of structural constituency or changes in the object.

16. The system of claim 1 , wherein the one or more processors are further configured to determine a friction component.

17. The system of claim 16 , wherein the one or more processors are further configured to manage progression based at least in the determined friction component.

18. The system of claim 1 , wherein the one or more processors are further configured to determine a contact patch based at least in part on the interaction of the end effector and the object.

19. The system of claim 18 , wherein the contact patch comprises a region of surface to surface contact of the end effector and the object.

20. The system of claim 1 , wherein the processors are configured to determine a contact pressure between a surface of the end effector and the deformable surface of the object.

Assignments (3)
NUNC PRO TUNC ASSIGNMENT Recorded Jul 23, 2026
From: AESCAPE, INC.
To: AESCAPE RECOVERY, INC.
Reel/Frame 075372/0959 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2026
From: AESCAPE, INC.
To: AESCAPE RECOVERY, INC.
Reel/Frame 074243/0001 →
SECURITY INTEREST Recorded Dec 30, 2025
From: AESCAPE, INC.
To: BLACK STAG LENDING, L.P.
Reel/Frame 073340/0403 →
Continuity (3)
Continuation 17319062 · May 12, 2021
Provisional Application 63023833 · May 12, 2020
Related Publication 20240342903A1 · Oct 17, 2024
References Cited (109)
US 4041938A · Wintoniw · 1977 [cited by examiner]
US 5023808A · Seraji · 1991 [cited by examiner]
US 5074286A · Gillaspie · 1991 [cited by applicant]
US 5876325A · Mizuno · 1999 [cited by applicant]
US 5916182A · Fengler · 1999 [cited by examiner]
US 6494851B1 · Becher · 2002 [cited by applicant]
US 6585668B2 · Nissim · 2003 [cited by applicant]
US 6607499B1 · Becher · 2003 [cited by applicant]
US 6685659B2 · Webb · 2004 [cited by examiner]
US 6832991B1 · Inada · 2004 [cited by examiner]
US D517218S · Kalen · 2006 [cited by applicant]
US D637304S · Feuerabend · 2011 [cited by applicant]
US D637305S · Feuerabend · 2011 [cited by applicant]
US 7998098B2 · Yang · 2011 [cited by examiner]
US D644675S · Abed · 2011 [cited by applicant]
US 8012107B2 · Einav · 2011 [cited by examiner]
US D665093S · Sedic · 2012 [cited by applicant]
US 8545420B2 · Einav · 2013 [cited by examiner]
US 8712512B2 · Doidge · 2014 [cited by examiner]
US 10034813B1 · Silver · 2018 [cited by applicant]
US 10034814B2 · Zhang · 2018 [cited by applicant]
US D831769S · Tranchard · 2018 [cited by applicant]
US D833028S · Olivares · 2018 [cited by applicant]
US 10390755B2 · Goodall · 2019 [cited by applicant]
US D861829S · Wang · 2019 [cited by applicant]
US D867609S · Couto · 2019 [cited by applicant]
US 10881571B1 · Theobald · 2021 [cited by applicant]
US 11154273B2 · O'Brien · 2021 [cited by examiner]
US 11197799B2 · Tian · 2021 [cited by applicant]
US 11338443B2 · Eyssautier · 2022 [cited by applicant]
US 11475630B2 · Tian · 2022 [cited by applicant]
US 11529900B2 · Kim · 2022 [cited by applicant]
US 11559278B2 · O'Brien · 2023 [cited by examiner]
US 11654551B2 · Huang · 2023 [cited by applicant]
US 20010014781A1 · Nissim · 2001 [cited by applicant]
US 20020013641A1 · Nourbakhsh · 2002 [cited by applicant]
US 20040193077A1 · Hsu · 2004 [cited by examiner]
US 20050154295A1 · Quistgaard · 2005 [cited by applicant]
US 20070000374A1 · Clark · 2007 [cited by applicant]
US 20070192910A1 · Vu · 2007 [cited by applicant]
US 20070282228A1 · Einav · 2007 [cited by examiner]
US 20070299371A1 · Einav · 2007 [cited by examiner]
US 20080004550A1 · Einav · 2008 [cited by examiner]
US 20080242521A1 · Einav · 2008 [cited by examiner]
US 20090062698A1 · Einav · 2009 [cited by examiner]
US 20100172567A1 · Prokoski · 2010 [cited by examiner]
US 20100261530A1 · Thomas · 2010 [cited by applicant]
US 20110112549A1 · Neubach · 2011 [cited by applicant]
US 20120053483A1 · Doidge · 2012 [cited by examiner]
US 20130198625A1 · Anderson · 2013 [cited by applicant]
US 20150298315A1 · Shick · 2015 [cited by applicant]
US 20150351999A1 · Brouse · 2015 [cited by applicant]
US 20160242995A1 · Karkkainen · 2016 [cited by applicant]
US 20170079871A1 · Zhang · 2017 [cited by applicant]
US 20170123487A1 · Hazra · 2017 [cited by applicant]
US 20170156662A1 · Goodall · 2017 [cited by applicant]
US 20170258598A1 · Radermacher · 2017 [cited by applicant]
US 20170266077A1 · Mackin · 2017 [cited by examiner]
US 20170281254A1 · Bonutti · 2017 [cited by applicant]
US 20190000447A1 · Shelton, IV · 2019 [cited by applicant]
US 20190160684A1 · Gu · 2019 [cited by examiner]
US 20190167512A1 · Forsythe · 2019 [cited by applicant]
US 20190201273A1 · Soltani-Zarrin · 2019 [cited by applicant]
US 20190209127A1 · O'Brien · 2019 [cited by examiner]
US 20190209128A1 · O'Brien · 2019 [cited by examiner]
US 20190381271A1 · Jo · 2019 [cited by applicant]
US 20200055195A1 · Ignakov · 2020 [cited by applicant]
US 20200113636A1 · Chino · 2020 [cited by applicant]
US 20200121556A1 · Tian · 2020 [cited by applicant]
US 20200126297A1 · Tian · 2020 [cited by applicant]
US 20200206913A1 · Kaehler · 2020 [cited by applicant]
US 20200281805A1 · Qiu · 2020 [cited by applicant]
US 20200391021A1 · Sachs · 2020 [cited by applicant]
US 20210085558A1 · Shin · 2021 [cited by applicant]
US 20210154852A1 · Eyssautier · 2021 [cited by applicant]
US 20210155136A1 · Kim · 2021 [cited by applicant]
US 20220133589A1 · Gruneberg · 2022 [cited by applicant]
US 20220134551A1 · Litman · 2022 [cited by applicant]
US 20220387118A1 · Litman · 2022 [cited by applicant]
US 20220388165A1 · Walsh · 2022 [cited by applicant]
US 20220388168A1 · Litman · 2022 [cited by applicant]
US 20220414291A1 · Eyssautier · 2022 [cited by applicant]
CN 203017580 · 2013 [cited by applicant]
CN 204684116 · 2015 [cited by applicant]
CN 206416184 · 2017 [cited by applicant]
CN 111053530 · 2020 [cited by applicant]
CN 113908035 · 2022 [cited by applicant]
SG 10201809094 · 2020 [cited by applicant]
WO 2021116554 · 2021 [cited by applicant]
WO 2021231663 · 2021 [cited by applicant]
WO 2022056181 · 2022 [cited by applicant]
Ex Parte Quayle Action for U.S. Appl. No. 29/732,265, mailed Dec. 2, 2022, 4 pages. [cited by applicant]
Hu et al., “A massage robot based on Chinese massage therapy”, 2013, Emerald Group Publishing, The Industrial Robot: An International Journal, vol. 40, No. 2, pp. 158-172. (Year: 2013). [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US21/32111, mailed Jan. 24, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US21/49741, mailed Feb. 7, 2022, 5 pages. [cited by applicant]
Lance Ulanoff, “Massage Robotics wants you to come and be touched by a robot—if that's your thing,” Jan. 6, 2022, Techradar, The source for Tech Buying Advice, 13 pages. [cited by applicant]
Luo et al., “Human Body Trajectory Generation Using Point Cloud Data for Robotics Massage Applications”, 2014 IEEE International Conference on Robotics & Automation (ICRA), Hong Kong Convention and Exhibition Center May… [cited by applicant]
Massage instruments. (Design—© Questel) orbit.com. 17 pgs. Print Dates Range Feb. 24, 2004-Feb. 14, 2020 [Retrieved Nov. 18, 2022] https://www .orbit.com/export/UCZAH95B/pdf4/e9bd54bf-4351-4947-8aae-2394fdea7fed-013045.… [cited by applicant]
Meera et al., “Path planning and motion control for a 3 DOF massaging robot,” 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), Amritapuri, India, 2016, pp. 1-6, doi: 10.1109… [cited by applicant]
Minyong et al., “Expert massage motion control by multi-fingered robot hand,” Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No. 03CH37453), Las Vegas, NV, USA, 20… [cited by applicant]
Pradeep David, “Cobots—A helping hand to the healthcare industry,” Nov. 24, 2017, Universal Robots, 6 pages. [cited by applicant]
Rachel Kraus, “Bow down before this $310,000 massage mega-robot, human: Who knew the robot uprising would be so good on the shoulders?,” Health & Wellness Artificial Intelligence, Dec. 30, 2021, <https://mashable.com/ar… [cited by applicant]
Screen captures from YouTube video clip entitled “Robots can now give full-body personalized massages at home,” 11 pages, uploaded Jul. 21, 2020, New Scientist, Retrieved from Internet: https://www.youtube.com/watch?v=t… [cited by applicant]
Si et al., “Green Internet of Things Application of a Medical Massage Robot With System Interruption,” IEEE Access, vol. 7, pp. 127066-127077, 2019, doi: 10.1109/ACCESS.2019.2939502. (Year: 2019). [cited by applicant]
Khoramshahi et al. “Arm-hand motion-force coordination for physical interactions with non-flat surfaces using dynamical systems: Toward compliant robotic massage” 2020 IEEE, International Conference on Robotics and Auto… [cited by applicant]
Li et al. “An Enhanced Robot Massage System in Smart Homes Using Force Sensing and a Dynamic Movement Primitive” 2020, Frontiers in Neurorobotics—Open Access, vol. 14: Article 30; doi: 10.3389/fnbot.2020.00030 (Year: 20… [cited by applicant]
Luo et al. “Robot Assisted Tapping Control for Therapeutical Percussive Massage Applications” 2017 IEEE International Conference on Robotics and Automation (ICRA) Singapore, May 29-Jun. 3, 2017, pp. 3606-3611 (Year: 201… [cited by applicant]
Luo et al. “Tapping motion detection incorporate with impedance control of robotics tapotement massage on human tissue” 2018 IEEE 15th International Workshop on Advanced Motion Control (AMC) (2018): 160-165. (Year: 2018… [cited by applicant]
Peng et al. “Development of intelligent massage manipulator and reconstruction of massage process path using image processing technique” 2010 IEEE Conference on Robotics, Automation and Mechatronics, Singapore, 2010, pp… [cited by applicant]