IP Library Granted Patent US 12,208,525
Granted Patent B2
US 12,208,525 · App. 18/299,660 · Granted Jan 28, 2025

Robotic system with piece-loss management mechanism

Inventors: Rosen Nikolaev Diankov (Tokyo, JP); Huan Liu (Tokyo, JP); Denys Kanunikov (Tokyo, JP)
Assignee: Mujin, Inc.
B25J9/1664B25J9/1633B25J9/1674B25J9/1687B25J15/0004B25J15/0019B65G61/00G05B2219/39107G05B2219/45063
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,208,525
App. No.
18/299,660
Granted
Jan 28, 2025
Kind
B2
Abstract

A method for operating a robotic system that includes calculating a base motion plan, wherein the base motion plan includes a sequence of commands or settings, or a combination thereof, that operates a robotic arm and a gripper to transfer a target object from a start location to a task location; receiving a contact measure while executing the base motion plan, wherein the contact measure represents an amount of grip of the gripper on the target object; and generating one or more actuator commands/settings that deviate from the base motion plan when the contact measure fails to satisfy a threshold, wherein the one or more actuator commands/settings thereof are configured to operate the robotic arm, the gripper, or a combination thereof to execute one or more response actions not included in the base motion plan.

Claims (78)

1. A method for operating a robotic system, the method comprising:

obtaining a base motion plan configured to operate a robotic assembly to transfer a target object from a start location to a task location;

receiving a contact measure while implementing the base motion plan;

determining whether the contact measure fails to satisfy a threshold; and

selectively generating a set of commands and/or settings based on the determination.

2. The method of claim 1 , wherein:

the contact measure represents an amount of grip on the target object provided by a suction gripper; and

determining whether the contact measure fails to satisfy the threshold includes comparing the contact measure to the threshold that represents a quantity, a location, or a combination thereof of the suction gripper contacting a surface of the target object, and holding a vacuum condition therein.

3. The method of claim 1 , wherein:

the contact measure represents an amount of grip on the target object provided by an impactive gripper; and

determining whether the contact measure fails to satisfy the threshold includes comparing the contact measure to the threshold configured to detect a shift in the target object.

4. The method of claim 1 , wherein:

the contact measure represents an amount of grip measured after gripping the target object and before initiating horizontal transfer of the target object;

the threshold is an initial threshold; and

the set of commands and/or settings includes commands and/or settings for regripping the target object.

5. The method of claim 4 , further comprising:

executing an initial portion of the base motion plan for placing a gripper of the robotic assembly about the start location and for initially gripping the target object with the gripper;

wherein:

receiving the contact measure includes receiving the contact measure determined after initially gripping the target object; and

the set of commands and/or settings are configured to operate the robotic assembly to:

release the target object, and

regrip the target object.

6. The method of claim 5 , wherein the set of commands and/or settings further includes commands and/or settings to adjust a position of the gripper between the release and the regrip.

7. The method of claim 5 , further comprising:

pausing execution of the base motion plan when the contact measure fails to satisfy the initial threshold.

8. The method of claim 1 , wherein selectively generating the set of commands and/or settings comprises calculating an adjusted motion plan that is different than a remaining portion of the base motion plan.

9. The method of claim 8 , wherein:

the contact measure represents a measurement of an amount of grip after initiating horizontal transfer of the target object; and

determining whether the contact measure fails to satisfy the threshold includes comparing the contact measure to a transfer threshold that is less than an initial grip threshold associated with initially gripping the target object before horizontally transferring the target object.

10. The method of claim 8 , further comprising:

tracking a current location of the target object during implementation of the base motion plan; and

wherein calculating the adjusted motion plan includes:

selecting a release area based on comparing the current location to a source release area, a destination release area, and/or a transit release area, and

calculating the adjusted motion plan to transfer the target object from the current location to an adjusted release location instead of the task location.

11. The method of claim 10 , wherein selecting the release area includes:

determining whether the current location is within the source release area that is associated with boundaries of a container or a pallet at the start location; and

selecting the source release area based on whether the current location is within the source release area to place the target object at the adjusted release location that is different from the start location.

12. The method of claim 10 , wherein selecting the release area includes:

determining whether the current location is within the destination release area that is associated with boundaries of a container or a pallet at the task location; and

selecting the destination release area based on the determination to intentionally place the target object at the adjusted release location therein.

13. The method of claim 10 , wherein selecting the release area includes:

determining whether the current location is within the transit release area that is between the source release area and the destination release area; and

selecting the transit release area based on the determination to intentionally place the target object at the adjusted release location therein.

14. A tangible, non-transient computer-readable medium having processor instructions stored thereon that, when executed by a robotic system via one or more processors thereof, cause the robotic system to perform a method, the method comprising:

obtaining a base motion plan configured to operate a robotic assembly to transfer a target object from a start location to a task location;

receiving a contact measure while implementing;

determining whether the contact measure fails to satisfy a threshold; and

selectively generating a set of commands and/or settings based on determination.

15. A robotic system, comprising:

at least one processor; and

at least one memory device connected to the at least one processor and having stored thereon instructions executable by the processor for:

obtaining a base motion plan configured to operate a robotic assembly to transfer a target object from a start location to a task location;

receiving a contact measure while implementing the base motion plan;

determining whether the contact measure fails to satisfy a threshold; and

selectively generating a set of commands and/or settings based on the determination.

16. The robotic system of claim 15 , wherein the contact measure represents a force, a torque, a pressure, or a combination thereof associated with a suction gripper or a set of jaws of the robotic assembly used to contact and grip the target object.

17. The robotic system of claim 15 , wherein the memory device includes instructions executable by the processor for:

tracking a current location of the target object during implementation of an initial portion of the base motion plan;

receiving the contact measure that represents an amount of grip after initiating horizontal transfer of the target object;

selecting a release area based on the current location, wherein the release area is selected from a source release area, a destination release area, a transit release area, or a combination thereof,

calculating an adjusted release location in the selected release area, wherein the adjusted release location is calculated after the contact measure is determined to be below the threshold, and

calculating an adjusted motion plan based on selectively generating the set of the commands and/or the settings, wherein the adjusted motion plan is configured to transfer the target object from the current location to the adjusted release location, wherein the adjusted release location is different from the task location.

18. The robotic system of claim 17 , wherein the memory device includes instructions executable by the processor for:

selecting the release area as the source release area, the destination release area, or the transit release area that overlaps with the current location intentionally placing the target object therein instead of the task location and instead of the start location, wherein:

the source release area is associated with boundaries of a container or a pallet including the start location,

the destination release area is associated with boundaries of a container or a pallet including the task location, and

the transit release area is between the source release area and the destination release area.

19. The robotic system of claim 15 , wherein the memory device includes instructions executable by the processor for:

receiving the contact measure that represents an amount of grip after gripping the target object and before initiating horizontal transfer of the target object; and

wherein:

the set of commands and/or settings includes regrip commands, regrip settings, or a combination thereof that are not in the base motion plan and that are for releasing and regripping the target object.

20. The robotic system of claim 19 , wherein the memory device includes instructions executable by the processor for:

implementing the base motion plan to place a gripper about the start location and grip the target object with the gripper;

wherein:

the contact measure represents an amount of grip determined after gripping the target object; and

the set of commands and/or settings are configured to operate the robotic assembly to:

release the target object after executing the base motion plan, and

regrip the target object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2023
From: DIANKOV, ROSEN NIKOLAEV; LIU, HUAN; KANUNIKOV, DENYS
To: MUJIN, INC.
Reel/Frame 063307/0452 →
Continuity (5)
Continuation 16992081 · Aug 12, 2020
Continuation 16600367 · Oct 11, 2019
Continuation 16414396 · May 16, 2019
Continuation 16252383 · Jan 18, 2019
Related Publication 20240042608A1 · Feb 8, 2024
References Cited (79)
US 9205558B1 · Zevenbergen · 2015 [cited by examiner]
US 9238304B1 · Bradski · 2016 [cited by examiner]
US 9333649B1 · Bradski · 2016 [cited by examiner]
US 9375853B1 · Edsinger · 2016 [cited by examiner]
US 9393693B1 · Kalakrishnan et al. · 2016 [cited by applicant]
US 9821458B1 · Watts · 2017 [cited by applicant]
US 10335947B1 · Diankov et al. · 2019 [cited by applicant]
US 10350755B2 · Wagner et al. · 2019 [cited by applicant]
US 10532462B1 · Diankov et al. · 2020 [cited by applicant]
US 10773385B2 · Diankov · 2020 [cited by examiner]
US 10864555B2 · McCoy et al. · 2020 [cited by applicant]
US 11059075B2 · McCoy et al. · 2021 [cited by applicant]
US 11654558B2 · Diankov · 2023 [cited by examiner]
US 20010052708A1 · Schmalz et al. · 2001 [cited by applicant]
US 20040265110A1 · Schnoor et al. · 2004 [cited by applicant]
US 20120004774A1 · Umetsu · 2012 [cited by applicant]
US 20120059515A1 · Abdallah et al. · 2012 [cited by applicant]
US 20120253507A1 · Eldershaw et al. · 2012 [cited by applicant]
US 20130184868A1 · Inazumi · 2013 [cited by examiner]
US 20160059412A1 · Oleynik · 2016 [cited by examiner]
US 20160075031A1 · Gotou · 2016 [cited by examiner]
US 20160239013A1 · Troy · 2016 [cited by examiner]
US 20170106534A1 · Nakamoto · 2017 [cited by examiner]
US 20170173795A1 · Tan · 2017 [cited by examiner]
US 20170183047A1 · Takagi et al. · 2017 [cited by applicant]
US 20170305694A1 · McMurrough et al. · 2017 [cited by applicant]
US 20180361586A1 · Tan et al. · 2018 [cited by applicant]
US 20180361595A1 · Troy · 2018 [cited by examiner]
US 20190001508A1 · Li et al. · 2019 [cited by applicant]
US 20190009414A1 · Lipay et al. · 2019 [cited by applicant]
US 20190160678A1 · Zhang et al. · 2019 [cited by applicant]
CN 102186638A · 2011 [cited by applicant]
CN 102310409A · 2012 [cited by applicant]
CN 103814279A · 2014 [cited by applicant]
CN 104044151 · 2014 [cited by applicant]
CN 104108104 · 2014 [cited by applicant]
CN 104942804A · 2015 [cited by applicant]
CN 105518754A · 2016 [cited by applicant]
CN 105835056A · 2016 [cited by applicant]
CN 106660212A · 2017 [cited by applicant]
DE 102004042825A1 · 2006 [cited by applicant]
DE 102004042825B3 · 2006 [cited by applicant]
DE 102007052012A1 · 2009 [cited by applicant]
DE 102010052396A1 · 2012 [cited by applicant]
EP 2146821B1 · 2012 [cited by applicant]
JP H05318356A · 1993 [cited by applicant]
JP 2000127071A · 2000 [cited by applicant]
JP 2004351527A · 2004 [cited by applicant]
JP 3672079B2 · 2005 [cited by applicant]
JP 2006102920 · 2006 [cited by applicant]
JP 2010006590 · 2010 [cited by applicant]
JP 2010172968A · 2010 [cited by applicant]
JP 2011218484A · 2011 [cited by applicant]
JP 2013078825 · 2013 [cited by applicant]
JP 2013103306A · 2013 [cited by applicant]
JP 2013154457A · 2013 [cited by applicant]
JP 2014210311A · 2014 [cited by applicant]
JP 2016132521A · 2016 [cited by applicant]
JP 2018058175A · 2018 [cited by applicant]
JP 2018158391A · 2020 [cited by applicant]
KR 20070033607 · 2007 [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/252,383, mailed Mar. 29, 2019, 9 pages. [cited by applicant]
Japanese Patent Office, Notice of Reasons for Rejection for Japanese patent application No. 2019-079502, mailed Aug. 13, 2019, official and translation, 9 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/414,396, mailed Jun. 11, 2019, 19 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/414,396, mailed Sep. 25, 2019, 20 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/600,367, mailed May 18, 2020, 18 pages. [cited by applicant]
Corrected Notice of Allowance for U.S. Appl. No. 16/600,367, mailed Jun. 25, 2020, 7 pages. [cited by applicant]
The German Patent Office, Office Action for Application No. 102019130048.7, Applicant: Mujin, Inc., mailed May 27, 2020, 10 pages. [cited by applicant]
CIPO Office Action mailed Sep. 9, 2020 for Chinese patent application No. 201910588639.9 filed Jul. 1, 2019. [cited by applicant]
CIPO Notice to Grant mailed Nov. 30, 2020 for Chinese patent application No. 20190588639.9 filed Jul. 1, 2019. [cited by applicant]
German Patent Office Decision to Grant mailed Oct. 6, 2020 for German patent application No. 102019130048.7 filed Nov. 7, 2019. [cited by applicant]
Japanese Patent Office Decision to Grant mailed Feb. 3, 2020 for Japanese patent application No. 2019079502 filed Apr. 18, 2019. [cited by applicant]
CIPO Office Action mailed May 27, 2020 for Chinese patent application No. 201910588639.9 filed Jul. 1, 2019. [cited by applicant]
CIPO Office Action mailed Nov. 23, 2021 for Application No. 201910337574.0, 8 pages. [cited by applicant]
German Patent Office, Office Action mailed Apr. 1, 2022 for application No. 102019009201.5, 10 pages. [cited by applicant]
German Patent Office, Decision to Grant mailed Aug. 3, 2022 for application No. 102019009201.5, 5 pages. [cited by applicant]
Japanese Patent Office Notice of Reasons for Rejection mailed Mar. 9, 2023 for Application No. 2020-029846, 17 pages with translation. [cited by applicant]
Japanese Patent Office Decision of Grant mailed Aug. 1, 2023 for Application No. 2020-029846, 3 pages. [cited by applicant]
Decision to Grant Japanese patent application No. 2023-139633 mailed Nov. 22, 2024, Applicant: Mujin, Inc., 3 pages. [cited by applicant]