IP Library Granted Patent US 12,296,480
Granted Patent B2
US 12,296,480 · App. 18/439,713 · Granted May 13, 2025

Robotic multi-gripper assemblies and methods for gripping and holding objects

Inventors: Hironori Mizoguchi (Tokyo, JP); Rosen Nikolaev Diankov (Tokyo, JP)
Assignee: MUJIN, Inc.
B25J9/1612B25J9/1653B25J9/1664B25J9/1669B25J9/1697B25J13/08B25J15/0616B25J19/022B25J19/023B25J19/04G05B2219/39553G05B2219/39558G05B2219/40006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,296,480
App. No.
18/439,713
Granted
May 13, 2025
Kind
B2
Abstract

A method for operating a transport robot includes receiving image data representative of a group of objects. One or more target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified one or more target objects. The transport robot is command to cause the selected addressable vacuum regions to hold and transport the identified one or more target objects. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. A vision sensor device can capture the image data, which is representative of the target objects adjacent to or held by the multi-gripper assembly.

Claims (44)

1. A robotic transport system comprising:

a robotic apparatus;

a multi-gripper assembly coupled to the robotic arm including:

a plurality of addressable vacuum regions, and

a manifold assembly configured to fluidically couple each of the addressable vacuum regions to at least one vacuum source such that each addressable vacuum region is capable of independently providing suction; and

a controller programmed to operate the robotic arm, the multi-gripper assembly, or a combination thereof to dynamically adjust a pressure level of air flow through at least one selected addressable vacuum region of to grip the target object.

2. The robotic transport system of claim 1 , wherein each of the addressable vacuum regions of the multi-gripper assembly includes one or more suction elements that are in communication with the at least one vacuum source.

3. The robotic transport system of claim 1 , wherein each of the addressable vacuum regions of the multi-gripper assembly includes a plurality of suction elements, and the multi-gripper assembly further comprises:

a contact member including a plurality of openings that correspond to the plurality of suction elements.

4. The robotic transport system of claim 3 , wherein each of the plurality of suction elements extend through a corresponding opening in a top plane of the contact member and without extending past a bottom plane of the contact member.

5. The robotic transport system of claim 3 , wherein the target object is pulled against the contact member when air is drawn through one or more of the plurality of suction elements.

6. The robotic transport system of claim 3 , wherein the contact member is comprised of one or more compressible materials configured to deform to accommodate surfaces of objects with different geometries.

7. The robotic transport system of claim 3 , the manifold assembly further comprising:

at least one manifold, each manifold connected to the suction elements of an associated gripper mechanism via vacuum lines of one or more associated addressable vacuum regions.

8. The robotic transport system of claim 7 , wherein each of the at least one manifold is configured to distribute suction via suction elements of the associated gripper mechanism to produce nonuniform vacuum gripping forces.

9. An end effector comprising:

a multi-gripper assembly including:

a plurality of addressable vacuum regions that each define a vacuum gripping zone, and

a manifold assembly configured to fluidically couple each of the plurality of addressable vacuum regions to at least one vacuum source such that each addressable vacuum region is capable of independently providing suction, wherein the suction is dynamically adjusted to grip the target object.

10. The end effector of claim 9 , wherein the multi-gripper assembly further comprises:

a gripper mechanism including the plurality of addressable vacuum regions, wherein each of the addressable vacuum regions of the gripper mechanism include a plurality of suction elements; and

a contact member including a plurality of openings that correspond to the plurality of suction elements.

11. The end effector of claim 10 , wherein each of the plurality of suction elements extend through a corresponding opening in a top plane of the contact member and without extending past a bottom plane of the contact member.

12. The end effector of claim 10 , wherein the manifold assembly is configured to distribute suction via the suction elements to produce nonuniform vacuum gripping forces based on a measurement of contact with the target object.

13. The end effector of claim 10 , wherein the contact member is comprised of one or more compressible materials configured to deform to accommodate surfaces of objects with different geometries.

14. The end effector of claim 10 , wherein the contact member is comprised of one or more material configured to allow air to be drawn by one or more of the plurality of suction elements to grip the target object.

15. A method of operating a robotic system, the method comprising:

selecting at least one of a plurality of addressable vacuum regions of a gripper, wherein the gripper is a multi-gripper assembly having the plurality of addressable vacuum regions that are independently controllable;

generating commands and/or settings to cause the transport robot to:

contact the one or more target objects with at least one of the plurality of addressable vacuum regions; and

dynamically control a pressure level of air flow through the at least one of the plurality of addressable vacuum regions to grip the one or more target objects using the selected at least one of the plurality of addressable vacuum regions.

16. The method of claim 15 , wherein:

the multi-gripper assembly comprises:

a gripper mechanism including the at least one of the plurality of addressable vacuum regions, wherein each of the addressable vacuum regions of the gripper mechanism includes a plurality of suction elements and

a contact member including a plurality of openings that correspond to the plurality of suction elements; and

generating the commands and/or the settings includes operating the transport robot to press at least a portion of the contact member directly on the one or more target objects overlapping the at least one of the addressable vacuum regions.

17. The method of claim 16 , wherein:

each of the plurality of suction elements extend through a corresponding opening in a top plane of the contact member and without extending past a bottom plane of the contact member; and

generating the commands and/or the settings includes compressing the contact member for enabling the suction elements within the at least one of the addressable vacuum regions to grip the one or more target objects.

18. The method of claim 16 , wherein generating commands and/or settings to draw air corresponds to operating the transport robot to pull the target object against the contact member.

19. The method of claim 16 , wherein:

the multi-gripper assembly further comprises at least one manifold, each manifold including one or more lines connected to the suction elements of an associated gripper mechanism; and

generating the commands and/or the settings includes operating the robotic system to draw air through the one or more lines.

20. The method of claim 19 , wherein each of the at least one manifold is configured to distribute suction via suction elements of the associated gripper mechanism to produce nonuniform vacuum gripping forces.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: MIZOGUCHI, HIRONORI; DIANKOV, ROSEN NIKOLAEV
To: MUJIN, INC.
Reel/Frame 069671/0482 →
Continuity (4)
Continuation 17723258 · Apr 18, 2022
Continuation 16855751 · Apr 22, 2020
Provisional Application 62889562 · Aug 21, 2019
Related Publication 20240181634A1 · Jun 6, 2024
References Cited (81)
US 7017961B1 · Parnell et al. · 2006 [cited by applicant]
US 9089969B1 · Theobald · 2015 [cited by applicant]
US 9333649B1 · Bradski et al. · 2016 [cited by applicant]
US 9393693B1 · Kalakrishnan et al. · 2016 [cited by applicant]
US 10124489B2 · Chitta et al. · 2018 [cited by applicant]
US 10207868B1 · Stubbs et al. · 2019 [cited by applicant]
US 10576630B1 · Diankov et al. · 2020 [cited by applicant]
US 11117256B2 · Diankov et al. · 2021 [cited by applicant]
US 11345029B2 · Mizoguchi · 2022 [cited by examiner]
US 11904468B2 · Mizoguchi · 2024 [cited by examiner]
US 20100222915A1 · Keuhnemann et al. · 2010 [cited by applicant]
US 20180032225A1 · Patil · 2018 [cited by applicant]
US 20180040132A1 · Eto et al. · 2018 [cited by applicant]
US 20180162660A1 · Saylor · 2018 [cited by applicant]
US 20190030730A1 · Tanaka et al. · 2019 [cited by applicant]
US 20190047158A1 · Petroviski · 2019 [cited by applicant]
US 20190077011A1 · Sezaki · 2019 [cited by applicant]
US 20190084012A1 · McCoy, Jr. · 2019 [cited by applicant]
US 20190263603A1 · Saylor · 2019 [cited by applicant]
US 20200269429A1 · Chavez et al. · 2020 [cited by applicant]
US 20200376662A1 · Arase et al. · 2020 [cited by applicant]
US 20210024298A1 · Doppler et al. · 2021 [cited by applicant]
US 20210053216A1 · Diankov et al. · 2021 [cited by applicant]
US 20210387333A1 · Diankov et al. · 2021 [cited by applicant]
CN 101296611A · 2008 [cited by applicant]
CN 101618544A · 2010 [cited by applicant]
CN 103043359A · 2013 [cited by applicant]
CN 104044151A · 2014 [cited by applicant]
CN 106660207A · 2017 [cited by applicant]
CN 106660212A · 2017 [cited by applicant]
CN 107838945A · 2018 [cited by applicant]
CN 108778636A · 2018 [cited by applicant]
CN 109129544A · 2019 [cited by applicant]
CN 109483554A · 2019 [cited by applicant]
CN 109500810A · 2019 [cited by applicant]
CN 112405570A · 2021 [cited by applicant]
JP 06305551A · 1994 [cited by applicant]
JP 2002254380A · 2002 [cited by applicant]
JP 2008501538A · 2008 [cited by applicant]
JP 2010005769A · 2010 [cited by applicant]
JP 5015957A · 2012 [cited by applicant]
JP 2013154457A · 2013 [cited by applicant]
JP 2014176926A · 2014 [cited by applicant]
JP 2017520417A · 2017 [cited by applicant]
JP 201847515A · 2018 [cited by applicant]
JP 2019085271A · 2019 [cited by applicant]
JP 2019162685A · 2019 [cited by applicant]
KR 20190068663A · 2019 [cited by applicant]
WO 2017093683A1 · 2017 [cited by applicant]
WO 2019147697A1 · 2019 [cited by applicant]
Domae et al., Fast graspability evaluation on single depth maps for bin picking with general grippers, 2014, IEEE, p. 1997-2004 (Year: 2014). [cited by examiner]
Dolezel et al., Memory Efficient Grasping Point Detection of Nontrivial Objects, 2021, IEEE, p. 82130-82145 (Year: 2021). [cited by examiner]
Low et al., Sensorized Reconfigurable Soft Robotic Gripper System for Automated Food Handling, 2021, IEEE, p. 3232-3243 (Year: 2021). [cited by examiner]
Causo et al., A Robust Robot Design for Item Picking, 2018, IEEE, p. 7421-7426 (Year: 2018). [cited by examiner]
Kenos Vacuum Gripping Systems, Piab USA, Inc., Hingham, MA, www.piab.com, brochure downloaded on Nov. 18, 2019, 20 pages. [cited by applicant]
The ultimate cobot gripper, Kenos KCS Gripper, Piab USA, Inc., Hingham, MA, www.piab.com, brochure downloaded on Nov. 18, 2019, 12 pages. [cited by applicant]
Notice of Reasons for Rejection for Japanese patent application No. 2020-122816, mailed Aug. 19, 2020, Translation and Official, 10 pages. [cited by applicant]
Decision to Grant for Japanese patent application No. 2020-122816, mailed Aug. 19, 2020, 3 pages. [cited by applicant]
ISA/KR Korean Intellectual Property Office, International Search Report and Written Opinion for PCT/US2020/047226 filed Aug. 20, 2020, mailed Dec. 4, 2020, 12 pages. [cited by applicant]
Notice of Allowance mailed Jan. 21, 2022 for U.S. Appl. No. 16/855,751, filed Apr. 22, 2020, Applicant: Mujin, Inc., Inventors: Rosen Nikolaev Diankov and Hironori Mizoguchi, 14 pages. [cited by applicant]
CNIPA Office Action mailed May 31, 2021 for Chinese patent application No. 20201769547.3, 12 pages. [cited by applicant]
CNIPA Office Action mailed Aug. 18, 2021 for Chinese patent application No. 20201769547.3, 12 pages. [cited by applicant]
CNIPA Notice to Grant mailed Nov. 15, 2021 for Chinese patent application No. 202010769547.3, 4 pages. [cited by applicant]
Notice of Reasons for Rejection for Japanese patent application No. 2020-569150, mailed Aug. 12, 2021, Translation and Official, 6 pages. [cited by applicant]
JPO Decision to Grant mailed Sep. 17, 2021 for Japanese patent application No. 2020-569150, 3 pages. [cited by applicant]
Notice of Allowance mailed Nov. 26, 2021 for U.S. Appl. No. 16/855,751, filed Apr. 22, 2020, Applicant: Mujin, Inc., Inventors: Rosen Nikolaev Diankov and Hironori Mizoguchi, 22 pages. [cited by applicant]
Fatikow et al., Microrobot System for Automatic Nanohandling Inside a Scanning Electron Microscope, 2007, IEEE, p. 244-252, Year: 2007. [cited by applicant]
Lee et al., Bin Picking for the Objects of Non-Lambertian Reflectance without usning an Explicit Object Model, 2014, IEEE, p. 489-493, Year: 2014. [cited by applicant]
Zesch et al., Vacuum tool for handling micro-objects with a NanoRobot, 1997, IEEE, p. 1761-1766, Year: 1997. [cited by applicant]
Takahashi et al. Octopus bioinspired vacuum gripper with micro bumps, 2016, IEEE, p. 1-4, Year: 2016. [cited by applicant]
Zhakypov et al., An Origami-Inspired Reconfigurable Suction Gripper for Picking Objects with Variable Shape and Size, 2018, IEEE, p. 2894-2901, Year: 2018. [cited by applicant]
Mueller et al., “A new Multi-Modal Approach towards reliable Bin-Picking Application,” 2016, IEEE, p. 1-7, Year: 2016. [cited by applicant]
Staretu et al., “Complex software for command and control of the anthropomorphic gripper for robots,” 2012, IEEE, p. 662-667, Year: 2012. [cited by applicant]
Fajardo et al., “Development of a variable negative pressure Jamming Gripper through visual object size classification and Artificial Neural Network,” 2016, IEEE, p. 2081-2085, Year: 2016. [cited by applicant]
Non-Final Office Action mailed Feb. 24, 2023 for U.S. Appl. No. 17/723,258, filed Apr. 18, 2022, Applicant: Mujin, Inc., Inventors: Rosen Nikolaev Diankov and Hironori Mizoguchi, 19 pages. [cited by applicant]
Notice of Allowance mailed Jun. 5, 2023 for U.S. Appl. No. 17/723,258, filed Apr. 18, 2022, Applicant: Mujin, Inc., Inventors: Rosen Nikolaev Diankov and Hironori Mizoguchi, 12 pages. [cited by applicant]
Notice of Allowance mailed Oct. 12, 2023 for U.S. Appl. No. 17/723,258, filed Apr. 18, 2022, Applicant: Mujin, Inc., Inventors: Rosen Nikolaev Diankov and Hironori Mizoguchi, 9 pages. [cited by applicant]
Decision to Grant issued Apr. 19, 2024 for Japanese patent application No. 2021-168434, Applicant: Mujin, Inc., 3 pages. [cited by applicant]
Office Action issued Feb. 7, 2024 for Japanese patent application No. 2021-168434, Applicant: Mujin, Inc., 2 pages. [cited by applicant]
Decision of Rejection issued Sep. 27, 2024 for Japanese patent application No. 2020-183455, Applicant: Mujin, Inc., 5 pages. [cited by applicant]
Office Action issued Feb. 21, 2024 for Japanese patent application No. 2020-183455, Applicant: Mujin, Inc., 5 pages. [cited by applicant]
Cited By (1)
US 12,472,637