IP Library Granted Patent US 11,235,458
Granted Patent B2
US 11,235,458 · App. 16/538,114 · Granted Feb 1, 2022

Manipulating boxes using a zoned gripper

Inventors: Sachin Chitta (Palo Alto, CA); David Hershberger (Menlo Park, CA); Karl Pauwels (Redwood City, CA)
Assignee: Boston Dynamics, Inc.
B25J9/10B25J9/1612B25J13/08B25J15/0683B66F9/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,235,458
App. No.
16/538,114
Granted
Feb 1, 2022
Kind
B2
Abstract

A method of manipulating boxes includes receiving a minimum box size for a plurality of boxes varying in size located in a walled container. The method also includes dividing a grip area of a gripper into a plurality of zones. The method further includes locating a set of candidate boxes based on an image from a visual sensor. For each zone, the method additionally includes, determining an overlap of a respective zone with one or more neighboring boxes to the set of candidate boxes. The method also includes determining a grasp pose for a target candidate box that avoids one or more walls of the walled container. The method further includes executing the grasp pose to lift the target candidate box by the gripper where the gripper activates each zone of the plurality of zones that does not overlap a respective neighboring box to the target candidate box.

Claims (43)

1. A method comprising:

receiving, at a control system, a minimum box size for a plurality of boxes varying in size, the plurality of boxes located in a walled container, the robot comprising a gripper with a plurality of vacuum suction cups;

dividing, by the control system, a grip area of the gripper into a plurality of zones based on the minimum box size;

locating, by the control system, a set of candidate boxes of the plurality of boxes based on an image from a visual sensor;

for each zone of the plurality of zones, determining, by the control system, an overlap of a respective zone with one or more neighboring boxes to the set of candidate boxes, the neighboring boxes identified by the image from the visual sensor;

determining, by the control system, a grasp pose for a target candidate box of the set of candidate boxes that avoids one or more walls of the walled container; and

executing, by the control system, the grasp pose to lift the target candidate box by the gripper, the gripper activating each zone of the plurality of zones that does not overlap a respective neighboring box to the target candidate box.

2. The method of claim 1 , further comprising, determining, by the control system, that the grasp pose includes minimum coverage of the target candidate box, the minimum coverage corresponding to an area providing suction force sufficient to lift the target candidate box.

3. The method of claim 1 , further comprising determining, by the control system, that a part-presence sensor overlaps with the target candidate box by a sufficient margin, the sufficient margin triggering the part-presence sensor to communicate a presence of the target candidate box.

4. The method of claim 1 , wherein determining the grasp pose for the target candidate box comprises offsetting the grasp pose based on a location of the one or more walls of the walled container.

5. The method of claim 1 , further comprising:

determining, by the control system, that the gripper has lifted the target candidate box a threshold height; and

activating, by the control system, all zones of the gripper.

6. The method of claim 1 , further comprising:

identifying, by the control system, a feature of the walled container to avoid during removal of the target candidate box from the walled container; and

determining, by the control system, a motion path for removal of the target candidate box from the walled container, the motion path avoiding the identified feature of the walled container.

7. The method of claim 1 , wherein the plurality of zones cascade across the plurality of vacuum suction cups of the gripper.

8. The method of claim 1 , wherein the plurality of boxes varying in size correspond to rectilinear objects.

9. The method of claim 1 , wherein the plurality of boxes varying in size corresponds to the plurality of boxes varying in height.

10. The method of claim 1 , wherein the grasp pose corresponds to a position of the gripper defined by a set of vacuum suction cups of the plurality of vacuum suction cups overlapping a top surface of a target candidate box.

11. A robot comprising:

a visual sensor;

a gripper comprising a plurality of vacuum suction cups; and

a control system configured to perform operations comprising:

receiving a minimum box size for a plurality of boxes varying in size, the plurality of boxes located in a walled container;

dividing a grip area of the gripper into a plurality of zones based on the minimum box size;

locating a set of candidate boxes of the plurality of boxes based on an image from the visual sensor;

for each zone of the plurality of zones, determining an overlap of a respective zone with one or more neighboring boxes to the set of candidate boxes, the neighboring boxes identified by the image from the visual sensor;

determining a grasp pose for a target candidate box of the set of candidate boxes that avoids one or more walls of the walled container; and

executing the grasp pose to lift the target candidate box by the gripper to the control system, the grasp pose actuating each zone of the plurality of zones that does not overlap a respective neighboring box to the target candidate box.

12. The robot of claim 11 , wherein the operations further comprise determining that the grasp pose includes minimum coverage of the target candidate box, the minimum coverage corresponding to an area providing suction force sufficient to lift the target candidate box.

13. The robot of claim 11 , wherein the operations further comprise determining that a part-presence sensor overlaps with the target candidate box by a sufficient margin, the sufficient margin triggering the part-presence sensor to communicate a presence of the target candidate box.

14. The robot of claim 11 , wherein determining the grasp pose for the target candidate box comprises offsetting the grasp pose based on a location of the one or more walls of the walled container.

15. The robot of claim 11 , wherein the control system is further configured to:

lift the target candidate box by a threshold height; and

activate all zones of the gripper.

16. The robot of claim 11 , wherein the operation further comprise:

identifying a feature of the walled container to avoid during removal of the target candidate box from the walled container; and

determining a motion path for removal of the target candidate box from the walled container, the motion path avoiding the identified feature of the walled container.

17. The robot of claim 11 , wherein the plurality of zones cascade across the plurality of vacuum suction cups of the gripper.

18. The robot of claim 11 , wherein the plurality of boxes varying in size correspond to rectilinear objects.

19. The robot of claim 11 , wherein the plurality of boxes varying in size corresponds to the plurality of boxes varying in height.

20. The robot of claim 11 , wherein the grasp pose corresponds to a position of the gripper defined by a set of vacuum suction cups of the plurality of vacuum suction cups overlapping a top surface of a target candidate box.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2023
From: KINEMA SYSTEMS INC.
To: BOSTON DYNAMICS, INC.
Reel/Frame 063659/0928 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATIONS NUMBERS 63127573 AND 11/302759 AND THE CITY OF THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 057111 FRAME: 0202. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 27, 2021
From: BOSTON DYNAMICS, INC.
To: BOSTON DYNAMICS, INC.
Reel/Frame 057964/0415 →
CHANGE OF NAME Recorded Oct 5, 2021
From: BOSTON DYNAMICS, INC.
To: BOSTON DYNAMICS, INC.
Reel/Frame 057711/0202 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2019
From: CHITTA, SACHIN; HERSHBERGER, DAVID; PAUWELS, KARL
To: KINEMA SYSTEMS INC.
Reel/Frame 050380/0187 →
Continuity (2)
Provisional Application 62718060 · Aug 13, 2018
Related Publication 20200047331A1 · Feb 13, 2020
Cited By (1)
US 12,552,030