IP Library Granted Patent US 11,494,575
Granted Patent B2
US 11,494,575 · App. 16/800,587 · Granted Nov 8, 2022

Systems and methods for identifying and processing a variety of objects

Inventors: Thomas Wagner (Concord, MA); Kevin Ahearn (Nebo, NC); Benjamin Cohen (Somerville, MA); Michael Dawson-Haggerty (Pittsburgh, PA); Christopher Geyer (Arlington, MA); Thomas Koletschka (Cambridge, MA); Kyle Maroney (North Attleboro, MA); Matthew T. Mason (Pittsburgh, PA); Gene Temple Price (Cambridge, MA); Joseph Romano (Arlington, MA); Daniel Smith (Canonsburg, PA); Siddhartha Srinivasa (Seattle, WA); Prasanna Velagapudi (Pittsburgh, PA); Thomas Allen (Reading, MA)
Assignee: Berkshire Grey Operating Company, Inc.
G06K7/1443B07C5/36B25J9/0093B25J9/1679B25J9/1694B25J9/1697B25J19/022B25J19/023B65G1/1373G05B19/124G05B19/4183G06K7/10693G06K7/1404G06K7/1447G06K19/06028G06Q10/087G06V20/64G06V40/1312G05B2219/14005G05B2219/36371G05B2219/45045G05B2219/45047G05B2219/45063G06V2201/06Y02P90/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,494,575
App. No.
16/800,587
Granted
Nov 8, 2022
Kind
B2
Abstract

A robotic system is disclosed that include an articulated arm and a first perception system for inspecting an object, as well as a plurality of additional perception systems, each of which is arranged to be directed toward a common area in which an object may be positioned by the robotic arm such that a plurality of views within the common area may be obtained by the plurality of additional perception systems.

Claims (70)

1. A method of processing a plurality of dissimilar objects, said method comprising:

presenting the plurality of dissimilar objects at a first location, each of which is in contact with at least another of the plurality of dissimilar objects;

providing first perceived information by a first perception unit that scans the plurality of dissimilar objects at the first location;

obtaining identifying indicia from the first perceived information;

associating a first object included among the plurality of dissimilar objects with one of the identifying indicia from the first perceived information by a control system;

grasping with an end effector of a programmable motion device the first object included among the plurality of dissimilar objects;

separating the first object from the plurality of dissimilar objects using the programmable motion device;

providing second perceived information by the first perception unit that scans the plurality of dissimilar objects after the first object is separated from the plurality of dissimilar objects;

determining by the control system whether the identifying indicia associated with the first object is present in the second perceived information after the first object is separated from the plurality of dissimilar objects; and

one of returning the first object back to the plurality of dissimilar objects in response to the control system determining that the identifying indicia associated with the first object is present in the second perceived information, or routing the first object toward a destination location associated with the identifying indicia in response to the control system determining that the identifying indicia associated with the first object is not present in the second perceived information.

2. The method as claimed in claim 1 , wherein the plurality of dissimilar objects at the first location include both objects with an exposed identifying indicia and objects without exposed identifying indicia.

3. The method as claimed in claim 1 , wherein the method further includes ranking at least two objects of the plurality of dissimilar objects with regard to a picking order.

4. The method as claimed in claim 1 , wherein grasping the first object includes grasping the first object without having identified the first object.

5. The method as claimed in claim 1 , further comprising:

determining from the first perceived information a second object having no identifying indicia that is included among the plurality of dissimilar objects;

separating the second object from the plurality of dissimilar objects using the programmable motion device;

presenting the second object using the programmable motion device to a second perception unit that includes a plurality of identity capturing devices, wherein the plurality of identity capturing devices are positioned in a generally bowl-shape;

scanning every surface of the second object for identifying indicia using the plurality of identity capturing devices of the second perception unit; and

routing the second object toward a destination location associated with the identifying indicia provided by the second perception unit.

6. The method as claimed in claim 5 , wherein the method further includes scanning every surface of the first object for identifying indicia using the plurality of identity capturing devices of the second perception unit includes rotating the first object with the end effector of the programmable motion device.

7. The method as claimed in claim 1 , further comprising:

determining from the first perceived information a second object having no identifying indicia that is included among the plurality of dissimilar objects;

separating the second object from the plurality of dissimilar objects using the programmable motion device;

dropping the second object from the end effector of the programmable motion device through a drop scanner that includes a plurality of identity capturing devices arranged between an open top and an open bottom of the drop scanner;

scanning every surface of the second object for identifying indicia using the plurality of identity capturing devices as the second object falls through the drop scanner; and

routing the second object toward a destination location associated with the identifying indicia provided by the drop scanner.

8. The method as claimed in claim 7 , wherein dropping the second object from the end effector of the programmable motion device through the drop scanner includes providing illumination of the second object by a plurality of illumination sources as the second object falls through the drop scanner.

9. The method as claimed in claim 6 , wherein the method further includes providing simulations of poses of the first object to optimize placement of the plurality of identity capturing devices.

10. The method as claimed in claim 9 , wherein providing simulations of poses of the first object involves the use of a barcode scanner performance model.

11. The method as claimed in claim 10 , wherein the barcode scanner performance model incorporates pitch and skew of planes of barcode symbologies.

12. A method of processing a plurality of dissimilar objects, said method comprising:

presenting the plurality of dissimilar objects at a first location, each of which is in contact with at least another of the plurality of dissimilar objects;

providing first perceived information by a first perception unit that scans the plurality of dissimilar objects at the first location;

determining from the first perceived information a first object having no identifying indicia included among the plurality of dissimilar objects;

grasping with an end effector of a programmable motion device the first object from among the plurality of dissimilar objects;

separating the first object from the plurality of dissimilar objects using the programmable motion device;

presenting the first object using the programmable motion device to a second perception unit that includes a plurality of identity capturing devices;

scanning every surface of the first object for identifying indicia using the plurality of identifying capturing devices of the second perception unit; and

routing the first object toward a destination location associated with the identifying indicia provided by the second perception unit.

13. The method as claimed in claim 12 , wherein presenting the first object to the plurality of identity capturing devices included in the second perception unit includes dropping the first object from the end effector of the programmable motion device through a drop scanner that includes the plurality of identity capturing devices between an open top and an open bottom of the drop scanner.

14. The method as claimed in claim 13 , wherein dropping the first object from the end effector of the programmable motion device through the drop scanner includes providing illumination of the first object by a plurality of illumination sources as the second object falls through the drop scanner.

15. The method as claimed in claim 12 , wherein the plurality of dissimilar objects at the first location include both objects with an exposed identifying indicia and objects without exposed identifying indicia.

16. The method as claimed in claim 12 , wherein the method further includes ranking at least two objects of the plurality of dissimilar objects with regard to a picking order.

17. The method as claimed in claim 12 , wherein the plurality of identity capturing devices included in the second perception unit are positioned in a generally bowl-shape.

18. The method as claimed in claim 17 , wherein the method further includes rotating the first object with the end effector of the programmable motion device in a space between the plurality of identity capturing devices of the second perception unit.

19. The method as claimed in claim 17 , wherein the method further includes providing simulations of poses of the first object to optimize placement of the plurality of identity capturing devices.

20. The method as claimed in claim 19 , wherein providing simulations of poses of the first object involves the use of a barcode scanner performance model.

21. The method as claimed in claim 20 , wherein the barcode scanner performance model incorporates pitch and skew of planes of barcode symbologies.

22. A method of processing a plurality of dissimilar objects, said method comprising:

presenting the plurality of dissimilar objects at a first location, each of which is in contact with at least another of the plurality of dissimilar objects;

providing first perceived information by a first perception unit that scans the plurality of dissimilar objects at the first location;

obtaining a plurality of unique markings and a position associated with each unique marking detected in the first perceived information;

generating a map of the plurality of dissimilar objects;

associating each unique marking to an object located in the map based on the position of the unique marking in the first perceived information;

locating a first object in the map that is not associated with any of the unique markings detected in the first perceived information;

grasping with an end effector of a programmable motion device the first object included among the plurality of dissimilar objects;

separating the first object from the plurality of dissimilar objects using the programmable motion device;

dropping the first object from the end effector of the programmable motion device through a drop scanner that includes a plurality of identity capturing devices positioned between an open top and an open bottom of the drop scanner;

scanning every surface of the first object for identifying indicia using the plurality of identity capturing devices as the first object falls through the drop scanner; and

routing the first object toward a destination location associated with the identifying indicia provided by the drop scanner.

23. The method as claimed in claim 22 , wherein dropping the first object from the end effector of the programmable motion device through the drop scanner includes providing illumination of the first object by a plurality of illumination sources as the first object falls through the drop scanner.

24. The method as claimed in claim 22 , wherein the plurality of dissimilar objects at the first location include both objects with an exposed identifying indicia and objects without exposed identifying indicia.

25. The method as claimed in claim 22 , wherein the method further includes:

associating a second object included among the plurality of dissimilar objects with one of the unique markings detected in the first perceived information provided by the first perception unit;

grasping with an end effector of a programmable motion device the second object included among the plurality of dissimilar objects;

separating the second object from the plurality of dissimilar objects using the programmable motion device;

providing second perceived information by the first perception unit that scans the plurality of dissimilar objects after the second object is separated from the plurality of dissimilar objects; and

routing the second object toward a destination associated with the unique marking associated with the second object in response to confirming that the unique marking associated with the second object is not present in the second perceived information of the plurality of dissimilar objects after the second object is separated from the plurality of dissimilar objects.

26. The method as claimed in claim 25 , wherein the method further includes

returning the second object back to the plurality of dissimilar objects in response to determining that the second object is present in the second perceived information of the plurality of dissimilar objects after the second object is separated from the plurality of dissimilar objects.

Assignments (3)
MERGER AND CHANGE OF NAME Recorded Feb 1, 2022
From: BERKSHIRE GREY, INC.; BERKSHIRE GREY OPERATING COMPANY, INC.
To: BERKSHIRE GREY OPERATING COMPANY, INC.
Reel/Frame 058947/0548 →
ASSIGNEE CHANGE OF ADDRESS Recorded Feb 12, 2021
From: BERKSHIRE GREY, INC.
To: BERKSHIRE GREY, INC.
Reel/Frame 055291/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2020
From: WAGNER, THOMAS; AHEARN, KEVIN; COHEN, BENJAMIN; DAWSON-HAGGERTY, MICHAEL; GEYER, CHRISTOPHER; KOLETSCHKA, THOMAS; MARONEY, KYLE; MASON, MATTHEW T.; PRICE, GENE TEMPLE; ROMANO, JOSEPH; SMITH, DANIEL; SRINIVASA, SIDDHARTHA; VELAGAPUDI, PRASANNA; ALLEN, THOMAS
To: BERKSHIRE GREY, INC.
Reel/Frame 052841/0716 →
Continuity (5)
Continuation 15982238 · May 17, 2018
Continuation 15260837 · Sep 9, 2016
Provisional Application 62269640 · Dec 18, 2015
Provisional Application 62217200 · Sep 11, 2015
Related Publication 20200218865A1 · Jul 9, 2020
Cited By (1)
US 12,280,967