IP Library Granted Patent US 10,752,442
Granted Patent B2
US 10,752,442 · App. 16/555,301 · Granted Aug 25, 2020

Identification and planning system and method for fulfillment of orders

Inventors: Anirudh Singh Shekhawat (Jaipur, IN); Sameer Narkar (Mumbai, IN); Akash Patil (Pune, IN); Avilash Kumar (Jamshedpur, IN); Vaibhav Tolia (Gurgaon, IN)
Assignee: GREY ORANGE PTE. LTD.
B65G1/1373B65G2203/0216G05B2219/31286
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,752,442
App. No.
16/555,301
Granted
Aug 25, 2020
Kind
B2
Abstract

A identification and planning system includes a scanner assembly, a robotic manipulator, and control server. The control server detects a first plurality of inventory items in a first inventory storage system and determines a first set of position parameters for a first inventory item from the detected first plurality of inventory items, with respect to a position of one or more image sensors in the scanner assembly. The control server generates a plurality of pick-path plans for the first inventory item, where each pick-path plan corresponds to a transformation of the determined first set of position parameters to a second set of position parameters with respect to the robotic manipulator. The control server further selects a first pick-path plan from the plurality of pick-path plans and controls the robotic manipulator to pick the first inventory item from the first inventory storage system, based on the first pick-path plan.

Claims (64)

1. An identification and planning system, comprising:

a scanner assembly that comprises one or more image sensors;

a robotic manipulator that comprises a robotic arm; and

a control server comprising control circuitry, wherein the control circuitry is configured to:

detect, by the one or more image sensors, a first plurality of inventory items in a first inventory storage system;

determine a first set of position parameters for a first inventory item from the detected first plurality of inventory items;

retrieve historical information associated with the first inventory item, the historical information indicating at least one of (i) a historical demand and (ii) item attribute information;

generate, based on the retrieved historical information, a plurality of pick-path plans for the first inventory item, wherein each pick-path plan of the plurality of pick-path plans corresponds to a transformation of the determined first set of position parameters to a second set of position parameters with respect to a spatial differentiation caused by a difference in position of the scanner assembly and the robotic manipulator;

select a first pick-path plan from the plurality of pick-path plans, wherein the first pick-path plan is selected before a pick operation is executed on the first inventory item, and the selection of the first pick-path plan is based on a success of the pick operation in a test computer-simulation, the success of the pick operation occurs when the second set of position parameters corresponding to the selected first pick-path plan allow the robotic manipulator to reach and hold the first inventory item; and

in the pick operation, control, based on the first pick-path plan, the robotic arm to pick the first inventory item from the first inventory storage system.

2. The identification and planning system of claim 1 , wherein in the historical information for the first inventory item is updated after a successful pick up of the first inventory item.

3. The identification and planning system of claim 1 , wherein the historical information includes previous ordering information of the first inventory item.

4. The identification and planning system according to claim 1 , wherein the first set of position parameters are spatially different from the second set of position parameters, and wherein the spatial differentiation is caused by a difference in a spatial location of the scanner assembly and the robotic manipulator.

5. The identification and planning system of claim 1 , wherein the scanner assembly is located at a position different than a position of the robotic manipulator such that scanner assembly is separated from the robotic manipulator.

6. The identification and planning system according to claim 5 , wherein, in the scanning operation, the control circuitry is further configured to extract color information and depth information from a plurality of three dimensional (3D) images of the first plurality of inventory items, and

wherein the scanning operation further comprises the detection of the first plurality of inventory items and the determination of first set of position parameters.

7. The identification and planning system according to claim 1 , further comprising a first mobile robot, wherein the first inventory storage system is mounted on the first mobile robot that is configured to move the first inventory storage system from a first location to a second location in a warehouse based on instructions received from the control circuitry.

8. The identification and planning system according to claim 1 , wherein the first inventory storage system comprises a first plurality of storage bins, wherein each storage bin of the first plurality of storage bins is located at different spatial positions in the first inventory storage system, the first plurality of storage bins accommodates the first plurality of inventory items.

9. The identification and planning system according to claim 8 , wherein the control circuitry is further configured to execute the pick operation for the first inventory item of the first inventory storage system, in parallel with a scanning operation on the second plurality of inventory items in one or more storage bins of the second inventory storage system.

10. The identification and planning system according to claim 1 , wherein the control circuitry is further configured to execute, using the one or more image sensors, a scanning operation of the first plurality of inventory items in the first inventory storage system.

11. The identification and planning system according to claim 9 , further comprising a second inventory storage system that comprises a second plurality of storage bins, wherein each storage bin of the second plurality of storage bins, present at different spatial positions in the second inventory storage system, accommodates a second plurality of inventory items.

12. The identification and planning system according to claim 1 , wherein the control circuitry is further configured to execute a queuing operation for the first inventory storage system and a second inventory storage system prior to an execution of the pick operation.

13. The identification and planning system according to claim 12 , further comprising at least one mobile robot,

wherein, in the queuing operation, the control circuitry is configured to control the at least one mobile robot to position the first inventory storage system and the second inventory storage system in a defined queue of a queuing station.

14. The identification and planning system according to claim 13 ,

wherein the defined queue comprises grid regions, and

wherein the scanner assembly is positioned in front of a first grid region of the grid regions and the robotic manipulator is positioned in front of a second grid region of the grid regions.

15. The identification and planning system according to claim 14 ,

wherein, in the queuing operation, the control circuitry is further configured to control the at least one mobile robot to move the first inventory storage system and the second inventory storage system through the grid regions of the defined queue, and

wherein the first inventory storage system and the second inventory storage system are moved for execution of the pick operation for the first inventory item in parallel with the scanning operation on the second plurality of inventory items in the second inventory storage system.

16. The identification and planning system according to claim 1 , wherein the item attribute information includes different surface attributes of the first inventory item, wherein the control circuitry is further configured to:

estimate, based on a scan by one or more image sensors, three dimensional (3D) information that corresponds to different surface attributes of the first inventory item in the first inventory storage system of the first plurality of inventory items; and

estimate an orientation of the first inventory item in the first inventory storage system, based on the scan.

17. The identification and planning system according to claim 16 , wherein the control circuitry is further configured to apply a plurality of transform operations to the determined first set of position parameters to obtain the second set of position parameters, based on the estimated 3D surface information and the estimated orientation of the first inventory item.

18. The identification and planning system according to claim 17 , wherein the control circuitry is further configured to verify, in the test computer-simulation, the success of the pick operation on the first inventory item, based on execution of the pick operation corresponding to the application of each transform operation of the plurality of transform operations on the determined first set of position parameters.

19. The identification and planning system according to claim 1 , wherein the robotic manipulator further comprises a plurality of actuators in the robotic arm, wherein the plurality of actuators allow a movement of the robotic arm and the end effector within a defined number of degrees of freedom in a three dimensional (3D) space.

20. The identification and planning system according to claim 19 ,

wherein the success of the pick operation corresponds to an event in the test computer-simulation, in which a simulation of the robotic manipulator picks the first inventory item using a simulated movement of the plurality of actuators, and

wherein the simulated movement is based on a defined number of degrees of freedom of the robotic arm and the second plurality of position parameters in the first pick-path plan.

21. The identification and planning system according to claim 1 , wherein the item attribute information includes a set of attributes of the first inventory item, the system further comprising a memory configured to store the set of attributes of the first inventory item prior to a scanning operation and the pick operation,

wherein the control circuitry is further configured to estimate a set of grip parameters associated with the end effector of the robotic manipulator, based on the stored set of attributes of the first inventory item.

22. The identification and planning system according to claim 21 , wherein the control circuitry is further configured to verify, in the test computer-simulation, the success of the pick operation of the first inventory item by execution of the pick operation with a plurality of modifications in the estimated set of grip parameters.

23. The identification and planning system according to claim 22 , wherein the control circuitry is further configured to select the end effector from a set of end effectors, based on the stored set of attributes of the first inventory item.

24. The identification and planning system according to claim 1 , wherein each of the detected first plurality of inventory items in the first inventory storage system is associated with a unique tag that corresponds to a stock keeping unit (SKU).

25. The identification and planning system according to claim 24 , wherein the control circuitry is further configured to segregate, prior to a scanning operation and the pick operation, the first plurality of inventory items into a first set of inventory items and a second set of inventory items.

26. The identification and planning system according to claim 25 ,

wherein the segregation of the first plurality of inventory items is based on the unique tag for each of the first plurality of inventory items, and

wherein the first set of inventory items correspond to inventory items that are auto pickable by the robotic manipulator and the second set of inventory items correspond to inventory items manually pickable by a warehouse operator.

27. An identification and planning system, comprising:

a control server comprising control circuitry, wherein the control circuitry is configured to:

detect a first plurality of inventory items in a first inventory storage system;

determine a first set of position parameters for a first inventory item from the detected first plurality of inventory items;

retrieve historical information associated with the first inventory item, the historical information indicating at least one of (i) a historical demand and (ii) item attribute information;

generate, based on the retrieved historical information, a plurality of pick-path plans for the first inventory item, wherein each pick-path plan of the plurality of pick-path plans corresponds to a transformation of the determined first set of position parameters to a second set of position parameters with respect to a spatial differentiation caused by a difference in position of the scanner assembly and a robotic manipulator;

select a first pick-path plan from the plurality of pick-path plans, wherein the first pick-path plan is selected before a pick operation is executed on the first inventory item, and the selection of the first pick-path plan is based on a success of the pick operation in a test computer-simulation, the success of the pick operation occurs when the second set of position parameters corresponding to the selected first pick-path plan allow the robotic manipulator to reach and hold the first inventory item; and

in the pick operation, control, based on the selected first pick-path plan, a robotic arm to pick the first inventory item from the first inventory storage system.

28. A method of an identification and planning system that includes control circuitry and one or more image sensors, the method comprising:

detecting, by the one or more image sensors, a first plurality of inventory items in a first inventory storage system;

determining, by the control circuitry, a first set of position parameters for a first inventory item from the detected first plurality of inventory items;

retrieving historical information associated with the first inventory item, the historical information indicating at least one of (i) a historical demand and (ii) item attribute information;

generating, by the control circuitry and based on the retrieved historical information, a plurality of pick-path plans for the first inventory item, wherein each pick-path plan of the plurality of pick-path plans corresponds to a transformation of the determined first set of position parameters to a second set of position parameters with respect to a spatial differentiation caused by a difference in position of the scanner assembly and a robotic manipulator;

selecting, by the control circuitry, a first pick-path plan from the plurality of pick-path plans, wherein the first pick-path plan is selected before a pick operation is executed on the first inventory item, and the selection of the first pick-path plan is based on a success of the pick operation in a test computer-simulation, the success of the pick operation occurs when the second set of position parameters corresponding to the selected first pick-path plan allow the robotic manipulator to reach and hold the first inventory item; and

in the pick operation, controlling, by the control circuitry and based on the selected first pick-path plan, a robotic arm and an end effector detachably attached to the robotic arm to pick the first inventory item from the first inventory storage system.

29. The identification and planning system according to claim 21 , wherein the set of attributes includes one or more of a size of the first inventory item, a Stock Keeping Unit (SKU) identifier of the first inventory item, a shape of the first inventory item, a price of the first inventory item, a degree of fragility of the first inventory item, a type of packaging of the first inventory item, a type of product material of the first inventory item, and an order-related, customer-specified, or supply-chain constraint for the first inventory item.

Assignments (6)
ACKNOWLEDGEMENT OF SUCCESSOR ADMINISTRATIVE AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENTS Recorded May 9, 2024
From: TD SLP, LLC (FORMERLY KNOWN AS CSI GP I LLC), AS RETIRING AGENT
To: ANTHELION FUND I GP LLC, AS SUCCESSOR AGENT
Reel/Frame 067370/0677 →
RELEASE OF SECURITY INTEREST Recorded Nov 17, 2023
From: ACQUIOM AGENCY SERVICES LLC
To: GREY ORANGE INCORPORATED; GREY ORANGE PTE. LTD.
Reel/Frame 065603/0442 →
SECURITY INTEREST Recorded Nov 10, 2023
From: GREY ORANGE INCORPORATED; GREY ORANGE PTE. LTD.
To: CSI GP I LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 065535/0861 →
RELEASE OF SECURITY INTEREST Recorded Jun 29, 2022
From: TRIPLEPOINT VENTURE GROWTH BDC CORP.
To: GREY ORANGE INTERNATIONAL INC.
Reel/Frame 060529/0041 →
SECURITY INTEREST Recorded May 6, 2022
From: GREY ORANGE INCORPORATED; GREY ORANGE PTE. LTD.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 059842/0292 →
SECURITY INTEREST Recorded Mar 25, 2021
From: GREY ORANGE INTERNATIONAL INC.
To: TRIPLEPOINT VENTURE GROWTH BDC CORP.
Reel/Frame 055726/0028 →
Continuity (2)
Continuation 16170958 · Oct 25, 2018
Related Publication 20200130936A1 · Apr 30, 2020
Cited By (2)
US 12,487,587 US 12,630,364