IP Library Patent Application 18659678
Patent Application
App. No. 18/659,678

Robotic Multi-Pick Detection

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/659,678
Abstract

A system may capture image data of one or more items at a scanning area using one or more cameras. The system may determine one or more thresholds for the image data using one or more first dimensions of a set of items and may filter the image data using the one or more thresholds. The system may estimate one or more second dimensions of the one or more items based on the filtered image data, and the system may identify a first item from among the one or more items by comparing the estimated one or more second dimensions of the one or more items with the one or more first dimensions of the set of items.

Claims (68)

1 . A computer-implemented method comprising:

capturing, by one or more processors and using one or more cameras, image data of one or more items at a scanning area;

determining, by the one or more processors, one or more thresholds for the image data using one or more first dimensions of a set of items;

filtering, by the one or more processors, the image data using the one or more thresholds;

estimating, by the one or more processors, one or more second dimensions of the one or more items based on the filtered image data; and

identifying, by the one or more processors, a first item from among the one or more items by comparing the estimated one or more second dimensions of the one or more items with the one or more first dimensions of the set of items.

2 . The computer-implemented method of claim 1 , further comprising:

determining, by the one or more processors, that the one or more items include a plurality of items based on the estimated one or more second dimensions and the one or more first dimensions.

3 . The computer-implemented method of claim 1 , further comprising:

receiving, by the one or more processors, a software trigger, the software trigger indicating when a robotic arm is holding the one or more items at the scanning area; and

responsive to receiving the software trigger, capturing the image data by a plurality of cameras, each of the plurality of cameras being placed at a different angle to the scanning area.

4 . The computer-implemented method of claim 1 , further comprising:

retrieving, by the one or more processors using a robotic arm, the one or more items from a mobile storage unit, the mobile storage unit holding the set of items; and

positioning, by the one or more processors using the robotic arm, the one or more items at the scanning area.

5 . The computer-implemented method of claim 1 , further comprising:

instructing, by the one or more processors, a robotic arm to retrieve a defined item of the set of items from a mobile storage unit;

determining, by the one or more processors, that the first item does not match the defined item; and

instructing, by the one or more processors, the robotic arm to replace the first item in the mobile storage unit.

6 . The computer-implemented method of claim 1 , further comprising:

instructing, by the one or more processors, a robotic arm to retrieve a defined item of the set of items from a mobile storage unit;

determining, by the one or more processors, that the first item does match the defined item; and

instructing, by the one or more processors, the robotic arm to release the first item to a shipping carton.

7 . The computer-implemented method of claim 6 , further comprising:

transporting, by the one or more processors using an automated guided vehicle, the mobile storage unit holding the set of items to an item delivery area associated with the one or more cameras; and

determining the one or more first dimensions describing the set of items based on an identity of the mobile storage unit.

8 . The computer-implemented method of claim 1 , wherein capturing the image data of the one or more items at the scanning area includes:

capturing two images from two different angles using the one or more cameras.

9 . The computer-implemented method of claim 8 , wherein estimating the one or more second dimensions of the one or more items includes:

generating, by the one or more processors, a point cloud using the two images, each of the two images being captured using a stereoscopic camera.

10 . The computer-implemented method of claim 1 , wherein filtering the image data using the one or more thresholds includes:

excluding, by the one or more processors, one or more objects in the image data based on the one or more objects being external to the scanning area of the image data defined by the one or more thresholds.

11 . A system comprising:

a robotic arm adapted to hold one or more items at a defined scanning area;

a frame holding two or more cameras at a defined angle to the defined scanning area; and

one or more processors executing instructions that cause the one or more processors to perform operations including:

processing image data captured using the two or more cameras; and

performing one or more of determining an identity of the one or more items and determining whether the one or more items include a plurality of items.

12 . The system of claim 11 , wherein:

each of the two or more cameras include a stereoscopic camera; and

the image data includes at least two stereoscopic images.

13 . The system of claim 11 , wherein the frame includes one or more horizontal members that allow the two or more cameras to be adjusted along two horizontal axes.

14 . The system of claim 11 , further comprising:

a chute below the defined scanning area, the robotic arm being configured to drop the one or more items through the chute.

15 . The system of claim 14 , further comprising:

an item delivery area from which the robotic arm is configured to grasp the one or more items; and

an item receiving area to which the robotic arm is configured to place the one or more items, the one or more items passing through the chute to the item receiving area responsive to the one or more processors determining that that the one or more items include a single item.

16 . The system of claim 11 , wherein the operations further include:

determining, by the one or more processors, one or more thresholds for the image data using one or more first dimensions of a defined set of items; and

filtering, by the one or more processors, the image data using the one or more thresholds.

17 . The system of claim 16 , wherein the operations further include:

estimating, by the one or more processors, one or more second dimensions of the one or more items based on the filtered image data; and

identifying, by the one or more processors, a first item from among the one or more items by comparing the estimated one or more second dimensions of the one or more items with the one or more first dimensions of the defined set of items.

18 . The system of claim 17 , wherein the operations further include:

determining, by the one or more processors, that the one or more items include the plurality of items based on the estimated one or more second dimensions and the one or more first dimensions.

19 . The system of claim 11 , wherein the operations further include:

retrieving, by the one or more processors using the robotic arm, the one or more items from a mobile storage unit, the mobile storage unit holding a set of items; and

positioning, by the one or more processors using the robotic arm, the one or more items at the defined scanning area.

20 . The system of claim 11 , wherein the operations further include:

instructing, by the one or more processors, the robotic arm to retrieve a defined item of a set of items from a mobile storage unit;

determining, by the one or more processors, that the one or more items do not match the defined item; and

instructing, by the one or more processors, the robotic arm to replace the one or more items in the mobile storage unit.

21 . A method comprising:

positioning, by a robotic arm, one or more items at a defined location;

capturing three-dimensional image data of the one or more items at the defined location using a plurality of stereoscopic cameras;

determining one or more thresholds for image processing using expected dimensions of the one or more items;

applying filtering using the one or more thresholds to the three-dimensional image data;

estimating dimensions of the one or more items using the filtered three-dimensional image data; and

determining that the one or more items include a plurality of items based on the estimated dimensions and the expected dimensions of the one or more items.

Assignments (4)
SECURITY INTEREST Recorded Jun 12, 2024
From: STAPLES, INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES AGENT
Reel/Frame 067711/0239 →
SECURITY INTEREST Recorded Jun 11, 2024
From: STAPLES, INC.
To: UBS AG, STAMFORD BRANCH, AS TERM LOAN AGENT
Reel/Frame 067687/0558 →
SECURITY INTEREST Recorded Jun 11, 2024
From: STAPLES, INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES AGENT
Reel/Frame 067697/0639 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2024
From: APPAKAYA, SAI BHARADWAJ; PASHAM, SWETHA; PATEL, AUM; AMBA, HARSHA
To: STAPLES, INC.
Reel/Frame 067366/0056 →