IP Library Granted Patent US 10,542,167
Granted Patent B2
US 10,542,167 · App. 16/007,069 · Granted Jan 21, 2020

Systems and methods relating to document and fastener identification

Inventors: Alex Fielding (Hayward, CA); Kevin Christopher Hall (Hayward, CA); Kirk H. Knight (Hayward, CA); Jens Jordan Hurley (Hayward, CA); Jonathan Floyd Grubb (Hayward, CA); Joseph David Dills Hartnagle (Hayward, CA)
Assignee: RIPCORD INC.
H04N1/00755G03B15/03G03B15/07G03G15/607G07D7/189H04N1/00588H04N1/00607H04N1/125G03G2215/00308
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,542,167
App. No.
16/007,069
Granted
Jan 21, 2020
Kind
B2
Abstract

Method and systems of automated document processing described herein include activating in sequence a plurality of illumination modules of an illumination source to illuminate a document, where the plurality of illumination modules are located at different positions relative to the document. The document can be imaged each time the document is illuminated by an illumination module to provide a plurality of images. A shadow profile of the document can be obtained based on the plurality of images. One or more of a boundary of the document and presence of a fastener attached to the document can be identified using the shadow profile. Any fasteners present may be removed using a robot arm.

Claims (35)

1. A method of document processing, comprising:

activating, in sequence, a plurality of illumination modules of an illumination source to illuminate a document, wherein the plurality of illumination modules are located at different positions relative to the document;

imaging the document each time the document is illuminated by an illumination module of the plurality of illumination modules, to provide a plurality of images;

obtaining a shadow profile of the document based on the plurality of images;

identifying, with aid of at least one processor, at least one or more members selected from the group consisting of a boundary of the document and presence of a fastener attached to the document, using the shadow profile, wherein identifying the presence of the fastener comprises recognizing when the fastener is an inverted fastener; and

when the fastener is the inverted fastener,

applying a suction force upon a portion of the document using a suction applicator to lift the document from a document pedestal;

positioning a first document platform under the lifted document;

positioning a second document platform over the lifted document to place the document between and in contact with the first document platform and the second document platform; and

rotating the first document platform and the second document platform around a horizontal axis to flip the document over.

2. The method of claim 1 , wherein identifying the boundary of the document comprises identifying an edge having a thickness of less than 0.1 millimeters (mm).

3. A method of document processing, comprising:

activating, in sequence, a plurality of illumination modules of an illumination source to illuminate a document, wherein the plurality of illumination modules are located at different positions relative to the document;

imaging the document each time the document is illuminated by an illumination module of the plurality of illumination modules, to provide a plurality of images;

obtaining a shadow profile of the document based on the plurality of images;

identifying, with aid of at least one processor, at least one of a boundary of the document and presence of a fastener attached to the document using the shadow profile; and

removing an identified fastener from the document, wherein the removing comprises:

coupling a document transfer end effector to a robot arm;

contacting a top surface of the document with the document transfer end effector coupled to the robot arm to apply a suction force upon the document to lift the document from a document pedestal on which the document is positioned to separate the document from other documents on the document pedestal;

rotating a document pincher of the document transfer end effector to contact a bottom surface of the document to secure the document against the document transfer end effector;

positioning a document platform under the lifted document to maintain separation of the document from the other documents;

releasing the suction force applied upon the document by the document transfer end effector to place the document on the document platform; and

releasing the document transfer end effector from the robot arm and coupling a fastener removal end effector to the robot arm.

4. The method of claim 1 or claim 3 , wherein the document further comprises a staple attached thereto, and wherein identifying the at least one of the boundary of the document and presence of the fastener comprises identifying presence of the staple.

5. The method of claim 3 , further comprising:

contacting the top surface of the document with a document contacting portion of the fastener removal end effector to hold the document against the document platform;

inserting a fastener removal tab of the fastener removal end effector between the fastener and the top surface of the document;

gripping the fastener with a fastener gripper of the fastener removal end effector to position at least a portion of the fastener between the fastener insert tab and the fastener gripper; and

moving the fastener gripper and the fastener removal tab away from the document to remove the fastener.

6. A method of document processing, comprising:

activating, in sequence, a plurality of illumination modules of an illumination source to illuminate a document, wherein the plurality of illumination modules are located at different position relative to the document;

imaging the document each time the document is illuminated by an illumination module of the plurality of illumination modules, to provide a plurality of images;

obtaining a shadow profile of the document based on the plurality of images;

identifying, with aid of at least one processor, at least one of a boundary of the document and presence of a fastener attached to the document using the shadow profile; and

identifying a corresponding fastener removal end effector for a robot arm based on type information of the fastener attached to the document.

Assignments (2)
SECURITY INTEREST Recorded Feb 14, 2025
From: RIPCORD INC.
To: PARTNERS FOR GROWTH VII, L.P.
Reel/Frame 070222/0746 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2018
From: FIELDING, ALEX; HALL, KEVIN CHRISTOPHER; KNIGHT, KIRK K.; HURLEY, JENS JORDAN; GRUBB, JONATHAN FLOYD; HARTNAGLE, JOSEPH DAVID DILLS
To: RIPCORD INC.
Reel/Frame 047463/0864 →
Continuity (5)
Continuation PCTUS2016067583 · Dec 19, 2016
Provisional Application 62233934 · Dec 19, 2015
Provisional Application 62233947 · Dec 19, 2015
Provisional Application 62233938 · Dec 19, 2015
Related Publication 20180295248A1 · Oct 11, 2018