IP Library Granted Patent US 11,636,648
Granted Patent B2
US 11,636,648 · App. 17/239,922 · Granted Apr 25, 2023

Workpiece sensing for process management and orchestration

Inventors: Brad C. Mello (Cambridge, MA); Paul Jakob Schroeder (Brookline, MA); Scott Denenberg (Newton, MA); Clara Vu (Cambridge, MA)
Assignee: VEO ROBOTICS, INC.
G06T17/00G06T15/005G06T15/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,648
App. No.
17/239,922
Granted
Apr 25, 2023
Kind
B2
Abstract

Systems and methods for identifying a workpiece in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the workpiece at a location where a specified position and orientation thereof is required. A processor may determine, from the recorded image(s) and a stored digital model, whether the workpiece conforms to the specified position and orientation.

Claims (21)

1. A method for ensuring proper positioning and alignment during processing of a workpiece in a processing environment, the method comprising:

providing a digital temporal model of a workpiece, the digital temporal model comprising a sequence of frames each corresponding to a discrete state of a production process requiring a different position and orientation of the workpiece;

before processing of the workpiece in the production process, establishing, for at least some of the frames, a range of acceptable variations in position and orientation relative to the digital temporal model; and

during processing of the workpiece in the production process, (i) digitally recording images of the workpiece that include workpiece position and workpiece orientation, (ii) continuously comparing the recorded images to the digital temporal model, and (iii) only when the workpiece positions and workpiece orientations in the recorded images conform to positions and orientations in the digital temporal model including the range of acceptable variations in position and orientation with respect thereto, continuing processing of the workpiece.

2. The method of claim 1 , wherein providing the digital temporal model comprises:

(a) digitally recording an image of the processing environment as at least one background image;

(b) physically situating a workpiece into a position and orientation required for a state of the production process;

(c) digitally recording an image of the workpiece in the required position and orientation;

(d) subtracting the background image from the image of the workpiece in the required position and orientation to produce a difference image;

(e) storing the difference image as a frame of the digital temporal model; and

(f) repeating steps (b)-(e) for each additional frame of the digital temporal model.

3. The method of claim 1 , wherein each frame of the digital temporal model includes offset boundaries.

4. The method of claim 3 , wherein the offset boundaries account for workpiece variations.

5. The method of claim 1 , wherein comparing the recorded images to the digital temporal model comprises playing back the digital temporal model and, thereduring, comparing the recorded images to the frames of the digital temporal model.

6. A system for ensuring proper positioning and alignment during processing of a workpiece in a processing environment, the system comprising:

at least one sensor positioned to digitally record a video sequence of a workpiece during processing thereof in the processing environment;

a computer memory for storing a digital temporal model of the workpiece, the digital temporal model comprising a sequence of frames each corresponding to a discrete state of the production process requiring a different position and orientation of the workpiece, and a range of acceptable variations in position and orientation relative to the digital temporal model; and

a processor configured to (i) continuously compare, during processing of the workpiece, the video sequence to the digital temporal model, and (ii) determine when the workpiece positions and workpiece orientations in the video sequence conform to positions and orientations in the digital temporal model including the range of acceptable variations in position and orientation.

7. The system of claim 6 , wherein each frame of the digital temporal model includes offset boundaries.

8. The system of claim 7 , wherein the offset boundaries account for workpiece variations.

9. The system of claim 6 , wherein the processor is configured to compare the video sequence to the digital temporal model by playing back the digital temporal model and, thereduring, comparing the video sequence to the frames of the digital temporal model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2024
From: VEO ROBOTICS, INC.
To: SYMBOTIC LLC
Reel/Frame 068839/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: MELLO, BRAD C.; SCHROEDER, PAUL JAKOB; DENENBERG, SCOTT; VU, CLARA
To: VEO ROBOTICS, INC.
Reel/Frame 056055/0115 →
Continuity (3)
Continuation 16868733 · May 7, 2020
Continuation In Part 15889524 · Feb 6, 2018
Related Publication 20210312706A1 · Oct 7, 2021
Cited By (2)
US 12,449,546 US 12,714,278