IP Library Granted Patent US 12,596,346
Granted Patent B2
US 12,596,346 · App. 17/994,655 · Granted Apr 7, 2026

Systems and methods for information-assisted sensor registration

Inventors: Clara Vu (Cambridge, MA); Audrey Lewis (Somerville, MA); Antonio Fiol-Mahon (Cambridge, MA); U. Murat Erdem (Melrose, MA); Patrick J. Foy (Reading, MA); Ilya A. Kriveshko (Boxborough, MA); Scott Denenberg (Newton, MA); Alberto Moel (Cambridge, MA)
Assignee: Symbotic LLC
G05B19/402G01S17/04G05B19/4061G06T7/001G06T7/30G05B2219/37555G05B2219/40557G06T2207/10028G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,596,346
App. No.
17/994,655
Granted
Apr 7, 2026
Kind
B2
Abstract

Image sensors distributed about a workcell including industrial machinery are registered using a registration object and an information tag associated therewith. The tag contains information specifying the location of the object and/or the pose of the object. This information is acquired along with images of the registration object, and the sensors are registered based at least in part on the images and the acquired information.

Claims (23)

1 . A method of ensuring safe operation of industrial machinery in a workcell, the workcell including at least one object having on or in proximity thereto a source of information specifying at least one of a location of the object or a pose of the object, the method comprising the steps of:

a. disposing a plurality of image sensors proximate to the workcell and acquiring, with at least some of the image sensors, a plurality of images of the workcell;

b. acquiring at least one of location or pose information of at least one object in the workcell appearing in at least one of the images; and

c. registering the sensors to each other and to the workcell based at least in part on the plurality of images and the acquired information.

2 . The method of claim 1 , wherein the information is acquired by a first one of the sensors and propagated electronically to the other sensors.

3 . The method of claim 1 , wherein the information is optical and detected by at least one of the sensors along a line of sight.

4 . The method of claim 3 , wherein the source of information is a barcode.

5 . The method of claim 1 , wherein the information is electromagnetic.

6 . The method of claim 5 , wherein the source of information is passive, and the information is detected by at least one reader emitting electromagnetic energy.

7 . The method of claim 6 , wherein the source of information is a passive RFID tag.

8 . The method of claim 6 , wherein the source of information is a retroreflective tag.

9 . The method of claim 5 , wherein the source of information emits an electromagnetic signal for detection by at least one reader.

10 . The method of claim 9 , wherein the electromagnetic signal is optical.

11 . The method of claim 9 , wherein the electromagnetic signal is radiofrequency.

12 . A registration object for facilitating registration among sensors distributed about a workspace, the registration object comprising:

a. a body portion including at least one asymmetric feature; and

b. affixed or in close proximity to the body portion, a source of optically or electronically readable information specifying a location and a pose of the object, wherein the source of optically or electronically readable information includes a geometry of the body portion.

13 . The object of claim 12 , wherein the information is detectable by an optical sensor along a line of sight.

14 . The object of claim 13 , wherein the source of information is a barcode.

15 . The object of claim 12 , wherein the information is detectable by at least one reader emitting electromagnetic energy, the source of information being responsive to an interrogation signal.

16 . The object of claim 12 , wherein the source of information is a passive RFID tag.

17 . The object of claim 12 , wherein the source of information is a retroreflective tag.

18 . The object of claim 12 , wherein the source of information emits an electromagnetic signal for detection by at least one reader.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2024
From: VEO ROBOTICS, INC.
To: SYMBOTIC LLC
Reel/Frame 068839/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2022
From: VU, CLARA; LEWIS, AUDREY; FIOL-MAHON, ANTONIO; ERDEM, U. MURAT; FOY, PATRICK J.; KRIVESHKO, ILYA A.; DENENBERG, SCOTT; MOEL, ALBERTO
To: VEO ROBOTICS, INC.
Reel/Frame 062022/0360 →
Continuity (4)
Continuation In Part 17412912 · Aug 26, 2021
Continuation 16553738 · Aug 28, 2019
Provisional Application 62724945 · Aug 30, 2018
Related Publication 20230099717A1 · Mar 30, 2023
References Cited (34)
US 9251598B2 · Wells et al. · 2016 [cited by applicant]
US 9452531B2 · Kikkeri et al. · 2016 [cited by applicant]
US 9524426B2 · Kim · 2016 [cited by examiner]
US 9796089B2 · Lawrence, III et al. · 2017 [cited by applicant]
US 9947134B2 · Komenczi · 2018 [cited by examiner]
US 10126116B2 · Becker · 2018 [cited by applicant]
US 10445944B2 · Galera et al. · 2019 [cited by applicant]
US 10521625B2 · Takeshima · 2019 [cited by examiner]
US 10803611B2 · Kay et al. · 2020 [cited by applicant]
US 10919144B2 · Sinnet · 2021 [cited by applicant]
US 20130086801A1 · Mimura · 2013 [cited by examiner]
US 20130201292A1 · Walter et al. · 2013 [cited by applicant]
US 20140207285A1 · Sakabe · 2014 [cited by applicant]
US 20160035079A1 · Tenney · 2016 [cited by examiner]
US 20160354927A1 · Kikkeri et al. · 2016 [cited by applicant]
US 20170302905A1 · Shteinfeld et al. · 2017 [cited by applicant]
US 20180222052A1 · Vu et al. · 2018 [cited by applicant]
US 20190262991A1 · Sugiyama et al. · 2019 [cited by applicant]
US 20190262993A1 · Cole et al. · 2019 [cited by applicant]
US 20200143564A1 · Ross · 2020 [cited by applicant]
US 20200164516A1 · Lehment et al. · 2020 [cited by applicant]
EP 0328687A1 · 1989 [cited by applicant]
JP 06270083A · 1994 [cited by applicant]
JP 2004163200A · 2004 [cited by applicant]
JP 2009121053A · 2009 [cited by applicant]
JP 2012057960A · 2012 [cited by applicant]
WO WO2002023121A1 · 2002 [cited by applicant]
WO WO2012091807A2 · 2012 [cited by applicant]
WO WO2018148181A1 · 2018 [cited by applicant]
Jeremy A. Marvel, et al., Tools for Robotics in SME Workcells: Challenges and Approaches for Calibration and Registration, National Institute of Standards and Techology NISTIR 8093, Nov. 1, 2015, pp. 1-29. [cited by applicant]
Tim Beyl, et al., Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgicial operating room, International Journal of Computer Assisted Radiology and Surgery, Spr… [cited by applicant]
Justinas Miseikis, et al., Multi 3D camera mapping for predictive and reflexive robot manipulator trajectory estimation, 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Dec. 6, 2016, pp. 1-8. [cited by applicant]
Bernard Schmidt, et al., Depth camera based collison avoidance via active robot control, Journal of Manufacturing Systems, vol. 33, No. 4, Oct. 1, 2014, pp. 711-718. [cited by applicant]
European Search Report, Patent Application No. PCT/US2019/048520, dated May 16, 2022, 12 pages. [cited by applicant]