IP Library › Granted Patent US 12,488,497
Granted Patent B2
US 12,488,497 · App. 18/241,494 · Granted Dec 2, 2025

Localizing an optical marker

Inventors: Christoph Hofmann (Waldkirch, DE); Alfred Arockiaraj (Waldkirch, DE)
Assignee: SICK AG
G06T7/73G06T7/85H04N13/239H04N13/246G01S17/86G01S17/894G06T2200/04G06T2207/10012G06T2207/10024G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,488,497
App. No.
18/241,494
Granted
Dec 2, 2025
Kind
B2
Abstract

A camera device for localizing an optical marker is provided that has at least one image sensor and a control and evaluation unit. A first camera channel for recording first image data having the optical marker is formed from the image sensor and the control and evaluation unit. The control and evaluation unit is configured to locate the optical marker in the first image data and to determine a first pose of the optical marker relative to the camera device. A second camera channel for recording second image data having the optical marker is formed from the image sensor and the control and evaluation unit. The control and evaluation unit is configured to locate the optical marker in the second image data, to determine a second pose of the optical marker relative to the camera device, and to compare the first pose and the second pose with one another.

Claims (19)

1 . A camera device for localizing an optical marker, wherein the camera device has at least one image sensor and a control and evaluation unit, wherein a first camera channel for recording first image data having the optical marker is formed from the at least one image sensor and the control and evaluation unit and the control and evaluation unit is configured to locate the optical marker in the first image data and to determine a first pose of the optical marker relative to the camera device, wherein the optical marker has at least three reference features of known positions within the optical marker, and wherein a second camera channel for recording second image data having the optical marker is formed from the at least one image sensor and the control and evaluation unit; and wherein the control and evaluation unit is configured to locate the optical marker in the second image data, to determine a second pose of the optical marker relative to the camera device, and to compare the first pose and the second pose with one another and to output a safeguarding signal to a monitored machine when the first pose and the second pose differ from one another beyond a predetermined tolerance.

2 . The camera device in accordance with claim 1 , wherein the optical marker has at least three reference features of known positions within the optical marker.

3 . The camera device in accordance with claim 1 , wherein the control and evaluation unit is configured to track the first pose and/or the second pose over time.

4 . The camera device in accordance with claim 3 , wherein the control and evaluation unit is configured to take account of a prediction of a pose in the comparison of the first pose with the second pose.

5 . The camera device in accordance with claim 1 , wherein at least one camera channel records color or monochrome two-dimensional image data and evaluates the two-dimensional image data.

6 . The camera device in accordance with claim 1 , wherein at least one camera channel records three-dimensional image data in accordance with the stereoscopic principle and evaluates the three-dimensional image data.

7 . The camera device in accordance with claim 1 , wherein at least one camera channel records three-dimensional image data in accordance with the time of flight principle and evaluates the three-dimensional image data.

8 . The camera device in accordance with claim 1 , wherein the camera device is formed as a monochrome stereo camera or as an RGB stereo camera having a monochrome image sensor or an RGB image sensor and two stereo image sensors for the stereoscopic capturing of two offset images, with the monochrome image sensor or the RGB image sensor being used in the first camera channel and the two stereo image sensors being used in the second camera channel.

9 . The camera device in accordance with claim 1 , wherein the camera is formed as a stereo camera having two stereo image sensors for the stereoscopic capturing of two offset images, with one of the stereo image sensors being used in the first camera channel and the two stereo image sensors being used in the second camera channel.

10 . The camera device in accordance with claim 1 , wherein the camera device is formed as a time of flight camera having a Time of Flight (ToF) image sensor, with the first image data being generated from intensities of the ToF image sensor and the second image data being generated from times of flight of the-FGE ToF image sensor.

11 . The camera device in accordance with claim 1 , wherein the camera device is formed as a time of flight camera having a Time of Flight (ToF) image sensor and an additional monochrome image sensor or RGB image sensor, with the monochrome image sensor or RGB image sensor being used in the first camera channel and the ToF image sensor being used in the second camera channel.

12 . The camera device in accordance with claim 1 , wherein the camera device has at least one image sensor per camera channel, and wherein the image sensors of different camera channels are formed as diverse with respect to one another.

13 . The camera device in accordance with claim 12 , wherein the camera device has at least one image sensor per camera channel, and wherein the image sensors of different camera channels differ from one another in the number of their pixels, their pixel size, their pixel pattern, their pixel design, or their fixed pattern nose.

14 . The camera device in accordance with claim 1 , wherein the control and evaluation unit is configured for a mutual calibration of the camera channels in which the first pose and the second pose are made congruent with one another at least at times.

15 . A method of localizing an optical marker using a camera device, wherein first image data are recorded and evaluated in a first camera channel to locate the optical marker in the first image data and to determine a first pose of the optical marker relative to the camera device, and wherein second image data are recorded and evaluated in a second camera channel to locate the optical marker in the second image data and to determine a second pose of the optical marker relative to the camera device; and wherein the first pose and the second pose are compared with one another and to output a safeguarding signal to a monitored machine when the first pose and the second pose differ from one another beyond a predetermined tolerance.

16 . The method in accordance with claim 15 , wherein the camera device has at least one image sensor and a control and evaluation unit, wherein the first camera channel for recording first image data having the optical marker is formed from the at least one image sensor and the control and evaluation unit and the control and evaluation unit is configured to locate the optical marker in the first image data and to determine the first pose of the optical marker relative to the camera device, wherein the second camera channel for recording second image data having the optical marker is formed from the at least one image sensor and the control and evaluation unit; and wherein the control and evaluation unit is configured to locate the optical marker in the second image data.

17 . The method in accordance with claim 15 , wherein the optical marker comprises fiducial marker.

18 . A camera device for localizing an optical marker, wherein the camera device has at least one image sensor and a control and evaluation unit, wherein a first camera channel for recording first image data having the optical marker is formed from the at least one image sensor and the control and evaluation unit and the control and evaluation unit is configured to locate the optical marker in the first image data and to determine a first pose of the optical marker relative to the camera device, and wherein a second camera channel for recording second image data having the optical marker is formed from the at least one image sensor and the control and evaluation unit; and wherein the control and evaluation unit is configured to locate the optical marker in the second image data, to determine a second pose of the optical marker relative to the camera device, and to compare the first pose and the second pose with one another and to output a safeguarding signal to a monitored machine when the first pose and the second pose differ from one another beyond a predetermined tolerance.

19 . The method in accordance with claim 18 , wherein the optical marker comprises fiducial marker.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2023
From: HOFMANN, CHRISTOPH; AROCKIARAJ, ALFRED
To: SICK AG
Reel/Frame 064814/0309 →
Priority Claims (1)
EP 22193749 · Sep 2, 2022 · regional
Continuity (1)
Related Publication 20240078697A1 · Mar 7, 2024
References Cited (18)
US 10582121B2 · Kamilov · 2020 [cited by examiner]
US 20110025827A1 · Shpunt et al. · 2011 [cited by applicant]
US 20170319143A1 · Yu · 2017 [cited by examiner]
US 20180012370A1 · Aghamohammadi · 2018 [cited by examiner]
US 20180345498A1 · Müncher · 2018 [cited by applicant]
US 20190364206A1 · Dal Mutto · 2019 [cited by examiner]
US 20200121245A1 · Barclay · 2020 [cited by examiner]
US 20210134013A1 · Carlsson · 2021 [cited by examiner]
US 20210383551A1 · Fiala · 2021 [cited by applicant]
US 20210398316A1 · Panse · 2021 [cited by examiner]
US 20240314289A1 · Liu · 2024 [cited by examiner]
DE 102005028490B4 · 2012 [cited by applicant]
EP 1933167A2 · 2008 [cited by applicant]
EP 3734423A1 · 2020 [cited by applicant]
WO WO2016094109A2 · 2016 [cited by examiner]
WO WO2019030235A1 · 2019 [cited by examiner]
Um, et al.; “Three-dimensional Scene Reconstruction Using Multi-view Images and Depth Camera”, Stereoscopic Displays and Virtual Reality Systems XII, edited by Andrew J. Woods, Mark T. Bolas, John 0. Merritt, Ian E. McD… [cited by applicant]
Shabalina, et al.; “Comparing Fiducial Markers Performance for a Task of a Humanoid Robot Self-Calibration of Manipulators: a Pilot Experimental Study”; Laboratory of Intelligent Robotic Systems, Kazan Federal Universit… [cited by applicant]
Cited By (1)
US 12,700,131