IP Library Granted Patent US 9,025,019
Granted Patent B2
US 9,025,019 · App. 12/906,622 · Granted May 5, 2015

Time of flight (TOF) sensors as replacement for standard photoelectric sensors

Inventors: Carl Meinherz (Malans, CH); Craig Martin Brockman (Windham, NH); Elik I. Fooks (Lexington, MA); Manfred Norbert Stein (Graubuenden, CH); Martin Hardegger (Sargans, CH); Wei Jie Chen (Westford, MA); Reto Berner (Aarau, CH); Richard Galera (Nashua, NH); Robert M. Black (Bolton, MA); Roger Merz (Richterswil, CH); Suresh Nair (Amherst, NH); Steven A. Eisenbrown (South Russell, OH)
Assignees: Rockwell Automation Technologies, Inc.; Cedes Safety & Automation AG
G01S17/89F16P3/142G01S7/4802
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,025,019
App. No.
12/906,622
Granted
May 5, 2015
Kind
B2
Abstract

Systems and methods are provided for utilizing time of flight sensors in an industrial automation environment. The method includes employing a multi pixel camera associated with a time of flight sensor to detect an object located within a defined or bounded target area, comparing pixels with adjacent pixels associated with an image of the object captured by the multi pixel camera, identifying the object as being a colored, texture, or highly reflective object, and controlling industrial machinery based on the identification of the object entering the target area.

Claims (23)

1. A method, comprising:

determining, by a controller in communication with a time of flight sensor, a presence of a three-dimensional object entering into or exiting out of a target area based on an amount of light returned to the time of flight sensor exceeding a set threshold;

determining, by the controller in communication with the time of flight sensor, a location of the three-dimensional object with respect to the target area, wherein detection limits of the time of flight sensor encompass a plurality of ranges between five millimeters and three-hundred meters;

determining, by the controller in communication with the time of flight sensor, a texture, a color, or a reflectivity of a surface of the three-dimensional object; and

actuating, by the controller, an industrial machine operating within the target area based on the determination of the three-dimensional object entering into or exiting out of the target area, the location, and the texture, color, or reflectivity of the surface of the three-dimensional object.

2. The method of claim 1 , wherein the target area is proximate to the time of flight sensor.

3. The method of claim 1 , wherein the determining presence further comprises ascertaining whether the three-dimensional object has skirted outside a periphery of the target area.

4. The method of claim 1 , wherein the time of flight sensor further comprises a multi pixel camera, and evaluating, by the controller in communication with the time of flight sensor, a sequence of images of the three-dimensional object obtained by the multi pixel camera to detect at least one edge of the three-dimensional object.

5. The method of claim 4 , further comprising obtaining, by the multi pixel camera, the sequences of images over a continuous period of time.

6. The method of claim 1 , wherein the determining presence further comprises detecting a movement of the three-dimensional object situated outside the target area.

7. The method of claim 4 , wherein the evaluating further comprises comparing at least two adjacent pixels in the sequence of images.

8. The method of claim 7 , further comprising suppressing a reflective background in the sequence of images.

9. A system, comprising:

a controller communicatively couple to a time of flight sensor configured to:

determine a presence of a three-dimensional object entering into or exiting out of a target area based on an amount of light returned to the time of flight sensor exceeding a set threshold;

detect a location of a three-dimensional object with respect to the target area, wherein detection limits of the time of flight sensor encompass a plurality of ranges between five millimeters and three-hundred meters; and

determine a texture, a color, or a reflectivity of a surface of the three-dimensional object; and

actuate an industrial equipment operating within the target area based on the determination of the three-dimensional object entering into or exiting out of the target area, the location, and the texture, color, or reflectivity of the surface of the three-dimensional object.

10. A non-transitory computer-readable medium having instructions stored thereon that, in response to execution, cause a controller in communication with a time of flight sensor to perform operations comprising:

determining a presence of a three-dimensional object entering into or exiting out of a target area based on an amount of light returned to the time of flight sensor exceeding a set threshold;

identifying a location of a three-dimensional object with respect to a target area, wherein detection limits of the time of flight sensor encompass a plurality of ranges between five millimeters and three-hundred meters; and

determining a texture, a color, or a reflectivity of a surface of the three-dimensional object; and

actuating an industrial device operating within the target area based on the determination of the three-dimensional object entering into or exiting out of the target area, the location, and the texture, color, or reflectivity of the surface of the three-dimensional object.

Assignments (3)
MERGER Recorded Jun 10, 2019
From: ROCKWELL AUTOMATION SAFETY AG
To: ROCKWELL AUTOMATION SWITZERLAND GMBH
Reel/Frame 049415/0679 →
CHANGE OF NAME Recorded Jan 13, 2016
From: CEDES SAFETY & AUTOMATION AG
To: ROCKWELL AUTOMATION SAFETY AG
Reel/Frame 037513/0154 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2010
From: MEINHERZ, CARL; BROCKMAN, CRAIG MARTIN; FOOKS, ELIK I.; STEIN, MANFRED NORBERT; HARDEGGER, MARTIN; CHEN, WEI JIE; BERNER, RETO; GALERA, RICHARD; BLACK, ROBERT M.; MERZ, ROGER; NAIR, SURESH; EISENBROWN, STEVEN A.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.; CEDES SAFETY & AUTOMATION AG
Reel/Frame 025154/0241 →
Continuity (1)
Related Publication 20120092485A1 · Apr 19, 2012