IP Library Granted Patent US 11,846,916
Granted Patent B2
US 11,846,916 · App. 17/991,895 · Granted Dec 19, 2023

System architecture for safety applications

Inventors: Scott Denenberg (Newton, MA); Clara Vu (Cambridge, MA); Patrick Sobalvarro (Harvard, MA); Lev Persits (Cambridge, MA); Ilya A. Kriveshko (Boxborough, MA); Elliot Simon (Arlington, MA); Alberto Moel (Cambridge, MA); Patrick J. Foy (Reading, MA); Justin Bronder (Littleton, MA)
Assignee: Veo Robotics, Inc.
G05B19/4061B25J9/1676G06T17/00G05B2219/40339G05B2219/50193
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,846,916
App. No.
17/991,895
Granted
Dec 19, 2023
Kind
B2
Abstract

Control systems for industrial machinery (e.g., robots) or other devices such as medical devices utilize a safety processor (SP) designed for integration into safety applications and computational components that are not necessarily safety-rated. The SP monitors performance of the non-safety computational components, including latency checks and verification of identical outputs. One or more sensors send data to the non-safety computational components for sophisticated processing and analysis that the SP cannot not perform, but the results of this processing are sent to the SP, which then generates safety-rated signals to the machinery or device being controlled by the SP. As a result, the system may qualify for a safety rating despite the ability to perform complex operations beyond the scope of safety-rated components.

Claims (51)

1. A control system comprising:

a sensor configured to produce a sensor output;

a non-safety computation module including a processor responsive to the sensor output and executing a safety analysis, the non-safety computation module producing control signals in response to detection of a safety condition by the safety analysis; and

a safety processor configured to receive the control signals from the computation module and generate therefrom safety-rated signals for controlling a device,

wherein the safety processor is further configured to monitor performance of the computation module including latency checks and verification of identical outputs.

2. The control system of claim 1 , wherein the safety processor is further configured to monitor intermediate results or data structures and error-correcting codes thereof.

3. The control system of claim 1 , wherein the safety analysis includes execution of an algorithm with non-deterministic or varying run times.

4. The control system of claim 1 , wherein the sensor is a 3D time-of-flight camera.

5. The control system of claim 4 , wherein the computation module is configured to perform image capture from the time-of-flight camera data, identification, and classification in real time with low latency.

6. The control system of claim 4 , wherein the computation module is configured to analyze occupancy and occlusion of a monitored space by:

generating a three-dimensional representation of the monitored space as a plurality of volumes;

for each sensor pixel having an intensity level above a threshold value, preliminarily marking as unoccupied volumes intercepted by a line-of-sight ray path through the pixel and terminating at an estimated distance from the sensor of an occlusion, marking as occupied the volumes corresponding to a terminus of the ray path, and marking as unknown any volumes beyond the occlusion along the ray path;

for each sensor pixel having an intensity level below the threshold value, preliminarily marking as unknown all voxels intercepted by a line-of-sight ray path through the pixel and terminating at a boundary of the monitored space; and

finally marking as unoccupied volumes that have been preliminarily marked at least once as unoccupied.

7. The control system of claim 4 , wherein the computation module is configured to evaluate safety conditions in a monitored space by:

generating a three-dimensional representation of the monitored space as a plurality of volumes; and

generating a volumetric representation of all points reachable by movable machinery in the monitored space within a specified time period.

8. The control system of claim 1 , wherein the device is at least one robot.

9. The control system of claim 1 , wherein the computation module is a dual-processor computation module.

10. The control system of claim 1 , wherein the computation module is configured to generate a 3D representation of a workcell monitored by the sensor.

11. The control system of claim 1 , wherein the safety analysis comprises speed and separation monitoring in accordance with at least one of ISO/TS 15066 or ISO 10218-2.

12. The control system of claim 1 , wherein the safety analysis comprises protective separation distance monitoring in accordance with at least one of ISO/TS 15066 or ISO 10218-2.

13. The control system of claim 1 , wherein the computation module is configured to receive latency tags issued by the safety processor.

14. The control system of claim 1 , wherein the safety processor is configured to generate and transmit latency tags to the sensor for return to the computation module with sensor outputs.

15. The control system of claim 14 , wherein the safety processor is configured to receive and analyze latency tags returned by the computation module to determine whether a duration associated with processing by the computation module exceeds a predetermined maximum interval.

16. The control system of claim 1 , wherein the safety processor is configured to receive and analyze intermediate values returned by the computation module to determine whether a processing error by the computation module has occurred.

17. A control system comprising:

a sensor configured to produce a sensor output;

a non-safety computation module including a processor responsive to the sensor output and executing a safety analysis, the non-safety computation module producing control signals in response to detection of a safety condition by the safety analysis; and

a safety processor configured to receive the control signals from the computation module and generate therefrom safety-rated signals for controlling a device,

wherein the computation module is configured to receive latency tags issued by the safety processor.

18. The control system of claim 17 , wherein the safety processor is further configured to monitor intermediate results or data structures and error-correcting codes thereof.

19. The control system of claim 17 , wherein the safety analysis includes execution of an algorithm with non-deterministic or varying run times.

20. The control system of claim 17 , wherein the sensor is a 3D time-of-flight camera.

21. The control system of claim 20 , wherein the computation module is configured to perform image capture from the time-of-flight camera data, identification, and classification in real time with low latency.

22. The control system of claim 20 , wherein the computation module is configured to analyze occupancy and occlusion of a monitored space by:

generating a three-dimensional representation of the monitored space as a plurality of volumes;

for each sensor pixel having an intensity level above a threshold value, preliminarily marking as unoccupied volumes intercepted by a line-of-sight ray path through the pixel and terminating at an estimated distance from the sensor of an occlusion, marking as occupied the volumes corresponding to a terminus of the ray path, and marking as unknown any volumes beyond the occlusion along the ray path;

for each sensor pixel having an intensity level below the threshold value, preliminarily marking as unknown all voxels intercepted by a line-of-sight ray path through the pixel and terminating at a boundary of the monitored space; and

finally marking as unoccupied volumes that have been preliminarily marked at least once as unoccupied.

23. The control system of claim 20 , wherein the computation module is configured to evaluate safety conditions in a monitored space by:

generating a three-dimensional representation of the monitored space as a plurality of volumes; and

generating a volumetric representation of all points reachable by movable machinery in the workspace within a specified time period.

24. The control system of claim 17 , wherein the device is at least one robot.

25. The control system of claim 17 , wherein the computation module is a dual-processor computation module.

26. The control system of claim 17 , wherein the computation module is configured to generate a 3D representation of a workcell monitored by the sensor.

27. The control system of claim 17 , wherein the safety analysis comprises speed and separation monitoring in accordance with at least one of ISO/TS 15066 or ISO 10218-2.

28. The control system of claim 17 , wherein the safety analysis comprises protective separation distance monitoring in accordance with at least one of ISO/TS 15066 or ISO 10218-2.

29. The control system of claim 17 , wherein the safety processor is configured to generate and transmit latency tags to the sensor for return to the computation module with sensor outputs.

30. The control system of claim 29 , wherein the safety processor is configured to receive and analyze latency tags returned by the computation module to determine whether a duration associated with processing by the computation module exceeds a predetermined maximum interval.

31. The control system of claim 17 , wherein the safety processor is configured to receive and analyze intermediate values returned by the computation module to determine whether a processing error by the computation module has occurred.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2024
From: VEO ROBOTICS, INC.
To: SYMBOTIC LLC
Reel/Frame 068839/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2023
From: DENENBERG, SCOTT; VU, CLARA; SOBALVARRO, PATRICK; PERSITS, LEV; KRIVESHKO, ILYA A.; SIMON, ELLIOT; MOEL, ALBERTO; FOY, PATRICK J.; BRONDER, JUSTIN
To: VEO ROBOTICS, INC.
Reel/Frame 062705/0925 →
Continuity (3)
Continuation 16800429 · Feb 25, 2020
Provisional Application 62811070 · Feb 27, 2019
Related Publication 20230087242A1 · Mar 23, 2023