IP Library Granted Patent US 12,066,810
Granted Patent B2
US 12,066,810 · App. 17/358,108 · Granted Aug 20, 2024

Continuous monitoring of a workcell safety system

Inventors: Ilya A. Kriveshko (Boxborough, MA); Lev Persits (Cambridge, MA); Scott Denenberg (Newton, MA); Paul Jakob Schroeder (Brookline, MA); Robert Craig Randall (Newton, MA); Valentina Chamorro (Somerville, MA); Gene Malkin (Brookline, MA)
Assignee: VEO ROBOTICS, INC.
G05B19/406G06T7/0008G05B2219/50193G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,066,810
App. No.
17/358,108
Granted
Aug 20, 2024
Kind
B2
Abstract

Systems and methods for continuously monitoring a workcell during operation of industrial machinery are disclosed. The system may comprise a safety system that includes at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell; a monitoring system for detecting a parameter value associated with the safety system; and a controller configured to determine a status of the safety system based at least in part on the detected parameter value and cause an alert to be issued if the status of the safety system does not satisfy a target objective.

Claims (67)

1. A system for continuously monitoring a workcell during operation of industrial machinery, the system comprising:

a safety system comprising at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell;

a monitoring system for detecting a parameter value associated with the safety system; and

a controller configured to:

determine a status of the safety system based at least in part on the detected parameter value; and

cause an alert to be issued if the status of the safety system does not satisfy a target objective,

wherein the acquired image data comprises a plurality of voxels, the controller being further configured to (i) classify the voxels into moving voxels corresponding to moving elements in the workcell and static voxels corresponding to static elements in the workcell, and (ii) compare the static voxels acquired during operation of the industrial machinery against the static voxels acquired prior to operating the industrial machinery and, based thereon, determine a position shift associated with each of the static voxels.

2. The system of claim 1 , wherein the monitoring system comprises at least one temperature sensor for monitoring a temperature associated with the at least one sensor.

3. The system of claim 1 , wherein the monitoring system comprises at least one humidity sensor for monitoring humidity associated with an environment of at least one sensor.

4. The system of claim 1 , wherein the monitoring system comprises at least one timer for recording a total cumulative operating time of at least one sensor, the timer being configured to transmit a signal to the controller when a predetermined total cumulative operating time has been exceeded.

5. The system of claim 1 , wherein at least one sensor is a 3D sensor.

6. The system of claim 5 , wherein the 3D sensor is a time-of-flight (ToF) sensor.

7. The system of claim 6 , wherein the ToF sensor comprises a module for self-detecting errors of signals therein.

8. The system of claim 1 , wherein the monitoring system comprises a safety-rated protocol for detecting errors occurring during data transmission between at least one sensor, the supporting software and/or hardware, and the controller.

9. The system of claim 1 , wherein the acquired image data comprises a plurality of surfaces and normals thereto, the controller being further configured to classify surfaces as corresponding to moving elements in the workcell or corresponding to static elements in the workcell.

10. The system of claim 1 , wherein the controller is further configured to cause the alert to be issued upon determining that more than a predetermined number of the static voxels have changed in value.

11. The system of claim 1 , further comprising memory for storing a plurality of configurations associated with the industrial machinery, the controller being further configured to (i) determine, based on the acquired image data, a configuration associated with the industrial machinery during operation thereof, and (ii) cause the alert to be issued upon determining that the configuration determined in step (i) does not match any of the configurations stored in the memory.

12. The system of claim 1 , wherein the controller is further configured to determine, based on the acquired image data, whether speed and safety monitoring requirements are violated and, if so, to cause the alert to be issued.

13. The system of claim 12 , wherein the controller is further configured to determine whether, in response to a command, the machinery stopped within a prescribed distance and stopping time conforming to speed and separation monitoring requirements.

14. The system of claim 1 , wherein the controller is further configured to analyze the image data and, based thereon, (i) detect and classify objects in the workcell, and (ii) cause the alert to be issued if an observed behavior of an identified object is inconsistent with its classification.

15. The system of claim 1 , wherein the controller is further configured to analyze the image data and, based thereon, (i) detect and classify objects in the workcell, (ii) detect and classify static objects in the workcell, and (iii) cause the alert to be issued if an identified object is observed to appear or disappear unexpectedly.

16. A system for continuously monitoring a workcell during operation of industrial machinery, the system comprising:

a safety system comprising at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell;

a monitoring system for detecting a parameter value associated with the safety system; and

a controller configured to:

determine a status of the safety system based at least in part on the detected parameter value; and

cause an alert to be issued if the status of the safety system does not satisfy a target objective,

wherein the acquired image data comprises a plurality of surfaces and normals thereto, the controller being further configured to (i) classify surfaces as corresponding to moving elements in the workcell or corresponding to static elements in the workcell, and (ii) compare the static surfaces acquired during operation of the industrial machinery against the static surfaces acquired prior to operating the industrial machinery and, based thereon, determine a position shift associated with each of the static surfaces.

17. The system of claim 16 , wherein the acquired image data comprises a plurality of voxels, the controller being further configured to classify the voxels into moving voxels corresponding to moving elements in the workcell and static voxels corresponding to static elements in the workcell.

18. The system of claim 16 , wherein the controller is further configured to cause the alert to be issued upon determining that more than a predetermined number of the static surfaces have position shifts exceeding a threshold value.

19. The system of claim 16 , wherein the monitoring system comprises at least one temperature sensor for monitoring a temperature associated with the at least one sensor.

20. The system of claim 16 , wherein the monitoring system comprises at least one humidity sensor for monitoring humidity associated with an environment of at least one sensor.

21. The system of claim 16 , wherein the monitoring system comprises at least one timer for recording a total cumulative operating time of at least one sensor, the timer being configured to transmit a signal to the controller when a predetermined total cumulative operating time has been exceeded.

22. The system of claim 16 , wherein at least one sensor is a 3D sensor.

23. The system of claim 22 , wherein the 3D sensor is a time-of-flight (ToF) sensor.

24. The system of claim 23 , wherein the ToF sensor comprises a module for self-detecting errors of signals therein.

25. The system of claim 16 , wherein the monitoring system comprises a safety-rated protocol for detecting errors occurring during data transmission between at least one sensor, the supporting software and/or hardware, and the controller.

26. The system of claim 16 , further comprising memory for storing a plurality of configurations associated with the industrial machinery, the controller being further configured to (i) determine, based on the acquired image data, a configuration associated with the industrial machinery during operation thereof, and (ii) cause the alert to be issued upon determining that the configuration determined in step (i) does not match any of the configurations stored in the memory.

27. The system of claim 16 , wherein the controller is further configured to determine, based on the acquired image data, whether speed and safety monitoring requirements are violated and, if so, to cause the alert to be issued.

28. The system of claim 27 , wherein the controller is further configured to determine whether, in response to a command, the machinery stopped within a prescribed distance and stopping time conforming to speed and separation monitoring requirements.

29. The system of claim 16 , wherein the controller is further configured to analyze the image data and, based thereon, (i) detect and classify objects in the workcell, and (ii) cause the alert to be issued if an observed behavior of an identified object is inconsistent with its classification.

30. The system of claim 16 , wherein the controller is further configured to analyze the image data and, based thereon, (i) detect and classify objects in the workcell, (ii) detect and classify static objects in the workcell, and (iii) cause the alert to be issued if an identified object is observed to appear or disappear unexpectedly.

31. A system for continuously monitoring a workcell during operation of industrial machinery, the system comprising:

a safety system comprising at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell;

a monitoring system for detecting a parameter value associated with the safety system; and

a controller configured to:

determine a status of the safety system based at least in part on the detected parameter value; and

cause an alert to be issued if the status of the safety system does not satisfy a target objective,

wherein the controller is further configured to:

analyze the image data acquired prior to operation of the industrial machinery for identifying a first set of elements in the workcell;

analyze the image data acquired during operation of the industrial machinery for identifying a second set of elements in the workcell;

compare the second set of elements against the first set of elements; and

cause the alert to be issued upon determining that the second set of elements does not match the first set of elements.

32. The system of claim 31 , wherein the monitoring system comprises at least one temperature sensor for monitoring a temperature associated with the at least one sensor.

33. The system of claim 31 , wherein the monitoring system comprises at least one humidity sensor for monitoring humidity associated with an environment of at least one sensor.

34. The system of claim 31 , wherein the monitoring system comprises at least one timer for recording a total cumulative operating time of at least one sensor, the timer being configured to transmit a signal to the controller when a predetermined total cumulative operating time has been exceeded.

35. The system of claim 31 , wherein at least one sensor is a 3D sensor.

36. The system of claim 35 , wherein the 3D sensor is a time-of-flight (ToF) sensor.

37. The system of claim 36 , wherein the ToF sensor comprises a module for self-detecting errors of signals therein.

38. The system of claim 31 , wherein the monitoring system comprises a safety-rated protocol for detecting errors occurring during data transmission between at least one sensor, the supporting software and/or hardware, and the controller.

39. The system of claim 31 , wherein the acquired image data comprises a plurality of voxels, the controller being further configured to classify the voxels into moving voxels corresponding to moving elements in the workcell and static voxels corresponding to static elements in the workcell.

40. The system of claim 31 , wherein the acquired image data comprises a plurality of surfaces and normals thereto, the controller being further configured to classify surfaces as corresponding to moving elements in the workcell or corresponding to static elements in the workcell.

41. The system of claim 31 , further comprising memory for storing a plurality of configurations associated with the industrial machinery, the controller being further configured to (i) determine, based on the acquired image data, a configuration associated with the industrial machinery during operation thereof, and (ii) cause the alert to be issued upon determining that the configuration determined in step (i) does not match any of the configurations stored in the memory.

42. The system of claim 31 , wherein the controller is further configured to determine, based on the acquired image data, whether speed and safety monitoring requirements are violated and, if so, to cause the alert to be issued.

43. The system of claim 42 , wherein the controller is further configured to determine whether, in response to a command, the machinery stopped within a prescribed distance and stopping time conforming to speed and separation monitoring requirements.

44. The system of claim 31 , wherein the controller is further configured to analyze the image data and, based thereon, (i) detect and classify objects in the workcell, and (ii) cause the alert to be issued if an observed behavior of an identified object is inconsistent with its classification.

45. The system of claim 31 , wherein the controller is further configured to analyze the image data and, based thereon, (i) detect and classify objects in the workcell, (ii) detect and classify static objects in the workcell, and (iii) cause the alert to be issued if an identified object is observed to appear or disappear unexpectedly.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2024
From: VEO ROBOTICS, INC.
To: SYMBOTIC LLC
Reel/Frame 068839/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: KRIVESHKO, ILYA A.; PERSITS, LEV; DENENBERG, SCOTT; SCHROEDER, PAUL JAKOB; RANDALL, ROBERT CRAIG; CHAMORRO, VALENTINA; MALKIN, GENE
To: VEO ROBOTICS, INC.
Reel/Frame 058277/0215 →
Continuity (2)
Provisional Application 63048349 · Jul 6, 2020
Related Publication 20220004162A1 · Jan 6, 2022