IP Library Granted Patent US 11,613,017
Granted Patent B2
US 11,613,017 · App. 17/375,447 · Granted Mar 28, 2023

Safety-rated multi-cell workspace mapping and monitoring

Inventors: Scott Denenberg (Newton, MA); Patrick Sobalvarro (Harvard, MA); Clara Vu (Cambridge, MA); Alberto Moel (Cambridge, MA); Richard A. Kelsey (Belmont, MA)
Assignee: VEO ROBOTICS, INC.
B25J9/1666B25J9/1676B25J9/1697G01S7/4808G01S17/04G01S17/87G01S17/89G06T17/10G01V8/20G05B2219/40202G06T17/05Y10S901/47Y10S901/49
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,613,017
App. No.
17/375,447
Granted
Mar 28, 2023
Kind
B2
Abstract

Safety systems in distributed factory workcells intercommunicate or communicate with a central controller so that when a person, robot or vehicle passes from one workcell or space into another on the same factory floor, the new workcell or space need not repeat the tasks of analysis and classification and can instead immediately integrate the new entrant into the existing workcell or space-monitoring schema. The workcell or space can also communicate attributes such as occlusions, unsafe areas, movement speed, and object trajectories, enabling rapid reaction by the monitoring system of the new workcell or space.

Claims (43)

1. A safety system for identifying safe regions in a three-dimensional workspace that includes controlled machinery and a plurality of workcells distributed about the workspace, the system comprising, with respect to each workcell, a controller configured to:

generate a three-dimensional representation of at least a portion of the workcell based on images obtained by a plurality of sensors;

map one or more safe zones within the workcell, the safe zones being outside a safety zone of the machinery;

receive, from a second controller, a three-dimensional representation of at least a portion of an adjacent workcell; and

transmit, to the second controller, at least a portion of the three-dimensional representation of the at least a portion of the workcell.

2. The safety system of claim 1 , wherein the controller is further configured to classify three-dimensional portions within the workcell as unoccupied, occupied or unknown, the one or more safe zones each being a three-dimensional portion classified as unoccupied.

3. The safety system of claim 2 , wherein the three-dimensional portions within the workcell partially overlap.

4. The safety system of claim 1 , wherein said at least a portion of the three-dimensional representation received from the second controller is classified as unoccupied, occupied or unknown.

5. The safety system of claim 1 , wherein the controller is further configured to transmit, to the second controller, predicted movements of objects in the workcell into the adjacent workcell.

6. The safety system of claim 5 , wherein the second controller is responsive to the predicted movements and is configured to alter operation of machinery in the adjacent workcell in response to a predicted intrusion into a safe zone of the adjacent workcell.

7. The safety system of claim 6 , wherein the second controller is configured to computationally extend the predicted intrusion into the adjacent workcell in accordance with a model of human movement.

8. The safety system of claim 6 , wherein the second controller is configured to computationally extend the predicted intrusion into the adjacent workcell in accordance with a trajectory of an autonomous guided vehicle.

9. The safety system of claim 8 , wherein the second controller is configured to receive the trajectory from the autonomous guided vehicle.

10. The safety system of claim 1 , wherein the safety zone is a 3D volume surrounding at least a portion of the machinery.

11. A method of identifying safe regions in a three-dimensional workspace that includes controlled machinery and a plurality of workcells distributed about the workspace, the method comprising the steps of:

obtaining, by a plurality of sensors, images of at least a portion of the workcell;

generating a three-dimensional digital representation of the at least a portion of the workcell based on the images;

computationally mapping one or more safe zones within the workcell, the safe zones being outside a safety zone of the machinery;

generating a three-dimensional representation of at least a portion of an adjacent workcell; and

combining the generated three-dimensional representations.

12. The method of claim 11 , further comprising the step of computationally classifying three-dimensional portions within the workcell as unoccupied, occupied or unknown, the one or more safe zones each being a three-dimensional portion classified as unoccupied.

13. The method of claim 12 , wherein the three-dimensional portions within the workcell partially overlap.

14. The method of claim 11 , further comprising the step of computationally classifying three-dimensional portions within the adjacent workcell as unoccupied, occupied or unknown, one or more safe zones within the adjacent workcell each being a three-dimensional portion classified as unoccupied.

15. The method of claim 11 , further comprising the step of computationally predicting movements of one or more objects in the workcell into the adjacent workcell.

16. The method of claim 15 , further comprising the step of altering operation of the machinery in the adjacent workcell in response to a predicted intrusion into a safe zone of the adjacent workcell.

17. The method of claim 16 , further comprising the step of computationally extending the predicted intrusion into the adjacent workcell in accordance with a model of human movement.

18. The method of claim 16 , further comprising the step of computationally extending the predicted intrusion into the adjacent workcell in accordance with a trajectory of an autonomous guided vehicle.

19. The method of claim 11 , wherein the safety zone is a 3D volume surrounding at least a portion of the machinery.

20. A safety system for identifying safe regions in a three-dimensional workspace including controlled machinery and a plurality of workcells distributed about the workspace, the system comprising:

a supervisory controller; and

associated with each workcell, a local controller configured to:

generate a three-dimensional representation of at least a portion of the workcell based on images obtained by a plurality of sensors;

map one or more safe zones within the workcell, the safe zones being outside a safety zone of the machinery; and

transmit, to the supervisory controller, at least a portion of the three-dimensional representation of the workcell,

wherein the supervisory controller is configured to transmit, to each local controller, predicted movements of one or more objects into the workcell associated with the local controller based on data received from one or more other local controllers.

21. The safety system of claim 20 , wherein the local controller of each workcell is further configured to classify three-dimensional portions within the workcell as unoccupied, occupied or unknown, the one or more safe zones each being a three-dimensional portion classified as unoccupied.

22. The safety system of claim 21 , wherein the three-dimensional portions within the workcell partially overlap.

23. The safety system of claim 20 , wherein the safety zone is a 3D volume surrounding at least a portion of the machinery.

24. The safety system of claim 20 , wherein the local controller of each workcell is responsive to the predicted movements and is configured to alter operation of machinery in the workcell in response to a predicted intrusion into a safe zone thereof.

25. The safety system of claim 20 , wherein the local controller of each workcell is configured to computationally extend a predicted intrusion into the workcell in accordance with a model of human movement.

26. The safety system of claim 20 , wherein the local controller of each workcell is configured to computationally extend a predicted intrusion into the workcell in accordance with a trajectory of an autonomous guided vehicle.

27. The safety system of claim 26 , wherein the local controller of each workcell is configured to receive the trajectory from the autonomous guided vehicle.

28. The safety system of claim 26 , wherein the supervisory controller is configured to receive the trajectory from the autonomous guided vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2024
From: VEO ROBOTICS, INC.
To: SYMBOTIC LLC
Reel/Frame 068839/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2023
From: DENENBERG, SCOTT; SOBALVARRO, PATRICK; VU, CLARA; MOEL, ALBERTO; KELSEY, RICHARD A.
To: VEO ROBOTICS, INC.
Reel/Frame 062650/0601 →
Continuity (7)
Continuation 16800427 · Feb 25, 2020
Continuation In Part 16129999 · Sep 13, 2018
Continuation 15889523 · Feb 6, 2018
Provisional Application 62811073 · Feb 27, 2019
Provisional Application 62455834 · Feb 7, 2017
Provisional Application 62455828 · Feb 7, 2017
Related Publication 20210339396A1 · Nov 4, 2021
Cited By (3)
US 12,330,311 US 12,449,546 US 12,714,278