IP Library › Granted Patent US 12,564,959
Granted Patent B1
US 12,564,959 · App. 18/123,587 · Granted Mar 3, 2026

Controlling robotic devices based on proximity detection

Inventors: Seth R Kaufman (Arlington, MA); Wesley Roy Connell (Melrose, MA); Siva Aduri (Stoneham, MA); Joshua Zarr (Nashua, NH); Shaun Hayward (Waltham, MA)
Assignee: Amazon Technologies, Inc.
B25J9/1666B25J9/161B25J13/006B25J13/086B25J19/06B65G47/905
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,564,959
App. No.
18/123,587
Filed
Mar 20, 2023
Granted
Mar 3, 2026
Kind
B1
Art Unit
3658
USPC
700/245
Abstract

Techniques for controlling motion of physical, moving devices within a robotic work cell of an inventory system are disclosed. A user device (e.g., a wearable device) can be used within the workspace to transmit wireless signals. One of these signals can be received by one or more receiving devices associated with the robotic work cell. A proximity monitoring engine can transmit notification data to a machine controller while the signal is being received. Transmitting the notification data may cause the machine controller to execute instructions to halt motion of the robotic device (and/or other moving devices associated with the robotic work cell). The devices of the robotic work cell may remain in a halted state while the signal continues to be received. When the signal is no longer being received, the devices of the robotic work cell may be instructed to resume motion.

Claims (42)

1 . An inventory management system, comprising:

a workspace comprising a robotic device, the robotic device being positioned at a stationary location within the workspace and within a robotic work cell, the robotic work cell being configured with one or more receiving devices that are configured by placement to detect signals from devices located within an area associated with the robotic work cell, the area being identified based at least in part on a distance that is determined to be great enough to account for a corresponding user device traveling at a presumed or known speed toward the robotic device such that the robotic device is able to halt motion completely prior to the corresponding user device reaching the robotic device;

the user device comprising one or more transmitter devices configured to transmit one or more corresponding signals, the one or more corresponding signals being configured to affect movement of devices within the workspace upon receipt;

a controller device configured to control the robotic device; and

a proximity monitoring engine, comprising:

a processor; and

one or more memories having thereon computer-executable instructions that, when executed by the processor, cause the proximity monitoring engine to:

monitor for one or more faults in the one or more receiving devices, wherein detecting a fault based on monitoring causes the proximity monitoring engine to determine whether a sub-area of the area exists in which signals cannot be received and, when the sub-area exists, to transmit an indication of the fault causing the controller device to halt motion of the robotic device;

receive, from the one or more receiving devices, data indicating receipt of a signal corresponding to one of the one or more transmitter devices of the user device;

transmit, to the controller device, notification data that indicates the signal has been received, the controller device being configured to halt motion of the robotic device based at least in part on receipt of the notification data;

determine that the signal is no longer being received by the one or more receiving devices; and

execute one or more operations that causes the robotic device to resume motion.

2 . The inventory management system of claim 1 , wherein the workspace comprises a plurality of mobile drive units, wherein the one or more corresponding signals transmitted by the one or more transmitter devices of the user device are configured to affect motion of the plurality of mobile drive units upon receipt.

3 . The inventory management system of claim 1 , wherein the user device is a wearable device.

4 . The inventory management system of claim 1 , wherein each of the one or more receiving devices comprises two receivers, each of the two receivers being configured to receive one signal of the one or more corresponding signals transmitted by the one or more transmitter devices of the user device.

5 . A computer-implemented method performed by a proximity monitoring engine that is associated with a robotic work cell of a workspace, comprising:

monitoring for one or more faults in one or more receiving devices that are placed at respective locations within the robotic work cell to receive signals transmitted by user devices within an area of the robotic work cell, the area being identified based at least in part on a distance that is determined to be great enough to account for a corresponding user device traveling at a presumed or known speed toward the robotic device such that a robotic device of the robotic work cell is able to halt motion completely prior to the corresponding user device reaching the robotic device, wherein detecting a fault in the one or more receiving devices based on the monitoring causes the proximity monitoring engine to determine whether a sub-area of the area exists in which the signals transmitted by other devices cannot be received and, when the sub-area exists, to transmit an indication of the fault causing a controller device of the robotic work cell to halt motion of a robotic device of the robotic work cell;

receiving, by the receiving device that is monitored by the proximity monitoring engine, from the user device, a signal transmitted by a transmitter device of the user device;

transmitting, to the controller device associated with the robotic work cell, notification data that indicates the signal is being received, the controller device being configured to halt motion of the robotic device of the robotic work cell based at least in part on receiving the notification data;

determining, by the proximity monitoring engine, that the signal is no longer being received by the receiving device; and

executing one or more operations that cause the controller device to instruct the robotic device to resume motion.

6 . The computer-implemented method of claim 5 , wherein executing the one or more operations further comprises halting ongoing transmissions of the notification data to the controller device.

7 . The computer-implemented method of claim 5 , wherein a receiving device of the one or more receiving devices is associated with a corresponding transmitter, and wherein monitoring for the one or more faults comprises:

transmitting, by the corresponding transmitter, a second signal that simulates the signal transmitted by the transmitter device of the user device; and

determining, by the proximity monitoring engine, that the receiving device is not receiving the second signal from the corresponding transmitter.

8 . The computer-implemented method of claim 5 , wherein the proximity monitoring engine periodically transmits the notification data that indicates the signal is being received while the signal is being received, and wherein the controller device is configured to cause the robotic device to resume motion when a predefined time period has elapsed since the notification data was last received.

9 . The computer-implemented method of claim 5 , wherein the controller device causes a second device of the robotic work cell to halt motion based at least in part on receipt of the notification data, wherein the second device is separate from the robotic device.

10 . The computer-implemented method of claim 5 , wherein the robotic device is at least one of a robotic arm or transfer apparatus, the robotic device and transfer apparatus being individually configured to move items from one location to another location within the workspace, while the robotic device and transfer apparatus remained affixed to a stationary location of the workspace.

11 . The computer-implemented method of claim 5 , wherein the receiving device is one of a plurality of receiving devices that are associated with the robotic work cell, and wherein the controller device is configured to halt motion of the robotic device based at least in part on receiving an corresponding indication that any of the plurality of receiving devices is receiving the signal.

12 . A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors of a proximity monitoring engine operating within a robotic work cell of a workspace, causes the proximity monitoring engine to:

monitor for one or more faults in one or more receiving devices that are placed at respective locations of the robotic work cell to detect signals transmitted by user devices within an area, the area being identified based at least in part on a distance that is determined to be great enough to account for a corresponding user device traveling at a presumed or known speed toward a robotic device of the robotic work cell such that the robotic device is able to halt motion completely prior to the corresponding user device reaching the robotic device, wherein detecting a fault based on the monitoring causes the proximity monitoring engine to determine whether a sub-area of the area exists within the robotic work cell in which signals from the user devices cannot be received and, when the sub-area exists, to transmit an indication of the fault causing a controller device of the robotic work cell to halt motion of a robotic device of the robotic work cell;

receive, from the user device via the receiving device, a first signal transmitted by a transmitter device of the user device, the user device being configured to the first signal and a second signal, the first signal having a shorter transmission range than a transmission range associated with the second signal;

periodically transmit, to the controller device while the first signal is being received, notification data that indicates the first signal is being received, the controller device being configured to halt motion of the robotic device of the robotic work cell based at least in part on receiving the notification data;

determine that the first signal is no longer being received; and

execute one or more operations that cause the controller device to execute additional operations that cause the robotic device to resume motion.

13 . The non-transitory computer-readable storage medium of claim 12 , wherein executing the computer-executable instructions further causes the proximity monitoring engine to transmit, to a workspace management module of the workspace, an indication that the robotic device has halted motion, the workspace management module being configured to manage motion of at least one device within the workspace and to identify respective task assignments for a plurality of robotic devices within the workspace, the plurality of robotic devices comprising the robotic device, wherein transmitting the indication to the workspace management module causes the workspace management module to modify a task assignment associated with a second robotic device of the plurality of robotic devices based at least in part on receiving the indication.

14 . The non-transitory computer-readable storage medium of claim 12 , wherein the first signal is received by a plurality of receiving devices associated with the proximity monitoring engine, and wherein the notification data continues to be periodically transmitted while at least one of the plurality of receiving devices is receiving the first signal transmitted by the user device.

15 . The non-transitory computer-readable storage medium of claim 14 , wherein the plurality of receiving devices are placed within the workspace according to a predefined configuration that is associated with the robotic work cell.

16 . The non-transitory computer-readable storage medium of claim 12 , wherein the workspace comprises a second work cell, the second work cell comprising a second robotic device that is different from the robotic device, the second work cell further comprising a second proximity monitoring engine that is configured to cause the second robotic device to halt motion based at least in part on determining that the first signal is being received.

17 . The non-transitory computer-readable storage medium of claim 12 , wherein the controller device is configured to instruct one or more machine controllers, each of the one or more machine controllers being configured to instruct one or more physical devices comprising the robotic device.

18 . The non-transitory computer-readable storage medium of claim 12 , wherein the workspace comprises a mobile drive unit that is configured to move to different locations within the workspace, and wherein the mobile drive unit is configured to 1) slow on receipt of the second signal, and 2) halt motion on receipt of the first signal.

19 . The non-transitory computer-readable storage medium of claim 13 , wherein the robotic device is a first robotic device, and wherein the task assignment associated with the second robotic device assigns the second robotic device to a task associated with repairing the first robotic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2023
From: KAUFMAN, SETH R; CONNELL, WESLEY ROY; ADURI, SIVA; ZARR, JOSHUA; HAYWARD, SHAUN
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 063034/0275 →
References Cited (124)
US 5382948A · Richmond · 1995 [cited by applicant]
US 6166371A · Milbrath et al. · 2000 [cited by applicant]
US 6445979B1 · Inoue · 2002 [cited by examiner]
US 8280547B2 · D'Andrea et al. · 2012 [cited by applicant]
US 8412400B2 · D'Andrea et al. · 2013 [cited by applicant]
US 8504202B2 · Ichinose et al. · 2013 [cited by applicant]
US 8538692B2 · Wurman et al. · 2013 [cited by applicant]
US 8606392B2 · Wurman et al. · 2013 [cited by applicant]
US 8884739B2 · Shimomura · 2014 [cited by applicant]
US 8930133B2 · Wurman et al. · 2015 [cited by applicant]
US 9070275B1 · Green et al. · 2015 [cited by applicant]
US 9073736B1 · Hussain et al. · 2015 [cited by applicant]
US 9087314B2 · Hoffman et al. · 2015 [cited by applicant]
US 9104271B1 · Adams et al. · 2015 [cited by applicant]
US 9607285B1 · Wellman · 2017 [cited by applicant]
US 9881277B2 · Brady · 2018 [cited by examiner]
US 10081106B2 · Rublee et al. · 2018 [cited by applicant]
US 10209711B1 · Brazeau · 2019 [cited by examiner]
US 10224758B2 · Leabman · 2019 [cited by examiner]
US 10248120B1 · Siegel et al. · 2019 [cited by applicant]
US 10255582B2 · Shydo, Jr. et al. · 2019 [cited by applicant]
US 10347369B1 · Dudzinski et al. · 2019 [cited by applicant]
US 10387032B2 · Lane et al. · 2019 [cited by applicant]
US 10419886B2 · Yang et al. · 2019 [cited by applicant]
US 10607132B1 · Dietz et al. · 2020 [cited by applicant]
US 11113777B1 · Aggarwal et al. · 2021 [cited by applicant]
US 11126944B1 · Aggarwal et al. · 2021 [cited by applicant]
US 11449052B1 · Kaufman et al. · 2022 [cited by applicant]
US 11513530B1 · Kaufman · 2022 [cited by examiner]
US 11675878B1 · Pandya et al. · 2023 [cited by applicant]
US 11919172B1 · Ebrahimi Afrouzi · 2024 [cited by examiner]
US 20050077085A1 · Zeller et al. · 2005 [cited by applicant]
US 20070290040A1 · Wurman et al. · 2007 [cited by applicant]
US 20070293978A1 · Wurman et al. · 2007 [cited by applicant]
US 20080051984A1 · Wurman et al. · 2008 [cited by applicant]
US 20080051985A1 · D'Andrea et al. · 2008 [cited by applicant]
US 20080309345A1 · Zeller et al. · 2008 [cited by applicant]
US 20090043462A1 · Stratton et al. · 2009 [cited by applicant]
US 20090109049A1 · Frederick et al. · 2009 [cited by applicant]
US 20090256751A1 · Zeller et al. · 2009 [cited by applicant]
US 20100096490A1 · Gordon · 2010 [cited by applicant]
US 20100219835A1 · Wentworth · 2010 [cited by applicant]
US 20100271009A1 · Zeller et al. · 2010 [cited by applicant]
US 20110010023A1 · Kunzig et al. · 2011 [cited by applicant]
US 20110062959A1 · Zeller et al. · 2011 [cited by applicant]
US 20110093134A1 · Emanuel et al. · 2011 [cited by applicant]
US 20110232972A1 · McQueen et al. · 2011 [cited by applicant]
US 20120151339A1 · Zhang et al. · 2012 [cited by applicant]
US 20120235579A1 · Chemel et al. · 2012 [cited by applicant]
US 20120239224A1 · McCabe et al. · 2012 [cited by applicant]
US 20130038320A1 · Frederick · 2013 [cited by applicant]
US 20130275045A1 · Tsujimoto et al. · 2013 [cited by applicant]
US 20130302132A1 · D'Andrea · 2013 [cited by applicant]
US 20130304253A1 · Wurman et al. · 2013 [cited by applicant]
US 20130314503A1 · Nix et al. · 2013 [cited by applicant]
US 20130317642A1 · Asaria et al. · 2013 [cited by applicant]
US 20140070934A1 · Chau et al. · 2014 [cited by applicant]
US 20140100998A1 · Mountz et al. · 2014 [cited by applicant]
US 20140100999A1 · Mountz et al. · 2014 [cited by applicant]
US 20150066283A1 · Wurman et al. · 2015 [cited by applicant]
US 20150073589A1 · Khodl et al. · 2015 [cited by applicant]
US 20150334582A1 · Liu · 2015 [cited by examiner]
US 20150353280A1 · Brazeau et al. · 2015 [cited by applicant]
US 20160121487A1 · Mohan et al. · 2016 [cited by applicant]
US 20160129917A1 · Gariepy et al. · 2016 [cited by applicant]
US 20160259061A1 · Carter · 2016 [cited by applicant]
US 20160271800A1 · Stubbs et al. · 2016 [cited by applicant]
US 20170244659A1 · Muthukrishnan · 2017 [cited by examiner]
US 20170278051A1 · Cohn · 2017 [cited by examiner]
US 20170334644A1 · Otto · 2017 [cited by examiner]
US 20170334696A1 · Otto et al. · 2017 [cited by applicant]
US 20170344023A1 · Laubinger et al. · 2017 [cited by applicant]
US 20180039402A1 · Lane et al. · 2018 [cited by applicant]
US 20180053141A1 · Shydo, Jr. · 2018 [cited by applicant]
US 20180062328A1 · Westbury · 2018 [cited by applicant]
US 20180143321A1 · Skowronek et al. · 2018 [cited by applicant]
US 20190013960A1 · Sadwick · 2019 [cited by applicant]
US 20190089193A1 · Ranjan et al. · 2019 [cited by applicant]
US 20190105779A1 · Einav · 2019 [cited by examiner]
US 20190176323A1 · Coady et al. · 2019 [cited by applicant]
US 20190196488A1 · Holmberg · 2019 [cited by examiner]
US 20190226266A1 · Eslami et al. · 2019 [cited by applicant]
US 20190381223A1 · Culbert et al. · 2019 [cited by applicant]
US 20200066054A1 · Yin et al. · 2020 [cited by applicant]
US 20200206928A1 · Denenberg · 2020 [cited by examiner]
US 20200301432A1 · Bose et al. · 2020 [cited by applicant]
US 20210064035A1 · Park · 2021 [cited by examiner]
US 20210065107A1 · Jajula · 2021 [cited by applicant]
US 20210069906A1 · Vu · 2021 [cited by examiner]
US 20220274269A1 · Fan · 2022 [cited by examiner]
CA 3025297C · 2019 [cited by examiner]
CN 101517622A · 2009 [cited by applicant]
CN 108064212A · 2018 [cited by applicant]
CN 209526452U · 2019 [cited by examiner]
DE 102015116510A1 · 2017 [cited by examiner]
GB 2112350A · 1983 [cited by examiner]
JP 1124750A · 1999 [cited by applicant]
JP 2001129776A · 2001 [cited by examiner]
JP 2010023183A · 2010 [cited by applicant]
JP 2017024097A · 2017 [cited by examiner]
JP 7505791B2 · 2024 [cited by examiner]
KR 101450843B1 · 2014 [cited by examiner]
WO WO0134336A1 · 2001 [cited by examiner]
WO 201835295A1 · 2018 [cited by applicant]
WO WO2018022265A1 · 2018 [cited by examiner]
WO WO2019140706A1 · 2019 [cited by examiner]
WO WO2024116221A1 · 2024 [cited by examiner]
WO2024116221A1 (Year: 2024). [cited by examiner]
C. Bererton and P. K. Khosla, “Towards a team of robots with reconfiguration and repair capabilities,” Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164), Seoul, Korea (S… [cited by examiner]
U.S. Appl. No. 17/853,118, “Light Activated Access Control Techniques”, filed Jun. 29, 2022. [cited by applicant]
U.S. Appl. No. 17/951,689, “Operational Planning Techniques Using Vision-Based Entity Localization”, filed Sep. 23, 2022. [cited by applicant]
Non-Final Office Action, U.S. Appl. No. 14/660,247, 39 pages, Jul. 29, 2016. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 14/660,247, 14 pages, Dec. 2, 2016. [cited by applicant]
PCT/US2017/047296, “International Search Report and Written Opinion”, Nov. 20, 2017, 12 pages. [cited by applicant]
Non-Final Office Action, U.S. Appl. No. 15/450,692, 15 pages, Nov. 1, 2018. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 15/240,938, 10 pages, Nov. 28, 2018. [cited by applicant]
PCT/US2017/047296, “International Preliminary Report on Patentability”, Feb. 28, 2019, 8 pages. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 15/450,692, 16 pages, Mar. 19, 2019. [cited by applicant]
Non-Final Office Action, U.S. Appl. No. 16/406,424, 32 pages, Feb. 1, 2022. [cited by applicant]
Durocher, et al., An Overview of Remote Isolation Systems Applied in Process Industries, IEEE Transactions on Industry Applications, vol. 53, No. 4, 6 pages, Aug. 2017. [cited by applicant]
United States Department of Labor Occupational Safety and Health Administration, OSHA Fact Sheet, 2 pages, 2002. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 16/406,424, 7 pages, May 20, 2022. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 16/406,424, 7 pages, Aug. 4, 2022. [cited by applicant]
Du et al., “Active Collision Avoidance for Human-robot Interaction With Ukf, Expert System, and Artificial Potential Field Method”, Frontiers in Robotics and AI, vol. 5, No. 125, Nov. 6, 2018, 11 pages. [cited by applicant]