IP Library Granted Patent US 12,015,879
Granted Patent B2
US 12,015,879 · App. 17/370,801 · Granted Jun 18, 2024

Contextual automated surveillance by a mobile robot

Inventors: Travis J. Deyle (San Jose, CA); Erik Schluntz (Mountain View, CA); Peregrine Badger (San Mateo, CA); Sarvagya Vaish (Albany, CA); Michael J. O'Kelly (Mountain View, CA)
Assignee: COBALT ROBOTICS INC.
H04N7/185G01C21/3453G05D1/0088G05D1/0219
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,015,879
App. No.
17/370,801
Granted
Jun 18, 2024
Kind
B2
Abstract

A mobile robot is configured for operation in a commercial or industrial setting, such as an office building or retail store. The robot can patrol one or more routes within a building, and can detect violations of security policies by objects, building infrastructure and security systems, or individuals. In response to the detected violations, the robot can perform one or more security operations. The robot can include a removable fabric panel, enabling sensors within the robot body to capture signals that propagate through the fabric. In addition, the robot can scan RFID tags of objects within an area, for instance coupled to store inventory. Likewise, the robot can generate or update one or more semantic maps for use by the robot in navigating an area and for measuring compliance with security policies.

Claims (30)

1. A mobile robot, comprising:

a motorized base configured to move the mobile robot within a building;

a wireless transceiver configured to communicatively couple to a remote security system;

a camera system configured to capture images of the mobile robot's surroundings; and

a controller configured to:

identify a pre-determined individual in an image captured by the camera system;

configure the mobile robot to monitor the identified individual;

while the individual is being monitored by the mobile robot, determine that the individual triggers a security condition comprising moving within a threshold distance of a boundary defining an area to which the individual does not have access;

in response to the individual moving within the threshold distance of the boundary, cause the mobile robot to 1) project an indication of the boundary on the ground and 2) warn the individual not to cross the boundary and perform a security operation without human operator intervention; and

in response to determining that the individual has crossed the boundary, perform an enhanced security operation determined to be more likely than the performed security operation to eliminate the security condition.

2. The mobile robot of claim 1 , wherein the pre-determined individual is an unidentified individual.

3. The mobile robot of claim 1 , wherein configuring the mobile robot to monitor the identified individual comprises configuring the mobile robot to maintain a second threshold distance or a line of sight to the individual.

4. The mobile robot of claim 1 , wherein configuring the mobile robot to monitor the identified individual comprises configuring the mobile robot to capture images or video of the individual.

5. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that a difference in location of the individual between a first image and a second image captured by the camera system exceeds a threshold distance.

6. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that a distance between the individual and a second individual exceeds a threshold distance.

7. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that the individual is performing a prohibited action.

8. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that the individual enters a location the individual is not allowed to access.

9. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that the individual is interacting with an object that the individual is not allowed to interact with.

10. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that the mobile robot has lost sight of the individual.

11. The mobile robot of claim 1 , wherein determining that the individual triggers a security condition further comprises determining that a distance between the mobile robot and the individual has exceeded a threshold distance.

12. The mobile robot of claim 1 , wherein performing the security operation comprises providing images or video of the individual to a central security system.

13. The mobile robot of claim 1 , wherein performing the security operation comprises providing images or video of the individual to a human operator or security personnel.

14. The mobile robot of claim 1 , wherein the security operation is performed without providing images or video captured by the camera system to a human operator.

15. The mobile robot of claim 1 , wherein performing the security operation comprises continuing on a patrol route.

16. The mobile robot of claim 1 , wherein performing the security operation comprises monitoring a location for a period of time.

17. The mobile robot of claim 1 , wherein performing the security operation comprises capturing additional images of the location.

18. The mobile robot of claim 1 , wherein performing the security operation comprises notifying one or more security personnel of the individual and the security condition.

19. The mobile robot of claim 1 , wherein performing the security operation comprises enabling remote control of the mobile robot by a human operator.

20. The mobile robot of claim 1 , wherein performing the security operation comprises instructing one or more additional mobile robots to monitor the individual.

21. The mobile robot of claim 1 , wherein performing the security operation comprises locking one or more doors within a vicinity of the individual.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2024
From: COBALT LIQUIDATION LLC
To: COBALT AI, LLC
Reel/Frame 068246/0575 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYANCE TYPE, ASSIGNEE NAME, AND REPLACE THE PREVIOUSLY RECORDED ASSIGNMENT DOCUMENT PREVIOUSLY RECORDED ON REEL 67338 FRAME 58. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 8, 2024
From: COBALT ROBOTICS, INC.
To: COBALT LIQUIDATION LLC
Reel/Frame 068217/0196 →
MERGER Recorded May 7, 2024
From: COBALT ROBOTICS INC.
To: COBALT AI, LLC
Reel/Frame 067338/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2021
From: DEYLE, TRAVIS J.; SCHLUNTZ, ERIK; BADGER, PEREGRINE; VAISH, SARVAGYA; O'KELLY, MICHAEL J.
To: COBALT ROBOTICS INC.
Reel/Frame 056867/0210 →
Continuity (2)
Continuation 16059037 · Aug 9, 2018
Related Publication 20210337168A1 · Oct 28, 2021