IP Library Granted Patent US 11,677,828
Granted Patent B2
US 11,677,828 · App. 16/506,821 · Granted Jun 13, 2023

Camera network for enhancing industrial monitoring and security

Inventors: Garrett Larsson (Carmichael, CA); Omar Khan (San Ramon, CA); Jonathan Egan Salcedo (San Francisco, CA)
Assignee: Rhombus Systems
H04L67/12G06T7/0004G06T7/70G06V20/52G08B21/18H04L9/32H04N23/90H04W76/19G06T2207/30232G06V40/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,677,828
App. No.
16/506,821
Granted
Jun 13, 2023
Kind
B2
Abstract

A sensor monitoring system includes a plurality of image capture devices. Each image capture device includes one or more sensors to detect image data representing an environment about the image capture device, communications circuitry to receive sensor data from a sensor device and remote sensor data including at least one of a second image of the sensor or second position data regarding the sensor device, and processing circuitry to validate the sensor device based on the sensor data, determine first position data regarding the sensor device based on at least one of the first network connection or the remote sensor data, determine that the sensor device is in an image capture range based on the first position data, retrieve one or more images of the sensor device, and generate an alert based on the first position data.

Claims (66)

1. A method, comprising:

maintaining, by one or more processors using one or more sensors of an image capture device, image data representing an environment about the image capture device;

receiving, by the one or more processors, sensor data from a sensor device;

maintaining, by the one or more processors, an expected location of the sensor device;

validating, by the one or more processors, the sensor device based on the received sensor data;

determining, by the one or more processors, position data regarding the sensor device based on at least one of (i) a network connection with the sensor device or (ii) remote sensor data including at least one of a second image of the sensor device or remote position data regarding the sensor device;

determining, by the one or more processors, that the sensor device is in an image capture range of the image capture device based on the position data;

retrieving, by the one or more processors responsive to determining that the sensor device is in the image capture range, one or more images of the sensor device from the image data, wherein retrieving the one or more images comprises retrieving at least one image from a remote image capture device based on occlusion of the sensor device; and

generating, by the one or more processors, an alert regarding the sensor device responsive to the position data indicating that the sensor is not at the expected location for the sensor device by comparing the position data with the expected location and using the one or more images.

2. The method of claim 1 , comprising:

validating, by the one or more processors, the sensor device by retrieving a cryptographic beacon from the sensor data and comparing a sensor identifier extracted from the cryptographic beacon by applying a private key to the cryptographic beacon to at least one of an expected identifier or an expected location of the sensor device.

3. The method of claim 1 , comprising:

determining, by the one or more processors, the position data regarding the sensor device using a signal strength of the network connection.

4. The method of claim 1 , comprising:

comparing, by the one or more processors, a device identifier of the sensor device and a user identifier of a user associated with the sensor device to determine whether the user is authorized to use the sensor device; and

generating, by the one or more processors, the alert responsive to the device identifier not matching the user identifier to indicate that the user is not authorized to use the sensor device.

5. The method of claim 1 , comprising:

detecting, by the one or more processors, an alarm condition of the sensor device using at least one of the first image data or the remote sensor data; and

generating, by the one or more processors, the alert based on the alarm condition.

6. The method of claim 1 , comprising:

determining, by the one or more processors, the position of the sensor based on a first predetermined position of the image capture device and a second predetermined position of the remote image capture device.

7. The method of claim 1 , comprising:

receiving, by the one or processors, the remote sensor data using a wireless communications circuit of the image capture device.

8. The method of claim 7 , wherein the wireless communications circuit operates using a Bluetooth low energy (BLE) protocol.

9. The method of claim 1 , comprising:

maintaining, by the one or more processors, a user database associating locations of a plurality of users to the plurality of users, each user associated with a particular sensor device; and

updating, by the one or more processors, the user database by executing object recognition using the first image data to identify a particular location to associate with a user associated with the sensor device.

10. The method of claim 1 , comprising:

determining, by the one or more processors, a maintenance state of the sensor using the first image data and sensor usage data regarding the sensor; and

predicting, by the one or more processors, a time at which to perform maintenance on the sensor based on the maintenance state.

11. The method of claim 1 , comprising:

monitoring, by the one or more processors, a wireless network connection of the remote image capture device with a gateway device;

requesting, by the one or more processors responsive to the monitoring indicating a disconnect of the wireless network connection, reconfiguration information for connecting the remote image capture device with the gateway device; and

providing, by the one or more processors, the reconfiguration information to the remote image capture device.

12. A sensor monitoring system, comprising:

an image capture device comprising:

one or more sensors configured to detect image data representing an environment about the image capture device;

communications circuitry configured to:

receive, via a first network connection with a sensor device, sensor data; and

receive, via a second network connection with a remote image capture device, remote sensor data including at least one of a second image of the sensor or second position data regarding the sensor device; and

processing circuitry configured to:

maintain an expected location of the sensor device;

validate the sensor device based on the sensor data;

determine first position data regarding the sensor device based on at least one of (i) a condition of the first network connection or (ii) the remote sensor data;

retrieve one or more images of the sensor device from the image data, wherein retrieving the one or more images comprises retrieving at least one image from a remote image capture device responsive to an indication of occlusion of the sensor device; and

generate an alert regarding the sensor device responsive to the first position data indicating that the sensor device is not at the expected location for the sensor device by comparing the first position data with the expected location and using the one or more images.

13. The system of claim 12 , wherein the processing circuitry is configured to:

validate the sensor device by retrieving a cryptographic beacon from the sensor data and comparing the cryptographic beacon to at least one of an expected identifier or an expected location of the sensor device.

14. The system of claim 12 , wherein the processing circuitry is configured to:

determine the first position data regarding sensor device using a signal strength of the first network connection.

15. The system of claim 12 , wherein the processing circuitry is configured to:

detect an alarm condition of the sensor device using at least one of the image data or the remote sensor data; and

generate the alert based on the alarm condition.

16. The system of claim 12 , wherein the processing circuitry is configured to determine the position data of the sensor based on a first predetermined position of the image capture device and a second predetermined position of the remote image capture device.

17. The system of claim 12 , wherein the communications circuitry operates using a Bluetooth low energy (BLE) protocol.

18. The system of claim 12 , wherein the processing circuitry is configured to:

maintain a user database associating locations of a plurality of users to the plurality of users, each user associated with a particular sensor device; and

update the user database by executing object recognition using the image data to identify a particular location to associate with a user associated with the sensor device.

19. The system of claim 12 , wherein the processing circuitry is configured to:

determine a maintenance state of the sensor using the image data and sensor usage data regarding the sensor; and

predict a time at which to perform maintenance on the sensor based on the maintenance state.

20. The system of claim 12 , wherein the processing circuitry is configured to:

monitor a network connection of the remote image capture device with a gateway device of the communications circuitry;

request, responsive to the monitoring indicating a disconnect of the network connection, a reestablishment of the network connection;

receive, from the gateway device, reconfiguration information for connecting with the gateway device; and

transmit the reconfiguration information to the remote image capture device to enable the remote image capture device to reestablish the network connection with the gateway device using the reconfiguration information.

Assignments (2)
SECURITY INTEREST Recorded Jul 22, 2026
From: RHOMBUS SYSTEMS, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 075364/0872 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2023
From: LARSSON, GARRETT; KHAN, OMAR; SALCEDO, JONATHAN EGAN
To: RHOMBUS SYSTEMS
Reel/Frame 062844/0652 →
Continuity (1)
Related Publication 20210014308A1 · Jan 14, 2021
Cited By (1)
US 12,620,283