Computer vision and RFID object detection
Techniques for an objection detection feature are described herein. Images of an object captured by a camera may be received along with information that includes a first timestamp. A presence of the object and a type of the object may be determined based on a computer vision model that uses the images. First RFID data may be received from an RFID sensor from an RFID tag associated with the object. The first RFID data may include a second timestamp and an identifier for the RFID tag. A determination that the object has entered the area may be determined based on the presence of the object within the images, the first RFID data, the first timestamp, and the second timestamp. A threshold for the object may be determined based on the first timestamp, the second timestamp, and one or more policies for the area.
1. A computer-implemented method, comprising:
receiving, by a computer system, one or more images of an object captured by a plurality of cameras and information about the one or more images, the plurality of cameras located in a certain configuration and within a volume of space of an entryway of an area, the plurality of cameras configured to capture the one or more images in response to associated motion detection sensors detecting the object, the information including a first timestamp that identifies a time when the one or more images of the object are captured by the plurality of cameras;
identifying, by the computer system, the object as a human within the one or more images based at least in part on a computer vision model that uses the one or more images, the computer vision model implemented by the computer system;
receiving, by the computer system, first radio frequency identification (RFID) data from an RFID sensor, the RFID sensor located within the volume of space of the entryway of the area, the first RFID data captured by the RFID sensor from an RFID tag associated with the object, the first RFID data including a second timestamp that identifies the time when the first RFID data is captured by the RFID sensor and an identifier for the RFID tag;
determining, by the computer system, that the object captured by the plurality of cameras has entered the area based at least in part on identifying the presence of the human in the one or more images, the first RFID data, the first timestamp, and the second timestamp;
determining, by the computer system, a time threshold for the object based at least in part on the first timestamp, the second timestamp, and one or more policies for the area;
associating, by the computer system, the time threshold with the identifier for the RFID tag;
generating, by the computer system and upon expiration of the time threshold, a first notification to exit the area; and
transmitting, by the computer system and to a user device associated with the RFID tag, the first notification, the user device identified based on the identifier for the RFID tag.
2. The computer-implemented method of claim 1 , further comprising identifying, by the computer system, a presence of one or more pieces of equipment in the one or more images based at least in part on the computer vision model that uses the one or more images captured by the plurality of cameras, the one or more pieces of equipment associated with the object.
3. The computer-implemented method of claim 2 , further comprising receiving, by the computer system, second RFID data from the RFID sensor, the second RFID data captured by the RFID sensor from one or more RFID tags associated with the one or more pieces of equipment.
4. The computer-implemented method of claim 3 , further comprising:
determining, by the computer system, a required amount of the equipment and a type of the equipment required for the area based at least in part on the one or more policies for the area;
generating, by the computer system, a second notification that identifies the required amount of the equipment and the type of the equipment based on identifying the presence of the one or more pieces of equipment in the one or more images and the second RFID data; and
transmitting, by the computer system, the second notification to the user device associated with the RFID tag.
5. A computer-implemented method, comprising:
receiving, by a computer system, one or more images of an object captured by a camera and information about the one or more images, the camera located inside and within a volume of space of an entryway of an area, the camera configured to capture the one or more images in response to an associated motion detection sensor detecting the object, the information including a first timestamp that identifies a time when the one or more images of the object are captured by the camera;
determining, by the computer system, a presence of the object and a type of the object within the one or more images based at least in part on a computer vision model that uses the one or more images, the computer vision model implemented by the computer system;
receiving, by the computer system, first radio frequency identification (RFID) data from an RFID sensor, the RFID sensor located within the volume of space of the entryway of the area, the first RFID data captured by the RFID sensor from an RFID tag associated with the object, the first RFID data including a second timestamp that identifies the time when the first RFID data is captured by the RFID sensor and an identifier for the RFID tag;
determining, by the computer system, that the object has entered the area based at least in part on determining the presence of the object within the one or more images, the first RFID data, the first timestamp, and the second timestamp;
determining, by the computer system, a threshold for the object based at least in part on the first timestamp, the second timestamp, and one or more policies for the area; and
associating, by the computer system, the threshold with the identifier for the RFID tag.
6. The computer-implemented method of claim 5 , wherein the threshold is a time threshold and further comprising:
generating, by the computer system and upon expiration of the time threshold, a notification to exit the area that includes the identifier for the RFID tag; and
transmitting, by the computer system and to a user device associated with the identifier, the notification.
7. The computer-implemented method of claim 6 , wherein the one or more policies for the area are based at least in part on the type of the object.
8. The computer-implemented method of claim 5 , wherein the computer vision model is further configured to determine a direction of motion of the object based at least in part on the one or more images.
9. The computer-implemented method of claim 5 , wherein determining the threshold for the object is further based at least in part on the type of the area.
10. The computer-implemented method of claim 5 , further comprising:
receiving, by the computer system, updated images of the object captured by the camera and the information about the updated images, the information including a third timestamp that identifies the time when the updated images of the object are captured by the camera, the threshold being a time threshold;
determining, by the computer system, the presence of the object within the updated images based at least in part on the computer vision model that uses the updated images;
receive, second RFID data from the RFID sensor from the RFID tag associated with the object, the second RFID data including a fourth timestamp that identifies the time when the second RFID data is captured by the RFID sensor and the identifier for the RFID tag; and
determining, by the computer system, that the object has exited the area within the time threshold based at least in part on determining the presence of the object within the updated images, the third timestamp, the fourth timestamp, and the time threshold for the object.
11. The computer-implemented method of claim 10 , further comprising disassociating, by the computer system and in response to determining that the object has exited the area, the time threshold with the identifier for the RFID tag.
12. The computer-implemented method of claim 5 , further comprising determining, by the computer system, that the object has entered the area based at least in part on determining the presence of the object within the one or more images and absent the RFID data and the second timestamp.
13. The computer-implemented method of claim 5 , further comprising updating, by the computer system, the second timestamp for the first RFID data by a specified time period.
14. The computer-implemented method of claim 13 , further comprising modifying, by the computer system, the updated second timestamp based at least in part on data from a facility that identifies a change to a physical structure of the area, the area located within the facility.
15. A computer system associated with a facility comprising:
a memory configured to store computer-executable instructions;
a camera associated with a motion detection sensor that is located at an entryway of an area of the facility and configured to capture images of an object in response to the motion detection sensor detecting the object;
a plurality of radio frequency identification (RFID) sensors located at the entryway of the area of the facility and configured to capture RFID data from RFID tags;
a processor in communication with the memory and configured to execute the computer-executable instructions to at least:
receive the images of the object captured by the camera and information about the images, the information including a first timestamp that identifies a time when the images of the object are captured by the camera;
determine a presence of object and a type of the object within the images based at least in part on a computer vision model that uses the images, the computer vision model implemented by the computer system;
receive first RFID data from the plurality of RFID sensors, the first RFID data captured by the RFID sensors from an RFID tag associated with the object, the first RFID data including a second timestamp that identifies the time when the first RFID data is captured by the plurality of RFID sensors and an identifier for the RFID tag;
determine that the object has entered the area based at least in part on determining the presence of the object within the images, the first RFID data, the first timestamp, and the second timestamp;
determine a threshold for the object based at least in part on the first timestamp, the second timestamp, and one or more policies for the area; and
associate the threshold with the identifier for the RFID tag.
16. The computer system of claim 15 , wherein the threshold is a time threshold and wherein the processor in communication with the memory is further configured to execute the computer-executable instructions to at least:
generate, upon expiration of the time threshold, a notification to exit the area that includes the identifier for the RFID tag; and
transmit, to a user device associated with the identifier, the notification.
17. The computer system of claim 16 , wherein generating and transmitting the notification occurs prior to expiration of the time threshold and within a certain time period prior to the time threshold.
18. The computer system of claim 15 , wherein the processor in communication with the memory is further configured to execute the computer-executable instructions to at least receive, from the plurality of RFID sensors, calibration data that indicates RFID detection events that are not transmitted to the computer system.
19. The computer system of claim 18 , wherein the processor in communication with the memory is further configured to execute the computer-executable instructions to at least:
generate instructions for updating calibration of detection for the plurality of RFID sensors based at least in part on the calibration data and the determining of the presence of the object within the images; and
transmit the instructions to the plurality of RFID sensors.
20. The computer system of claim 19 , wherein the instructions are transmitted to only a portion of the plurality of RFID sensors, the portion of the plurality of RFID sensors determined based at least in part on the calibration data.