Object detection in edge devices for barrier operation and parcel delivery
Human or object presence in or absence from a field-of-view of a camera can be achieved by analyzing camera data using a processor inside of or adjacent to the camera itself. In an example, a video signal processing system receives image data from one or more cameras and uses a processing circuit to determine whether a designated object is or is not present at a particular time, during a particular interval, or over a designated sequence of frames. In an example, the designated object can include one or more of a human being, a vehicle, or a parcel. In an example, results of the determination, such as including positive human or object identification, can be used as a trigger for operation of a barrier or access door.
1 . A method for securely receiving delivery of a parcel, the method comprising:
using a control circuit, receiving, from a remote device and via a network, information about a physical dimension attribute of the parcel;
monitoring an environment using a camera;
using an image processor circuit coupled to the camera, receiving the information about the physical dimension attribute of the parcel from the control circuit, and analyzing image information from the camera to determine whether an object in the environment corresponds to the physical dimension attribute of the parcel; and
in response to determining the object in the environment corresponds to the physical dimension attribute of the parcel, providing a control signal from the control circuit to open a barrier door by a specified minimum opening amount to facilitate delivery of the parcel and inhibit entry of other unauthorized objects.
2 . The method of claim 1 , wherein receiving the information about the physical dimension attribute of the parcel comprises receiving, from the remote device, an electronic message with information about the parcel when the parcel is en route to, or expected to be received at, the environment.
3 . The method of claim 1 , wherein analyzing the image information from the camera comprises using a machine learning model to determine whether the object in the environment corresponds to the physical dimension attribute of the parcel.
4 . The method of claim 3 , wherein analyzing the image information from the camera using the machine learning model includes applying one or more frames from the camera as an input to a first neural network and, in response, receiving an indication of a likelihood that the one or more frames includes at least a portion of a specified object corresponding to the physical dimension attribute; and
wherein providing the control signal to control operation of the barrier door includes when the likelihood meets or exceeds a threshold likelihood criteria; and
wherein the specified object includes one or more of the parcel, delivery personnel, or a delivery vehicle.
5 . The method of claim 1 , wherein analyzing the image information to determine whether an object in the environment corresponds to the physical dimension attribute of the parcel includes determining whether known delivery personnel are detected in the image information from the camera, and
wherein providing the control signal to open the barrier door includes providing instructions to open the barrier door when the known delivery personnel are detected.
6 . The method of claim 1 , wherein analyzing the image information to determine whether an object in the environment corresponds to the physical dimension attribute of the parcel includes determining whether a known delivery vehicle is detected in the image information from the camera, and
wherein providing the control signal to open the barrier door includes providing instructions to open the barrier door when the known delivery vehicle is detected.
7 . The method of claim 1 , wherein analyzing the image information to determine whether an object in the environment corresponds to the physical dimension attribute of the parcel includes determining that known delivery personnel and/or a known delivery vehicle is not detected in the image information from the camera, and
providing instructions to dose the barrier door or to maintain the barrier door in a closed position.
8 . The method of claim 1 , further comprising using the image processor circuit, analyzing subsequent image information from the camera to detect when a delivery event corresponding to the parcel is completed; and
providing a second control signal from the control circuit to close or secure the barrier door.
9 . The method of claim 1 , wherein the specified minimum opening amount is based on information received from the remote device.
10 . The method of claim 9 , wherein receiving, from the remote device and via the network, information about the physical dimension attribute of the parcel comprises receiving a parcel delivery notification that includes:
the physical dimension attribute;
the specified minimum opening amount; and
an expected delivery date or time for the parcel.
11 . A method for operating a barrier based on a determination about whether a designated object is present in or absent from an environment monitored by a camera using image information from the camera, the method comprising:
receiving, at a first processor circuit, multiple frames from the camera, the multiple frames corresponding to a sequence of substantially adjacent time instances;
using the first processor circuit, identifying a difference between at least first and second frames from among the multiple frames, the difference indicating movement by a first object in the environment monitored by the camera;
using the first processor circuit, selecting a third frame from among the multiple frames for full-frame analysis;
using the first processor circuit, providing the third frame as an input to a first neural network and, in response, receiving a first indication of a likelihood that the third frame includes an image of the designated object; and
using the first processor circuit and based on the first indication of the likelihood that the third frame includes an image of the designated object, providing a control signal to a barrier control device to open the barrier when the information indicates the designated object is present in the environment, the barrier configured to be opened by a specified minimum opening amount to facilitate delivery of the designated object and inhibit entry of other unauthorized objects.
12 . The method of claim 11 , wherein the control signal comprises information about whether the designated object is present in or absent from the environment, wherein the information is based on (1) the identified difference indicating movement by the first object, and on (2) the received first indication of the likelihood that the third frame includes an image of the designated object.
13 . The method of claim 12 , further comprising opening the barrier when the information indicates the designated object is present in the environment;
providing information about delivery of a parcel through the barrier to a user or to a sender of the parcel, the parcel comprising the designated object; and
recording audio and/or video information from the environment using the same or different camera, the recording being concurrent with or following the opening the barrier;
wherein providing the information about delivery of the parcel through the barrier includes providing at least a portion of the recorded audio and/or video information.
14 . The method of claim 12 , further comprising receiving a parcel delivery notification message; and
determining a correspondence between the parcel delivery notification message and the information about whether the designated object is present in or absent from the environment;
wherein providing the control signal to the barrier control device includes providing a command to open or close a barrier door based on the determined correspondence between the parcel delivery notification message and the information about whether the designated object is present in or absent from the environment.
15 . The method of claim 11 , further comprising using the first processor circuit, providing a notification to a user to monitor a live feed of video and/or audio information from the environment using the same camera or a different camera, the video and/or audio information including information about delivery of a parcel to a secure area behind the barrier, wherein the parcel comprises the designated object.