Refuse collection system
The technology relates to a refuse collection system including: a camera configured to capture image data; a sensor configured to capture spatial data; and a processing module in communication with the camera and the sensor, the processing module configured to: process the image data to assist in identifying an object; and process the spatial data in a region associated with the object in order to determine one or more characteristics associated therewith, wherein in response to confirming that the object is a bin based on the one or more characteristics associated with the object, the processing module is configured to provide information to assist in retrieving the bin with a bin-collecting device.
1. A refuse collection system including:
a camera configured to capture image data;
a sensor configured to capture spatial data, said captured spatial data including 3D information; and
a processor in communication with the camera and the sensor, the processor configured to:
process the image data to assist in identifying an object; and
process the spatial data in a region associated with the object in order to determine one or more characteristics associated therewith,
wherein, in response to confirming that the object is a bin based on the one or more characteristics associated with the object, the processor is configured to create a 3D map of the bin and surrounding objects using the spatial data and thereby provide information to assist in retrieving the bin with a bin collector.
2. The refuse collection system of claim 1 , wherein the processor is configured to process the image data by passing the image data through an object detection algorithm configured to assist in identifying the object.
3. The refuse collection system of claim 2 , wherein the object detection algorithm is configured to compare the image data with one or more prescribed features, and, in response to the image data providing a sufficient match with the one or more prescribed features, the processor is configured to determine that the object is a bin.
4. The refuse collection system of claim 1 , wherein the processor is further configured to present to a user a selectable representation associated with the identified object on a user interface, which selectable representation is selectable by the user to confirm that the object is a bin.
5. The refuse collection system of claim 1 wherein, in order to confirm that the object is a bin based upon the one or more characteristics associated with the object, the processor is configured to compare the one or more characteristics with one or more prescribed characteristics.
6. The refuse collection system of claim 5 wherein, in response to determining that the one or more characteristics have a sufficient match with the one or more prescribed characteristics, the processor is configured to confirm that the object is a bin.
7. The refuse collection system of claim 1 , wherein the processor is further configured to determine the type of bin.
8. The refuse collection system of claim 7 , wherein the type of bin is determined based upon any one or more of the following: a shape of the bin, a colour of the bin, and a size of the bin.
9. The refuse collection system of claim 1 , wherein the one or more characteristics associated with the object include one or more geometrical features of the bin and/or a position of the bin.
10. The refuse collection system of claim 9 , wherein, based on the position of the bin, the processor is configured to determine information concerning a path to the bin for movement of the bin collector to retrieve the bin.
11. The refuse collection system of claim 10 , wherein the processor is configured to use the image data and/or the spatial data to determine the presence of an obstacle in the path of the bin collector to the bin.
12. The refuse collection system of claim 11 wherein, in response to determining that the path of the bin collector to the bin is not clear, the processor is configured to determine or select an alternative path for the bin collector to retrieve the bin.
13. The refuse collection system of claim 12 wherein, in the event that the processor is unable to determine a clear path to the bin for movement of the bin collector to retrieve the bin, the bin retrieval control module is prevented from carrying out the bin retrieval operation.
14. The refuse collection system of claim 10 , wherein the processor is configured to determine a safe path for the bin collector to retrieve the bin.
15. The refuse collection system of claim 9 , wherein the processor is configured to provide information relating to the position of the bin to a bin retrieval control module to be used in a bin retrieval operation.
16. The refuse collection system of claim 15 , wherein the processor is configured to provide a motion profile to the bin retrieval control module, based on a path to the bin, in order to control movement of the bin collector in the bin retrieval operation.
17. The refuse collection system of claim 1 , wherein the sensor is further configured to capture the spatial data in two or more dimensions, and wherein the sensor comprises any one or more of the following: a stereo camera, a laser scanner, a RADAR unit, a LIDAR unit, and an echolocation unit.
18. A refuse collection vehicle including:
a refuse collection device having a bin collector configured to collect a bin; and
a refuse collection system as defined in claim 1 .
19. A refuse collection system including:
a camera configured to capture image data;
a sensor configured to collect spatial data, said collected spatial data including 3D information; and
a processor in communication with the camera and the sensor, the processor configured to:
process the image data in order to assist in identifying an object;
determine a region associated with the object; and
process the spatial data in the region associated with the object in order to determine one or more characteristics associated therewith,
wherein, in response to confirming that the object is a bin, the processor is configured to create a 3D map of the bin and surrounding objects using the spatial data and assist in retrieving the bin based on the one or more characteristics associated with the object.
20. A method for collecting a bin, the method including:
capturing image data from a zone where a bin may be present;
capturing spatial data for said zone where a bin may be present, said captured spatial data including 3D information;
processing the image data to assist in identifying an object;
processing the spatial data in a region associated with the object in order to determine one of more characteristics associated therewith to assist in confirming that the object is a bin;
creating a 3D map of the bin and surrounding objects using the spatial data; and
providing information to assist with retrieving the bin with a bin collector.
21. A refuse collection vehicle including:
a refuse collection device having a bin collector configured to collect a bin; and
a refuse collection system as defined in claim 19 .