System, server and data capture device for roadside asset tracking and maintenance monitoring
There is provided herein an apparatus and method for roadside asset tracking and maintenance monitoring having a mobile unit with data capture devices for capturing roadside asset imagery, global positioning system (GPS) receivers and data interfaces for communicating with an asset management server. As such, the apparatus may take roadside imagery for automated asset identification which may include utilising an asset type image recognition technique for automating the identification of the roadside assets.
1. A method for roadside asset tracking and maintenance monitoring, the method comprising:
periodically deploying a vehicle alongside a roadside section, the vehicle comprising a data capture device comprising:
an asset data capture device comprising forward and rearward facing cameras configured for capturing forward and rearward facing roadside asset image data from the perspective of the vehicle;
a global positioning system (GPS) receiver; and
a data interface for communicating with an asset management server, the server comprising an asset tracking register database;
receiving the roadside asset image data representing images taken of a plurality of roadside assets;
receiving location data from the GPS receiver representing the respective locations the roadside assets;
utilising an asset type image recognition technique for automating the identification of the roadside assets;
generating a map representation, representing the roadside section and the locations of the identified roadside assets along the roadside section, for displaying before and after maintenance comparison imagery utilising the image data received from the forward and rearward facing cameras;
comparing roadside asset data of the asset tracking register database to:
record newly identified roadside assets and their respective locations in the asset tracking register database; and
identify missing roadside assets.
2. The method as claimed in claim 1 , wherein the asset type image recognition technique comprises an image recognition stage comprising edge shape detection.
3. The method as claimed in claim 2 , wherein the edge shape detection comprises rotation invariance processing to allow for edge shape detection of skew roadsign assets.
4. The method as claimed in claim 3 , wherein edge shape detection comprises comparison to reference shapes in a shape reference database.
5. The method as claimed in claim 1 , wherein the image recognition comprises an image recognition stage comprising colour detection.
6. The method as claimed in claim 5 , wherein the colour detection comprises colour juxtapose detection.
7. The method as claimed in claim 6 , wherein colour detection comprises comparison to reference colours in a colour reference database.
8. The method as claimed in claim 1 , wherein the image recognition comprises an image recognition stage comprising symbol detection.
9. The method as claimed in claim 8 , wherein symbol detection comprises comparison to reference symbols in a symbol reference database.
10. The method as claimed in claim 8 , wherein symbol detection comprises alphanumeric symbol detection.
11. The method as claimed in claim 8 , wherein symbol detection comprises text recognition.
12. The method as claimed in claim 1 , wherein the vehicle further comprises an asset proximity detector for detecting the proximity of roadside assets and wherein the asset data capture device is triggered by the asset proximity detector.
13. The method as claimed in claim 12 , wherein the vehicle comprises a grass cutter unit and wherein the proximity detector is configured for detecting when the roadside asset is engaged by the grass cutter unit.
14. The method as claimed in claim 1 , wherein the vehicle comprises a grass cutter unit and wherein the grass cutter unit is controllable to be moveable with respect to the vehicle and wherein the forward facing camera is configured to follow the movement of the grass cutter unit.
15. The method as claimed in claim 1 , wherein the method further comprises image comparison for detecting roadside asset damage or degradation to identify assets requiring maintenance.
16. The method as claimed in claim 15 , wherein the image comparison comprises colour comparison.
17. The method as claimed in claim 15 , wherein the image comparison comprises shape comparison.
18. The method as claimed in claim 15 , wherein the image comparison comprises colour detection.
19. The method as claimed in claim 15 , wherein the image comparison comprises symbol comparison.