Drone systems and methods for assisting a crane operator
The present disclosure presents systems and methods for assisting a crane operator. An imaging system automatically images each building material object contained within a shakeout field on a construction site and processes the images to determine each object's identifying indicium and its geometric properties. These values are compared with a construction site database to ensure that all necessary building materials are present. A positioning device tracks, in real time, the location of the imaging system, the location of structural members within the shakeout field, and/or other important features of the job site, such as obstacles that the crane operator will need to avoid while lifting a structural member from its initial location to its destination location. Real-time images of the construction site, including indications of the next building material object to be hoisted and/or a path between the object's initial and final locations, can be generated to guarantee that the crane operator hoists the expected object to the expected location.
1. A drone-mounted imaging system, comprising:
a drone;
an imager physically coupled to the drone;
a distance sensor physically coupled to the drone;
a processor communicatively coupled to the imager and the distance sensor; and
a memory communicatively coupled to the processor, the memory storing instructions which, when executed, cause the drone-mounted imaging system to:
capture with the imager at least one aerial image of a building material object within a shakeout field, wherein the at least one aerial image contains identifying indicium for the corresponding building material object;
determine the distance from the imager to the building material object using the distance sensor;
recognize the identifying indicium and compare the recognized identifying indicium to a plurality of identifying indicia on a lifting list;
measure, using the image and the distance, at least one dimension of the building material object;
confirm that the at least one dimension of the building material object matches a corresponding dimension for the corresponding building material object on the lifting list; and
transmit a message comprising a location of the building material object within the shakeout field.
2. The drone-mounted imaging system of claim 1 , wherein the memory comprises further instructions which, when executed cause the drone-mounted imaging system to automatically traverse the shakeout field while capturing the at least one aerial image.
3. The drone-mounted imaging system of claim 2 , the drone-mounted imaging system further comprising an inertial navigation system physically coupled to the drone, wherein the drone-mounted imaging system automatically traverses the shakeout field while remaining within a geofence corresponding to outer boundaries of the shakeout field.
4. The drone-mounted imaging system of claim 3 , wherein the memory comprises further instructions which, when executed cause the drone-mounted imaging system to automatically stitch together more than one image providing an aerial view of the entire shakeout field.
5. The drone-mounted imaging system of claim 4 , wherein the processor is communicatively coupled to a crane-operator system, the crane operator system comprising a display configured to:
display the entire shakeout field image; and
identify each building material object within the shakeout field.
6. The drone-mounted imaging system of claim 5 , wherein the crane-operator system displays an indicator identifying a building material object to be lifted based on the lifting list.
7. The drone-mounted imaging system of claim 6 , wherein the drone-mounted imaging system traverses the shakeout field under remote control.
8. The drone-mounted imaging system of claim 1 , wherein:
the distance sensor is a scanning LIDAR sensor; and
the memory comprises further instructions which, when executed cause the drone-mounted imaging system to generate a 3D representation of the shakeout field, including 3D representations of each building material object in the shakeout field.
9. The system of claim 1 , wherein the imager includes a wavelength-responsive progressive scan CMOS imager.
10. The system of claim 1 , wherein the imager is calibrated for lens and perspective distortion.
11. The system of claim 1 , wherein the imager is calibrated to determine a GPS position of each image pixel.
12. A drone-mounted imaging system, comprising:
a drone,
an imager physically coupled to the drone;
a distance sensor physically coupled to the drone;
a processor communicatively coupled to the imager and the distance sensor; and
a memory communicatively coupled to the processor, the memory storing instructions which, when executed, cause the drone-mounted imaging system to:
capture, with the imager, a plurality of images of building material objects within the shakeout field, wherein one or more of the images contains an identifying indicium for the corresponding building material object;
recognize the identifying indicium and compare the recognized identifying indicium to a plurality of identifying indicia on a lifting list;
measure, using the imager and the distance sensor, at least one dimension of one or more of the imaged building material objects;
confirm that the at least one dimension of a particular building material object matches a corresponding dimension for the particular building material object on the lifting list; and
transmit a message comprising a location of the particular building material object within the shakeout field.
13. The drone-mounted imaging system of claim 12 , wherein the memory comprises further instructions which, when executed cause the drone-mounted imaging system to automatically traverse the shakeout field while capturing the plurality of images.
14. The drone-mounted imaging system of claim 13 , the drone-mounted imaging system further comprising an inertial navigation system physically coupled to the drone, wherein the drone-mounted imaging system automatically traverses the shakeout field while remaining within a geofence corresponding to outer boundaries of the shakeout field.
15. The drone-mounted imaging system of claim 12 , wherein the memory comprises further instructions which, when executed cause the drone-mounted imaging system to form a composite image of the shakeout field.
16. The drone-mounted imaging system of claim 12 , wherein the processor is communicatively coupled to a crane-operator system, the crane operator system comprising a display configured to:
display the composite image; and
identify one or more building material objects within the shakeout field.
17. The drone-mounted imaging system of claim 16 , wherein the crane-operator system displays an indicator identifying a building material object to be lifted based on the lifting list.
18. The drone-mounted imaging system of claim 12 , wherein the drone-mounted imaging system traverses the shakeout field under remote control.
19. The drone-mounted imaging system of claim 12 , wherein:
the distance sensor is a scanning LIDAR sensor; and
the memory comprises further instructions which, when executed cause the drone-mounted imaging system to generate a 3D representation of the shakeout field, including 3D representations of each building material object in the shakeout field.
20. The system of claim 12 , wherein the imager includes a wavelength-responsive progressive scan CMOS imager.
21. The system of claim 12 , wherein the imager is calibrated for lens and perspective distortion.
22. The system of claim 12 , wherein the imager is calibrated to determine a GPS position of each image pixel.
23. The system of claim 22 , wherein the processor determines a two-dimensional location of one or more of the building material objects.