Method of imaging a wind turbine rotor blade
A method of imaging a wind turbine rotor blade is provided, which method includes the steps of controlling a camera to capture a plurality of images, each image showing a part of the rotor blade surface; augmenting each image with geometry metadata; generating a three-dimensional model of the rotor blade from the image metadata; and re-projecting the images on the basis of the three-dimensional model to obtain a composite re-projection image of the rotor blade. Also provided is a wind turbine rotor blade imaging arrangement.
1 . A method of imaging a wind turbine rotor blade, the method comprising:
controlling a camera to capture a plurality of images, each image showing a part of a rotor blade surface;
augmenting each image with geometry metadata;
generating a three-dimensional model of the rotor blade from the image metadata;
re-projecting the images on a basis of the three-dimensional model to obtain a composite re-projection image of the rotor blade, wherein the re-projecting the images is assisted by a neural network that automatically determines an alignment of the images relative to a fixed reference point of the rotor blade, wherein the re-projecting comprises applying a homograph matrix to each image to re-project the images onto a same plane and at a uniform scale to realign each re-projected image to be at a same distance from a principle axis of the rotor blade; and
using the composite re-projected image of the rotor blade to identify a defect in the rotor blade surface.
2 . The method according to claim 1 , wherein the homograph matrix of an image is compiled on the basis of geometry metadata of that image.
3 . The method according to claim 1 , wherein the neural network automatically determines which end of an image is closest to the fixed reference point.
4 . The method according to claim 1 , wherein the neural network is pre-trained using a plurality of annotated datasets.
5 . The method according to claim 1 , wherein geometry metadata of an image comprises the spatial coordinates of the camera at an instant of image capture, and/or comprises a camera viewing angle at the instant of image capture.
6 . The method according to claim 1 , wherein geometry metadata of an image comprises a distance between the camera and the rotor blade surface at an instant of image capture.
7 . The method according to claim 1 , further comprising mapping an image feature to a coordinate system of the rotor blade.
8 . A wind turbine rotor blade imaging arrangement, comprising:
a camera configured to capture a plurality of images, each image showing part of a rotor blade surface; and
one or more processors configured to:
generate geometry metadata for an image;
augment each image with the geometry metadata provided by the plurality of metadata generators;
generate a three-dimensional model of the rotor blade from the image metadata of the images; and
re-project the images on a basis of the three-dimensional model to obtain a composite re-projection image of the rotor blade, wherein a neural network trained to automatically determine an alignment of the images relative to a fixed reference point of the rotor blade, wherein obtaining the composite reprojection comprises applying a homograph matrix to each image to re-project the images onto a same plane and at a uniform scale to realign each re-projected image to be at a same distance from a principle axis of the rotor blade.
9 . The imaging arrangement according to claim 8 , wherein the neural network automatically determines which end of an image is closest to the fixed reference point.
10 . The imaging arrangement according to claim 8 , wherein the plurality of metadata generators comprises a position tracking unit configured to obtain camera spatial coordinates and/or a viewing angle tracking unit configured to obtain a camera viewing angle and/or a range-finding unit configured to measure a distance between the camera and rotor blade surface.
11 . The imaging arrangement according to claim 8 , comprising a camera controller configured to adjust a position of the camera and/or an orientation of the camera and/or a focal length of the camera.
12 . The imaging arrangement according to claim 8 , configured to identify a finding in an image and to determine coordinates of the finding in a reference frame of the rotor blade.
13 . The imaging arrangement according to claim 8 , wherein the camera is carried by a drone, and/or the camera is mounted on a fixed track.
14 . A computer program product, comprising a computer readable hardware storage device having computer readable program code stored therein, said program code executable by a processor of a computer system to implement a method according to claim 1 when the computer program product is loaded into a memory of a programmable device.
15 . The method according to claim 1 , wherein the step of re-projecting the images comprises re-projecting the images at the same scale and viewing angle on the basis of the three-dimensional model to obtain the composite re-projection image of the rotor blade.
16 . The method according to claim 1 , wherein the three-dimensional model provides a reference frame from which to carry out the re-projection of the images for accurately relate any pixel of a specific image to a point on the re-projected composite image.
17 . The method according to claim 1 , comprising the step of identifying a defect on the rotor blade surface by applying an image processing algorithm configured to detect color anomalies and/or edge anomalies.
18 . A wind turbine rotor blade imaging arrangement comprising a camera and one or more processors configured for performing the method according to claim 1 .