Vehicle comprising a working equipment, and a working equipment, and a method in relation thereto
A vehicle ( 2 ) comprising a working equipment ( 4 ) equipped with a movable loading arrangement ( 5 ) comprising a first attachment member ( 7 ), said vehicle further comprises a sensor system ( 6 ) configured to capture environmental data reflecting the environment around the vehicle and to determine, based on said data, image data ( 8 ) representing an area at least partly surrounding the vehicle ( 2 ). The sensor system ( 6 ) is configured to detect and track positions of the first attachment member ( 7 ) and a mating second attachment member ( 9 ) of the object ( 20 ) to load in said image data representation, and, the detected and tracked positions of the first and second attachment members ( 7, 9 ) are used to generate a first set of operation instructions for the loading arrangement ( 5 ) of the working equipment that decreases the distance between said first and second attachment members such that said attachment members ( 7, 9 ) come into position to engage to each other. The control unit 16 is configured to verify that said attachment members ( 7, 9 ) are engaged based on the detected and tracked positions from the sensor system ( 6 ), and in response to verifying that said attachment members ( 7, 9 ) are engaged, enable activation of an object loading mode in which the control system generates a second set of operation instructions for the working equipment to move the loading arrangement ( 5 ) so that the object to load is loaded on the vehicle.
1. A vehicle comprising a working equipment equipped with a movable loading arrangement comprising a first attachment member, said vehicle further comprises:
a sensor system configured to capture environmental data reflecting the environment around the vehicle and to determine, based on said data, image data representing an area at least partly surrounding the vehicle,
a control unit configured to receive said image data, and to determine and generate control signals for controlling said vehicle, wherein said control signals comprise operation instructions for the vehicle and working equipment,
the control unit is configured to receive a working task to be performed by the vehicle, wherein said working task includes information of an object for the vehicle to load when performing said working task,
wherein said control unit is configured to:
determine that the vehicle has reached a target position dependent upon the type of working equipment and being a position based on the location of the object to load when performing said working task, using said image data representation from the sensor system,
in response to determining that the vehicle has reached the target position enable activation of an attachment mode of the working equipment in which:
the sensor system is configured to detect and track positions of the first attachment member and a mating second attachment member of the object to load in said image data representation, and,
the detected and tracked positions of the first and second attachment members are used to generate a first set of operation instructions for the loading arrangement of the working equipment that decreases the distance between said first and second attachment members such that said attachment members come into position to engage to each other,
verify that said attachment members are engaged based on the detected and tracked positions from the sensor system,
in response to verifying that said attachment members are engaged, enable activation of an object loading mode in which the control unit generates a second set of operation instructions for the working equipment to move the loading arrangement so that the object to load is loaded on the vehicle.
2. The vehicle according to claim 1 , wherein said sensor system comprises a first and a second sensor unit placed on different locations on the working equipment and vehicle, and wherein image data from said first and the second sensor units is used to detect and track the position of said first attachment member in relation to said second attachment member in three dimensions by mapping sets of image data from the first and second sensor unit to a common three-dimensional coordinate system.
3. The vehicle according to claim 1 , wherein said movable loading arrangement is a hooklift loading arm, or a crane arm with one or more booms, and wherein said first attachment member comprises a hook, grip or fork.
4. The vehicle according to claim 1 , wherein said sensor system comprises one or many of radar, LIDAR, 3D cameras, cameras, lasers, thermal cameras, and wherein said image data being data organized in a matrix to describe the spatial relationship of the surrounding with respect to what said sensor system is measuring.
5. The vehicle according to claim 1 , wherein in order for the vehicle to reach the target position the control unit is configured to identify an object for loading and estimate the position of the identified object in relation to the vehicle by comparing spatial features of objects in the captured set of image data to corresponding spatial features of an object for the vehicle to load according to said working task, wherein said control unit is then configured to determine and generate a third set of operation instructions for moving the vehicle towards the estimated position of the detected object.
6. The vehicle according to claim 5 , further comprising a vehicle data unit configured to determine vehicle data representing characteristics of the vehicle, and that said control unit is also configured to receive said vehicle data, and wherein said vehicle data comprises one or many of the number of wheels in contact with the ground, the location of wheels in contact with the ground relative to the vehicle, the weight of the vehicle, the center of mass of the vehicle, and the type of tires, and wherein said vehicle data is applied to determine said third set of operation instructions.
7. A working equipment structured to be mounted on a vehicle and equipped with a movable loading arrangement comprising a first attachment member, said working equipment comprises:
a sensor system configured to capture environmental data reflecting the environment around the working equipment and vehicle when mounted on the vehicle, and to determine, based on said data, image data representing an area at least partly surrounding the working equipment and the vehicle,
a control unit configured to receive said image data, and to determine and generate control signals for controlling said vehicle and working equipment, wherein said control signals comprise operation instructions,
the control unit is configured to receive a working task to be performed by the working equipment when mounted on said vehicle, wherein said working task includes information of an object for the vehicle to load when performing said working task,
wherein said control unit is configured to:
determine that the vehicle has reached a target position dependent upon the type of working equipment and being a position based on the location of the object to load when performing said working task, using said image data representation from the sensor system,
in response to determining that the vehicle has reached the target position enable activation of an attachment mode of the working equipment in which:
the sensor system is configured to detect and track positions of the first attachment member and a mating second attachment member of the object to load in said image data representation, and,
the detected and tracked positions of the first and second attachment members are used to generate a first set of operation instructions for the loading arrangement of the working equipment that decreases the distance between said first and second attachment members such that said attachment members come into position to engage to each other,
verify that said attachment members are engaged based on the detected and tracked positions from the sensor system,
in response to verifying that said attachment members are engaged, enable activation of an object loading mode in which the control unit generates a second set of operation instructions for the working equipment to move the loading arrangement so that the object to load is loaded on the vehicle.
8. The working equipment according to claim 7 , wherein said movable loading arrangement is a hooklift loading arm, or a crane arm with one or more booms, and wherein said first attachment member comprises a hook, grip or fork.
9. The working equipment according to claim 7 , wherein said sensor system comprises one or many of radar, LIDAR, 3D cameras, cameras, lasers, thermal cameras, and wherein said image data being data organized in a matrix to describe the spatial relationship of the surrounding with respect to what said sensor system is measuring.
10. The working equipment according to claim 7 , wherein in order for the vehicle to reach the target position the control unit is configured to identify an object for loading and estimate the position of the identified object in relation to the vehicle by comparing spatial features of objects in the captured set of image data to corresponding spatial features of an object for the vehicle to load according to said working task, wherein said control unit is then configured to determine and generate a third set of operation instructions for moving the vehicle towards the estimated position of the detected object.
11. A method in relation to a vehicle comprising a working equipment, or in relation to a working equipment structured to be mounted on a vehicle, said working equipment is equipped with a movable loading arrangement comprising a first attachment member, and that said vehicle or working equipment comprises:
a sensor system configured to capture environmental data reflecting the environment around the vehicle and/or the working equipment, and to determine, based on said data, image data representing an area at least partly surrounding the vehicle and/or the working equipment,
a control unit configured to receive said image data, and said vehicle data, and to determine and generate control signals for controlling said vehicle, wherein said control signals comprise driving instructions,
the control unit is configured to receive a working task to be performed by the vehicle, wherein said working task includes information of an object for the vehicle to load when performing said working task,
wherein said method comprises:
determining that the vehicle has reached a target position dependent upon the type of working equipment and being a position based on the location of the object to load when performing said working task, using said image data representation from the sensor system,
in response to determining that the vehicle has reached the target position enabling activation of an attachment mode of the working equipment comprising:
detecting and tracking positions of the first attachment member and a mating second attachment member of the object to load in said image data representation, and, using the detected and tracked positions of the first and second attachment members are to generate a first set of operation instructions for the loading arrangement of the working equipment that decreases the distance between said first and second attachment members such that said attachment members come into position to engage to each other,
verifying that said attachment members are engaged based on the detected and tracked positions from the sensor system,
in response to verifying that said attachment members are engaged, enabling activation of an object loading mode comprising generating a second set of operation instructions for the working equipment to move the loading arrangement so that the object to load is loaded on the vehicle.
12. The method according to claim 11 , comprising detecting and tracking the position of said first attachment member in relation to said second attachment member in three dimensions by mapping sets of image data to a common three-dimensional coordinate system.
13. The method according to claim 11 , wherein, in order for the vehicle to reach the target position, the method comprises identifying an object for loading and estimating the position of the identified object in relation to the vehicle by comparing spatial features of objects in the captured set of image data to corresponding spatial features of an object for the vehicle to load according to said working task, and determining and generating a third set of operation instructions for moving the vehicle towards the estimated position of the detected object.