Movable object performing real-time mapping using a payload assembly
Techniques are disclosed for real-time mapping in a movable object environment. A real-time mapping system can include at least an unmanned aerial vehicle (UAV), comprising a propulsion system, a main body coupled to the propulsion system and a payload assembly coupled to the main body via a payload port, wherein the payload assembly is configured to couple to the payload port and support a scanning sensor and a positioning sensor.
1. A movable object, comprising:
a propulsion system;
a main body coupled to the propulsion system;
a payload assembly coupled to the main body via a payload port, the payload assembly comprising a payload support bracket configured to couple to the payload port and support a scanning sensor;
a positioning sensor;
at least one memory including instructions; and
at least one processor, wherein the instructions when executed by the at least one processor, cause the movable object to at least to:
receive control data from an external device,
move the scanning sensor with respect to the movable object via a movement of the payload assembly based on the control data,
obtain mapping data from the scanning sensor in a first coordinate system based on the control data,
obtain positioning data from the positioning sensor,
construct a dense map in real-time based on the mapping data and the positioning data, and
transform the dense map into a sparse map;
and
a communication device configured to transmit the sparse map to the external device in real-time
wherein the external device is configured to:
receive the sparse map; and
render the sparse map in a second coordinate system in real-time, the second coordinate system being different from the first coordinate system,
wherein the first coordinate system is a scanner reference coordinate system, and the second coordinate system is a north-east-down (NED) coordinate system or a FlightGear coordinate system.
2. The movable object of claim 1 , wherein the payload support bracket is configured to orient the scanning sensor at a predetermined scanning angle relative to the main body.
3. The movable object of claim 2 , wherein the payload assembly comprises adjustable pivot brackets coupled to the payload support bracket, the adjustable pivot brackets configured to provide a plurality of predetermined scanning angles for orienting the scanning sensor relative to the main body.
4. The movable object of claim 3 , wherein the payload assembly comprises a payload support structure coupled to the payload support bracket via adjustable pivot brackets, the payload support structure configured to support the scanning sensor and the positioning sensor.
5. The movable object of claim 4 , wherein the payload support structure comprises a scanning sensor support and a positioning sensor support, the scanning sensor support receiving the scanning sensor and the positioning sensor support accommodating the positioning sensor.
6. The movable object of claim 4 , wherein the positioning sensor support comprises a positioning sensor enclosure configured to expose the positioning sensor support for placing or changing a type of the positioning sensor.
7. The movable object of claim 1 , wherein the payload support bracket configured to releasably couple to the payload port using a quick release connection.
8. The movable object of claim 2 , wherein the predetermined scanning angle relative to the main body is selected based on a scanning pattern of the scanning sensor.
9. The movable object of claim 1 , wherein the positioning sensor is configured to detect a pose of the scanning sensor.
10. The movable object of claim 1 , wherein the instructions, when executed by the at least one processor, cause the movable object to at least to process the mapping data and the positioning data using sensor fusion.
11. The movable object of claim 10 , wherein the instructions, when executed by the at least one processor, cause the movable object to at least to correlate the mapping data and the positioning data using time data, wherein the time data is obtained based on a reference clock signal associated with the scanning sensor, the positioning sensor, or a synchronization module coupled to the at least one processors.
12. The movable object of claim 1 , wherein the payload assembly includes a payload processor, wherein the payload processor configured to process the mapping data obtained by the scanning sensor and the positioning data obtained by the positioning sensor using sensor fusion to generate post-processed sensor data.
13. The movable object of claim 12 , wherein the payload port is configured to transmit the post-processed sensor data to the at least one processor.
14. The movable object of claim 1 , wherein the payload port is provided by a mounting assembly configured to couple the payload assembly to the main body, wherein the mounting assembly includes one or more dampers configured to reduce vibration to the payload assembly caused by the main body.
15. The movable object of claim 1 , wherein the instructions further cause the movable object to: cause the positioning sensor to output a clock signal to the scanning sensor.
16. The movable object of claim 1 , wherein the instructions further cause the movable object to: output the mapping data or the map to the external device in a LiDAR Data Exchange (LAS) file.
17. A movable object system, comprising:
a propulsion system;
a main body coupled to the propulsion system;
a payload assembly coupled to the main body via a payload port, the payload assembly comprising a payload support bracket configured to couple to the payload port and support a scanning sensor;
a positioning sensor;
at least one memory including instructions; and
at least one processor, wherein the instructions when executed by the at least one processor, cause the movable object to at least to:
receive control data from an external device,
move the scanning sensor with respect to the movable object system via a movement of the payload assembly based on the control data,
obtain mapping data from the scanning sensor in a first coordinate system based on the control data,
obtain positioning data from the positioning sensor,
construct a dense map in real-time based on the mapping data and the positioning data, and
transform the dense map into a sparse map;
a communication device to transmit the sparse map to the external device in real-time; and
the external device configured to:
receive the sparse map in real-time; and
render the sparse map in a second coordinate system in real-time, the second coordinate system being different from the first coordinate system,
wherein the first coordinate system is a scanner reference coordinate system, and the second coordinate system is a north-east-down (NED) coordinate system or a FlightGear coordinate system.
18. A movable object, comprising:
a propulsion system;
a main body coupled to the propulsion system;
a payload assembly coupled to the main body via a payload port, the payload assembly comprising a payload support bracket configured to couple to the payload port and support a scanning sensor and IMU sensor;
a positioning sensor including GPS sensor and/or RTK sensor;
at least one memory including instructions;
at least one processor, wherein the instructions when executed by the at least one processor, cause the movable object to at least to:
receive control data from an external device;
move the scanning sensor with respect to the movable object via a movement of the payload assembly based on the control data;
obtain mapping data from the scanning sensor in a first coordinate system based on the control data;
obtain positioning data from the positioning sensor and IMU data indicating an attitude of the scanning sensor from the IMU sensor; and
construct a map in real-time based on the mapping data, the positioning data and the IMU data; and
a communication device configured to transmit the map to the external device in real-time,
wherein the external device is configured to:
receive the sparse map; and
render the sparse map in a second coordinate system in real-time, the second coordinate system being different from the first coordinate system,
wherein the first coordinate system is a scanner reference coordinate system, and the second coordinate system is a north-east-down (NED) coordinate system or a FlightGear coordinate system.