Software development kit for LiDAR data
The present invention relates to a method and system for compressing and retrieving Light Detection and Ranging output data, and, more specifically, to a method and system for compressing Light Detection and Ranging output data by Run Length Encoding Light Detection and Ranging output data and rapidly accessing this compressed data which is filtered by attributes without the need to read or decompress the entire collection of data.
1. A computer implemented method for reducing total storage space used to store Light Detection and Ranging (LiDAR) output data, the method comprising:
receiving LiDAR output data containing point data information comprising a plurality of data points;
separating and arranging the point data information, by a processor, into a plurality of fields based on predetermined parameters, wherein each field comprises an array of values;
compressing the point data information in each field array, by said processor, by one or more data compression techniques;
organizing and storing in a memory each compressed field array;
storing location data in a file header of each compressed field array indicating where each compressed field array is stored in said memory;
implementing an interface allowing access to a first subset of field arrays of a set of field arrays based on a user request, wherein said first subset of requested field arrays includes a lower number of field arrays than said set of field arrays, and
selectively decompressing, by said processor, said first subset of requested field arrays based on said user request.
2. The computer implemented method of claim 1 , further comprising the step of creating an index file, wherein said index file contains metadata describing the content of said memory.
3. The computer implemented method of claim 2 , wherein said metadata includes text that is searchable.
4. The computer implemented method of claim 1 , wherein said LiDAR output data is in LAS file format.
5. The computer implemented method of claim 1 , wherein said one or more data compression techniques is selected from the group consisting of byte run length encoding, Boolean run length encoding, delta encoding, float to integer scaling, byte packing, and byte splitting.
6. The computer implemented method of claim 1 , further comprising the step of storing each field array in a column first format.
7. A computer implemented method for reducing total storage space used to store Light Detection and Ranging (LiDAR) output data, the method comprising:
receiving LiDAR output data containing point data information comprising a plurality of data points;
separating and arranging the point data information, by a processor, into a plurality of fields based on predetermined parameters, wherein each field comprises an array of values;
compressing the point data information in each field array, by said processor, by one or more data compression techniques;
organizing and storing in a memory each compressed field array, wherein the memory is allocated to only non-zero point data information, incorporating null pointers for any non-populated fields;
implementing an interface allowing access to a first subset of field arrays of a set of field arrays based on a user request, wherein said first subset of requested field arrays includes a lower number of field arrays than said set of field arrays, and
selectively decompressing, by said processor, said first subset of requested field arrays based on said user request.
8. A non-transitory computer-readable storage medium containing program code comprising:
program code for receiving Light Detection and Ranging (LiDAR) output data containing point data information comprising a plurality of data points;
program code for separating and arranging the point data information, by a processor, into a plurality of fields based on predetermined parameters, wherein each field comprises an array of values;
program code for compressing the point data information in each field array, by said processor, by one or more data compression techniques;
program code for organizing and storing in a memory each compressed field array;
program code for storing location data in a file header of each compressed field array indicating where each compressed field array is stored in said memory;
program code for organizing and storing in a memory each compressed field array;
program code for storing location data in a file header of each compressed field array indicating where each compressed field array is stored in said memory;
program code for implementing an interface allowing access to a first subset of field arrays of a set of field arrays based on a user request, wherein said first subset of requested field arrays includes a lower number of field arrays than said set of field arrays, and
program code for selectively decompressing, by said processor, said first subset of requested field arrays based on said user request.
9. The non-transitory computer-readable storage medium of claim 8 , further comprising program code for creating an index file, wherein said index file contains metadata describing the content of said memory.
10. The non-transitory computer-readable storage medium of claim 9 , wherein said metadata includes text that is searchable.
11. The non-transitory computer-readable storage medium of claim 8 , wherein said LiDAR output data is in LAS file format.
12. The non-transitory computer-readable storage medium of claim 8 , wherein said one or more data compression techniques is selected from the group consisting of byte run length encoding, Boolean run length encoding, delta encoding, float to integer scaling, byte packing, and byte splitting.
13. The non-transitory computer-readable storage medium of claim 8 , further comprising program code for storing each field array is in a column first format.
14. A non-transitory computer-readable storage medium containing program code comprising:
program code for receiving Light Detection and Ranging (LiDAR) output data containing point data information comprising a plurality of data points;
program code for separating and arranging the point data information, by a processor, into a plurality of fields based on predetermined parameters, wherein each field comprises an array of values;
program code for compressing the point data information in each field array, by said processor, by one or more data compression techniques;
program code for organizing and storing in a memory each compressed field array, wherein the memory is allocated to only non-zero point data information, incorporating null pointers for any non-populated fields;
program code for implementing an interface allowing access to a first subset of field arrays of a set of field arrays based on a user request, wherein said first subset of requested field arrays includes a lower number of field arrays than said set of field arrays, and
program code for selectively decompressing, by said processor, said first subset of requested field arrays based on said user request.