Methods and systems for recursive descent parsing
Methods, systems, and devices for parsing text are described herein. A method of securing executable files is performed at a computing device having one or more processors and memory. The memory stories one or more programs configured for execution by the one or more processors. The computing device obtains source text that comprises a disassembled executable file and identifies, via a general parser module, the syntax of the source text by performing a recursive descent parsing of the source text. The device generates an abstract syntax tree (AST) for the source text based on the identified syntax and generates a transformed AST from the generated AST by replacing one or more system calls with respective protected system functions. The device also generates a secured executable file by assembling the transformed AST.
1. A method of securing executable files, performed at a computing device having one or more processors and memory storing one or more programs configured for execution by the one or more processors, the method comprising:
receiving an executable file;
disassembling the executable file to form source text;
identifying syntax of the source text by performing a recursive descent parsing of the source text, including matching grammar rules to the source text;
generating an abstract syntax tree (AST) for the source text based on the identified syntax;
generating a transformed AST from the generated AST by replacing each of one or more calls to kernel system functions with a respective call to a respective protected system function that performs security checks and calls the respective kernel system function when the security checks are passed; and
generating a secured executable file by assembling the transformed AST.
2. The method of claim 1 , wherein identifying the syntax of the source text further comprises:
recognizing a plurality of language tokens in the source text; and
recognizing corresponding identifier strings for the plurality of language tokens, wherein the syntax of the source text is identified based on the plurality of language tokens and the corresponding identifier strings.
3. The method of claim 1 , further comprising storing the AST to a file having a secure protocol format.
4. The method of claim 3 , further comprising:
reconstructing the AST in memory from the file having the secure protocol format.
5. The method of claim 3 , wherein the file is a binary file.
6. The method of claim 1 , wherein identifying the syntax of the source text further comprises identifying one or more structural statements and one or more substructural statements in the source text.
7. The method of claim 6 , wherein generating the AST comprises identifying a respective production rule for each of one or more structural statements.
8. The method of claim 1 , wherein the transformed AST is digitally signed prior to assembly.
9. The method of claim 1 , wherein the one or more calls to kernel system functions comprise a first call to a file and a second call to a socket.
10. A computing device, comprising:
one or more processors;
memory; and
one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs comprising instructions for:
receiving an executable file;
disassembling the executable file to form source text;
identifying syntax of the source text by performing a recursive descent parsing of the source text, including matching grammar rules to the source text;
generating an abstract syntax tree (AST) for the source text based on the identified syntax;
generating a transformed AST from the generated AST by replacing each of one or more calls to kernel system functions with a respective call to a respective protected system function that performs security checks and calls the respective kernel system function when the security checks are passed; and
generating a secured executable file by assembling the transformed AST.
11. The computing device of claim 10 , wherein identifying the syntax of the source text further comprises:
recognizing a plurality of language tokens in the source text; and
recognizing corresponding identifier strings for the plurality of language tokens, wherein the syntax of the source text is identified based on the plurality of language tokens and the corresponding identifier strings.
12. The computing device of claim 10 , wherein the one or more programs further comprise instructions for storing the AST to a file having a secure protocol format.
13. The computing device of claim 10 , wherein identifying the syntax of the source text further comprises identifying one or more structural statements and one or more substructural statements in the source text.
14. The computing device of claim 13 , wherein generating the AST comprises identifying a respective production rule for each of one or more structural statements.
15. The computing device of claim 10 , wherein the transformed AST is digitally signed prior to assembly.
16. A non-transitory computer-readable storage medium storing one or more programs configured for execution by a computing device having one or more processors and memory, the one or more programs comprising instructions for:
receiving an executable file;
disassembling the executable file to form source text;
identifying syntax of the source text by performing a recursive descent parsing of the source text, including matching grammar rules to the source text;
generating an abstract syntax tree (AST) for the source text based on the identified syntax;
generating a transformed AST from the generated AST by replacing each of one or more calls to kernel system functions with a respective call to a respective protected system function that performs security checks and calls the respective kernel system function when the security checks are passed; and
generating a secured executable file by assembling the transformed AST.
17. The non-transitory computer-readable storage medium of claim 16 , wherein identifying the syntax of the source text further comprises:
recognizing a plurality of language tokens in the source text; and
recognizing corresponding identifier strings for the plurality of language tokens, wherein the syntax of the source text is identified based on the plurality of language tokens and the corresponding identifier strings.
18. The non-transitory computer-readable storage medium of claim 16 , wherein the one or more programs further comprise instructions for storing the AST to a file having a secure protocol format.
19. The non-transitory computer-readable storage medium of claim 16 , wherein identifying the syntax of the source text further comprises identifying one or more structural statements and one or more substructural statements in the source text.
20. The non-transitory computer-readable storage medium of claim 19 , wherein generating the AST comprises identifying a respective production rule for each of one or more structural statements.