Error tables to track errors associated with a base table
Techniques for creating and using error tables to track errors associated with a base table are described. A command to perform an operation on a base table stored in a network-based data system can be received and executed, causing at least one error. At least one error record corresponding to the at least one error can be inputted into an error table, which is nested with the base table. Contextual information can be added to the at least one error record.
1. A method comprising:
receiving, by at least one hardware processor, a command to perform an operation on a base table stored in a network-based data system;
executing the operation on the base table, the execution of the operation causing at least one error;
inputting at least one error record corresponding to the at least one error into an error table, the error table being nested with the base table including that the base table is provided as a parent object and the error table is provided as a child object to the base table in the network-based data system; and
adding contextual information to the at least one error record.
2. The method of claim 1 , further comprising:
receiving a query directed to the error table; and
executing the query to provide information about the at least one error record.
3. The method of claim 2 , further comprising:
performing a recovery action based on the information about the at least one error record; and
re-executing the operation on at least one row in the base table corresponding to the at least one error record.
4. The method of claim 3 , further comprising:
determining that the re-executing the operation is successful; and
deleting the at least one error record from the error table.
5. The method of claim 1 , wherein the operation includes auto-ingestion of data in a file from an external location into the base table.
6. The method of claim 1 , wherein the operation includes performing an action on an external table stored outside of the data system.
7. The method of claim 6 , wherein the base table is an object stored in the data system representing the external table.
8. The method of claim 1 , wherein the base table includes a materialized view.
9. A non-transitory machine-storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
receiving a command to perform an operation on a base table stored in a network-based data system;
executing the operation on the base table, the execution of the operation causing at least one error;
inputting at least one error record corresponding to the at least one error into an error table, the error table being nested with the base table including that the base table is provided as a parent object and the error table is provided as a child object to the base table in the network-based data system; and
adding contextual information to the at least one error record.
10. The non-transitory machine-storage medium of claim 9 , further comprising:
receiving a query directed to the error table; and
executing the query to provide information about the at least one error record.
11. The non-transitory machine-storage medium of claim 10 , further comprising:
performing a recovery action based on the information about the at least one error record; and
re-executing the operation on at least one row in the base table corresponding to the at least one error record.
12. The non-transitory machine-storage medium of claim 11 , further comprising:
determining that the re-executing the operation is successful; and
deleting the at least one error record from the error table.
13. The non-transitory machine-storage medium of claim 9 , wherein the operation includes auto-ingestion of data in a file from an external location into the base table.
14. The non-transitory machine-storage medium of claim 9 , wherein the operation includes performing an action on an external table stored outside of the data system.
15. The non-transitory machine-storage medium of claim 14 , wherein the base table is an object stored in the data system representing the external table.
16. The non-transitory machine-storage medium of claim 9 , wherein the base table includes a materialized view.
17. A system comprising:
at least one hardware processor; and
at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising:
receiving a command to perform an operation on a base table stored in a network-based data system;
executing the operation on the base table, the execution of the operation causing at least one error;
inputting at least one error record corresponding to the at least one error into an error table, the error table being nested with the base table including that the base table is provided as a parent object and the error table is provided as a child object to the base table in the network-based data system; and
adding contextual information to the at least one error record.
18. The system of claim 17 , further comprising:
receiving a query directed to the error table; and
executing the query to provide information about the at least one error record.
19. The system of claim 18 , further comprising:
performing a recovery action based on the information about the at least one error record; and
re-executing the operation on at least one row in the base table corresponding to the at least one error record.
20. The system of claim 19 , further comprising:
determining that the re-executing the operation is successful; and
deleting the at least one error record from the error table.
21. The system of claim 17 , wherein the operation includes auto-ingestion of data in a file from an external location into the base table.
22. The system of claim 17 , wherein the operation includes performing an action on an external table stored outside of the data system.
23. The system of claim 22 , wherein the base table is an object stored in the data system representing the external table.
24. The system of claim 17 , wherein the base table includes a materialized view.