Database data modification request processing
View Patent ↗A data modification request for modifying data in a primary database is received at the primary database. Based on the data modification request, second data in the primary database is modified to first data. Based on the data modification request, a first log and a second log are generated, where the first log is a simplified log including the first data and the second log is a complete log including the second data. Persistence processing is performed on the first log. A modification result that corresponds to the data modification request is returned.
1. A computer-implemented method, comprising:
receiving, at a primary database storing a plurality of database records each having a respective value, a data modification request for modifying data in the primary database, wherein the data modification request specifies updated values of one or more of the plurality of database records;
modifying, in response to the data modification request, previous values of the one or more of the plurality of database records to have the updated values;
generating, based on the data modification request, a first log that comprises only the updated values of the one or more of the plurality of database records;
generating, based on the data modification request, a second log that comprises at least (i) the previous values of the one or more of the plurality of database records and (ii) the updated values of the one or more of the plurality of database records;
in response to receiving the data modification request, storing the updated values of the one or more of the plurality of database records in the first log and synchronizing the first log to a secondary database before returning a modification result to a user and synchronizing the previous values of the one or more of the plurality of database records in the second log to the secondary database only after returning the modification result to the user; and
returning the modification result to the user that is indicative of having successfully modified the data in the primary database in response to receiving the data modification request.
2. The computer-implemented method of claim 1 , wherein the data modification request comprises at least one of a data update request, a data deletion request, or a data addition request.
3. The computer-implemented method of claim 1 , wherein the first log and the second log are generated in a memory, and wherein the first log and the second log are in a transient and non-stable state.
4. The computer-implemented method of claim 1 , wherein generating the first log further comprises:
recording the first log as a file in a certain format, and
storing the file in a nonvolatile storage device.
5. The computer-implemented method of claim 1 , further comprising:
receiving, by the secondary database, the first log synchronized by the primary database;
performing, by the secondary database, persistence processing on the first log;
performing, by the secondary database, a replay on the first log;
generating, by the secondary database, the second log in a memory through the replay; and
performing, by the secondary database, persistence processing on the second log.
6. The computer-implemented method of claim 1 , further comprising:
detecting, by the primary database, a newly generated second log in a memory;
obtaining the newly generated second log;
performing persistence processing on the newly generated second log; and
sending the newly generated second log to an external data analysis system that is configured to perform real-time or non-real-time analysis of primary database based on the newly generated second log.
7. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:
receiving, at a primary database storing a plurality of database records each having a respective value, a data modification request for modifying data in the primary database, wherein the data modification request specifies updated values of one or more of the plurality of database records;
modifying, in response to the data modification request, previous values of the one or more of the plurality of database records to have the updated values;
generating, based on the data modification request, a first log that comprises only the updated values of the one or more of the plurality of database records;
generating, based on the data modification request, a second log that comprises at least (i) the previous values of the one or more of the plurality of database records and (ii) the updated values of the one or more of the plurality of database records;
in response to receiving the data modification request, storing the updated values of the one or more of the plurality of database records in the first log and synchronizing the first log to a secondary database before returning a modification result to a user and synchronizing the previous values of the one or more of the plurality of database records in the second log to the secondary database only after returning the modification result to the user; and
returning the modification result to the user that is indicative of having successfully modified the data in the primary database in response to receiving the data modification request.
8. The non-transitory, computer-readable medium of claim 7 , wherein the data modification request comprises at least one of a data update request, a data deletion request, or a data addition request.
9. The non-transitory, computer-readable medium of claim 7 , wherein the first log and the second log are generated in a memory, and wherein the first log and the second log are in a transient and non-stable state.
10. The non-transitory, computer-readable medium of claim 7 , wherein generating the first log further comprises:
recording the first log as a file in a certain format, and
storing the file in a nonvolatile storage device.
11. The non-transitory, computer-readable medium of claim 7 , wherein the operations further comprise:
receiving, by the secondary database, the first log synchronized by the primary database;
performing, by the secondary database, persistence processing on the first log;
performing, by the secondary database, a replay on the first log;
generating, by the secondary database, the second log in a memory through the replay; and
performing, by the secondary database, persistence processing on the second log.
12. The non-transitory, computer-readable medium of claim 7 , wherein the operations further comprise:
detecting, by the primary database, a newly generated second log in a memory;
obtaining the newly generated second log;
performing persistence processing on the newly generated second log; and
sending the second log to an external data analysis system that is configured to perform real-time or non-real-time analysis of primary database based on the newly generated second log.
13. A computer-implemented system, comprising:
one or more computers; and
one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations comprising:
receiving, at a primary database storing a plurality of database records each having a respective value, a data modification request for modifying data in the primary database, wherein the data modification request specifies updated values of one or more of the plurality of database records;
modifying, in response to the data modification request, previous values of the one or more of the plurality of database records to have the updated values;
generating, based on the data modification request, a first log that comprises only the updated values of the one or more of the plurality of database records;
generating, based on the data modification request, a second log that comprises at least (i) the previous values of the one or more of the plurality of database records and (ii) the updated values of the one or more of the plurality of database records;
in response to receiving the data modification request, storing the updated values of the one or more of the plurality of database records in the first log and synchronizing the first log to a secondary database before returning a modification result to a user and synchronizing the previous values of the one or more of the plurality of database records in the second log to the secondary database only after returning the modification result to the user; and
returning the modification result to the user that is indicative of having successfully modified the data in the primary database in response to receiving the data modification request.
14. The computer-implemented system of claim 13 , wherein the data modification request comprises at least one of a data update request, a data deletion request, or a data addition request.
15. The computer-implemented system of claim 13 , wherein the first log and the second log are generated in a memory, and wherein the first log and the second log are in a transient and non-stable state.
16. The computer-implemented system of claim 13 , wherein generating the first log further comprises:
recording the first log as a file in a certain format, and
storing the file in a nonvolatile storage device.
17. The computer-implemented system of claim 13 , wherein the operations further comprise:
receiving, by the secondary database, the first log synchronized by the primary database;
performing, by the secondary database, persistence processing on the first log;
performing, by the secondary database, a replay on the first log;
generating, by the secondary database, the second log in a memory through the replay; and
performing, by the secondary database, persistence processing on the second log.
18. The computer-implemented system of claim 13 , wherein the operations further comprise:
detecting, by the primary database, a newly generated second log in a memory;
obtaining the newly generated second log;
performing persistence processing on the newly generated second log; and
sending the newly generated second log to an external data analysis system that is configured to perform real-time or non-real-time analysis of primary database based on the newly generated second log.
19. The method of claim 1 , wherein storing the updated values of the one or more of the plurality of database records in the first log comprises:
performing persistence processing to store the first log in persistent storage.
20. The non-transitory, computer-readable medium of claim 7 , wherein storing the updated values of the one or more of the plurality of database records in the first log comprises:
performing persistence processing to store the first log in persistent storage.
21. The computer-implemented system of claim 13 , wherein storing the updated values of the one or more of the plurality of database records in the first log comprises:
performing persistence processing to store the first log in persistent storage.
22. The method of claim 1 , wherein synchronizing the first log to the secondary database comprises allowing for the secondary database to modify data locally maintained at the secondary database in response to the data modification request received at the primary database.
23. The non-transitory, computer-readable medium of claim 7 , wherein synchronizing the first log to the secondary database comprises allowing for the secondary database to modify data locally maintained at the secondary database in response to the data modification request received at the primary database.
24. The computer-implemented system of claim 13 , wherein synchronizing the first log to the secondary database comprises allowing for the secondary database to modify data locally maintained at the secondary database in response to the data modification request received at the primary database.