Management of database migration
View Patent ↗Methods, systems, and apparatus, are described, including computer programs encoded on a computer storage medium, for managing migration of data. The methods, systems, and apparatus may include actions of enabling a server to operate in different states. Generally, the different states of the server may enable code on client devices to be gradually updated from using data stored in an old database to using data stored in a new database in a different format, while enabling the server to continue responding to requests for data from client devices.
1. A computer-implemented method comprising:
receiving, by a server and from a client device, a request to migrate data from a first data store in a first structure format to a different, second data store in a different, second data structure format;
accessing, by the server, the data in the first data store based on the received request to migrate the data;
storing, by the server, the data accessed in the first data store in the second data store;
determining, by the server, that the server has completed storing the data in the second data store, wherein when the server has completed storing the data in the second data store the server is in a first state where the server (i) exposes data from the first data store to the client device, (ii) does not expose data from the second data store to the client device, and (iii) replicates changes in the first data store to the second data store;
receiving, by the server and from a user, a request to place the server in the second state, wherein while in the second state the server (i) exposes data from the first data store to the client device, (ii) exposes data from the second data store to the client device, (iii) replicates changes in the first data store to the second data store, and (iv) replicates changes in the second data store to the first data store;
in response to receiving, by the server, the request to place the server in the second state, placing, by the server, the server in the second state;
replicating, by the server while in the second state, changes in the first data store to the second data store;
replicating, by the server while in the second state, changes in the second data store to the first data store;
obtaining, by the server while in the second state, data for responding to a user request, wherein the data for responding to the user request is obtained from the first data store or the second data store without downtime that interrupts a service function of the server that is used for responding to user requests, based on the server replicating changes: (i) in the first data store to the second data store, and (ii) in the second data store to the first data store;
providing, by the server, the data obtained from the first data store or the second data store as a response to the user request;
receiving, by the server, a request to place the server in a third state, wherein while in the third state the server (i) does not expose data from the first data store to the client device, (ii) exposes data from the second data store to the client device, and (iii) replicates changes in the second data store to the first data store; and
placing the server in the third state.
2. The method of claim 1 , further comprising:
receiving a request for data from the second data store;
determining that the server is in the first state; and
in response to determining that the server is in the first state, providing an indication that data from the second data store is not available.
3. The method of claim 2 , wherein placing the server in the third state comprises deleting the first data store.
4. The method of claim 1 , further comprising:
receiving a request for data from the first data store;
determining that the server is in the third state; and
in response to determining that the server is in the third state, providing an indication that data from the first data store is not available.
5. The method of claim 1 , wherein in the second state, the server intercepts requests to change data stored in the first data store and generates a corresponding request to change data stored in the second data store.
6. The method of claim 1 , wherein in the second state the server intercepts requests to change data stored in the second data store and generates a corresponding request to change data stored in the first data store.
7. The method of claim 1 , wherein the first structure format includes fields with single values and the second structure format includes corresponding fields with multiple values.
8. The method of claim 7 , wherein storing the data in the second data store comprises storing the data according to one or more migration rules that specify the fields in the first structure format that correspond to the fields in the second structure format.
9. A system comprising:
one or more computers; and
one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
receiving, by a server and from a client device, a request to migrate data from a first data store in a first structure format to a different, second data store in a different, second structure format;
accessing, by the server, the data in the first data store based on the received request to migrate the data;
storing, by the server, the data accessed in the first data store in the second data store;
determining, by the server, that the server has completed storing the data in the second data store, wherein when the server has completed storing the data in the second data store the server is in a first state where the server (i) exposes data from the first data store to the client device, (ii) does not expose data from the second data store to the client device, and (iii) replicates changes in the first data store to the second data store;
receiving, by the server and from a user, a request to place the server in the second state, wherein while in the second state the server (i) exposes data from the first data store to the client device, (ii) exposes data from the second data store to the client device, (iii) replicates changes in the first data store to the second data store, and (iv) replicates changes in the second data store to the first data store;
in response to receiving, by the server, the request to place the server in the second state, placing, by the server, the server in the second state;
replicating, by the server while in the second state, changes in the first data store to the second data store;
replicating, by the server while in the second state, changes in the second data store to the first data store;
obtaining, by the server while in the second state, data for responding to a user request, wherein the data for responding to the user request is obtained from the first data store or the second data store without downtime that interrupts a service function of the server that is used for responding to user requests, based on the server replicating changes: (i) in the first data store to the second data store, and (ii) in the second data store to the first data store;
providing, by the server, the data obtained from the first data store or the second data store as a response to the user request;
receiving, by the server, a request to place the server in a third state, wherein while in the third state the server (i) does not expose data from the first data store to the client device, (ii) exposes data from the second data store to the client device, and (iii) replicates changes in the second data store to the first data store; and
placing, by the server, the server in the third state.
10. The system of claim 9 , the operations further comprising:
receiving a request for data from the second data store;
determining that the server is in the first state; and
in response to determining that the server is in the first state, providing an indication that data from the second data store is not available.
11. The system of claim 10 , wherein placing the server in the third state comprises deleting the first data store.
12. The system of claim 9 , the operations further comprising:
receiving a request for data from the first data store;
determining that the server is in the third state; and
in response to determining that the server is in the third state, providing an indication that data from the first data store is not available.
13. The system of claim 9 , wherein in the second state, the server intercepts requests to change data stored in the first data store and generates a corresponding request to change data stored in the second data store.
14. The system of claim 9 , wherein in the second state the server intercepts requests to change data stored in the second data store and generates a corresponding request to change data stored in the first data store.
15. The system of claim 9 , wherein the first structure format includes fields with single values and the second structure format includes corresponding fields with multiple values.
16. The system of claim 15 , wherein storing the data in the second data store comprises storing the data according to one or more migration rules that specify the fields in the first structure format that correspond to the fields in the second structure format.
17. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
receiving, by a server and from a client device, a request to migrate data from a first data store in a first structure format to a different, second data store in a different, second structure format;
accessing, by the server, the data in the first data store based on the received request to migrate the data;
storing, by the server, the data accessed in the first data store in the second data store;
determining, by the server, that the server has completed storing the data in the second data store, wherein when the server has completed storing the data in the second data store the server is in a first state where the server (i) exposes data from the first data store to the client device, (ii) does not expose data from the second data store to the client device, and (iii) replicates changes in the first data store to the second data store;
receiving, by the server and from a user, a request to place the server in the second state, wherein while in the second state the server (i) exposes data from the first data store to the client device, (ii) exposes data from the second data store to the client device, (iii) replicates changes in the first data store to the second data store, and (iv) replicates changes in the second data store to the first data store;
in response to receiving, by the server, the request to place the server in the second state, placing, by the server, the server in the second state;
replicating, by the server while in the second state, changes in the first data store to the second data store;
replicating, by the server while in the second state, changes in the second data store to the first data store;
obtaining, by the server while in the second state, data for responding to a user request, wherein the data for responding to the user request is obtained from the first data store or the second data store without downtime that interrupts a service function of the server that is used for responding to user requests, based on the server replicating changes: (i) in the first data store to the second data store, and (ii) in the second data store to the first data store; and
providing, by the server, the data obtained from the first data store or the second data store as a response to the user request;
receiving, by the server, a request to place the server in a third state, wherein while in the third state the server (i) does not expose data from the first data store to the client device, (ii) exposes data from the second data store to the client device, and (iii) replicates changes in the second data store to the first data store; and
placing, by the server, the server in the third state.
18. The medium of claim 17 , the operations further comprising:
receiving a request for data from the second data store;
determining that the server is in the first state; and
in response to determining that the server is in the first state, providing an indication that data from the second data store is not available.
19. The medium of claim 17 the operations further comprising:
receiving a request for data from the first data store;
determining that the server is in the third state; and
in response to determining that the server is in the third state, providing an indication that data from the first data store is not available.
20. The medium of claim 17 , wherein in the second state, the server intercepts requests to change data stored in the first data store and generates a corresponding request to change data stored in the second data store.