IP Library Granted Patent US 10,083,057
Granted Patent B1
US 10,083,057 · App. 15/083,843 · Granted Sep 25, 2018

Migration of active virtual machines across multiple data centers

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,083,057
App. No.
15/083,843
Granted
Sep 25, 2018
Kind
B1
Abstract

A method of providing migration of active virtual machines by performing data migrations between data centers using distributed volume and stretched cluster mechanisms to migrate the data synchronously within the distance and time latency limits defined by the distributed volume protocol, then performing data migrations within data centers using local live migration, and for long distance data migrations on a scale or distance that may exceed synchronous limits of the distributed volume protocol, combining appropriate inter- and intra-site data migrations so that data migrations can be performed exclusively using synchronous transmission.

Claims (29)

1. A computer-implemented method for performing multi-site migration of active virtual machines, comprising:

performing inter-site data migrations among a plurality of data centers separated by metropolitan-scale distances using a distributed volume system and a stretched cluster system to migrate the data synchronously within a distance and time latency limits defined by the distributed volume protocol;

wherein the distributed volume system comprises a clustered system using a distributed virtual volume as network storage media for the data migrations, wherein a cluster comprises a plurality of highly available and fully redundant enterprise-scale backup engines, each supporting on the order of thousands of virtual volumes that are accessible by all data centers of the plurality of data centers;

wherein the inter-site data migrations are performed by setting up distributed virtual volumes between pairs of data centers of the plurality of data centers to form migratable data clusters, and deploying pairs of migratable clusters as relay stations between each pair of distributed virtual volumes to link three data centers through the pair of distributed virtual volumes;

performing intra-site data migrations within each data center of the data centers using local live migration; and

combining the inter-site data migrations using the migratable cluster relay stations and the intra-site data migrations such that that data migrations among the plurality of data centers can be performed exclusively using synchronous transmission even if a distance between source and target data centers exceeds synchronous limits of the distributed volume protocol.

2. The method of claim 1 wherein the stretched volume system comprises a metro-scale virtualization system for storage clusters of the clustered system.

3. The method of claim 2 wherein the local live migration comprises a system encapsulating an entire state of a virtual machine by a set of files stored on the network storage media and transferring an execution state of the virtual machine rapidly from a source computer server to a destination server computer.

4. The method of claim 1 wherein the distributed virtual volumes between pairs of data centers of the plurality of data centers effectively form a single distributed virtual volume accessible by all data centers of the plurality of data centers.

5. The method of claim 1 wherein the synchronous limits comprise at least one of a distance exceeding 100 kilometers, or a round-trip time of data transfer in excess of 10 milliseconds.

6. The method of claim 1 further comprising performing at least one routing optimization, load balancing, or least distance algorithm to optimize the combining of the inter-site and intra-site data migrations.

7. A system configured to perform multi-site migration of active virtual machines in a large-scale network, comprising:

a plurality of physical storage devices configured to store data of the active virtual machines during the multi-site migration;

a backup server computer coupled to the physical storage devices performing inter-site data migrations among a plurality of data centers separated by metropolitan-scale distances using a distributed volume system and a stretched cluster system to migrate the data synchronously within a distance and time latency limits defined by the distributed volume protocol;

wherein the distributed volume system comprises a clustered system using a distributed virtual volume as network storage media for the data migrations, wherein a cluster comprises a plurality of highly available and fully redundant enterprise-scale backup engines, each supporting on the order of thousands of virtual volumes that are accessible by all data centers of the plurality of data centers; and

wherein the inter-site data migrations are performed by setting up distributed virtual volumes between pairs of data centers of the plurality of data centers to form migratable data clusters, and deploying pairs of migratable clusters as relay stations between each pair of distributed virtual volumes to link three data centers through the pair of distributed virtual volumes; and

a backup component performing intra-site data migrations within each data center of the data centers using local live migration, and combining the inter-site data migrations using the migratable cluster relay stations and the intra-site data migrations such that that data migrations among the plurality of data centers can be performed exclusively using synchronous transmission even if a distance between source and target data centers exceeds synchronous limits of the distributed volume protocol.

8. The system of claim 7 wherein the stretched volume system comprises a metro-scale virtualization system for storage clusters of the clustered system.

9. The system of claim 8 wherein the local live migration comprises a system encapsulating an entire state of a virtual machine by a set of files stored on the network storage media and transferring an execution state of the virtual machine rapidly from a source computer server to a destination server computer.

10. The system of claim 7 wherein the distributed virtual volumes between pairs of data centers of the plurality of data centers effectively form a single distributed virtual volume accessible by all data centers of the plurality of data centers.

11. The system of claim 7 wherein the synchronous limits comprise at least one of a distance exceeding 100 kilometers, or a round-trip time of data transfer in excess of 10 milliseconds.

12. The system of claim 7 further comprising an optimization component performing at least one routing optimization, load balancing, or least distance algorithm to optimize the combining of the inter-site and intra-site data migrations.

13. A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to perform multi-site migration of active virtual machines by executing instructions implementing a method comprising:

performing inter-site data migrations among a plurality of data centers separated by metropolitan-scale distances using a distributed volume system and a stretched cluster system to migrate the data synchronously within the distance and time latency limits defined by the distributed volume protocol;

wherein the distributed volume system comprises a clustered system using a distributed virtual volume as network storage media for the data migrations, wherein a cluster comprises a plurality of highly available and fully redundant enterprise-scale backup engines, each supporting on the order of thousands of virtual volumes that are accessible by all data centers of the plurality of data centers; and

wherein the inter-site data migrations are performed by setting up distributed virtual volumes between pairs of data centers of the plurality of data centers to form migratable data clusters, and deploying pairs of migratable clusters as relay stations between each pair of distributed virtual volumes to link three data centers through the pair of distributed virtual volumes; and

performing intra-site data migrations within each data center of the data centers using local live migration; and

combining the inter-site data migrations using the migratable cluster relay stations and the intra-site data migrations such that that data migrations among the plurality of data centers can be performed exclusively using synchronous transmission even if a distance between source and target data centers exceeds synchronous limits of the distributed volume protocol.

14. The computer-program product of claim 13 wherein the method further comprises performing at least one routing optimization, load balancing, or least distance algorithm to optimize the combining of the inter-site and intra-site data migrations.

Assignments (4)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2017
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 041872/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2016
From: CURRIE, JOHN; MITCHELL, JR., DANIEL E
To: EMC CORPORATION
Reel/Frame 039228/0899 →
Cited By (1)
US 12,265,855