IP Library › Granted Patent US 11,030,213

Granted Patent B2

US 11,030,213 · App. 16/672,573 · Granted Jun 8, 2021

Transforming data structures and data objects for migrating data between databases having different schemas

Inventors: Tao Huang (Bellevue, WA); Sriharsha Jana (Seattle, WA)

Assignee: Bank of America Corporation

G06F16/258 G06F16/214 G06F16/24554

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,030,213
App. No.: 16/672,573
Granted: Jun 8, 2021
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Aspects of the disclosure relate to transforming data structures and data objects. A computing platform may query a logical view of a data table associated with a first database maintained by a first database server in a first schema and may receive source data associated with the logical view. Subsequently, the computing platform may split the source data into a plurality of data chunks associated with the logical view. Next, the computing platform may move the plurality of data chunks to a plurality of nodes configured to receive and transform the plurality of data chunks from the first schema to a second schema different from the first schema. Then, the computing platform may command the plurality of nodes to transform the plurality of data chunks and may move the transformed data from the plurality of nodes to a second database maintained by a second database server in the second schema.

Claims (63)

1. A computing platform, comprising:

at least one processor;

a communication interface communicatively coupled to the at least one processor; and

memory storing computer-readable instructions that, when executed by the at least one processor, cause the computing platform to:

query a logical view of a data table associated with a first database maintained by a first database server in a first schema;

responsive to querying the logical view of the data table associated with the first database maintained by the first database server in the first schema, receive, via the communication interface, from the first database server, source data associated with the logical view;

split the source data associated with the logical view to produce a plurality of data chunks associated with the logical view;

move the plurality of data chunks associated with the logical view to a plurality of nodes associated with the computing platform;

command the plurality of nodes associated with the computing platform to transform the plurality of data chunks associated with the logical view to produce transformed data; and

move the transformed data from the plurality of nodes associated with the computing platform to a second database maintained by a second database server in a second schema different from the first schema,

wherein splitting the source data associated with the logical view to produce the plurality of data chunks associated with the logical view comprises identifying one or more available nodes and determining a uniform size of the plurality of data chunks associated with the logical view based on the one or more available nodes,

wherein a numerical column included in the logical view of the data table associated with the first database maintained by the first database server provides an index indicative of a total size of the source data associated with the logical view, and

wherein splitting the source data associated with the logical view to produce the plurality of data chunks associated with the logical view comprises splitting the source data associated with the logical view based on the numerical column to balance processing load across the one or more available nodes.

2. The computing platform of claim 1 , wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, cause the computing platform to:

prior to querying the logical view of the data table associated with the first database maintained by the first database server in the first schema:

receive, via the communication interface, from an administrative computing device, a data migration command;

responsive to receiving the data migration command from the administrative computing device, generate a view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server; and

send, via the communication interface, to the first database server, the view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server.

3. The computing platform of claim 2 , wherein the view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server is configured to cause the first database server to execute a script that creates the logical view of the data table associated with the first database maintained by the first database server.

4. The computing platform of claim 1 , wherein the first schema is a relational database schema.

5. The computing platform of claim 4 , wherein the second schema is a non-relational database schema.

6. The computing platform of claim 1 , wherein the plurality of nodes associated with the computing platform are configured to process the plurality of data chunks associated with the logical view in parallel.

7. The computing platform of claim 1 , wherein commanding the plurality of nodes associated with the computing platform to transform the plurality of data chunks associated with the logical view to produce the transformed data comprises initiating a data transformation process at the plurality of nodes associated with the computing platform and directing the plurality of nodes associated with the computing platform to transfer the transformed data to the second database maintained by the second database server when the data transformation process is completed.

8. The computing platform of claim 1 , wherein moving the transformed data from the plurality of nodes associated with the computing platform to the second database maintained by the second database server comprises moving the transformed data from the plurality of nodes associated with the computing platform to the second database maintained by the second database server using at least one application programming interface function call provided by the second database server.

9. A method, comprising:

at a computing platform comprising at least one processor, memory, and a communication interface:

querying, by the at least one processor, a logical view of a data table associated with a first database maintained by a first database server in a first schema;

responsive to querying the logical view of the data table associated with the first database maintained by the first database server in the first schema, receiving, by the at least one processor, via the communication interface, from the first database server, source data associated with the logical view;

splitting, by the at least one processor, the source data associated with the logical view to produce a plurality of data chunks associated with the logical view;

moving, by the at least one processor, the plurality of data chunks associated with the logical view to a plurality of nodes associated with the computing platform;

commanding, by the at least one processor, the plurality of nodes associated with the computing platform to transform the plurality of data chunks associated with the logical view to produce transformed data; and

moving, by the at least one processor, the transformed data from the plurality of nodes associated with the computing platform to a second database maintained by a second database server in a second schema different from the first schema,

10. The method of claim 9 , comprising:

prior to querying the logical view of the data table associated with the first database maintained by the first database server in the first schema:

receiving, by the at least one processor, via the communication interface, from an administrative computing device, a data migration command;

responsive to receiving the data migration command from the administrative computing device, generating, by the at least one processor, a view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server; and

sending, by the at least one processor, via the communication interface, to the first database server, the view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server.

11. The method of claim 10 , wherein the view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server is configured to cause the first database server to execute a script that creates the logical view of the data table associated with the first database maintained by the first database server.

12. The method of claim 9 , wherein the first schema is a relational database schema.

13. The method of claim 12 , wherein the second schema is a non-relational database schema.

14. The method of claim 9 , wherein the plurality of nodes associated with the computing platform are configured to process the plurality of data chunks associated with the logical view in parallel.

15. The method of claim 9 , wherein commanding the plurality of nodes associated with the computing platform to transform the plurality of data chunks associated with the logical view to produce the transformed data comprises initiating a data transformation process at the plurality of nodes associated with the computing platform and directing the plurality of nodes associated with the computing platform to transfer the transformed data to the second database maintained by the second database server when the data transformation process is completed.

16. The method of claim 9 , wherein moving the transformed data from the plurality of nodes associated with the computing platform to the second database maintained by the second database server comprises moving the transformed data from the plurality of nodes associated with the computing platform to the second database maintained by the second database server using at least one application programming interface function call provided by the second database server.

17. One or more non-transitory computer-readable media storing instructions that, when executed by a computing platform comprising at least one processor, memory, and a communication interface, cause the computing platform to:

query a logical view of a data table associated with a first database maintained by a first database server in a first schema;

split the source data associated with the logical view to produce a plurality of data chunks associated with the logical view;

move the plurality of data chunks associated with the logical view to a plurality of nodes associated with the computing platform;

command the plurality of nodes associated with the computing platform to transform the plurality of data chunks associated with the logical view to produce transformed data; and

18. The one or more non-transitory computer-readable media of claim 17 , storing additional instructions that, when executed by the computing platform, cause the computing platform to:

prior to querying the logical view of the data table associated with the first database maintained by the first database server in the first schema:

receive, via the communication interface, from an administrative computing device, a data migration command;

19. The one or more non-transitory computer-readable media of claim 18 , wherein the view command directing the first database server to create the logical view of the data table associated with the first database maintained by the first database server is configured to cause the first database server to execute a script that creates the logical view of the data table associated with the first database maintained by the first database server.

20. The one or more non-transitory computer-readable media of claim 17 , wherein the first schema is a relational database schema, and wherein the second schema is a non-relational database schema.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2019

From: HUANG, TAO; JANA, SRIHARSHA

To: BANK OF AMERICA CORPORATION

Reel/Frame 050901/0879 →

Continuity (2)

Continuation 15454471 · Mar 9, 2017

Related Publication 20200065315A1 · Feb 27, 2020