IP Library Granted Patent US 9,092,493
Granted Patent B2
US 9,092,493 · App. 13/776,425 · Granted Jul 28, 2015

Adaptive warehouse data validation tool

Inventor: Harold Seto (Ottawa, CA)
Assignee: International Business Machines Corporation
G06F17/30563G06F17/30371G06F17/30424
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,092,493
App. No.
13/776,425
Granted
Jul 28, 2015
Kind
B2
Abstract

Techniques for data validation may include dynamically generating one or more database queries to be performed on a target data warehouse and a baseline data warehouse based on warehouse model metadata for the target data warehouse and the baseline data warehouse. The techniques may further include executing the one or more database queries against the target data warehouse and the baseline data warehouse to receive one or more data sets from the baseline data warehouse and one or more data sets from the target data warehouse. The techniques may further include comparing the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse to validate target data in the target data warehouse against baseline data in the baseline data warehouse.

Claims (29)

1. A computer system for validating data in a data warehouse comprising:

one or more processors;

one or more computer-readable memories;

one or more computer-readable tangible storage devices;

program instructions stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories to:

dynamically generate one or more database queries to be performed on a target data warehouse and a baseline data warehouse based on warehouse model metadata for the target data warehouse and the baseline data warehouse, including:

generating one or more queries against the warehouse model metadata,

executing the one or more queries against the warehouse model metadata to extract, from the warehouse model metadata, information regarding a warehouse object, the extracted information indicating one or more dimension tables referenced by a fact table in the warehouse object, and

dynamically generating the one or more database queries based at least in part on the extracted information;

execute the one or more database queries against the target data warehouse and the baseline data warehouse to receive one or more data sets from the baseline data warehouse and one or more data sets from the target data warehouse; and

compare the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse to validate target data in the target data warehouse against baseline data in the baseline data warehouse.

2. The computer system of claim 1 , wherein the baseline data and the target data each includes one or more warehouse objects.

3. The computer system of claim 2 , wherein one or more of the one or more warehouse objects includes the fact table that references the one or more dimension tables.

4. The computer system of claim 3 , wherein compare the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse target data warehouse further comprises:

compare the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse to determine if, for the warehouse object in the target data warehouse, a foreign key for the respective fact table matches a primary key for a dimension table of the one or more dimension tables referenced by the respective fact table.

5. The computer system of claim 3 , wherein for each of the one or more warehouse objects, the warehouse model metadata includes respective one or more of physical object metadata, warehouse object metadata, and reference metadata.

6. A computer program product for validating data in a data warehouse, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code readable/executable by at least one processor to perform a method comprising:

dynamically generating, by the at least one processor, one or more database queries to be performed on a target data warehouse and a baseline data warehouse based on warehouse model metadata for the target data warehouse and the baseline data warehouse, including:

generating one or more queries against the warehouse model metadata,

executing the one or more queries against the warehouse model metadata to extract, from the warehouse model metadata, information regarding a warehouse object, the extracted information indicating one or more dimension tables referenced by a fact table in the warehouse object, and

dynamically generating the one or more database queries based at least in part on the extracted information;

executing, by the at least one processor, the one or more database queries against the target data warehouse and the baseline data warehouse to receive one or more data sets from the baseline data warehouse and one or more data sets from the target data warehouse; and

comparing, by the at least one processor, the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse to validate target data in the target data warehouse against baseline data in the baseline data warehouse.

7. The computer program product of claim 6 , wherein the target data is loaded using a data model that is different from a baseline data model that models the baseline data.

8. The computer program product of claim 6 , wherein the baseline data and the target data each includes one or more warehouse objects.

9. The computer program product of claim 8 , wherein one or more of the one or more warehouse objects includes the fact table that references the one or more dimension tables.

10. The computer program product of claim 9 , wherein comparing the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse target data warehouse further comprises:

comparing, by the at least one processor, the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse to determine if, for the warehouse object in the target data warehouse, a foreign key for the respective fact table matches a primary key for a dimension table of the one or more dimension tables referenced by the respective fact table.

11. The computer program product of claim 9 , wherein for each of the one or more warehouse objects, the warehouse model metadata includes respective one or more of physical object metadata, warehouse object metadata, and reference metadata.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: AIRBNB, INC.
Reel/Frame 056427/0193 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 25, 2013
From: SETO, HAROLD
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 029870/0992 →
Continuity (1)
Related Publication 20140244569A1 · Aug 28, 2014