Granted Patent B2

US 12,339,829 · App. 17/588,965 · Granted Jun 24, 2025

Inventors: Amit Weisman (Bedford, MA); Cory Christopher James Fantasia (East Walpole, MA); Matthew Douglas Becker (Roslindale, MA); Ian Robert Schechter (Sharon, MA); Edward Alan Bach (Melrose, MA); Robert Parks (Weston, MA)

Assignee: Ab Initio Technology LLC

G06F16/2365G06F16/211G06F16/2358G06F16/258

Abstract

Claims (46)

1. A method, performed by a data processing system, for generating entries in a dataset catalog and/or using the entries in the dataset catalog to enable access to physical datasets in data stores, wherein the data processing system is configured to execute data processing applications programmed to access logical datasets, the method comprising:

creating a plurality of entries in the dataset catalog, each of the plurality of entries being associated with a logical dataset and a physical dataset and having associated therewith computer-executable instructions for accessing the physical dataset;

receiving a first input identifying, at least in part, a first logical dataset for accessing to perform an operation within a data processing application specifying access to a dataset;

upon execution of the operation within the data processing application, invoking the computer-executable instructions for accessing a physical dataset associated with a first entry in the dataset catalog associated with the first logical dataset;

updating one or more of the plurality of entries in the dataset catalog in response to events indicating changes in the physical datasets associated with the logical datasets, wherein updating the one or more of the plurality of entries comprises updating the first entry in the dataset catalog associated with the first logical dataset; and

after updating the first entry in the dataset catalog associated with the first logical dataset:

receiving a second input identifying, at least in part, the first logical dataset for accessing to perform the operation within the data processing application; and

upon execution of the operation within the data processing application, invoking the computer-executable instructions for accessing a physical dataset associated with the updated first entry in the dataset catalog associated with the first logical dataset.

2. The method of claim 1 , wherein creating a plurality of entries in the dataset catalog comprises:

receiving information relating to a first physical dataset of the physical datasets stored in a first data store of the data stores, wherein the first physical dataset corresponds to the first logical dataset;

generating, based on the information relating to the first physical dataset, a first program comprising the computer-executable instructions for accessing the first physical dataset from the first data store; and

storing, in the first entry in the dataset catalog, a link to the first program to enable the data processing application to access the first physical dataset with the first program.

3. The method of claim 2 , wherein generating the first program for accessing the first physical dataset from the first data store comprises:

identifying a type of the first data store from the received information;

selecting a first program template for the type of the first data store; and

populating the first program template with one or more values for one or more parameters of the first program template to generate the first program.

4. The method of claim 1 , wherein receiving input identifying, at least in part, the first logical dataset comprises:

providing an user interface through which a user identifies, at least in part, the first logical dataset.

5. The method of claim 1 , wherein invoking the computer-executable instructions comprises:

enabling access to the first entry, in the dataset catalog, associated with the first logical dataset; and

enabling access, based on information within the first entry, to a data store storing the physical dataset corresponding to the first logical dataset.

6. The method of claim 1 , wherein updating one or more of the plurality of entries in the dataset catalog comprises:

detecting an event indicating a change associated with a physical dataset corresponding to the first logical dataset; and

based on the detection of the event, modifying the first entry in the dataset catalog associated with the first logical dataset.

7. The method of claim 6 , wherein modifying the first entry in the dataset catalog comprises:

modifying the computer-executable instructions for accessing the physical dataset corresponding to the first logical dataset.

8. The method of claim 1 , wherein:

each logical dataset comprises a schema for data independent of a format of corresponding data in a physical dataset, and

the data processing system comprises a dataset multiplexer that is configurable to provide an application with access to the physical datasets in the data stores.

9. A method, performed by a data processing system, for using entries in a dataset catalog to enable an application to access a plurality of physical datasets in a plurality of data stores, the method comprising:

providing an user interface through which a user identifies, at least in part, a logical dataset for accessing in the application;

executing the application and, upon execution of an operation involving access to the identified logical dataset:

accessing an object, in a library of objects, associated with the identified logical dataset; and

accessing, based on information within the object, a data store storing a physical dataset corresponding to the identified logical dataset, wherein:

the information within the object comprises an executable program for accessing the physical dataset, and

accessing the data store comprises accessing the data store storing the physical dataset using the executable program; and

based on an event associated with the storage of data corresponding to the identified logical dataset, updating the information within the object such that subsequent accessing of the data store is performed using the updated information within the object.

10. The method of claim 9 , wherein the information in the object comprises one or more parameters used to access the data store storing the physical dataset, and accessing the data store storing the physical dataset comprises:

executing the executable program using the one or more parameters.

11. The method of claim 10 , wherein the one or more parameters comprise at least one parameter indicating whether data in the physical dataset is compressed, indicating a type of the access, indicating whether data in the physical dataset is encrypted, or specifying criteria for a filter operation on the data.

12. The method of claim 9 , wherein:

the data processing system comprises a repository of metadata relating to logical datasets; and

providing the user interface comprises presenting a menu of logical datasets based on metadata in the repository.

13. The method of claim 9 , wherein:

the data processing system is operable with the application and the plurality of physical datasets stored in the plurality of data stores, and

the application is programmed to access a logical dataset comprising a schema for data independent of a format of corresponding data in a physical dataset.

Assignments (3)

Continuity (3)

References Cited (258)