Granted Patent B2

US 12,554,711 · App. 18/589,670 · Granted Feb 17, 2026

Inventors: Lin Luo (Carp, CA); Yong Wang (Pointe Claire, CA); Laszlo Toeroek (Toronto, CA); Boris Kuschel (Gatineau, CA); Ian Fraser Watts (Stouffville, CA)

Assignee: International Business Machines Corporation

G06F16/24534G06Q10/067

Abstract

Claims (91)

1 . A computer-implemented method comprising:

receiving an input query in a pipeline query language;

receiving, from an external configuration file that defines at least one customized transformation query rule supplied by a user;

detecting a pipeline dialect of the input query;

validating the input query using the pipeline dialect by a pipeline processor of a pipeline query transformation system;

parsing the input query into pipeline operators;

processing the pipeline operators using the pipeline dialect by the pipeline processor;

generating a query context for each of the pipeline operators;

generating an SQL query from the query context of each of the pipeline operators;

applying the at least one customized transformation query rule to at least one pipeline operator to generate customized SQL operators, wherein the customized SQL operators are added to the query context and used in generating the SQL query; and

executing the SQL query, wherein the SQL query is SQL representation of the input query.

2 . The computer-implemented method of claim 1 , wherein processing the pipeline operators comprises:

determining that a pipeline operator of the pipeline operators is a data source;

initializing the query context; and

in response to determining the pipeline operator has a source argument, transforming the source argument to a new query context by invoking a new pipeline processor.

3 . The computer-implemented method of claim 1 , wherein processing the pipeline operators comprises:

determining that a pipeline operator of the pipeline operators is a query context producer;

generating SQL operators from the pipeline operator;

generating a new query context comprising the query context and the SQL operators embedded as sources; and

replacing the query context with the new query context.

4 . The computer-implemented method of claim 1 , wherein processing the pipeline operators comprises:

determining that a pipeline operator of the pipeline operators is a query context decorator;

generating SQL operators from the pipeline operator; and

modifying the query context using the SQL operators.

5 . The computer-implemented method of claim 1 , further comprising:

generating customized SQL operators for a pipeline operator of the pipeline operators using a customized transformation query rule; and

adding the customized SQL operators to the query context.

6 . The computer-implemented method of claim 1 , further comprising:

selecting the pipeline dialect for the pipeline processor.

7 . The computer-implemented method of claim 1 , wherein the query context is a query representation that produces a tabular data output when executed.

8 . A system comprising:

a non-transitory memory having computer readable instructions; and

one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:

receiving an input query in a pipeline query language;

receiving, from an external configuration file that defines at least one customized transformation query rule supplied by a user,

detecting a pipeline dialect of the input query;

validating the input query using the pipeline dialect by a pipeline processor of a pipeline query transformation system;

parsing the input query into pipeline operators;

processing the pipeline operators using the pipeline dialect by the pipeline processor;

generating a query context for each of the pipeline operators;

generating an SQL query from the query context of each of the pipeline operators;

applying the at least one customized transformation query rule to at least one pipeline operator to generate customized SQL operators, wherein the customized SQL operators are added to the query context and used in generating the SQL query; and

executing the SQL query, wherein the SQL query is SQL representation of the input query.

9 . The system of claim 8 , wherein the operations to process the pipeline operators further comprise:

determining that a pipeline operator of the pipeline operators is a data source;

initializing the query context; and

in response to determining the pipeline operator has a source argument, transforming the source argument to a new query context by invoking a new pipeline processor.

10 . The system of claim 8 , wherein the operations to process the pipeline operators further comprise:

determining that a pipeline operator of the pipeline operators is a query context producer;

generating SQL operators from the pipeline operator;

generating a new query context comprising the query context and the SQL operators embedded as sources; and

replacing the query context with the new query context.

11 . The system of claim 8 , wherein the operations to process the pipeline operators further comprise:

determining that a pipeline operator of the pipeline operators is a query context decorator;

generating SQL operators from the pipeline operator; and

modifying the query context using the SQL operators.

12 . The system of claim 8 , wherein the operations further comprise:

generating customized SQL operators for a pipeline operator of the pipeline operators using a customized transformation query rule; and

adding the customized SQL operators to the query context.

13 . The system of claim 8 , wherein the operations further comprise:

selecting the pipeline dialect for the pipeline processor.

14 . The system of claim 8 , wherein the query context is a query representation that produces a tabular data output when executed.

15 . A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:

receiving an input query in a pipeline query language;

receiving, from an external configuration file that defines at least one customized transformation query rule supplied by a user;

detecting a pipeline dialect of the input query;

validating the input query using the pipeline dialect by a pipeline processor of a pipeline query transformation system;

parsing the input query into pipeline operators;

processing the pipeline operators using the pipeline dialect by the pipeline processor;

generating a query context for each of the pipeline operators; and

generating an SQL query from the query context of each of the pipeline operators;

applying the at least one customized transformation query rule to at least one pipeline operator to generate customized SQL operators, wherein the customized SQL operators are added to the query context and used in generating the SQL query; and

executing the SQL query, wherein the SQL query is SQL representation of the input query.

16 . The computer program product of claim 15 , wherein the operations to process the pipeline operators further comprise:

determining that a pipeline operator of the pipeline operators is a data source;

initializing the query context; and

in response to determining the pipeline operator has a source argument, transforming the source argument to a new query context by invoking a new pipeline processor.

17 . The computer program product of claim 15 , wherein the operations to process the pipeline operators further comprise:

determining that a pipeline operator of the pipeline operators is a query context producer;

generating SQL operators from the pipeline operator;

generating a new query context comprising the query context and the SQL operators embedded as sources; and

replacing the query context with the new query context.

18 . The computer program product of claim 15 , wherein the operations to process the pipeline operators further comprise:

determining that a pipeline operator of the pipeline operators is a query context decorator;

generating SQL operators from the pipeline operator; and

modifying the query context using the SQL operators.

19 . The computer program product of claim 15 , wherein the operations further comprise:

generating customized SQL operators for a pipeline operator of the pipeline operators using a customized transformation query rule; and

adding the customized SQL operators to the query context.

20 . The computer program product of claim 15 , wherein the operations further comprise:

selecting the pipeline dialect for the pipeline processor.

Assignments (1)

Continuity (1)

References Cited (27)