SYSTEM AND METHOD FOR QUERYING A DATABASE BY INTEGRATING ARTIFICIAL INTELLIGENCE WITH DATA STREAMING
Systems and methods for integrating generative artificial intelligence (AI) with real-time data streaming platforms in distributed computing environments are disclosed. A real-time streaming platform receives a natural language input from a client device, stores a corresponding text request in a topic, and generates a prompt using a processing engine. The prompt is provided to a generative AI system, which generates a structured query language (SQL) query. The SQL query is stored in the topic and executed on a cloud SQL database to obtain an SQL result. The SQL result is stored in the topic and a response based on the SQL result is transmitted to the client device. This approach leverages real-time data streaming, automated prompt generation, and AI-driven query construction to facilitate accurate and timely access to distributed data sources.
1 . A method comprising:
receiving, by a real-time streaming platform, a natural language input from a client device, the natural language input indicating a query to be performed on a SQL database;
storing a text request corresponding to the natural language input in a topic of a storage layer, each topic comprising an unbounded sequence of serialized events;
generating, by a processing engine of the real-time streaming platform, a prompt based on the text request, the prompt being used to prompt a generative artificial intelligence (AI) system to generate a SQL query;
transmitting, by the processing engine, the prompt to the generative AI system;
receiving, by the processing engine, an SQL query generated by the generative AI system based on the prompt;
storing the SQL query to the topic in the storage layer;
triggering, by an SQL executor of the real-time streaming platform, execution of the SQL query on a cloud SQL to obtain an SQL result;
storing the SQL result in the topic of the storage layer; and
transmitting, by the real-time streaming platform, a response to the client device based on the SQL result.
2 . The method of claim 1 , further comprising:
generating, by the generative AI system, a summary of the SQL result prior to transmitting the response to the client device, the response being based on the summary of the SQL result.
3 . The method of claim 2 , further comprising:
storing the summary of the SQL result in the topic; and
converting the summary of the SQL result into an audio file, wherein the response comprises the audio file of the summary of the SQL result.
4 . The method of claim 1 , further comprising:
converting the response from text to audio prior to transmitting the response to the client device.
5 . The method of claim 1 , wherein the natural language input comprises a verbal input, the method further comprising:
storing the verbal input as an audio file in the topic; and
converting, by a text/audio converter, the audio file into the text request.
6 . The method of claim 1 , wherein the natural language input comprises the text request.
7 . The method of claim 1 , wherein:
the generative AI system comprises an external AI system; and
the transmitting of the prompt to the generative AI system comprises making a direct call by the processing engine to the generative AI system.
8 . The method of claim 1 , wherein the prompt describes fields in tables, includes business descriptions for each field, provides an example of an expected SQL query, and specifies an expected result.
9 . The method of claim 1 , wherein generating the prompt comprises tailoring the prompt based on a location associated with the client device.
10 . The method of claim 1 , wherein generating the prompt comprises tailoring the prompt based on the SQL database being targeted.
11 . The method of claim 1 , further comprising:
performing A/B testing of different prompts by replaying events in the real-time streaming platform to improve accuracy and relevance of SQL queries generated by the generative AI system.
12 . The method of claim 1 , further comprising:
replaying, by the real-time streaming platform, a previously executed SQL query to obtain updated SQL results based on newly received data, wherein the replaying is performed at a predetermined later time or at a regular interval.
13 . The method of claim 1 , wherein each of the receiving, storing, generating, triggering, and transmitting is a microservice.
14 . The method of claim 1 , wherein transmitting the response comprises generating and transmitting a user interface or dashboard that displays the SQL result or a summary of the SQL result.
15 . The method of claim 1 , further comprising:
continuously training a prompt model within a prompt component of the processing engine based in part on replayed events to improve prompt accuracy and relevance.
16 . A system comprising:
one or more hardware processors; and
a memory storing instructions that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:
receiving a natural language input from a client device, the natural language input indicating a query to be performed on a SQL database;
storing a text request corresponding to the natural language input in a topic of a storage layer, each topic comprising an unbounded sequence of serialized events;
generating a prompt based on the text request, the prompt being used to prompt a generative artificial intelligence (AI) system to generate a SQL query;
transmitting the prompt to the generative AI system;
receiving an SQL query generated by the generative AI system based on the prompt;
storing the SQL query to the topic in the storage layer;
triggering execution of the SQL query on a cloud SQL to obtain an SQL result;
storing the SQL result in the topic of the storage layer; and
transmitting a response to the client device based on the SQL result.
17 . The system of claim 16 , wherein the operations further comprise:
performing A/B testing of different prompts by replaying events to improve accuracy and relevance of SQL queries generated by the generative AI system.
18 . The system of claim 16 , wherein the operations further comprise:
replaying a previously executed SQL query to obtain updated SQL results based on newly received data, wherein the replaying is performed at a predetermined later time or at a regular interval.
19 . The system of claim 16 , wherein the operations further comprise:
continuously training a prompt model within a prompt component of a processing engine based in part on replayed events to improve prompt accuracy and relevance.
20 . A machine-storage medium comprising instructions which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving a natural language input from a client device, the natural language input indicating a query to be performed on a SQL database;
storing a text request corresponding to the natural language input in a topic of a storage layer, each topic comprising an unbounded sequence of serialized events;
generating a prompt based on the text request, the prompt being used to prompt a generative artificial intelligence (AI) system to generate a SQL query;
transmitting the prompt to the generative AI system;
receiving an SQL query generated by the generative AI system based on the prompt;
storing the SQL query to the topic in the storage layer;
triggering execution of the SQL query on a cloud SQL to obtain an SQL result;
storing the SQL result in the topic of the storage layer; and
transmitting a response to the client device based on the SQL result.