Granted Patent B1

US 12,271,389 · App. 17/816,254 · Granted Apr 8, 2025

Inventors: Raman Arora (Seattle, WA); Ankit Jain (Sunnyvale, CA); Meng Su (Sunnyvale, CA); Hailun Yan (Sunnyvale, CA); Sophia Rui Zhu (Los Gatos, CA)

G06F16/248G06F16/2452G06F16/2455G06F16/2477

Abstract

Claims (72)

1. A method, comprising:

receiving, at a computing device of a first query system, a first query in a first query language, the first query identifying a set of data and a manner of processing the set of data, wherein the first query includes a time-based query command;

processing the first query to determine the set of data includes a dataset residing in a shared storage system and accessible via a second query system using a second query language that is different from the first query language;

translating the first query into a second query in the second query language, wherein the second query includes one or more computer executable instructions;

communicating the second query to the second query system, wherein the second query system executes the second query by: retrieving the dataset from a first location, processing the dataset according to the one or more computer executable instructions of the second query to generate first query results, and storing the first query results in a second location that is different from the first location;

determining, by the computing device of the first query system, the second location of the stored first query results;

determining, by the computing device of the first query system, a quantity of the stored first query results;

generating a plurality of results readers based on the determined quantity of the stored first query results;

concurrently retrieving the stored first query results from the second location using the generated plurality of results readers;

processing the retrieved first query results to generate second query results; and

communicating the second query results to a computing device associated with a user.

2. The method of claim 1 , wherein generating the plurality of results readers based on the determined quantity of the stored first query results comprises generating a plurality of computing threads.

3. The method of claim 1 , wherein determining the second location of the stored first query results, comprises identifying a storage system storing the stored first query results.

4. The method of claim 1 , wherein determining the second location of the stored first query results, comprises requesting metadata from the second query system and parsing the metadata to identify a storage system storing the stored first query results.

5. The method of claim 1 , wherein processing the retrieved first query results comprises changing a format of the retrieved first query results to a second format to generate the second query results, wherein communicating the second query results comprises communicating the second query results in the second format.

6. The method of claim 1 ,

wherein processing the retrieved first query results comprises combining the retrieved first query results with third query results received from a third query system to determine the second query results.

7. The method of claim 1 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider, and

wherein the first location comprises a portion of a shared storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider.

8. The method of claim 1 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider,

wherein the first location comprises a first storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider, and

wherein the second location comprises a second storage system of the cloud service provider, wherein the second storage system is associated with the first cloud service account of the cloud service provider.

9. The method of claim 1 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider,

wherein the first location comprises a first portion of a shared storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider, and

wherein the second location comprises second portion of the shared storage system, wherein the second portion of the shared storage system is associated with the first cloud service account of the cloud service provider.

10. Non-transitory computer-readable media including computer-executable instructions that, when executed by a computing device of a first query system, cause the computing device to:

receive a first query in a first query language, the first query identifying a set of data and a manner of processing the set of data, wherein the first query includes a time-based query command;

process the first query to determine the set of data includes a dataset residing in a shared storage system and accessible via a second query system using a second query language that is different from the first query language;

translate the first query into a second query in the second query language, wherein the second query includes one or more computer executable instructions;

communicate the second query to the second query system, wherein the second query system executes the second query by retrieving the dataset from a first location, processing the dataset according to the one or more computer executable instructions of the second query to generate first query results, and storing the first query results in a second location that is different from the first location;

determine the second location of the stored first query results;

determine a quantity of the stored first query results;

generate a plurality of results readers based on the determined quantity of the stored first query results;

concurrently retrieve the stored first query results from the second location using the generated plurality of results readers;

process the retrieved first query results to generate second query results; and

communicate the second query results to a computing device associated with a user.

11. The non-transitory computer-readable media of claim 10 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider,

wherein the first location comprises a first storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider, and

wherein from the second location comprises a second storage system of the cloud service provider, wherein the second storage system is associated with the first cloud service account of the cloud service provider.

12. A computing device of a first query system, the computing device comprising:

a data store; and

one or more processors, the one or more processors configured to:

receive a first query in a first query language, the first query identifying a set of data and a manner of processing the set of data, wherein the first query includes a time-based query command;

process the first query to determine the set of data includes a dataset residing in a shared storage system and accessible via a second query system using a second query language that is different from the first query language;

translate the first query into a second query in the second query language, wherein the second query includes one or more computer executable instructions;

communicate the second query to the second query system, wherein the second query system executes the second query by retrieving the dataset from a first location, processing the dataset according to the one or more computer executable instructions of the second query to generates first query results, and storing the first query results in a second location that is different from the first location;

determine the second location of the stored first query results;

determine a quantity of the stored first query results;

generate a plurality of results readers based on the determined quantity of the stored first query results;

concurrently retrieve the stored first query results from the second location using the generated plurality of results readers;

process the retrieved first query results to generate second query results; and

communicate the second query results to a computing device associated with a user.

13. The computing device of claim 12 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider,

wherein the first location comprises a first storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider, and

wherein from the second location comprises a second storage system of the cloud service provider, wherein the second storage system is associated with the first cloud service account of the cloud service provider.

14. The computing device of claim 12 , wherein to generate the plurality of results readers based on the determined quantity of the stored first query results, the one or more processors are configured to generate a plurality of computing threads.

15. The computing device of claim 12 , wherein to determine the second location of the stored first query results, the one or more processors are configured to identify a storage system storing the stored first query results.

16. The computing device of claim 12 , wherein to determine the second location of the stored first query results, the one or more processors are configured to request metadata from the second query system and parse the metadata to identify a storage system storing the stored first query results.

17. The computing device of claim 12 , wherein to process the retrieved first query results, the one or more processors are configured to change a format of the retrieved first query results to a second format to generate the second query results, wherein communicating the second query results comprises communicating the second query results in the second format.

18. The computing device of claim 12 , wherein to process the retrieved first query results, the one or more processors are configured to combine the retrieved first query results with third query results received from a third query system to determine the second query results.

19. The computing device of claim 12 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider, and

wherein the first location comprises a portion of a shared storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider.

20. The computing device of claim 12 ,

wherein the first query system and the second query system are instantiated in a shared computing resource environment of a cloud service provider and are associated with a first cloud service account of the cloud service provider,

wherein the first location comprises a first portion of a shared storage system of the cloud service provider and is associated with a second cloud service account of the cloud service provider, and

wherein from the second location comprises a second portion of the shared storage system, wherein the second portion of the shared storage system is associated with the first cloud service account of the cloud service provider.

Assignments (4)

Continuity (1)

References Cited (400)