Partitioning to support invocation of external table functions on multiple batches of input rows

1. A system comprising:

one or more hardware processors; and

one or more memories storing instructions that cause the one or more hardware processors to perform operations comprising:

receiving, from a computing device, a query including input data and referencing an external table function provided by a remote software component, the input data including a plurality of batches of input rows;

grouping the plurality of batches of input rows into a plurality of partitions;

assigning a partition identifier to a partition into which one or more batches of input rows of the plurality of batches of input rows are grouped;

sending, to a proxy service of a cloud computing service platform, a set of requests to execute the external table function on the input data, the proxy service comprising an externally managed web application programming interface (API) management system, the cloud computing service platform further comprising the remote software component, a request from the set of requests including the one or more batches of input rows and the partition identifier that identifies the partition into which the one or more batches of input rows are grouped; and

receiving, from the proxy service, one or more responses to the set of requests.

2. The system of claim 1 , wherein:

at least one of the one or more responses include the partition identifier, the one or more responses comprising result data, the result data comprising a result of executing the table function on the input data,

the operations further comprise processing the result data according to the query.

3. The system of claim 1 , wherein the operations further comprise:

prior to sending the set of requests, sending, to the proxy service, a preliminary request for metadata associated with query processing; and

receiving, from the proxy service, the metadata associated with query processing.

4. The system of claim 3 , wherein the operations further comprise:

configuring parallelism parameters associated with query processing based on the metadata.

5. The system of claim 4 , wherein:

configuring the parallelism parameters comprises determining a number of parallel requests to send to the proxy service;

the set of requests includes the number of parallel requests; and

sending the set of requests comprises sending the number of parallel requests.

6. The system of claim 1 , wherein:

the one or more responses include a first response that includes a first portion of result data and a pagination token, the pagination token indicating that at least a second portion of the result data; and

the operations further comprise:

sending, to the proxy service, a further request to obtain the second portion of the result data based on the first response including the pagination token; and

receiving, from the proxy service, the second portion of the result data.

7. The system of claim 6 , wherein the further request and at least one of the one or more responses include a batch identifier of a batch of input rows corresponding to the first and second portion of the result data.

8. The system of claim 6 , wherein the one or more responses include a second response corresponding to the further request, the second response including the second portion of the result data.

9. The system of claim 1 , wherein the request in the set of requests is electronically signed using temporary security credentials corresponding to a role associated with the proxy service that has permission to send calls to an endpoint corresponding to the remote software component.

10. The system of claim 9 , wherein the operations further comprise

in response to the query, accessing, from a data store, a function object associated with the remote software component, the function object identifying the endpoint corresponding to the remote software component and an integration object associated with the remote software component; and

accessing, from the data store, the integration object identifying the role.

11. The system of claim 1 , wherein:

each request in the set of requests corresponds to a hypertext transfer protocol (HTTP) request;

each of the one or more responses correspond to an HTTP response and comprise JavaScript Object Notation (JSON) encoded data, APACHE ARROW encoded data, or eXtensible Markup Language (XML) encoded data.

12. A method comprising:

receiving, from a computing device, a query including input data and referencing an external table function provided by a remote software component, the input data including a plurality of batches of input rows;

grouping the plurality of batches of input rows into a plurality of partitions;

assigning a partition identifier to a partition into which one or more batches of input rows of the plurality of batches of input rows are grouped;

sending, to a proxy service of a cloud computing service platform, a set of requests to execute the external table function on the input data, the proxy service comprising an externally managed web application programming interface (API) management system, the cloud computing service platform further comprising the remote software component, a request from the set of requests including the one or more batches of input rows and the partition identifier that identifies the partition into which the one or more batches of input rows are grouped; and

receiving, from the proxy service, one or more responses to the set of requests.

13. The method of claim 12 , wherein:

at least one of the one or more responses include the partition identifier, the one or more responses comprising result data, the result data comprising a result of executing the table function on the input data; and

the method further comprises processing the result data according to the query.

14. The method of claim 12 , further comprising:

prior to sending the set of requests, sending, to the proxy service, a preliminary request for metadata associated with query processing; and

receiving, from the proxy service, the metadata associated with query processing.

15. The method of claim 14 , further comprising configuring parallelism parameters associated with query processing based on the metadata.

16. The method of claim 15 , wherein:

configuring the parallelism parameters comprises determining a number of parallel requests to send to the proxy service;

the set of requests includes the number of parallel requests; and

sending the set of requests comprises sending the number of parallel requests.

17. The method of claim 12 , wherein:

the one or more responses include a first response that includes a first portion of result data and a pagination token, the pagination token indicating that at least a second portion of the result data; and

the method further comprises:

sending, to the proxy service, a further request to obtain the second portion of the result data based on the first response including the pagination token; and

receiving, from the proxy service, the second portion of the result data.

18. The method of claim 17 , wherein the further request and at least one of the one or more responses include a batch identifier of a batch of input rows corresponding to the first and second portion of the result data.

19. The method of claim 17 , wherein the one or more responses include a second response corresponding to the further request, the second response including the second portion of the result data.

20. A computer-storage medium comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:

receiving, from a computing device, a query including input data and referencing an external table function provided by a remote software component, the input data including a plurality of batches of input rows;

grouping the plurality of batches of input rows into a plurality of partitions;

assigning a partition identifier to a partition into which one or more batches of input rows of the plurality of batches of input rows are grouped;

sending, to a proxy service of a cloud computing service platform, a set of requests to execute the external table function on the input data, the proxy service comprising an externally managed web application programming interface (API) management system, the cloud computing service platform further comprising the remote software component, a request from the set of requests including the one or more batches of input rows and the partition identifier that identifies the partition into which the one or more batches of input rows are grouped; and

receiving, from the proxy service, one or more responses to the set of requests.

21. The computer-storage medium of claim 20 , wherein:

at least one of the one or more responses include the partition identifier, the one or more responses comprising result data, the result data comprising a result of executing the table function on the input data; and

the operations further comprise processing the result data according to the query.

22. The computer-storage medium of claim 20 , wherein the operations further comprise:

prior to sending the set of requests, sending, to the proxy service, a preliminary request for metadata associated with query processing; and

receiving, from the proxy service, the metadata associated with query processing.

23. The computer-storage medium of claim 22 , wherein the operations further comprise configuring parallelism parameters associated with query processing based on the metadata.

24. The computer-storage medium of claim 23 , wherein:

configuring the parallelism parameters comprises determining a number of parallel requests to send to the proxy service;

the set of requests includes the number of parallel requests; and

sending the set of requests comprises sending the number of parallel requests.

25. The computer-storage medium of claim 21 , wherein:

the one or more responses include a first response that includes a first portion of the result data and a pagination token, the pagination token indicating that at least a second portion of the result data; and

the operations further comprise:

sending, to the proxy service, a further request to obtain the second portion of the result data based on the first response including the pagination token; and

receiving, from the proxy service, the second portion of the result data.

26. The computer-storage medium of claim 25 , wherein the further request and at least one of the one or more responses include a batch identifier of a batch of input rows corresponding to the first and second portion of the result data.

27. The computer-storage medium of claim 25 , wherein the one or more responses include a second response corresponding to the further request, the second response including the second portion of the result data.

28. The computer-storage medium of claim 20 , wherein the request in the set of requests is electronically signed using temporary security credentials corresponding to a role associated with the proxy service that has permission to send calls to an endpoint corresponding to the remote software component.

29. The computer-storage medium of claim 28 , wherein the operations further comprise:

in response to the query, accessing, from a data store, a function object associated with the remote software component, the function object identifying the endpoint corresponding to the remote software component and an integration object associated with the remote software component; and

accessing, from the data store, the integration object identifying the role.

30. The computer-storage medium of claim 20 , wherein:

each request in the set of requests corresponds to a hypertext transfer protocol (HTTP) request;

each of the one or more responses correspond to an HTTP response and comprise JavaScript Object Notation (JSON) encoded data, APACHE ARROW encoded data, or eXtensible Markup Language (XML) encoded data.