Isolated read channel categories at streaming data service
In response to a first programmatic request, metadata indicating that a first isolated read channel of a real-time category has been associated with a first target stream is stored at a stream management service. In response to another request, metadata indicating that a second isolated read channel of a non-real-time category has been associated with a second target stream is stored. In response to a read request indicating the first channel or the second channel, one or more data records of the corresponding target streams are provided.
1. A computer-implemented method, comprising:
configuring, on behalf of a first client of a streaming data service, a dedicated resource for access to one or more data streams by the first client, wherein the dedicated resource is not to be shared with other clients;
causing, by the streaming data service, contents of the one or more data streams to be provided to the first client using the dedicated resource in accordance with a first performance limit selected for the dedicated resource; and
in response to receiving, at the streaming data service, a programmatic request for a change to the first performance limit, causing additional contents of the one or more data streams to be provided to the first client via the dedicated resource in accordance with a second performance limit which differs from the first performance limit.
2. The computer-implemented method as recited in claim 1 , wherein the first performance limit indicates a first rate at which contents of the one or more data streams are to be read by the first client, and wherein the second performance limit indicates a second rate at which contents of the one or more data streams are to be read by the first client.
3. The computer-implemented method as recited in claim 1 , further comprising:
assigning, by the streaming data service in response to the programmatic request for the change to the first performance limit, at least a portion of an additional storage device to a particular data stream of the one or more data streams.
4. The computer-implemented method as recited in claim 1 , further comprising:
causing, by the streaming data service in response to the programmatic request for the change to the first performance limit, at least a subset of contents of a particular data stream of the one or more data streams to be transferred from a first storage device with a first performance capacity to a second storage device with a second performance capacity.
5. The computer-implemented method as recited in claim 1 , further comprising:
obtaining, from the first client, a programmatic request indicating a single-tenancy requirement of the first client with respect to the one or more data streams, wherein said configuring the dedicated resource is responsive to the programmatic request indicating the single-tenancy requirement.
6. The computer-implemented method as recited in claim 1 , further comprising:
obtaining, from the first client, a filtering criterion associated with a particular data stream of the one or more data streams;
receiving, from one or more sources, one or more records of the particular data stream; and
in response to determining that a particular record of the one or more records satisfies the filtering criterion, transmitting at least a portion of the particular record using the dedicated resource.
7. The computer-implemented method as recited in claim 1 , wherein the further comprising:
establishing a persistent network connection between a stream processing application of the first client and a data retrieval subsystem of the streaming data service, wherein causing the additional contents of the one or more data streams to be provided to the first client via the dedicated resource comprises utilizing the persistent network connection to transfer a plurality of stream data records in a push mode, without receiving respective read requests for individual ones of the plurality of stream data records.
8. A system, comprising:
one or more computing devices;
wherein the one or more computing devices include instructions that upon execution on or across the one or more computing devices:
configure, on behalf of a first client of a streaming data service, a dedicated resource for access to one or more data streams by the first client, wherein the dedicated resource is not to be shared with other clients;
cause, by the streaming data service, contents of the one or more data streams to be provided to the first client using the dedicated resource in accordance with a first performance limit selected for the dedicated resource; and
in response to receiving, at the streaming data service, a programmatic request for a change to the first performance limit, cause additional contents of the one or more data streams to be provided to the first client via the dedicated resource in accordance with a second performance limit which differs from the first performance limit.
9. The system as recited in claim 8 , wherein the first performance limit indicates a first rate at which contents of the one or more data streams are to be read by the first client, and wherein the second performance limit indicates a second rate at which contents of the one or more data streams are to be read by the first client.
10. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across the one or more computing devices:
assign, by the streaming data service in response to the programmatic request for the change to the first performance limit, at least a portion of an additional storage device to a particular data stream of the one or more data streams.
11. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across the one or more computing devices:
cause, by the streaming data service in response to the programmatic request for the change to the first performance limit, at least a subset of contents of a particular data stream of the one or more data streams to be transferred from a first storage device with a first performance capacity to a second storage device with a second performance capacity.
12. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across the one or more computing devices:
obtain, from the first client, a programmatic request indicating a single-tenancy requirement of the first client with respect to the one or more data streams, wherein the dedicated resource is configured in response to the programmatic request indicating the single-tenancy requirement.
13. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across the one or more computing devices:
obtain, from the first client, a filtering criterion associated with a particular data stream of the one or more data streams;
receive, from one or more sources, one or more records of the particular data stream; and
in response to determining that a particular record of the one or more records satisfies the filtering criterion, transmit at least a portion of the particular record using the dedicated resource.
14. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across the one or more computing devices:
establish a persistent network connection between a stream processing application of the first client and a data retrieval subsystem of the streaming data service, wherein the additional contents of the one or more data streams are provided via the persistent network connection in a push mode, wherein the additional contents comprise a plurality of stream data records, and wherein in accordance with the push mode, individual ones of the plurality of data stream records are provided without receiving respective read requests.
15. One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors:
configure, on behalf of a first client of a streaming data service, a dedicated resource for access to one or more data streams by the first client, wherein the dedicated resource is not to be shared with other clients;
cause, by the streaming data service, contents of the one or more data streams to be provided to the first client using the dedicated resource in accordance with a first performance limit selected for the dedicated resource; and
in response to receiving, at the streaming data service, a programmatic request for a change to the first performance limit, cause additional contents of the one or more data streams to be provided to the first client via the dedicated resource in accordance with a second performance limit which differs from the first performance limit.
16. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the first performance limit indicates a first rate at which contents of the one or more data streams are to be read by the first client, and wherein the second performance limit indicates a second rate at which contents of the one or more data streams are to be read by the first client.
17. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:
assign, by the streaming data service in response to the programmatic request for the change to the first performance limit, at least a portion of an additional storage device to a particular data stream of the one or more data streams.
18. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:
cause, by the streaming data service in response to the programmatic request for the change to the first performance limit, at least a subset of contents of a particular data stream of the one or more data streams to be transferred from a first storage device with a first performance capacity to a second storage device with a second performance capacity.
19. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:
obtain, from the first client, a programmatic request indicating a single-tenancy requirement of the first client with respect to the one or more data streams, wherein the dedicated resource is configured in response to the programmatic request indicating the single-tenancy requirement.
20. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:
obtain, from the first client, a filtering criterion associated with a particular data stream of the one or more data streams;
receive, from one or more sources, one or more records of the particular data stream; and
in response to determining that a particular record of the one or more records satisfies the filtering criterion, transmit at least a portion of the particular record using the dedicated resource.