Systems and methods for implementing and using a cross-process queue within a single computer
A system, method, and computer-program product includes implementing a cross-process queue within a single computer that is configured to transfer a data block between an operating system process executing a write operation and an operating system process executing a read operation, initializing in-memory cell indices within the cross-process queue that include a write operation index tracking index values of one or more cells within the cross-process queue that are available to write and a read operation index tracking index values of one or more cells within the cross-process queue that are available to read, and implementing a cell synchronization data structure tracking states of a plurality of cells of the index of cells of the cross-process queue.
1. A computer-program product embodied in a non-transitory machine-readable storage medium storing computer instructions that, when executed by one or more processors, perform operations comprising: implementing a cross-process queue within a shared memory of a single computer that is configured to transfer a data block between a write operating process executing a write operation and a read operating system process executing a read operation, wherein the cross-process queue includes an index of cells; initializing in-memory cell indices within the shared memory that includes: (1) a write operation index tracking index values of one or more cells within the cross-process queue that are available to write, and (2) a read operation index tracking index values of one or more cells within the cross-process queue that are available to read, wherein the in-memory cell indices govern write operations to and read operations from a plurality of cells of the index of cells as directed by the write operating system process executing the write operation and the read operating system process executing the read operation based on the index values tracked by the write operation index and the index values tracked by the read operation index; and implementing a cell synchronization data structure tracking states of the plurality of cells of the index of cells of the cross-process queue, wherein the cell synchronization data structure tracks a first count of cells of the plurality of cells of the index of cells that are available to write and tracks a second count of cells of the plurality of cells of the index of cells that are available to read, wherein the cell synchronization data structure regulates a utilization of the cross-process queue for the write operating system process executing the write operation and the read operating system process executing the read operation based on the first count of cells of the index of cells that are available to write and the second count of cells of the index of cells that are available to read.
2. The computer-program product according to claim 1 , wherein: when the first count of cells of the index of cells that are available to write is greater than zero, the cell synchronization data structure causes a given write operating system process requesting to execute a given write operation to access the cross-process queue, and when the first count of cells of the index of cells that are available to write is zero, the cell synchronization data structure causes the given write operating system process requesting to execute the given write operation to pause and not access the cross-process queue.
3. The computer-program product according to claim 1 , wherein: when the second count of cells of the index of cells that are available to read is greater than zero, the cell synchronization data structure causes a given read operating system process requesting to execute a given read operation to access the cross-process queue, and when the second count of cells of the index of cells that are available to read is zero, the cell synchronization data structure causes the given read operating system process requesting to execute the given read operation to pause and not access the cross-process queue.
4. The computer-program product according to claim 1 , wherein: the cell synchronization data structure further regulates the utilization of the cross-process queue by a plurality of write operating system processes requesting to execute write operations and a plurality of read operating system processes requesting to execute read operations based on the first count of cells of the index of cells that are available to write and the second count of cells of the index of cells that are available to read, and the in-memory cell indices govern write operations to and read operations from the plurality of cells of the index of cells as directed by the plurality of write operating system processes requesting to execute write operations and the plurality of read operating system processes requesting to execute read operations based on the write index values tracked by the write operations index and the read index values tracked by the read operation index.
5. The computer-program product according to claim 4 , wherein:
when the write operation index of the in-memory cell indices tracks at least one index value of a cell of the index of cells that is available to write, a given index value of a cell of the index of cells is assigned to a given write operating system process of the plurality of operating system processes requesting to execute write operations.
6. The computer-program product according to claim 4 , wherein:
when the read operation index of the in-memory cell indices tracks at least one index value of a cell of the index of cells that is available to read, a given index value of a cell of the index of cells is assigned to a given read operating system process of the plurality of operating system processes requesting to execute read operations.
7. The computer-program product according to claim 1 , further comprising:
executing, by the read operating system process executing the read operation and the write operating system process executing the write operation, atomic updates causing a change to the write index values tracked by the write operation index and the read index values tracked by the read operation index.
8. The computer-program product according to claim 1 , further comprising:
implementing a plurality of shared memory channels defining a channel index of shared memory channels within the single computer, the plurality of shared memory channels each having an associated cross-process queue for transferring data between a plurality of write operating system processes executing write operations and a plurality of read operating system processes executing read operations.
9. The computer-program product according to claim 8 , further comprising:
implementing in-memory channel indices of the plurality of shared memory channels that include:
a first free channel index tracking a given channel index value of a given shared memory channel at a head of a queue of shared memory channels that are available to write;
a first used channel index tracking another given channel index value of another given shared memory channel at a head of a queue of shared memory channels that are available to read;
a last used channel index tracking a further given channel index value of a further given shared memory channel at a tail of the queue of shared memory channels that are available to read,
wherein the in-memory channel indices regulate a utilization of the channel index of shared memory channels by the plurality of operating system processes executing write operations and the plurality of read operating system processes executing read operations based on given index values of the first free channel index and another given index values of the first used channel index.
10. The computer-program product according to claim 8 , further comprising:
implementing a channel synchronization data structure tracking states of the plurality of shared memory channels of the channel index of shared memory channels, wherein the channel synchronization data structure:
tracks a count of channels of the channel index of shared memory channels not assigned to any operating system processes, and
tracks a count of channels of the channel index of shared memory channels assigned to any given write operating system process executing write operations and that are not assigned to any given read operating system process executing read operations;
wherein the channel synchronization data structure controls an acquisition of one or more of the plurality of shared memory channels by the plurality of operating system processes executing write operations and the plurality of operating system processes executing read operations based on the count of channels of the channel index of shared memory channels not assigned to any operating system processes and the count of channels of the channel index of shared memory channels assigned to any given write operating system process executing write operations and that are not assigned to any given read operating system process executing read operations.
11. The computer-program product according to claim 10 , wherein:
when the count of channels of the channel index of shared memory channels not assigned to any operating system processes is greater than zero, the channel synchronization data structure allows an acquisition of a given shared memory channel of the channel index of shared memory channels by a subject operating system process requesting to execute a write operation to the channel index of shared memory channels, and
when the count of channels of the channel index of shared memory channels not assigned to any operating system processes is zero, the channel synchronization data structure disallows the acquisition of the given shared memory channel of the channel index of shared memory channels by the subject operating system process requesting to execute the write operation to the channel index of shared memory channels.
12. The computer-program product according to claim 11 , wherein:
the acquisition of the given shared memory channel by the subject operating system process requesting to execute the write operation, removes a given index value of the given shared memory channel from an array of index values of shared memory channels that are available to write and inserts the given index value of the given shared memory channel to an array of index values of shared memory channels that are available to read at a completion of the write operation.
13. The computer-program product according to claim 11 , wherein:
the acquisition of the given shared memory channel by the subject operating system process requesting to execute the read operation, removes a given index value of the given shared memory channel from the array of index values of shared memory channels that are available to read and inserts the given index value of the given shared memory channel to the array of index values of shared memory channels that are available to write at a completion of the read operation.
14. A computer-implemented method comprising: implementing a cross-process queue within a shared memory of a single computer that is configured to transfer a data block between a write operating process executing a write operation and a read operating system process executing a read operation, wherein the cross-process queue includes an index of cells; initializing in-memory cell indices within the shared memory that includes: (1) a write operation index tracking write index values of one or more cells within the cross-process queue that are available to write, and (2) a read operation index tracking read index values of one or more cells within the cross-process queue that are available to read, wherein the in-memory cell indices govern write operations to and read operations from a plurality of cells of the index of cells as directed by the write operating system process executing the write operation and the read operating system process executing the read operation based on the index values tracked by the write operation index and the index values tracked by the read operation index; and implementing a cell synchronization data structure tracking states of the plurality of cells of the index of cells of the cross-process queue, wherein the cell synchronization data structure tracks a first count of cells of the plurality of cells of the index of cells that are available to write and tracks a second count of cells of the plurality of cells of the index of cells that are available to read, wherein the cell synchronization data structure regulates a utilization of the cross-process queue for the write operating system process executing the write operation and the read operating system process executing the read operation based on the first count of cells of the index of cells that are available to write and the second count of cells of the index of cells that are available to read.
15. The computer-implemented method according to claim 14 , wherein: when the first count of cells of the index of cells that are available to write is greater than zero, the cell synchronization data structure causes a given write operating system process requesting to execute a given write operation to access the cross-process queue, and when the first count of cells of the index of cells that are available to write is zero, the cell synchronization data structure causes the given write operating system process requesting to execute the given write operation to pause and not access the cross-process queue.
16. The computer-implemented method according to claim 14 , wherein: when the second count of cells of the index of cells that are available to read is greater than zero, the cell synchronization data structure causes a given read operating system process requesting to execute a given read operation to access the cross-process queue, and when the second count of cells of the index of cells that are available to read is zero, the cell synchronization data structure causes the given read operating system process requesting to execute the given read operation to pause and not access the cross-process queue.
17. The computer-implemented method according to claim 14 , wherein: the cell synchronization data structure further regulates the utilization of the cross-process queue by a plurality of write operating system processes requesting to execute write operations and a plurality of read operating system processes requesting to execute read operations based on the first count of cells of the index of cells that are available to write and the second count of cells of the index of cells that are available to read, and the in-memory cell indices govern write operations to and read operations from the plurality of cells of the index of cells as directed by the plurality of write operating system processes requesting to execute write operations and the plurality of read operating system processes requesting to execute read operations based on the write index values tracked by the write operations index and the read index values tracked by the read operation index.
18. The computer-implemented method according to claim 17 , wherein:
when the write operation index of the in-memory cell indices tracks at least one index value of a cell of the index of cells that is available to write, a given index value of a cell of the index of cells is assigned to a given read operating system process of the plurality of write operating system processes requesting to execute write operations.
19. The computer-implemented method according to claim 17 , wherein:
when the read operation index of the in-memory cell indices tracks at least one index value of a cell of the index of cells that is available to read, a given index value of a cell of the index of cells is assigned to a given read operating system process of the plurality of read operating system processes requesting to execute read operations.
20. The computer-implemented method according to claim 14 , further comprising:
executing, by the read operating system process executing the read operation and the write operating system process executing the write operation, atomic updates causing a change to the index values tracked by the write operation index and the index values tracked by the read operation index.
21. The computer-implemented method according to claim 14 , further comprising:
implementing a plurality of shared memory channels defining an index of shared memory channels within the single computer, the plurality of shared memory channels each having an associated cross-process queue for transferring data between a plurality of write operating system processes executing write operations and a plurality of read operating system processes executing read operations.
22. The computer-implemented method according to claim 21 , further comprising:
implementing in-memory channel indices of the plurality of shared memory channels that include:
a first free channel index tracking a given index value of a given shared memory channel at a head of a queue of shared memory channels that are available to write;
a first used channel index tracking another given index value of another given shared memory channel at a head of a queue of shared memory channels that are available to read;
a last used channel index tracking a further given index value of a further given shared memory channel at a tail of the queue of shared memory channels that are available to read,
wherein the in-memory channel indices regulate a utilization of the index of shared memory channels by the plurality of write operating system processes executing write operations and the plurality of read operating system processes executing read operations based on index values of the first free channel index and index values of the first used channel index.
23. The computer-implemented method according to claim 21 , further comprising:
implementing a channel synchronization data structure tracking states of the plurality of shared memory channels of the channel index of shared memory channels, wherein the channel synchronization data structure:
tracks a count of channels of the channel index of shared memory channels not assigned to any operating system processes, and
tracks a count of channels of the channel index of shared memory channels assigned to any given write operating system process executing write operations and that are not assigned to any given read operating system process executing read operations;
wherein the channel synchronization data structure controls an acquisition of one or more of the plurality of shared memory channels by the plurality of write operating system processes executing write operations and the plurality of read operating system processes executing read operations based on the count of channels of the channel index of shared memory channels not assigned to the any operating system processes and the count of channels of the channel index of shared memory channels assigned to any given write operating system process executing write operations and that are not assigned to any given read operating system process executing read operations.
24. The computer-implemented method according to claim 23 , wherein:
when the count of channels of the channel index of shared memory channels not assigned to the any operating system processes is greater than zero, the channel synchronization data structure allows an acquisition of a given shared memory channel of the index of shared memory channels by a subject operating system process requesting to execute a write operation to the index of shared memory channels, and
when the count of channels of the index of shared memory channels not assigned to the any operating system processes is zero, the channel synchronization data structure disallows the acquisition of the given shared memory channel of the channel index of shared memory channels by the subject write operating system process requesting to execute the write operation to the channel index of shared memory channels.
25. The computer-implemented method according to claim 24 , wherein:
the acquisition of the given shared memory channel by the subject write operating system process requesting to execute the write operation, removes a channel index value of the given shared memory channel from an array of index values of shared memory channels that are available to write and inserts the channel index value of the given shared memory channel to an array of index values of shared memory channels that are available to read at a completion of the write operation.
26. The computer-implemented method according to claim 24 , wherein:
the acquisition of the given shared memory channel by the subject read operating system process requesting to execute the read operation, removes an index value of the given shared memory channel from the array of index values of shared memory channels that are available to read and inserts the index value of the given shared memory channel to the array of index values of shared memory channels that are available to write at a completion of the read operation.
27. A computer-implemented system comprising: one or more processors; a memory; a computer-readable medium operably coupled to the one or more processors, the computer-readable medium having computer-readable instructions stored thereon that, when executed by the one or more processors, cause a computing device to perform operations comprising: implementing a cross-process queue within a shared memory of a single computer that is configured to transfer a data block between a write operating process executing a write operation and a read operating system process executing a read operation, wherein the cross-process queue includes an index of cells; initializing in-memory cell indices within the shared memory that includes: (1) a write operation index tracking index values of one or more cells within the cross-process queue that are available to write, and (2) a read operation index tracking index values of one or more cells within the cross-process queue that are available to read, wherein the in-memory cell indices govern write operations to and read operations from a plurality of cells of the index of cells as directed by the write operating system process executing the write operation and the read operating system process executing the read operation based on the index values tracked by the write operation index and the index values tracked by the read operation index; and implementing a cell synchronization data structure tracking states of the plurality of cells of the index of cells of the cross-process queue, wherein the cell synchronization data structure tracks a first count of cells of the plurality of cells of the index of cells that are available to write and tracks a second count of cells of the plurality of cells of the index of cells that are available to read, wherein the cell synchronization data structure regulates a utilization of the cross-process queue for the write operating system process executing the write operation and the read operating system process executing the read operation based on the first count of cells of the index of cells that are available to write and the second count of cells of the index of cells that are available to read.
28. The computer-implemented system according to claim 27 , wherein: when the first count of cells of the index of cells that are available to write is greater than zero, the cell synchronization data structure causes a given write operating system process requesting to execute a given write operation to access the cross-process queue, and when the first count of cells of the index of cells that are available to write is zero, the cell synchronization data structure causes the given write operating system process requesting to execute the given write operation to pause and not access the cross-process queue.
29. The computer-implemented system according to claim 27 , wherein: when the second count of cells of the index of cells that are available to read is greater than zero, the cell synchronization data structure causes a given read operating system process requesting to execute a given read operation to access the cross-process queue, and when the second count of cells of the index of cells that are available to read is zero, the cell synchronization data structure causes the given read operating system process requesting to execute the given read operation to pause and not access the cross-process queue.
30. The computer-implemented system according to claim 27 , wherein: the cell synchronization data structure further regulates the utilization of the cross-process queue by a plurality of write operating system processes requesting to execute write operations and a plurality of read operating system processes requesting to execute read operations based on the first count of cells of the index of cells that are available to write and the second count of cells of the index of cells that are available to read, and the in-memory cell indices govern write operations to and read operations from the plurality of cells of the index of cells as directed by the plurality of write operating system processes requesting to execute write operations and the plurality of read operating system processes requesting to execute read operations based on the write index values tracked by the write operations index and the read index values tracked by the read operation index.