Global secondary path locking technique enabling high read concurrency for read-mostly workloads
A reader of a set of data accessors that includes readers and writer detects that a particular lock of a first collection of non-global locks associated with a data object of a computing environment is held by another accessor. After checking a blocking indicator, the reader uses a second lock (which is not part of the first collection) to obtain read access to the data object and implements its reads without acquiring the particular lock. Prior to implementing a write on the data object, a writer acquires at least some locks of the first collection, and sets the blocking indicator to prevent readers from using the second lock to obtain read access to the data object.
1. A computer-implemented method, comprising:
determining, by a first reader of a plurality of data accessors, whether a particular lock of a first collection of one or more locks associated with a first data object is held by another data accessor;
based at least in part on determining that the particular lock is held by the other data accessor:
utilizing, by the first reader, after checking a blocking indicator different from the particular lock to determine that read access is permitted for the first data object, a second lock associated with the first data object to obtain read access to the first data object, wherein the second lock is not a member of the first collection, and wherein the blocking indicator indicates whether the first reader is prevented from utilizing the second lock to obtain read access to the first data object; and
implementing, by the first reader, one or more read operations on the first data object, without acquiring the particular lock; and
based at least in part on determining that the particular lock is not held by the other data accessor, implementing the one or more read operations on the first data object subsequent to acquiring the particular lock.
2. The computer-implemented method as recited in claim 1 , wherein the other accessor holding the particular lock is a second reader of the plurality of data accessors.
3. The computer-implemented method as recited in claim 1 , wherein the plurality of data accessors comprises a second reader, the computer-implemented method further comprising:
in response to detecting, by the second reader that another lock of the first collection of one or more locks is held by another data accessor,
utilizing, by the second reader, after checking the blocking indicator and prior to the completion of the one or more read operations of the first reader, the second lock associated with the first data object to obtain read access to the first data object; and
implementing, by the second reader, one or more read operations on the first data object, without acquiring the other lock of the first collection.
4. The computer-implemented method as recited in claim 1 , wherein utilizing the second lock comprises modifying a counter associated with the second lock.
5. The computer-implemented method as recited in claim 1 , wherein the plurality of data accessors includes a first writer, the computer-implemented method further comprising:
prior to implementing a write operation on the first data object by the first writer,
acquiring, by the first writer, one or more locks of the first collection of locks, and
setting, by the first writer, the blocking indicator to prevent another reader from using the second lock to obtain read access to the first data object.
6. The computer-implemented method as recited in claim 1 , wherein the plurality of data accessors run in a computing environment comprising a particular count of processing elements, and wherein the number of locks included in the first collection of locks is based at least in part on the particular count.
7. The computer-implemented method as recited in claim 6 , wherein an individual processing element of the computing environment comprises one of: (a) a CPU (central processing unit), (b) a core, or (c) a NUMA (non-uniform memory access) node.
8. A system, comprising:
one or more computing devices;
wherein the one or more computing devices include instructions that upon execution on or across one or more processors cause a first reader of a plurality of data accessors to:
determine whether a particular lock of a first collection of one or more locks associated with a first data object is held by another data accessor; based at least in part on determining that the particular lock is held by the other data accessor:
utilize, after checking a blocking indicator different from the particular lock to determine that read access is permitted for the first data object, a second lock associated with the first data object to obtain read access to the first data object, wherein the second lock is not a member of the first collection, and wherein the blocking indicator indicates whether the first reader is prevented from utilizing the second lock to obtain read access to the first data object; and
implement one or more read operations on the first data object, without acquiring the particular lock; and
based at least in part on determining that the particular lock is not held by the other data accessor, implement the one or more read operations on the first data object subsequent to acquiring the particular lock.
9. The system as recited in claim 8 , wherein the other accessor holding the particular lock is a second reader of the plurality of data accessors.
10. The system as recited in claim 8 , wherein the plurality of data accessors comprises a second reader, and wherein the one or more computing devices include further instructions that upon execution on or across one or more processors further cause the second reader to:
in response to detecting that another lock of the first collection of one or more locks is held by another data accessor,
utilize, after checking the blocking indicator and prior to the completion of the one or more read operations of the first reader, the second lock associated with the first data object to obtain read access to the first data object; and
implement one or more read operations on the first data object, without acquiring the other lock of the first collection.
11. The system as recited in claim 8 , wherein to cause the first reader to utilize the second lock, the one or more computing devices include further instructions that upon execution on or across one or more processors further cause the first reader to:
modify a counter associated with the second lock.
12. The system as recited in claim 8 , wherein the plurality of data accessors includes a first writer, and wherein the one or more computing devices include further instructions that upon execution on or across one or more processors further cause the first writer to:
prior to implementing a write operation on the first data object,
acquire one or more locks of the first collection of locks, and
set the blocking indicator to prevent another reader from using the second lock to obtain read access to the first data object.
13. The system as recited in claim 8 , wherein the plurality of data accessors run in a computing environment comprising a particular count of processing elements, and wherein the number of locks included in the first collection of locks is based at least in part on the particular count.
14. The system as recited in claim 13 , wherein an individual processing element of the computing environment comprises one of: (a) a CPU (central processing unit), (b) a core, or (c) a NUMA (non-uniform memory access) node.
15. One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors:
cause a first reader of a plurality of data accessors to:
determine whether a particular lock of a first collection of one or more locks associated with a first data object is held by another data accessor; based at least in part on determining that the particular lock is held by the other data accessor:
utilize, after checking a blocking indicator different from the particular lock to determine that read access is permitted for the first data object, a second lock associated with the first data object to obtain read access to the first data object, wherein the second lock is not a member of the first collection, and wherein the blocking indicator indicates whether the first reader is prevented from utilizing the second lock to obtain read access to the first data object; and
implement one or more read operations on the first data object, without acquiring the particular lock; and
based at least in part on determining that the particular lock is not held by the other data accessor, implement the one or more read operations on the first data object subsequent to acquiring the particular lock.
16. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the other accessor holding the particular lock is a second reader of the plurality of data accessors.
17. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the plurality of data accessors comprises a second reader, and wherein the one or more non-transitory computer-accessible storage media store further program instructions that when executed on or across one or more processors further cause the second reader to:
in response to detecting that another lock of the first collection of one or more locks is held by another data accessor,
utilize, after checking the blocking indicator and prior to the completion of the one or more read operations of the first reader, the second lock associated with the first data object to obtain read access to the first data object; and
implement one or more read operations on the first data object, without acquiring the other lock of the first collection.
18. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein to cause the first reader to utilize the second lock, the one or more non-transitory computer-accessible storage media store further program instructions that when executed on or across one or more processors further cause the first reader to:
modify a counter associated with the second lock.
19. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the plurality of data accessors includes a first writer, and wherein the one or more non-transitory computer-accessible storage media store further program instructions that when executed on or across one or more processors further cause the first writer to:
prior to implementing a write operation on the first data object,
acquire one or more locks of the first collection of locks, and
set the blocking indicator to prevent another reader from using the second lock to obtain read access to the first data object.
20. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the plurality of data accessors run in a computing environment comprising a particular count of processing elements, and wherein the number of locks included in the first collection of locks is based at least in part on the particular count.