Dynamically scheduling items for re-evaluation for a possible change based on an evaluation backlog
Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.
1 . A computer-implemented method comprising:
obtaining, via a computing device, a time to wait for an item to be analyzed to detect a possible change based on an evaluation backlog indicator;
determining, via the computing device, that the time to wait is above a maximum threshold value that is based on a previous expiration time of the item or below a minimum threshold value based on the previous expiration time of the item, the previous expiration time indicates when the item is available for scheduling analysis of the item; and
assigning, via the computing device, the item a new expiration time, wherein the new expiration time is greater than the previous expiration time when the time to wait is above the maximum threshold value or the new expiration time is less than the previous expiration time when the time to wait is below the minimum threshold value.
2 . The computer-implemented method of claim 1 , wherein a start time associated with the evaluation backlog indicator is a system time when the item is identified as being in a TIMEOUT state, and a stop time associated with the evaluation backlog indicator is the system time when the item is analyzed for a possible change in a STAT state.
3 . The computer-implemented method of claim 1 , wherein the evaluation backlog indicator is based on an incrementing time counter that is started when the item is identified as being in a TIMEOUT state and stopped when the item is analyzed for a possible change in a STAT state.
4 . The computer-implemented method of claim 1 , wherein the time to wait is a difference between a start time associated with the evaluation backlog indicator and a stop time associated with the evaluation backlog indicator.
5 . The computer-implemented method of claim 1 , wherein the maximum threshold value is selected based on a percentage of the previous expiration time for the item.
6 . The computer-implemented method of claim 1 , wherein the new expiration time is determined based on an increase of the previous expiration time or the time to wait.
7 . The computer-implemented method of claim 1 , further comprising identifying the item to be in a TIMEOUT state with the new expiration time.
8 . The computer-implemented method of claim 1 , wherein the minimum threshold value is determined based on a percentage of the previous expiration time for the item.
9 . The computer-implemented method of claim 1 , wherein the time to wait is obtained in response to identifying that there is not a possible change to the item based on an evaluation of metadata associated with the item.
10 . The computer-implemented method of claim 1 , wherein the evaluation backlog indicator is assigned to the item and identifies a duration for which the item is delayed for evaluation based on a backlog of other items to be evaluated prior to the item.
11 . One or more computer-readable storage media having instructions stored thereon, wherein the instructions, when executed by a computing device, cause the computing device to:
obtain a time to wait for an item to be analyzed to detect a possible change based on an evaluation backlog indicator;
determine that the time to wait is above a maximum threshold value that is based on a previous expiration time of the item or below a minimum threshold value based on the previous expiration time of the item, the previous expiration time indicates when the item is available for scheduling analysis of the item; and
assign the item a new expiration time, wherein the new expiration time is greater than the previous expiration time when the time to wait is above the maximum threshold value or the new expiration time is less than the previous expiration time when the time to wait is below the minimum threshold value.
12 . The one or more computer-readable storage media of claim 11 , wherein a start time associated with the evaluation backlog indicator is a system time when the item is identified as being in a TIMEOUT state and a stop time associated with evaluation backlog indicator is a system time when the item is analyzed for a possible change in a STAT state.
13 . The one or more computer-readable storage media of claim 11 , wherein the evaluation backlog indicator is based on an incrementing time counter that is started when the item is identified as being in a TIMEOUT state and stopped when the item is analyzed for a possible change in a STAT state.
14 . The one or more computer-readable storage media of claim 11 , wherein the time to wait is a difference between a start time associated with the evaluation backlog indicator and a stop time associated with the evaluation backlog indicator.
15 . The one or more computer-readable storage media of claim 11 , wherein the maximum threshold value is selected based on a percentage of the previous expiration time for the item.
16 . The one or more computer-readable storage media of claim 11 , wherein the new expiration time is determined based on an increase of the previous expiration time or the time to wait.
17 . A computing system comprising:
one or more processors; and
a memory coupled with the one or more processors, the memory having instructions stored thereon, wherein the instructions, when executed by the one or more processors, cause the computing system to:
obtain a time to wait for an item to be analyzed to detect a possible change based on an evaluation backlog indicator;
determine that the time to wait is above a maximum threshold value that is based on a previous expiration time of the item or below a minimum threshold value based on the previous expiration time of the item, the previous expiration time indicates when the item is available for scheduling analysis of the item; and
assign the item a new expiration time, wherein the new expiration time is greater than the previous expiration time when the time to wait is above the maximum threshold value or the new expiration time is less than the previous expiration time when the time to wait is below the minimum threshold value.
18 . The computing system of claim 17 , wherein the minimum threshold value is determined based on a percentage of the previous expiration time for the item.
19 . The computing system of claim 17 , wherein the time to wait is obtained in response to identifying that there is not a possible change to the item based on an evaluation of metadata associated with the item.
20 . The computing system of claim 17 , wherein the evaluation backlog indicator is assigned to the item and identifies a duration for which the item is delayed for evaluation based on a backlog of other items to be evaluated prior to the item.