INFORMATION PROCESSING APPARATUS
An information processing apparatus includes: an acquisition unit that acquires, for each past input for a determining unit, a group of sets each including a determination accuracy on an input and correct/incorrect answer information indicating whether a determination result from the determining unit on the input is a correct or incorrect answer; and a determination unit that determines each threshold for defining each section by using the group acquired by the acquisition unit in an order starting from a section where the determination accuracy is relatively high and in such a manner that a correct answer rate of the determining unit obtained from the group of sets that belongs a section satisfies a target correct answer rate of the determining unit corresponding to the section.
1 . An information processing apparatus useful for a determining system including:
a determining unit that determines an input; a calculation unit that calculates a determination accuracy of the determining unit on the input;
a plurality of post-stage processing units that are each capable of generating an output for the input by performing a post-stage processing on a determination result from the determining unit, have different degrees of dependency on the determination result from the determining unit in generating the output, and are associated with sections, respectively, obtained by dividing, by one or more thresholds, a range where the determination accuracy can lie; and
a control unit that performs a control to cause, to generate the output for the input, one of the plurality of post-stage processing units that corresponds to a section to which the determination accuracy calculated by the calculation unit belongs,
the information processing apparatus being configured to determine the thresholds for the division into the sections for the determination accuracy and comprising:
an acquisition unit that acquires, for each past input for the determining unit, a group of sets each including the determination accuracy on the input and correct/incorrect answer information indicating whether the determination result from the determining unit on the input is a correct or incorrect answer; and
a determination unit that determines each of the thresholds for defining each section by using the group acquired by the acquisition unit in an order starting from a section where the determination accuracy is relatively high and in such a manner that a correct answer rate of the determining unit obtained from the group of sets that belongs a section satisfies a target correct answer rate of the determining unit corresponding to the section.
2 . The information processing apparatus according to claim 1 , wherein
a target recognition rate of the determining unit corresponding to each section has a higher value as the determination accuracy of the section increases, and
the determination unit determines each of the thresholds for defining each section in an order starting from a section where the target recognition rate is relatively high.
3 . The information processing apparatus according to claim 1 , wherein
the post-stage processing unit corresponding to the section where the determination accuracy is relatively high uses a lower cost method for generating the output by using the determination result, and
the determination unit determines each of the thresholds for defining each section in an order starting from a section where the cost is relatively low.
4 . The information processing apparatus according to claim 1 , wherein
the post-stage processing unit corresponding to the section where the determination accuracy is highest directly generates, as the output, the determination result from the determining unit, and
a target correct answer rate set for the determining system is used as the target correct answer rate for the post-stage processing unit corresponding to the section where the determination accuracy is highest.
5 . The information processing apparatus according to claim 1 , wherein
the plurality of post-stage processing units include a second type of post-stage processing unit that generates an output for the input without using the determination result from the determining unit, and
the second type of post-stage processing unit is associated with a section where the determination accuracy is lowest among the sections.
6 . The information processing apparatus according to claim 5 , wherein
the target correct answer rate corresponding to the second type of post-stage processing unit is 0.
7 . The information processing apparatus according to claim 1 , wherein
the plurality of post-stage processing units includes a first post-stage processing unit that directly generates, as the output, the determination result from the determining unit, a second post-stage processing unit that generates the output based on a determination result obtained by a human operator on the input without using the determination result from the determining unit, and a third post-stage processing unit that generates the output through a comparison between the determination result from the determining unit and the determination result obtained by a human operator on the input, and
a target correct answer rate set for the determining system is used as the target correct answer rate for the first post-stage processing unit,
0 is used as the target correct answer rate for the second post-stage processing unit, and
the target correct answer rate for the third post-stage processing unit is obtained from the correct answer rate of the human operator and the correct answer rate of the determining unit.
8 . The information processing apparatus according to claim 1 , wherein
the acquisition unit acquires, instead of the set of the determination accuracy and the correct/incorrect answer information, a set of the determination accuracy and information on a result of accumulation of the correct/incorrect answer information for each determination accuracy within a range from the determination accuracy to a largest value of determination accuracy, and
the determination unit uses the information on the result of accumulation for each determination accuracy to obtain the correct answer rate of a section for which the threshold is to be determined.
9 . An information processing apparatus comprising:
a determining unit that determines an input;
a calculation unit that calculates a determination accuracy of the determining unit on the input;
a plurality of post-stage processing units that are each capable of generating an output for the input by performing a post-stage processing on a determination result from the determining unit, have different degrees of dependency on the determination result from the determining unit in generating the output, and are associated with sections, respectively, obtained by dividing, by one or more thresholds, a range where the determination accuracy can lie;
a control unit that performs a control to cause, to generate the output for the input, one of the plurality of post-stage processing units that corresponds to a section to which the determination accuracy calculated by the calculation unit belongs;
an acquisition unit that acquires, for each past input for the determining unit, a group of sets each including the determination accuracy on the input and correct/incorrect answer information indicating whether the determination result from the determining unit on the input is a correct or incorrect answer; and
a determination unit that determines each of the thresholds for defining each section by using the group acquired by the acquisition unit in an order starting from a section where the determination accuracy is relatively high and in such a manner that a correct answer rate of the determining unit obtained from the group of sets that belongs a section satisfies a target correct answer rate of the determining unit corresponding to the section.
10 . An information processing apparatus comprising:
a determining unit that determines an input to obtain a determination result;
a checking unit that checks whether the determination result is a correct or incorrect answer, adopts the determination result when the determination result is a correct answer, and obtains an accurate determination result on the input and adopts the obtained determination result when the determination result is an incorrect answer;
a unit that obtains a degree indicating a possibility that the determination unit provides a correct answer for each input;
an output control unit that performs a control to output the determination result from the determining unit without using the checking unit with respect to the input for which the degree is equal to or more than a threshold and to output the determination result adopted by the checking unit when the degree is less than the threshold;
a correct answer rate calculation unit that calculates, as a correct answer rate of the determining unit in a first range where the degree is less than the threshold, a proportion of an input determined as a correct answer by the checking unit among inputs within the first range; and
an estimation unit that estimates, based on the correct answer rate in the first range, a correct answer rate of the determining unit in a second range where the degree is equal to or more than the threshold.
11 . The information processing apparatus according to claim 10 , wherein
the first range is from a value that is determined to be more than 0 according to a predetermined criterion to the threshold.
12 . The information processing apparatus according to claim 10 , wherein
the estimation unit assumes that the correct answer rate calculated by the correct answer rate calculation unit corresponds to a first representative value of the degree in the first range, and estimates a correct answer rate corresponding to a second representative value of the degree in the second range by a linear interpolation between the correct answer rate corresponding to the first representative value and a predetermined maximum correct answer rate at a maximum value that the degree can reach.
13 . The information processing apparatus according to claim 10 , wherein
the correct answer rate calculation unit obtains each correct answer rate for a plurality of ranges where the degree is less than the threshold, and
the estimation unit estimates the correct answer rate in the second range based on a tendency of a change in the correct answer rate according to the degree for each of the plurality of ranges.
14 . The information processing apparatus according to claim 10 , wherein
the correct answer rate calculation unit obtains each correct answer rate for a plurality of ranges where the degree is less than the threshold, and
the estimation unit estimates a function for obtaining the correct answer rate corresponding to the degree from a relationship between the correct answer rate for each of the plurality of ranges and the degree, and estimates the correct answer rate in the second range by using the estimated function.
15 . The information processing apparatus according to claim 10 , wherein
the estimation unit obtains a probability density function of the degree from a distribution of occurrence frequency of the degree, and estimates the correct answer rate in the second range by using the probability density function.