Photoelectric conversion device, movable apparatus, control method, and storage medium
A photoelectric conversion device includes a plurality of pixels each including a photoelectric conversion unit that emits pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter, a control means for generating a signal based on a difference between a count value of the counter at the start of an accumulation period and a count value at the end of the accumulation period and for performing control so that a signal generated in a first accumulation period is output between the end of the first accumulation period and the end of a second accumulation period, wherein one full frame period includes the first accumulation period and the second accumulation period longer than the first accumulation period, and a recognition processing means for performing recognition processing based on an image signal, and for changing a frequency of recognition within the one full frame period based on subject information.
1 . A photoelectric conversion device comprising:
a plurality of pixels each including a photoelectric conversion unit that emits pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter;
one or more memories storing instructions; and
one or more processors executing the instructions to
generate a signal based on a difference between a count value of the counter at the start of an accumulation period and a count value at the end of the accumulation period,
perform control so that a signal generated in a first accumulation period is output between the end of the first accumulation period and the end of a second accumulation period, wherein one full frame period includes the first accumulation period and the second accumulation period longer than the first accumulation period,
perform recognition processing based on an image signal, and
change a frequency of recognition within the one full frame period based on subject information in the recognition processing.
2 . The photoelectric conversion device according to claim 1 , wherein intervals of timings at which the recognition processing unit starts recognition are set to be equal.
3 . The photoelectric conversion device according to claim 1 , wherein the first accumulation period and the second accumulation period overlap each other.
4 . The photoelectric conversion device according to claim 1 , wherein the first accumulation period and the second accumulation period start simultaneously.
5 . The photoelectric conversion device according to claim 1 , wherein the end of the second accumulation period coincides with the end of the full frame period.
6 . The photoelectric conversion device according to claim 1 , wherein the one or more processors further execute the instructions to recognize a subject based on signals generated at least in the first accumulation period in the recognition processing.
7 . The photoelectric conversion device according to claim 6 , wherein the one or more processors further execute the instructions to further recognize the subject based on signals generated in the second accumulation period in the recognition processing.
8 . The photoelectric conversion device according to claim 1 , wherein the one or more processors further execute the instructions to perform the recognition processing based on signals read out for each first accumulation period within the second accumulation period in the recognition processing.
9 . The photoelectric conversion device according to claim 1 , further comprising a display unit displaying signals generated at least in the second accumulation period as an image.
10 . The photoelectric conversion device according to claim 1 , wherein the photoelectric conversion unit includes an avalanche photodiode.
11 . The photoelectric conversion device according to claim 1 , wherein the subject information includes a moving direction of a subject.
12 . The photoelectric conversion device according to claim 1 , wherein the subject information includes a moving speed of a subject.
13 . The photoelectric conversion device according to claim 1 , wherein the subject information includes a type of subject.
14 . A movable apparatus comprising:
a plurality of pixels each including a photoelectric conversion unit that emits pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter;
one or more memories storing instructions; and
one or more processors executing the instructions to
generate a signal based on a difference between a count value of the counter at the start of an accumulation period and a count value at the end of the accumulation period,
perform control so that a signal generated in a first accumulation period is output between the end of the first accumulation period and the end of a second accumulation period, wherein one full frame period includes the first accumulation period and the second accumulation period longer than the first accumulation period,
perform recognition processing based on an image signal, and
change a frequency of recognition within the one full frame period based on subject information in the recognition processing, wherein
an operation of the movable apparatus is controlled based on a recognition result of the recognition processing.
15 . A method of controlling a photoelectric conversion device including a plurality of pixels each including a photoelectric conversion unit that emits pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter, the method comprising:
generating a signal based on a difference between a count value of the counter at the start of an accumulation period and a count value at the end of the accumulation period;
performing control so that a signal generated in a first accumulation period is output between the end of the first accumulation period and the end of a second accumulation period, and one full frame period includes the first accumulation period and the second accumulation period longer than the first accumulation period;
performing recognition processing based on an image signal; and
changing a frequency of recognition within the one full frame period based on subject information.
16 . A non-transitory computer-readable storage medium configured to store a computer program for a photoelectric conversion device comprising instructions for executing following processes,
wherein the photoelectric conversion device includes a plurality of pixels each including a photoelectric conversion unit that emits pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter;
the computer program comprising instructions for executing following processes:
generating a signal based on a difference between a count value of the counter at the start of an accumulation period and a count value at the end of the accumulation period;
performing control so that a signal generated in a first accumulation period is output between the end of the first accumulation period and the end of a second accumulation period, and one full frame period includes the first accumulation period and the second accumulation period longer than the first accumulation period;
performing recognition processing based on an image signal; and
changing a frequency of recognition within the one full frame period based on subject information.