Photoelectric conversion device, movable apparatus, photoelectric conversion method, and storage medium

1 . A photoelectric conversion device comprising:

a plurality of pixels each of which is configured to include a sensor unit that generates pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter; and

at least one processor or circuit configured to function as:

a control unit configured to:

generate signals based on count values of the counter counted within plural first accumulation periods and within a second accumulation period,

perform accumulation operations in the plural first accumulation periods and the second accumulation period within a full frame period, wherein each of the first accumulation periods is shorter than the second accumulation period,

for each of the plural first accumulation periods, output a signal generated in the respective first accumulation period between an end of the first accumulation period and an end of the second accumulation period, and

control the number of times of first accumulation periods subsequent to one of the plural first accumulation periods and a duration of the first accumulation periods subsequent to the one of the plural first accumulation periods within the full frame period based on a result of evaluating signals generated based on the signal generated in the one of the plural first accumulation periods.

2 . The photoelectric conversion device according to claim 1 , wherein each of the plural first accumulation periods overlaps with the second accumulation period.

3 . The photoelectric conversion device according to claim 1 , wherein the one of the plural first accumulation periods and the second accumulation period start at the same time.

4 . The photoelectric conversion device according to claim 1 , wherein an end time of the second accumulation period coincides with an end time of the full frame period.

5 . The photoelectric conversion device according to claim 1 , wherein the at least one processor or circuit is further configured to function as a recognition unit configured to recognize an object based on a signal generated in at least the one of the plural first accumulation periods.

6 . The photoelectric conversion device according to claim 5 , wherein the evaluation signals are based on a recognition result output from the recognition unit.

7 . The photoelectric conversion device according to claim 5 , wherein the recognition unit is further configured to recognize the object based on a signal generated in the second accumulation period.

8 . The photoelectric conversion device according to claim 1 , wherein the at least one processor or circuit is further configured to function as a display unit configured to display a signal generated in at least the second accumulation period as an image.

9 . The photoelectric conversion device according to claim 1 , wherein the sensor unit includes an avalanche photodiode.

10 . The photoelectric conversion device according to claim 1 , wherein an average value of the signals generated in the one of the plural first accumulation periods is used as the evaluation signals.

11 . The photoelectric conversion device according to claim 1 , wherein the number of increases per unit time of a minimum value or a maximum value among the signals generated in the one of the plural first accumulation periods is used as the evaluation signals.

12 . The photoelectric conversion device according to claim 1 , wherein a histogram of the signals generated in the one of the plural first accumulation periods is used as the evaluation signals.

13 . A movable apparatus comprising:

the photoelectric conversion device according to claim 1 ,

wherein the at least one processor or circuit is further configured to function as a movable control unit configured to control an operation of the movable apparatus based on a result of recognition processing using the signals generated in at least the one of the plural first accumulation periods.

14 . A photoelectric conversion method in which photoelectric conversion is performed by a plurality of pixels each of which is configured to include a sensor unit that generates pulses corresponding to photons, a counter that counts the number of the pulses, and a memory that stores a count value of the counter, the photoelectric conversion method comprising:

generating signals based on count values of the counter counted within plural first accumulation periods and within a second accumulation period;

performing accumulation operations in the plural first accumulation periods and the second accumulation period within a full frame period, wherein each of the first accumulation periods is shorter than the second accumulation period;

for each of the plural first accumulation periods, outputting a signal generated in the respective first accumulation period between an end of the first accumulation period and an end of the second accumulation period; and

controlling of the number of times of first accumulation periods subsequent to one of the plural first accumulation periods and a duration of the first accumulation periods subsequent to the one of the first accumulation periods within the full frame period based on a result of evaluating signals generated based on the signals generated in the one of the plural first accumulation periods.

15 . A non-transitory computer-readable storage medium configured to store a computer program to cause a photoelectric conversion device according to any of claims 1 to 13 to perform the photoelectric conversion method according to claim 14 .