Object determining apparatus, image pickup apparatus, and object determining method

1 . An object determining apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect an object from image data obtained by imaging,

acquire information about orientation of the object from the image data,

determine a main object in the image data using a detection result of the object and the information about the orientation,

acquire a first evaluation value indicating possibility that the object is the main object from the information about the orientation,

determine the main object by comparing the first evaluation value and a first threshold, and

change the first threshold according to the detection result of the object.

2 . The object determining apparatus according to claim 1 , the processor is configured to:

acquire a first evaluation value indicating possibility that the object is the main object from the information about the orientation,

determine the main object by comparing the first evaluation value and a first threshold, and

change the number of pieces of image data obtained by imaging from which the information about the orientation is acquired, for acquiring the first evaluation value according to the detection result of the object.

3 . The object determining apparatus according to claim 1 , wherein in a case where a plurality of objects are detected from the image data, the processor is configured to determine the main object using the information about the orientation of each of the plurality of objects in order according to the detection result.

4 . The object determining apparatus according to claim 1 , wherein the processor is configured to acquire a second evaluation value indicating a similarity of the object to registered object data as the detection result of the object.

5 . The object determining apparatus according to claim 4 , wherein the processor is configured to acquire the second evaluation value using a plurality of registered object data in a preset order.

6 . The object determining apparatus according to claim 1 , the processor is configured to:

acquire a first evaluation value indicating possibility that the object is the main object from the information about the orientation,

acquire a second evaluation value indicating a similarity of the object to a registered object,

perform authentication processing for the object by comparing the second evaluation value with a second threshold,

determine as the main object an object that has been determined to be an object that is likely to be the main object based on the first evaluation value and that has been authenticated in the authentication processing, and

change the second threshold according to the first evaluation value.

7 . The object determining apparatus according to claim 6 , wherein in a case where a plurality of objects are detected from the image data, the processor is configured to set priority of the object subject to the authentication processing according to the first evaluation value of each of the plurality of objects.

8 . The object determining apparatus according to claim 1 , wherein the processor is configured to detect the object using a convolutional neural network.

9 . An image pickup apparatus comprising:

an image sensor configured to capture an object image; and

the object determining apparatus according to claim 1 .

10 . An object determining apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect an object from image data obtained by imaging,

perform personal authentication for the object,

detect an orientation of the object from the image data and acquire information about the orientation,

determine a main object in the image data using a detection result of the object and the information about the orientation, and

control at least one of a detection of the orientation and a determination of the main object, by prioritizing authentication of an object likely to be the main object based on information about the orientation, so that an authenticated object is more likely to be determined as the main object than an unauthenticated object.

11 . The object determining apparatus according to claim 10 , wherein the processor is configured to make the number of pieces of image data obtained by imaging from which the information about the orientation is acquired for determining the main object for the authenticated object smaller than that the number of image data for the unauthenticated object.

12 . An image pickup apparatus comprising:

an image sensor configured to capture an object image; and

the object determining apparatus according to claim 10 .

13 . An object determining apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect an object from image data obtained by imaging,

perform personal authentication for the object,

acquire information about orientation of the object from the image data,

determine a main object in the image data using a detection result of the object and the information about the orientation,

acquire a first evaluation value indicating possibility that the object is the main object from the information about the orientation, and

determine the main object by comparing the first evaluation value and a first threshold,

preferentially determine an authenticated object, since a first reliability indicating a likelihood of the main object obtained from the orientation information is equal to or higher than the first threshold and is the highest, as the main object, in a case where there are a plurality of objects for each of which the information about the orientation has been acquired.

14 . An image pickup apparatus comprising:

an image sensor configured to capture an object image; and

the object determining apparatus according to claim 13 .

15 . An object determining method comprising the steps of:

detecting an object from image data obtained by imaging;

acquiring information about orientation of the object from the image data;

determining a main object in the image data using a detection result of the object and the information about the orientation;

acquiring a first evaluation value indicating possibility that the object is the main object from the information about the orientation,

determining the main object by comparing the first evaluation value and a first threshold, and

changing the first threshold according to the detection result of the object.

16 . A non-transitory computer-readable storage medium storing a program that causes a computer to execute the object determining method described in claim 15 .

17 . An object determining method comprising the steps of:

detecting an object from image data obtained by imaging;

performing personal authentication for the object;

detecting an orientation of the object from the image data and acquire information about the orientation;

determining a main object in the image data using a detection result of the object and the information about the orientation; and

controlling at least one of a detection of the orientation and a determination of the main object, by prioritizing authentication of an object likely to be the main object based on information about the orientation, so that an authenticated object is more likely to be determined as the main object than an unauthenticated object.

18 . An object determining method comprising the steps of:

detecting an object from image data obtained by imaging;

performing personal authentication for the object;

acquiring information about orientation of the object from the image data;

determining a main object in the image data using a detection result of the object and the information about the orientation;

acquiring a first evaluation value indicating possibility that the object is the main object from the information about the orientation, and

determining the main object by comparing the first evaluation value and a first threshold,

preferentially determining an authenticated object, since a first reliability indicating a likelihood of the main object obtained from the orientation information is equal to or higher than the first threshold and is the highest, as the main object, in a case where there are a plurality of objects for each of which the information about the orientation has been acquired.

19 . A non-transitory computer-readable storage medium storing a program that causes a computer to execute the object determining method described in claim 18 .