Information processing apparatus and information processing method

1. An information processing apparatus, comprising:

a central processing unit (CPU) configured to:

acquire eye information regarding an eye of a user; and

determine a first line-of-sight direction based on the eye information using a first method, wherein

the eye information includes an eyeball image of an eyeball of the user,

the eyeball image is obtained by performing image-capturing on the eyeball in a state of being irradiated with at least one piece of irradiation light,

the at least one piece of irradiation light is a plurality of pieces of irradiation light,

the first method is a method including detecting, from the eyeball image, at least one bright spot generated due to the at least one piece of irradiation light, and determining the first line-of-sight direction based on the detected at least one bright spot;

determine a second line-of-sight direction based on the eye information using a second method that is different from the first method;

calculate reliability information regarding at least one of reliability of the first line-of-sight direction or reliability of the second line-of-sight direction;

synthesize, based on the reliability information, the first line-of-sight direction and the second line-of-sight direction, wherein

the reliability information includes a weighting coefficient used to synthesize the first line-of-sight direction and the second line-of-sight direction;

determine a line-of-sight direction of the user, based on the synthesized first line-of-sight direction and the synthesized second line-of-sight direction;

detect, from the eyeball image, a pair of bright spots from among a plurality of bright spots generated due to the plurality of pieces of irradiation light, wherein the pair of bright spots is a pair of bright spots provided in a specified arrangement;

detect a corneal region of the eyeball; and

calculate the weighting coefficient based on a position of the pair of bright spots in the corneal region.

2. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

detect a pupil center of the eyeball, and

calculate the weighting coefficient based on a distance from the pair of bright spots to the pupil center.

3. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

calculate an area of the at least one bright spot, and

calculate the weighting coefficient based on the calculated area of the at least one bright spot.

4. The information processing apparatus according to claim 1 , wherein

the first method is a method of determining the first line-of-sight direction based on the pair of bright spots from among the plurality of bright spots, and

the second method is a method of determining the second line-of-sight direction based on a single bright spot from among the plurality of bright spots.

5. The information processing apparatus according to claim 1 , wherein the CPU is further configured to

update at least one of a first correction parameter or a second correction parameter based on the reliability information, the first correction parameter being used to determine the first line-of-sight direction, the second correction parameter being used to determine the second line-of-sight direction.

6. The information processing apparatus according to claim 5 , wherein

the first method is a method of determining the first line-of-sight direction based on a reference point that is set on a surface of the eyeball, and

the CPU is further configured to update the second correction parameter based on the first line-of-sight direction.

7. The information processing apparatus according to claim 5 , wherein

CPU is further configured to update the second correction parameter according to the reliability of the first line-of-sight direction.

8. The information processing apparatus according to claim 7 , wherein

CPU is further configured to calculate the reliability of the first line-of-sight direction based on the eyeball image.

9. The information processing apparatus according to claim 8 , wherein the at least one piece of irradiation light is irradiated onto one of a central region or a surrounding region of an eye region of the user.

10. The information processing apparatus according to claim 5 , wherein the CPU is further configured to

update the second correction parameter based on a position of a pupil in an eye region in the eyeball image, the eye region including the eyeball.

11. The information processing apparatus according to claim 5 , wherein

the CPU is further configured to correct the second correction parameter based on the weighting coefficient.

12. The information processing apparatus according to claim 1 , wherein

the second method is a method of determining the second line-of-sight direction by detecting at least one of a position or a shape of a specified feature of the eyeball from the eyeball image.

13. The information processing apparatus according to claim 12 , wherein the specified feature includes one of a pupil, a cornea, or an iris of the eyeball.

14. An information processing method, comprising:

acquiring, by a computer system, eye information regarding an eye of a user;

determining, by the computer system, a first line-of-sight direction based on the eye information using a first method, wherein

the eye information includes an eyeball image of an eyeball of the user,

the eyeball image is obtained by performing image-capturing on the eyeball in a state of being irradiated with at least one piece of irradiation light,

the at least one piece of irradiation light is a plurality of pieces of irradiation light,

the first method is a method including detecting, from the eyeball image, at least one bright spot generated due to the at least one piece of irradiation light, and determining the first line-of-sight direction based on the detected at least one bright spot;

determining, by the computer system, a second line-of-sight direction based on the eye information using a second method that is different from the first method;

calculating, by the computer system, reliability information regarding at least one of reliability of the first line-of-sight direction or reliability of the second line-of-sight direction;

synthesizing, based on the reliability information, the first line-of-sight direction and the second line-of-sight direction, wherein

the reliability information includes a weighting coefficient used to synthesize the first line-of-sight direction and the second line-of-sight direction;

determining, by the computer system, a line-of-sight direction of the user, based on the synthesized first line-of-sight direction and the synthesized second line-of-sight direction;

detecting, from the eyeball image, a pair of bright spots from among a plurality of bright spots generated due to the plurality of pieces of irradiation light, wherein the pair of bright spots is a pair of bright spots provided in a specified arrangement;

detecting a corneal region of the eyeball; and

calculating the weighting coefficient based on a position of the pair of bright spots in the corneal region.

15. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

acquiring eye information regarding an eye of a user;

determining a first line-of-sight direction based on the eye information using a first method, wherein

the eye information includes an eyeball image of an eyeball of the user,

the eyeball image is obtained by performing image-capturing on the eyeball in a state of being irradiated with at least one piece of irradiation light,

the at least one piece of irradiation light is a plurality of pieces of irradiation light,

the first method is a method including detecting, from the eyeball image, at least one bright spot generated due to the at least one piece of irradiation light, and determining the first line-of-sight direction based on the detected at least one bright spot;

determining a second line-of-sight direction based on the eye information using a second method that is different from the first method;

calculating reliability information regarding at least one of reliability of the first line-of-sight direction or reliability of the second line-of-sight direction;

synthesizing, based on the reliability information, the first line-of-sight direction and the second line-of-sight direction, wherein

the reliability information includes a weighting coefficient used to synthesize the first line-of-sight direction and the second line-of-sight direction;

determining a line-of-sight direction of the user, based on the synthesized first line-of-sight direction and the synthesized second line-of-sight direction;

detecting, from the eyeball image, a pair of bright spots from among a plurality of bright spots generated due to the plurality of pieces of irradiation light, wherein the pair of bright spots is a pair of bright spots provided in a specified arrangement;

detecting a corneal region of the eyeball; and

calculating the weighting coefficient based on a position of the pair of bright spots in the corneal region.