IP Library Granted Patent US 10,893,802
Granted Patent B2
US 10,893,802 · App. 16/301,313 · Granted Jan 19, 2021

Information processing apparatus, information processing method, and recording medium

Inventors: Yuki Yamamoto (Chiba, JP); Eisuke Nomura (Tokyo, JP); Yoshiaki Iwai (Tokyo, JP); Takuro Noda (Tokyo, JP)
Assignee: SONY CORPORATION
A61B3/113A61B3/14A61B3/156G02B27/02G02B27/021G06F3/038G06T1/00G06T1/0007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,893,802
App. No.
16/301,313
Granted
Jan 19, 2021
Kind
B2
Abstract

There is provided an information processing apparatus to make it possible to dynamically change the blinking pattern of the light source according to the imaging result, the information processing apparatus including: a light source control unit configured to control each of light sources constituting a plurality of light sources that irradiate an eye with light; and an image acquisition unit configured to acquire a captured image of the eye including a bright spot that is a reflection point of the light. The light source control unit controls blinking of each of the light sources on a basis of the captured image of the eye.

Claims (31)

1. An information processing apparatus comprising:

a light source control unit configured to control each of light sources constituting a plurality of light sources that irradiate an eye with light; and

an image acquisition unit configured to acquire a current frame of a captured image of the eye including a bright spot that is a reflection point of the light,

wherein the light source control unit controls blinking of each of the light sources on a basis of imaging processing performed on the current frame of the captured image of the eye,

wherein the light source control unit controls the blinking of each of the light sources on a basis of bright spot light source correspondence information in which the captured bright spot and each of the light sources are associated with each other and imaging analysis information that is information regarding an imaging result of the eye,

wherein the light source control unit determines a light source to be in an on state in a next frame in which imaging processing is performed after the imaging processing is performed on the current frame, on a basis of the bright spot light source correspondence information and the imaging analysis information obtained before imaging the current frame, and p 1 wherein the light source control unit and the image acquisition unit are each implemented via at least one processor.

2. The information processing apparatus according to claim 1 , wherein the light source control unit determines the light source to be in the on state in the next frame in which the imaging processing is performed next after the imaging processing is performed on the current frame, on the basis of the bright spot light source correspondence information and the imaging analysis information obtained before imaging the current frame during the imaging processing.

3. The information processing apparatus according to claim 1 , wherein the light source control unit determines a light source to be in an on state or an off state on a basis of a blinking pattern in which a pattern for setting each of the light sources to be in the on state or the off state is defined, and changes the blinking pattern on the basis of the bright spot light source correspondence information and the imaging analysis information.

4. The information processing apparatus according to claim 1 , wherein the imaging analysis information is position information regarding a pupil.

5. The information processing apparatus according to claim 4 , wherein the light source control unit determines a light source to be in an on state on a basis of a position of the pupil or a pupil center predicted by the position information regarding the pupil.

6. The information processing apparatus according to claim 5 , wherein the light source control unit sets a light source associated with a predetermined number of bright spots of which distances to the predicted position of the pupil or the pupil center are relatively close, among bright spots included in the bright spot light source correspondence information, to be in the on state.

7. The information processing apparatus according to claim 1 , wherein the imaging analysis information is position information of a bright spot of which an associated light source is not present.

8. The information processing apparatus according to claim 7 , wherein the light source control unit sets a light source associated with a bright spot of which a distance to the bright spot of which an associated light source is not present is within a predetermined range, among bright spots included in the bright spot light source correspondence information, to be in an off state.

9. The information processing apparatus according to claim 1 , wherein the imaging analysis information is eye related information that is information regarding a state of an imaged outer corner of eye, inner corner of eye, or eyelid.

10. The information processing apparatus according to claim 9 , wherein, in a case in which it is predicted that the bright spot is not generated on a cornea on a basis of the eye related information, the light source control unit sets a light source associated with the bright spot to be in an off state.

11. The information processing apparatus according to claim 9 , wherein, in a case in which it is predicted that the bright spot is generated on a cornea on a basis of the eye related information, the light source control unit sets a light source associated with the bright spot to be in an on state.

12. The information processing apparatus according to claim 1 , wherein the light source control unit determines a light source to be in an on state on a basis of statistical information regarding an accuracy of the bright spot light source correspondence information.

13. The information processing apparatus according to claim 12 , wherein the light source control unit sets a light source associated with a bright spot of which the accuracy of the bright spot light source correspondence information is higher than a predetermined threshold value to be in the on state on the basis of the statistical information.

14. The information processing apparatus according to claim 12 , wherein the light source control unit sets a light source associated with a bright spot of which the accuracy of the bright spot light source correspondence information is lower than a predetermined threshold value to be in an off state on the basis of the statistical information.

15. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

controlling each of light sources constituting a plurality of light sources that irradiate an eye with light;

acquiring a current frame of a captured image of the eye including a bright spot that is a reflection point of the light;

controlling blinking of each of the light sources on a basis of imaging processing performed on the current frame of the captured image of the eye,

wherein the controlling of the blinking of each of the light sources is based on bright spot light source correspondence information in which the captured bright spot and each of the light sources are associated with each other and imaging analysis information that is information regarding an imaging result of the eye; and

determining a light source to be in an on state in a next frame in which imaging processing is performed after the imaging processing is performed on the current frame, on a basis of the bright spot light source correspondence information and the imaging analysis information obtained before imaging the current frame.

16. An information processing method comprising:

controlling each of light sources constituting a plurality of light sources that irradiate an eye with light;

acquiring a current frame of a captured image of the eye including a bright spot that is a reflection point of the light;

controlling blinking of each of the light sources on a basis of imaging processing performed on the current frame of the captured image of the eye,

wherein the controlling of the blinking of each of the light sources is based on bright spot light source correspondence information in which the captured bright spot and each of the light sources are associated with each other and imaging analysis information that is information regarding an imaging result of the eye; and

determining a light source to be in an on state in a next frame in which imaging processing is performed after the imaging processing is performed on the current frame, on a basis of the bright spot light source correspondence information and the imaging analysis information obtained before imaging the current frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2018
From: YAMAMOTO, YUKI; NOMURA, EISUKE; IWAI, YOSHIAKI; NODA, TAKURO
To: SONY CORPORATION
Reel/Frame 047511/0896 →
Priority Claims (1)
JP 2016-105808 · May 27, 2016 · national
Continuity (1)
Related Publication 20190191994A1 · Jun 27, 2019
Cited By (1)
US 12,474,775