IP Library Granted Patent US 10,757,337
Granted Patent B2
US 10,757,337 · App. 16/097,683 · Granted Aug 25, 2020

Information processing apparatus and information processing method to control exposure for imaging the eye

Inventors: Eisuke Nomura (Tokyo, JP); Yoshiaki Iwai (Tokyo, JP); Yuki Yamamoto (Chiba, JP); Takuro Noda (Tokyo, JP)
Assignee: SONY CORPORATION
H04N5/2352G02B27/02G03B7/097G03B15/02G03B15/05G03B17/00G06K9/00604H04N5/232H04N5/2351H04N5/2353
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,757,337
App. No.
16/097,683
Granted
Aug 25, 2020
Kind
B2
Abstract

An information processing device including a light source control unit that controls a light source that irradiates an eye with light; and an exposure control unit that controls exposure for imaging the eye. The light source control unit sets a state of the light source to an on state or an off state at a time when the exposure is not performed.

Claims (59)

1. An information processing apparatus, comprising:

circuitry configured to:

control a light source that irradiates an eye with light;

control exposure for an imaging operation of the eye;

acquire imaging processing information comprising an exposure end time corresponding to each frame of a plurality of successive frames and an exposure start time corresponding to each frame of the plurality of successive frames, wherein the plurality of successive frames is associated with the imaging operation;

determine the exposure end time of a first frame of a plurality of successive frames based on the imaging processing information;

determine the exposure start time of a second frame of the plurality of successive frames based on the imaging processing information, wherein the second frame is successive to the first frame; and

change a state of the light source in a time interval between the exposure end time of the first frame and the exposure start time of the second frame, wherein

the state of the light source is one of an on state or an off state, and

the state of the light source is changed after the exposure end time of the first frame.

2. The information processing apparatus according to claim 1 , wherein

the imaging processing information further comprises a completion notification of an exposure operation, and

the circuitry is further configured to change, based on the acquired imaging processing information, the state of the light source to one of the on state or the off state subsequent to a time of acquisition of the completion notification of the exposure operation.

3. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to

change, based on the acquired imaging processing information, the state of the light source to one of the on state or the off state before the exposure start time of the second frame.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control exposure by a rolling shutter method.

5. The information processing apparatus according to claim 4 , wherein the circuitry is further configured to:

acquire information associated with a predicted bright spot position, wherein

the predicted bright spot position is a position on a captured image,

a bright spot is predicted to appear at the predicted bright spot position, and

the bright spot is a reflection point of the light irradiated on the eye; and

change the state of the light source to one of the on state or the off state at a time when the exposure is not performed with respect to a line in the captured image, wherein the line in the captured image corresponds to the predicted bright spot position.

6. The information processing apparatus according to claim 5 , wherein the circuitry is further configured to set a timing at which a state of each light source of a plurality of light sources is changed to one of the on state or the off state.

7. The information processing apparatus according to claim 5 , wherein the predicted bright spot position is predicted based on at least one of prediction related information including a frame rate, three-dimensional position attitude information of an imaging unit corresponding to a frame subjected to imaging processing, three-dimensional position information of a bright spot corresponding to the frame subjected to the imaging processing, or position information of the bright spot in the captured image corresponding to the frame that is subjected to the imaging processing.

8. The information processing apparatus according to claim 7 , wherein

the circuitry is further configured to change the state of the light source to one of the on state or the off state based on predicted bright spot position related information corresponding to the line in the captured image, and

the line in the captured image corresponds to the prediction related information and the predicted bright spot position.

9. The information processing apparatus according to claim 1 , further comprising an imaging unit configured to image the eye based on the light.

10. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to set luminance of the light source based on one of illuminance information, captured image illuminance information generated by an analysis result of a captured image, or a parameter related to imaging processing.

11. An information processing method, the information processing method comprising:

controlling a light source that irradiates an eye with light;

controlling exposure in an imaging operation on the eye based on the light;

acquiring imaging processing information comprising an exposure end time corresponding to each frame of a plurality of successive frames and an exposure start time corresponding to each frame of the plurality of successive frames, wherein the plurality of successive frames is associated with the imaging operation;

determining the exposure end time of a first frame of a plurality of successive frames based on the imaging processing information;

determining the exposure start time of a second frame of the plurality of successive frames based on the imaging processing information, wherein the second frame is successive to the first frame; and

changing a state of the light source in a time interval between the exposure end time of the first frame and the exposure start time of the second frame, wherein

the state of the light source is one of an on state or an off state, and

the state of the light source is changed after the exposure end time of the first frame.

12. An information processing apparatus, comprising:

circuitry configured to:

control a light source that irradiates an eye with light;

control exposure for an imaging operation of the eye;

determine an exposure end time of a first frame of a plurality of successive frames associated with the imaging operation;

determine an exposure start time of a second frame of the plurality of successive frames, wherein the second frame is successive to the first frame; and

change, in a case where imaging processing information including the exposure end time is not acquired, a state of the light source in a time interval between the determined exposure end time of the first frame and the determined exposure start time of the second frame based on light source control setting information, wherein

the state of the light source is one of an on state or an off state, and

the light source control setting information corresponds to

an exposure time for each frame of the plurality of successive frames, and

one of an on time of the light source or an off time of the light source.

13. An information processing apparatus, comprising:

circuitry configured to:

control a light source that irradiates an eye with light;

control exposure for an imaging operation of the eye;

acquire imaging processing information that comprises a completion notification of an exposure operation;

determine an exposure end time of a first frame of a plurality of successive frames based on the imaging processing information;

determine an exposure start time of a second frame of the plurality of successive frames based on the imaging processing information, wherein the second frame is successive to the first frame; and

change a state of the light source in a time interval between the exposure end time of the first frame and the exposure start time of the second frame, wherein

the state of the light source is one of an on state or an off state, and

the state of the light source is changed to one of the on state or the off state subsequent to a time of acquisition of the completion notification of the exposure operation.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2018
From: NOMURA, EISUKE; IWAI, YOSHIAKI; YAMAMOTO, YUKI; NODA, TAKURO
To: SONY CORPORATION
Reel/Frame 047354/0856 →