Adjusting image sensor parameters based on gaze
There is provided an image acquisition controller for acquiring an adapted image. The image acquisition controller comprises an interface towards a first image sensor, the first image sensor being arranged to acquire an image, and an interface towards a gaze tracking unit, the gaze tracking unit comprising a second image sensor for registering a gaze position on a scene associated with the image acquired by the first image sensor. The image acquisition controller is arranged to periodically receive information over the interface towards the gaze tracking unit about at least a position on the scene associated with the image provided from the first image sensor where the scene represents a larger part of an image registered by the first image sensor than intended to be acquired as the adapted image. The image acquisition controller is arranged to provide information over the interface towards the first image sensor about a position on the first image sensor, a size of a sensor area associated with the position on the first image sensor and a frame rate for image acquisition within said area. The image acquisition controller is arranged to receive image data over the interface towards the first image sensor wherein the image data at least comprises image data with the size, the position on the first image sensor, and the frame rate for image acquisition within said area such that the received image data is stored. An image acquisition system or device comprising the controller, a communication device with corresponding image acquisition capabilities, a method of image acquisition, and a computer program for implementing the method are also disclosed.
1 . An image acquisition controller for acquiring an adapted image, the image acquisition controller comprising:
an interface towards a first image sensor, the first image sensor being arranged to acquire an image; and
an interface towards a gaze tracking unit, the gaze tracking unit comprising a second image sensor for registering a gaze position on a scene associated with an image acquired by the first image sensor, wherein
the image acquisition controller is arranged to periodically receive information over the interface towards the gaze tracking unit about at least a position on the scene associated with the image provided from the first image sensor where the scene represents a larger part of an image registered by the first image sensor than intended to be acquired as the adapted image;
the image acquisition controller is arranged to provide information over the interface towards the first image sensor about a position on the first image sensor, a size of a sensor area associated with the position on the first image sensor and a frame rate for image acquisition within said area; and
the image acquisition controller is arranged to receive image data over the interface towards the first image sensor wherein the image data at least comprises image data with the size, the position on the first image sensor, and the frame rate for image acquisition within said area such that the received image data is stored,
wherein the image acquisition controller is arranged to monitor timing of the information over the interface towards the gaze tracking unit about a gaze at the respective position on the scene, wherein the size of the sensor area associated with the position depends on a duration of the gaze at the position, respectively.
2 . The image acquisition controller of claim 1 , wherein the interface towards the first image sensor comprises;
a control interface arranged to provide the information about the position on the first image sensor, the size of a sensor area associated with the position on the first image sensor and the frame rate for image acquisition within said area; and
an image data interface arranged to receive the image data.
3 . The image acquisition controller of claim 1 , wherein at least one of the size of the sensor area associated with the position on the first image sensor and the frame rate for image acquisition within the area depends on a number of periodically received positions being within a distance from each other below a first threshold.
4 . The image acquisition controller of claim 1 , arranged to recognise objects from the image data, wherein the information about the position on the first image sensor and the size of the sensor area associated with the position on the first image sensor provided over the interface towards the first image sensor is adapted based on a found object.
5 . An image acquisition system comprising:
a first image sensor arranged to acquire an image;
a gaze tracking unit comprising a second image sensor for registering a gaze position on a scene associated with an image acquired by the first image sensor; and
an image acquisition controller according to claim 1 .
6 . A communication device comprising:
a transceiver arranged to communicate with a communications network; and
an image acquisition system according to claim 5 ,
wherein the communication device is capable of transmitting an adapted image based on the stored image data via the transceiver.
7 . An image acquisition method comprising:
acquiring an image by a first image sensor;
registering a series of gaze positions at a scene associated with the image acquired by the first image sensor;
providing information to the first image sensor about a position on the first image sensor, a size of a sensor area associated with the position on the first image sensor and a frame rate for image acquisition within said area;
receiving image data from the first image sensor wherein the image data at least comprises image data with the size, the position on the first image sensor, and the frame rate for image acquisition within said area;
storing an adapted image based on the received image data, where the scene represents a larger part of an image registered by the first image sensor than intended to be acquired as the adapted image; and
monitoring timing of the gaze at the respective position on the scene, wherein the size of the sensor area associated with the position depends on a duration of the gaze at the position, respectively.
8 . The method of claim 7 , wherein at least one of the size of the sensor area associated with the position on the first image sensor and the frame rate for image acquisition within the area depends on a number of periodically received positions being within a distance from each other below a first threshold.
9 . The method of claim 7 , comprising recognising objects from the image data, wherein the information about the position on the first image sensor and the size of the sensor area associated with the position on the first image sensor provided over the interface towards the first image sensor is adapted based on a found object.
10 . A non-transitory computer readable storage medium comprising a computer program comprising instructions which, when executed on a processor of an image acquisition device, causes the image acquisition device to perform an image acquisition method comprising:
acquiring an image by a first image sensor;
registering a series of gaze positions at a scene associated with the image acquired by the first image sensor;
providing information to the first image sensor about a position on the first image sensor, a size of a sensor area associated with the position on the first image sensor and a frame rate for image acquisition within said area;
receiving image data from the first image sensor wherein the image data at least comprises image data with the size, the position on the first image sensor, and the frame rate for image acquisition within said area;
storing an adapted image based on the received image data, where the scene represents a larger part of an image registered by the first image sensor than intended to be acquired as the adapted image; and
monitoring timing of the gaze at the respective position on the scene, wherein the size of the sensor area associated with the position depends on a duration of the gaze at the position, respectively.