Sensor auto-configuration

1. An apparatus comprising:

an inertial measurement unit (IMU) configured to measure at least one of motion or orientation of the apparatus;

a processing unit receiving from the IMU the at least one of motion or orientation of the apparatus; and

an image sensor periodically transmitting to the processing unit a first image and a second image,

wherein the first image is constructed from pixels of a first group each exposed with a corresponding first exposure time period that is determined by the processing unit based on the measured at least one of motion or orientation of the apparatus received from the IMU,

wherein the second image is constructed from pixels of a second group that are interleaved among the pixels of the first group and each exposed with a corresponding predetermined second exposure time period based on information related to an illumination condition,

wherein the first exposure time period and the second exposure time period are of unequal overlapping durations.

2. The apparatus of claim 1 , wherein the processing unit is configured to determine positions of each of a plurality of points in the first image, and to process the second image for display based on the determined positions.

3. The apparatus of claim 1 , wherein the IMU comprises an accelerometer, a gyroscope, or a combination of at least one accelerometer and at least one gyroscope.

4. The apparatus of claim 1 , wherein the image sensor is configured to transmit periodically to the processing unit the first image and the second image in alternation.

5. The apparatus of claim 1 , wherein the image sensor is configured to transmit periodically to the processing unit the first image and the second image in parallel with two virtual channels.

6. The apparatus of claim 1 , wherein the image sensor is part of an Augmented Reality (AR) device.

7. A method of reading an image sensor having a matrix of pixels, the method comprising:

exposing pixels of a first group in a row of the matrix with a first exposure time period, wherein the first exposure time period that is determined at bast based on information obtained from an inertial measurement unit (IMU);

exposing pixels of a second group of pixels in the row that are interleaved among the pixels of the first group with a second exposure time period based on information related to an illumination condition, wherein the first exposure time period and the second exposure time period are of unequal overlapping durations;

determining a position of each of multiple identified points in a first image constructed from the pixels of the first group in the row; and

displaying based on the determined positions a second image constructed from the pixels of the second group in the row.

8. The method of claim 7 , wherein an algorithm based on key points is executed in determining a position of each of multiple identified points in the first image.

9. The method of claim 7 , wherein:

the first image is further constructed from the pixels of the first group in each of multiple rows.

10. The method of claim 7 , wherein:

the second image is further constructed from the pixels of the second group in each of multiple rows.

11. The method of claim 7 , wherein the first exposure time period is determined based on information related to an illumination condition and the information obtained from the IMU.

12. The method of claim 7 , wherein the IMU comprises an accelerometer, a gyroscope, or a combination of at least one accelerometer and at least one gyroscope.

13. The method of claim 7 ,

wherein the image sensor and the IMU are affixed thereon to an augmented reality (AR) device, and

wherein the IMU is configured to measure at least one of motion or orientation of the AR device.

14. The method of claim 7 , further comprising:

starting exposure of pixels, in the row, at a first starting instant to create pixels of the first group in the row;

selecting the row of pixels, after the first exposure time period since the first starting instant, to read the pixels of the first group in the row during a first reading period,

starting exposure of pixels, in the row, at a second starting instant to create pixels of the second group in the row after an ending of the first reading period; and

selecting the row of pixels, after the second exposure time period since the second starting instant, to read the pixels of the second group in the row during a second reading period.

15. The method of claim 7 , further comprising:

starting exposure of pixels, in the row, at a first starting instant to create pixels of the first group in the row;

starting exposure of pixels, in the same row, at a second starting instant to create pixels of the second group in the row; and

selecting the row of pixels to read in parallel the pixels of the first group in the row and the pixels of second in the row,

wherein the first starting instant is different from the second starting instant.

16. The method of claim 7 , further comprising:

starting exposure of pixels, in the row, that belongs to the first group of pixels at a first starting instant to create pixels of the first group and pixels of the second group;

selecting the row of pixels, after the first exposure time period since the first starting instant, to read the pixels of the first group during a first reading period,

starting exposure of pixels, in the row, at a second starting instant, to create additional pixels of the second group in the row from the pixels that are read as the pixels of the first group, after an ending of the first reading period;

selecting the row of pixels, after the second exposure time period since the second starting instant, to read the pixels of the second group in the row during a second reading period.

17. The method of claim 7 , further comprising:

starting exposure of pixels, in the row, at a first starting instant to create pixels of the first group in the row;

selecting the row of pixels, after the first exposure time period since the first starting instant, to read the pixels of the first group in the row during a first reading period;

storing in a memory buffer, pixels that are read as the pixels of the first group;

starting exposure of pixels, in the row, at a second starting instant to create pixels of a temporary group in the row after an ending of the first reading period;

selecting the row of pixels, after the second exposure time period since the second starting instant, to read the pixels of the temporary group in the row during a second reading period; and

combining the pixels stored in the memory buffer with the pixels of the temporary group to create the pixels of the second group in the row.

18. The method of claim 7 , further comprising:

transmitting periodically, from the image sensor to a processing unit, the first image and the second image.

19. A non-transitory computer-readable medium on which instructions are encoded for carrying out a process of reading an image sensor, the process comprising:

exposing a first plurality of pixels in a line across the image sensor during a first exposure time period, wherein the first exposure time period is responsive to motion of the image sensor;

exposing a second plurality of pixels in the line that are interleaved among the pixels of the first plurality during a second exposure time period, wherein the second exposure time period is responsive to illumination and of varying duration relative to the first exposure time period;

determining first pixel motions from the exposed pixels of the first plurality; and

processing an image constructed from the exposed pixels of the second plurality based on the determined first pixel motions.

20. The non-transitory computer-readable medium of claim 19 , wherein the exposed pixels of the second plurality are each processed based on the determined first pixel motions of adjacent exposed pixels of the first plurality, respectively.