Head-mounted display apparatus that controls exposure timings of plurality of imaging units

1 . A head-mounted display apparatus comprising:

a display unit;

a first imaging unit;

a second imaging unit; and

a generation unit configured to, based on a signal indicating an image input timing of input of an image to the display unit, generate a first signal for controlling a start of exposure of the first imaging unit and a second signal for controlling a start of exposure of the second imaging unit,

wherein the generation unit adjusts the generation timing of the first and second signals so that a predetermined time within respective exposure periods of the first and second imaging units substantially coincides with the image input timing of the display unit.

2 . The head-mounted display apparatus according to claim 1 , wherein the generation unit generates the first and second signals so that a first time in an exposure time of the first imaging unit and a second time in an exposure time of the second imaging unit coincide with each other.

3 . The head-mounted display apparatus according to claim 1 , wherein in a case where an exposure time of the first imaging unit or an exposure time of the second imaging unit is correspondingly adjusted, the generation unit changes a generation timing of the first or second signal so that a first time in the exposure time of the first imaging unit and a second time in the exposure time of the second imaging unit coincide with each other.

4 . The head-mounted display apparatus according to claim 1 , wherein in a case where processing times of images captured by the first and second imaging units vary between frames, the generation unit changes a generation timing of the first or second signal.

5 . The head-mounted display apparatus according to claim 1 , further comprising an identifying unit configured to identify a region of interest in an imaging range of the first imaging unit.

6 . The head-mounted display apparatus according to claim 5 , wherein the identifying unit is a first detection unit configured to detect a line-of-sight position of a wearer of the head-mounted display apparatus in the imaging range of the first imaging unit and identifies the line-of-sight position as the region of interest.

7 . The head-mounted display apparatus according to claim 6 , wherein based on the signal indicating the image input timing of the input of the image to the display unit, the generation unit generates a fourth signal for controlling an acquisition timing of the line-of-sight position detected by the first detection unit.

8 . The head-mounted display apparatus according to claim 7 , wherein the generation unit generates the first, second, and fourth signals so that a first time in an exposure time of the first imaging unit, a second time in an exposure time of the second imaging unit, and the acquisition timing of the line-of-sight position detected by the first detection unit coincide with each other.

9 . The head-mounted display apparatus according to claim 5 , wherein a first time in an exposure time of the first imaging unit is set based on the region of interest in the imaging range of the first imaging unit.

10 . The head-mounted display apparatus according to claim 5 ,

wherein the display unit displays a combined image of an image captured by the first imaging unit and an image of a virtual space based on an image captured by the second imaging unit and a position and orientation detected by a second detection unit, and

wherein the identifying unit identifies the region of interest based on a drawing position of a virtual object included in the image of the virtual space.

11 . The head-mounted display apparatus according to claim 5 , wherein the identifying unit identifies the region of interest based on extraction information regarding a feature extracted from an image captured by the second imaging unit.

12 . The head-mounted display apparatus according to claim 11 , wherein the extracted feature is a marker.

13 . The head-mounted display apparatus according to claim 1 , further comprising a second detection unit configured to detect a position and orientation of the head-mounted display apparatus,

wherein based on the signal indicating the image input timing of the input of the image to the display unit, the generation unit generates a third signal for controlling an acquisition timing of the position and orientation detected by the second detection unit.

14 . The head-mounted display apparatus according to claim 13 , wherein the generation unit generates the first, second, and third signals so that a first time in an exposure time of the first imaging unit, a second time in an exposure time of the second imaging unit, and the acquisition timing of the position and orientation detected by the second detection unit coincide with each other.

15 . The head-mounted display apparatus according to claim 13 , wherein the display unit displays a combined image of an image captured by the first imaging unit and an image of a virtual space based on an image captured by the second imaging unit and the position and orientation detected by the second detection unit.

16 . The head-mounted display apparatus according to claim 1 , wherein the first imaging unit captures an image using a first shutter method, and the second imaging unit captures an image using a second shutter method different from the first shutter method.

17 . The head-mounted display apparatus according to claim 16 ,

wherein the first shutter method is a rolling shutter method, and

wherein the second shutter method is a global shutter method.

18 . The head-mounted display apparatus according to claim 1 , wherein the display unit displays a combined image of an image captured by the first imaging unit and an image of a virtual space based on an image captured by the second imaging unit.

19 . A system comprising:

a head-mounted display apparatus; and

an image processing apparatus,

the head-mounted display apparatus comprising:

a display unit;

a first imaging unit;

a second imaging unit; and

a generation unit configured to, based on a signal indicating an image input timing of input of an image to the display unit, generate a first signal for controlling a start of exposure of the first imaging unit and a second signal for controlling a start of exposure of the second imaging unit,

wherein the generation unit adjusts the generation timing of the first and second signals so that a predetermined time within respective exposure periods of the first and second imaging units substantially coincides with the image input timing of the display unit,

the image processing apparatus comprising:

a combining unit configured to generate an image of a virtual space based on an image captured by the second imaging unit and generate a combined image obtained by combining the image of the virtual space and an image captured by the first imaging unit; and

a transmission unit configured to transmit the combined image and the signal indicating the image input timing to the head-mounted display apparatus,

wherein the display unit displays the combined image.

20 . A control method for a head-mounted display apparatus including a display unit, a first imaging unit, and a second imaging unit, the control method comprising, based on a signal indicating an image input timing of input of an image to the display unit,

generating a first signal for controlling a start of exposure of the first imaging unit and a second signal for controlling a start of exposure of the second imaging unit,

wherein the generating adjusts the generation timing of the first and second signals so that a predetermined time within respective exposure periods of the first and second imaging units substantially coincides with the image input timing of the display unit.