Head mounted display of video see-through type

1 . A head mounted display of a video see-through type, the head mounted display comprising:

an image sensor configured to be able to execute, in parallel and within a same frame period, (1) storing, in a first charge storage path, of signal charges generated by a photoelectric conversion portion and corresponding to a first image representing a real space and (2) storing, in a second charge storage path different from the first charge storage path, of signal charges generated by the photoelectric conversion portion and corresponding to a second image representing the real space;

a display configured to display the first image;

a detection unit configured to detect a predetermined real object from the second image; and

a processor configured to perform predetermined processing based on a result of the detection of the predetermined real object,

wherein the storing in the second charge storage path of the signal charges generated by the photoelectric conversion portion and corresponding to the second image completes before the storing in the first charge storage path of the signal charges generated by the photoelectric conversion portion and corresponding to the first image completes.

2 . The head mounted display according to claim 1 , wherein the processor combines a graphic with the first image, based on the result of the detection of the predetermined real object.

3 . The head mounted display according to claim 1 , wherein the image sensor captures the second image in a shorter imaging period than an imaging period of the first image.

4 . The head mounted display according to claim 1 , wherein the image sensor captures the second image at a lower resolution than a resolution of the first image.

5 . The head mounted display according to claim 4 , wherein an imaging range of the second image is substantially same as an imaging range of the first image.

6 . The head mounted display according to claim 4 , wherein an imaging range of the second image is a part of an imaging range of the first image.

7 . The head mounted display according to claim 1 , wherein capturing of the second image completes before capturing of the first image completes, and

wherein processing for the detection unit to detect the predetermined real object from the second image completes before capturing of the first image completes.

8 . The head mounted display according to claim 1 , wherein capturing of the second image completes before capturing of the first image completes, and

wherein at least a part of a period of processing for the detection unit to detect the predetermined real object from the second image overlaps with at least a part of a period for the image sensor to read the first image.

9 . The head mounted display according to claim 1 , wherein the image sensor includes an image sensor for a right eye and an image sensor for a left eye,

wherein a phase in which the first image is captured is different between the image sensor for the right eye and the image sensor for the left eye, and

wherein a phase in which the second image is captured is different between the image sensor for the right eye and the image sensor for the left eye.

10 . The head mounted display according to claim 1 , wherein the image sensor is an image sensor for a right eye,

wherein the head mounted display further comprises another image sensor configured to be able to execute, in parallel, capturing of a first image representing a real space, and capturing of a second image representing the real space,

wherein the another image sensor is an image sensor for a left eye,

wherein a phase in which the first image is captured is same for the image sensor for the right eye and the image sensor for the left eye, and

wherein a phase in which the second image is captured is different between the image sensor for the right eye and the image sensor for the left eye.

11 . A control method of a head mounted display of a video see-through type, the control method comprising:

executing with an image sensor, in parallel and within a same frame period, (1) storing, in a first charge storage path, of signal charges generated by a photoelectronic conversion portion and corresponding to a first image representing a real space and (2) storing, in a second charge storage path different from the first charge storage path, of signal charges generated by the photoelectric conversion portion and corresponding to a second image representing the real space; displaying the first image;

detecting a predetermined real object from the second image; and

performing predetermined processing based on a result of the detection of the predetermined real object,

wherein the storing in the second charge storage path of the signal charges generated by the photoelectric conversion portion and corresponding to the second image completes before the storing in the first charge storage path of the signal charges generated by the photoelectric conversion portion and corresponding to the first image completes.

12 . A non-transitory computer-readable medium that stores a program, wherein the program causes a computer to execute a control method of a head mounted display of a video see-through type, the control method comprising:

executing with an image sensor, in parallel and within a same frame period, (1) storing, in a first charge storage path, of signal charges generated by a photoelectric conversion portion and corresponding to a first image representing a real space and (2) storing, in a second charge storage path different from the first charge storage path, of signal charges generated by the photoelectric conversion portion and corresponding to a second image representing the real space; displaying the first image;

detecting a predetermined real object from the second image; and

performing predetermined processing based on a result of the detection of the predetermined real object,

wherein the storing in the second charge storage path of the signal charges generated by the photoelectric conversion portion and corresponding to the second image completes before the storing in the first charge storage path of the signal charges generated by the photoelectric conversion portion and corresponding to the first image completes.

13 . The head mounted display according to claim 1 , wherein the image sensor is an image pickup element, and

wherein there is no parallax between the first image and the second image.