Granted Patent B2

US 12,748,491 · App. 19/077,326 · Granted Sep 29, 2026

Inventors: Yoshihiko Konno (Tokyo, JP); Koichi Ito (Tokyo, JP)

Assignee: Canon Kabushiki Kaisha

G06F3/013

Abstract

Claims (45)

1 . A head mounted display device comprising:

a right image sensor disposed on an edge of a right opening portion, the right image sensor being configured to capture an image of a right eye facing a right lens disposed in the right opening portion;

a left image sensor disposed on an edge of a left opening portion, the left image sensor being configured to capture an image of a left eye facing a left lens disposed in the left opening portion;

a plurality of right light sources disposed along the edge of the right opening portion, the plurality of right light sources being disposed to illuminate the right eye;

a plurality of left light sources disposed along the edge of the left opening portion, the plurality of left light sources being disposed to illuminate the left eye, and

a processor,

wherein the right image sensor is disposed near an inner corner of the right eye,

wherein the left image sensor is disposed near an inner corner of the left eye,

the plurality of right light sources includes

a first right light source group disposed at a first distance from an optical axis of the right lens and configured to emit light toward the right eye through the right lens, and

a second right light source group disposed at a second distance longer than the first distance from the optical axis of the right lens and configured to emit light toward the right eye without passing through the right lens,

the plurality of left light sources includes

a first left light source group disposed at the first distance from an optical axis of the left lens and configured to emit light toward the left eye through the left lens, and

a second left light source group disposed at the second distance from the optical axis of the left lens and configured to emit light toward the left eye without passing through the left lens,

the processor

performs first line-of-sight detection based on reflection images acquired by the right image sensor,

determines, based on a result of the first line-of-sight detection, whether the right eye has rotated toward a side on which the right image sensor is disposed or has rotated toward a side opposite to the right image sensor,

controls, in a case where it is determined that the right eye has rotated toward the side on which the right image sensor is disposed, to perform second line-of-sight detection using reflection images corresponding to the first right light source group, and

controls, in a case where it is determined that the right eye has rotated toward the side opposite to the right image sensor, to perform second line-of-sight detection using reflected images corresponding to the second right light source group, and

the processor

performs first line-of-sight detection based on reflection images acquired by the left image sensor,

determines, based on a result of the first line-of-sight detection, whether the left eye has rotated toward a side on which the left image sensor is disposed or has rotated toward a side opposite to the left image sensor,

controls, in a case where it is determined that the left eye has rotated toward the side on which the left image sensor is disposed, to perform second line-of-sight detection using reflection images corresponding to the first left light source group, and

controls, in a case where it is determined that the left eye has rotated toward the side opposite to the left image sensor, to perform the second line-of-sight detection using reflected images corresponding to the second left light source group.

2 . The head mounted display device according to claim 1 ,

wherein the right image sensor and the left image sensor are disposed on a horizontal line passing through the optical axis of the right lens and the optical axis of the left lens.

3 . The head mounted display device according to claim 1 ,

wherein the right image sensor is disposed at a position at 270° rotated clockwise from a position directly above the optical axis of the right lens, with the optical axis of the right lens as a center, and

wherein the left image sensor is disposed at a position at 90° rotated clockwise from a position directly above the optical axis of the left lens, with the optical axis of the left lens as a center.

4 . The head mounted display according to claim 1 ,

wherein a number of right light sources disposed in a 120° range on the opposite side of the right image sensor with respect to the optical axis of the right lens is more than a number of right light sources disposed in a range other that the outside the 120° range on the opposite side of the right image sensor with respect to the optical axis of the right lens, and

wherein a number of left light sources disposed in a 120° range on the opposite side of the left image sensor with respect to the optical axis of the left lens is more than a number of left light sources disposed in a range other that the outside the 120° range on the opposite side of the left image sensor with respect to the optical axis of the left lens.

5 . The head mounted display according to claim 1 , wherein intervals between right light sources disposed in a 120° range on the opposite side of the right image sensor with respect to the optical axis of the right lens is smaller than intervals between right light sources disposed in a range other that the outside the 120° range on the opposite side of the right image sensor with respect to the optical axis of the right lens, and

wherein intervals between left light sources disposed in a 120° range on the opposite side of the left image sensor with respect to the optical axis of the left lens is more than intervals between left light sources disposed in a range other that the outside the 120° range on the opposite side of the left image sensor with respect to the optical axis of the left lens.

6 . The head mounted display according to claim 1 ,

wherein a number of right light sources disposed on a lower side of a horizontal line passing through the optical axis of the right lens and the optical axis of the left lens is more than a number of right light sources disposed on an upper side of the horizontal line, and

wherein a number of left light sources disposed on the lower side of the horizontal line is more than a number of left light sources disposed on the upper side of the horizontal line.

7 . The head mounted display according to claim 1 ,

each right light source of the first right light source group and each left light source of the first left light source group are lit at a higher brightness than each right light source of the second right light source group and left light source of the second left light source group.

8 . The head mounted display according to claim 1 , further comprising a right mask disposed between the plurality of right light sources and the right lens, and a left mask disposed between the plurality of left light sources and the left lens,

wherein, in the right mask and the left mask, transmittance of an infrared light is higher than transmittance of a visible light.

9 . The head mounted display according to claim 1 ,

a surface of the right lens facing the right image sensor and a surface of the right lens facing the plurality of right light sources have different shapes,

a surface of the left lens facing the left image sensor and a surface of the left lens facing the plurality of left light sources have different shapes, and

the surface of the right lens facing the right image sensor and the surface of the left lens facing the left image sensor are planar surfaces.

Priority Claims (1)

Continuity (2)

References Cited (16)