Head-mounted virtual reality device

1 . A head-mounted virtual reality device, comprising an eye movement recognition assembly and a processor, wherein the eye movement recognition assembly comprises a light source assembly, a first camera, and a second camera;

the light source assembly is configured to project, when the head-mounted virtual reality device is used, a plurality of strip-shaped light rays to an eye of a user, wherein at least some of the strip-shaped light rays are projected to an iris of the user;

the first camera is configured to capture, when the head-mounted virtual reality device is used, a first eye image of the user, wherein the first eye image comprises a reflected pattern formed by the strip-shaped light rays on the eye of the user;

the second camera is configured to capture, when the head-mounted virtual reality device is used, a second eye image of the user, wherein the second eye image comprises a reflected pattern formed by the strip-shaped light rays on the eye of the user; and

the processor is in signal connection with the first camera and the second camera respectively, and is configured to determine an eye depth map with depth information based on the first eye image and the second eye image, and determine coordinates of a center of the iris of the user based on the eye depth map;

wherein the second eye image and the first eye image have an overlapping area, wherein the overlapping area comprises an image formed by at least part of the iris; and

the processor is specifically configured to:

determine a first eye depth map with depth information by using a three-dimensional (3D) structured light principle based on the first eye image, and determine a second eye depth map with depth information by using the 3D structured light principle based on the second eye image;

determine a third eye depth map with depth information based on the first eye image and the second eye image; and

fuse the third eye depth map with at least one of the first eye depth map and the second eye depth map to obtain an eye depth map with depth information.

2 . The head-mounted virtual reality device according to claim 1 , further comprising two lens barrel assemblies, wherein the two lens barrel assemblies respectively correspond to two eyes of the user, and when the head-mounted virtual reality device is used, the two lens barrel assemblies display a virtual scene to the user;

wherein the eye movement recognition assembly comprises two eye movement recognition assemblies respectively corresponding to the two eyes of the user;

each of the two lens barrel assemblies corresponds to one eye movement recognition assembly of the two eye movement recognition assemblies, and in the lens barrel assembly and the eye movement recognition assembly that correspond to each other, the first camera and the light source assembly are disposed at a lower portion of the lens barrel assembly, and the second camera is disposed at an upper portion of the lens barrel assembly.

3 . The head-mounted virtual reality device according to claim 2 , further comprising a housing, wherein the two lens barrel assemblies are disposed in the housing, a first space for accommodating eyeglasses worn by the user is provided between a first side of the housing and the lens barrel assemblies, and the first side of the housing is a side of the housing facing the eyes of the user when the head-mounted virtual reality device is worn on the eyes of the user; and

in the lens barrel assembly and the eye movement recognition assembly that correspond to each other, the first camera is located at a lower portion of an end, in a first direction, of the first space, and is disposed on the housing, wherein the first direction is a direction of a connection line between centers of the two lens barrel assemblies.

4 . The head-mounted virtual reality device according to claim 3 , wherein in the lens barrel assembly and the eye movement recognition assembly that correspond to each other, the second camera is located at a side close to the other lens barrel assembly, and is disposed on the housing.

5 . The head-mounted virtual reality device according to claim 3 , wherein in the lens barrel assembly and the eye movement recognition assembly that correspond to each other, the light source assembly is disposed directly below a central axis of the lens barrel assembly, and is disposed on the housing.

6 . The head-mounted virtual reality device according to claim 2 , wherein

the processor is configured to: obtain coordinates of centers of irises of the two eyes of the user respectively based on information fed back by the two eye movement recognition assemblies, and obtain an interpupillary distance based on the coordinates of the centers of the irises of the two eyes of the user.

7 . The head-mounted virtual reality device according to claim 1 , wherein the light source assembly comprises a vertical cavity surface emitting laser and a diffractive optical element, the diffractive optical element comprises a plurality of longitudinal lines and transverse lines that vertically intersect each other, and when the head-mounted virtual reality device is worn on eyes of the user, light emitted by the vertical cavity surface emitting laser is emitted to the eye of the user through the plurality of longitudinal lines and transverse lines that vertically intersect each other of the diffractive optical element, and a projection area comprising a plurality of longitudinal lines and transverse lines that vertically intersect each other is formed on the eye of the user.

8 . The head-mounted virtual reality device according to claim 7 , wherein the projection area covers at least a square area with a length and a width of 28 mm.

9 . The head-mounted virtual reality device according to claim 7 , wherein a distance that the light emitted by the vertical cavity surface emitting laser illuminates an eyeball of the user is 25 mm to 27 mm;

the diffractive optical element comprises more than 21 longitudinal lines and more than 21 transverse lines, and a spacing between two adjacent longitudinal lines and a spacing between two adjacent transverse lines are 3.5 mm to 5 mm.

10 . The head-mounted virtual reality device according to claim 7 , wherein the vertical cavity surface emitting laser is pulse-driven with a pulse width of 2 μs, a pulse duty cycle of 0.06% and a frequency of 30 Hz.

11 . The head-mounted virtual reality device according to claim 1 , wherein each of the first camera and the second camera has a field of view of 90°, a depth of field of 20 mm to 40 mm, a resolution greater than 400×400, and a resolving power that a value of modulation transfer function of a full field of view is greater than 0.5 at a frequency of 56 lp/mm.

12 . The head-mounted virtual reality device according to claim 1 , wherein the eye depth map with depth information is obtained by fusing the third eye depth map with the higher-resolution one of the first eye depth map and the second eye depth map.

13 . The head-mounted virtual reality device according to claim 2 , wherein the two eye movement recognition assemblies comprise a first eye movement recognition assembly and a second eye movement recognition assembly, and the first eye movement recognition assembly and the second eye movement recognition assembly are mirror-symmetrical relative to a first plane along a first direction, wherein the first direction is a direction of a connection line between centers of the two lens barrel assemblies.

14 . The head-mounted virtual reality device according to claim 1 , wherein the first camera and the second camera are eye-tracking (ET) camera.