Virtual image display system and operation method thereof

1 . An operation method of a virtual image display system, comprising:

using a plurality of cameras to perform image capturing action on a target portion of a user, and obtain a plurality of image information;

using the cameras to obtain a plurality of position information corresponding to the target portion according to the image information;

using a head-mounted display (HMD) to receive the position information, calculating an extrinsic parameter according to the position information, and establishing a plurality of reprojection image information according to the extrinsic parameter and the position information;

using the HMD to obtain a plurality of error information according to a prediction image information and the re-projection image information; and

using the HMD to display each of the error information, and calibrating the extrinsic parameter to generate a calibrated extrinsic parameter according to each of the error information,

wherein the cameras are disposed external from the HMD.

2 . The operation method according to claim 1 , further comprises:

adjusting a position of the target portion corresponding to each of the error information by the user.

3 . The operation method according to claim 1 , further comprises:

using each of the cameras to establish posture information of the user according to a posture prediction algorithm;

using each of the cameras to transmit each of the corresponding posture information to the HMD; and

using the HMD to display a full-body three-dimensional image of the user according to each of the posture information.

4 . The operation method according to claim 1 , wherein the step of establishing the re-projection image information according to the extrinsic parameter and the position information comprises:

triangulating the position information and the location information of each of the cameras based on the extrinsic parameter to establish each of the re-projection image information.

5 . The operation method according to claim 1 , wherein the step of using the HMD to obtain the error information according to the prediction image information and the reprojection image information comprises:

using the HMD to establish the prediction image information of the user; and

calculating a position deviation between the prediction image information and each of the re-projection image information to generate each of the error information.

6 . The operation method according to claim 5 , further comprises:

using the HMD to project the prediction image information and one of the re-projection image information; and

using the HMD to guide the user to adjust the position of the target portion so that the prediction image information overlaps with each of the projected re-projection image information.

7 . The operation method according to claim 1 , wherein the extrinsic parameter comprises rotation and translation information between a coordinate system of each of the cameras and a coordinate system of the HMD.

8 . A virtual image display system, comprising:

a plurality of cameras, perform image capturing action on a target portion of a user and obtain a plurality of image information, and the cameras provide a plurality of position information corresponding to the target portion according to the image information; and

a head-mounted display (HMD), coupled to the cameras, receives the position information, calculates an extrinsic parameter according to the position information, establishes a plurality of re-projection image information according to the extrinsic parameter and the position information, obtains a plurality of error information according to a prediction image information and the re-projection image information, displays each of the error information, and calibrates the extrinsic parameter to generate a calibrated extrinsic parameter according to each of the error information,

wherein the cameras are disposed external from the HMD.

9 . The virtual image display system according to claim 8 , wherein the HMD is configured to guide the user to adjust a position of the target portion corresponding to each of the error information.

10 . The virtual image display system according to claim 8 , wherein each of the cameras establishes posture information of the user according to a posture prediction algorithm and transmits each of the corresponding posture information to the HMD, and the HMD displays a full-body three-dimensional image of the user according to each of the posture information.

11 . The virtual image display system according to claim 8 , wherein the HMD triangulates the position information and the location information of each of the cameras based on the extrinsic parameter to establish each of the re-projection image information.

12 . The virtual image display system according to claim 8 , wherein the HMD establishes the prediction image information of the user and calculates a position deviation between the prediction image information and each of the re-projection image information to generate each of the error information.

13 . The virtual image display system according to claim 8 , wherein the HMD projects the prediction image information and one of the re-projection image information and guides the user to adjust the position of the target portion so that the prediction image information overlaps with each of the projected re-projection image information.

14 . The virtual image display system according to claim 8 , wherein the number of the cameras is greater than or equal to 2.

15 . The virtual image display system according to claim 8 , wherein the extrinsic parameter comprises rotation and translation information between a coordinate system of each of the cameras and a coordinate system of the HMD.