Information processing apparatus for controlling display of GUI in optical see-through type head mounted display apparatus

1 . An information processing apparatus capable of being used with an optical see-through type head mounted display apparatus, the information processing apparatus comprising

one or more processors and/or circuitry configured to execute:

first instruction processing of issuing, to a user, a first instruction to cause an operation body located at a position of a hand of the user to move forwards to a predetermined distance from the head mounted display apparatus;

first acquisition processing of acquiring first information on a depth position of the operation body in a state in which the user moves the operation body forwards to the predetermined distance in response to the first instruction; and

determination processing of determining, on a basis of the first information, a depth position of a GUI displayed on the head mounted display apparatus and operated by the operation body,

wherein the predetermined distance is a maximum distance that the operation body is movable from the head mounted display apparatus and the depth position of the GUI is determined to be within the predetermined distance when the GUI is displayed on the head mounted display apparatus.

2 . The information processing apparatus according to claim 1 , wherein the first instruction includes an instruction to stretch an arm of the user.

3 . The information processing apparatus according to claim 1 , wherein the first instruction includes an instruction to move the operation body to a depth position at which the GUI is easily operated.

4 . The information processing apparatus according to claim 1 , wherein

the one or more processors and/or circuitry further executes:

second instruction processing of issuing a second instruction to cause the user to gaze at the operation body moved forwards by the user in response to the first instruction; and

second acquisition processing of acquiring second information on a convergence angle of the user in a state in which the user gazes at the operation body in response to the second instruction, and

in the determination processing, a depth position obtained by adjusting, on a basis of the second information, the depth position of the GUI determined on a basis of the first information is determined as the depth position of the GUI.

5 . An information processing apparatus capable of being used with an optical see-through type head mounted display apparatus, the information processing apparatus comprising

one or more processors and/or circuitry configured to execute:

first acquisition processing of repeatedly acquiring first information on a depth position of an operation body located at a position of a hand of a user;

first determination processing of determining, on a basis of a plurality of pieces of the first information up to latest first information, a parameter indicating a predetermined distance of the operation body from the head mounted display apparatus for determining a depth position of a GUI displayed on the head mounted display apparatus and operated by the operation body; and

second determination processing of determining the depth position of the GUI on a basis of the parameter,

wherein the predetermined distance is a maximum distance that the operation body is movable from the head mounted display apparatus and the depth position of the GUI is determined to be within the predetermined distance when the GUI is displayed on the head mounted display apparatus.

6 . The information processing apparatus according to claim 5 , wherein

the parameter includes the first information, and

in a case where the depth position associated with the latest first information is deeper than a depth position associated with past first information included in the parameter, in the first determination processing, the first information included in the parameter is updated from the past first information to the latest first information.

7 . The information processing apparatus according to claim 5 , wherein

the parameter includes average information on an average of a plurality of depth positions respectively associated with a plurality of pieces of first information acquired when an operation is performed on the GUI, and

in a case where the GUI is operated, in the first determination processing, the average information included in the parameter is updated from average information on a past average to average information on a current average.

8 . The information processing apparatus according to claim 5 , wherein

the one or more processors and/or circuitry further executes second acquisition processing of acquiring second information on a convergence angle of the user when the first information is acquired in a case where the user gazes at the operation body, and

in the second determination processing, a depth position obtained by adjusting, on a basis of the second information, the depth position of the GUI determined on a basis of the parameter is determined as the depth position of the GUI.

9 . An optical see-through type head mounted display apparatus comprising:

the information processing apparatus according to claim 1 ; and

a display configured to display the GUI.

10 . A control method of an information processing apparatus capable of being used with an optical see-through type head mounted display apparatus, the control method comprising:

issuing, to a user, a first instruction to cause an operation body located at a position of a hand of the user to move forwards to a predetermined distance from the head mounted display apparatus;

acquiring first information on a depth position of the operation body in a state in which the user moves the operation body forwards to the predetermined distance in response to the first instruction; and

determining, on a basis of the first information, a depth position of a GUI displayed on the head mounted display apparatus and operated by the operation body;

wherein the predetermined distance is a maximum distance that the operation body is movable from the head mounted display apparatus and the depth position of the GUI is determined to be within the predetermined distance when the GUI is displayed on the head mounted display apparatus.

11 . A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute a control method of an information processing apparatus capable of being used with an optical see-through type head mounted display apparatus, the control method comprising:

issuing, to a user, a first instruction to cause an operation body located at a position of a hand of the user to move forwards to a predetermined distance from the head mounted display apparatus;

acquiring first information on a depth position of the operation body in a state in which the user moves the operation body forwards to the predetermined distance in response to the first instruction; and

determining, on a basis of the first information, a depth position of a GUI displayed on the head mounted display apparatus and operated by the operation body;

wherein the predetermined distance is a maximum distance that the operation body is movable from the head mounted display apparatus and the depth position of the GUI is determined to be within the predetermined distance when the GUI is displayed on the head mounted display apparatus.

12 . The information processing apparatus according to claim 1 , wherein the predetermined distance is a threshold distance of movement of the operation body from the head mounted display apparatus.

13 . The information processing apparatus according to claim 1 , wherein the maximum distance corresponds to a length of an arm of the user.

14 . The information processing apparatus according to claim 1 , wherein the determination processing includes, in a case where a current depth position of the GUI already displayed on the head mounted display apparatus is deeper than the predetermined distance, updating the depth position of the GUI to the predetermined distance.

15 . The information processing apparatus according to claim 1 , wherein, regardless of a current position of the operation body, a new GUI is displayed on the head mounted display apparatus at a depth position determined to be within the predetermined distance.

16 . The information processing apparatus according to claim 1 , wherein the predetermined distance is acquired using phase-difference auto-focus distance measurement.

17 . The information processing apparatus according to claim 1 , wherein the first information includes at least one of (i) a distance to a back of the hand of the user and (ii) a distance to an index finger extended by the user.

18 . The information processing apparatus according to claim 1 , wherein a definition of a distance corresponding to the depth position of the operation body is changed based on a type of the operation body and a type of a registered gesture.

19 . The information processing apparatus according to claim 2 , wherein the first instruction includes displaying an index and instructing the user to stretch the arm of the user toward the index displayed at a depth position at which the operation body does not reach.

20 . The information processing apparatus according to claim 1 , further comprising a memory configured to store the predetermined distance, wherein the predetermined distance stored in the memory is used in subsequently determining the depth position of the GUI.