Information processing apparatus for achieving cross reality, control method therefor, and storage medium storing control program therefor

1. An information processing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to:

detect an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality;

determine the holding hand based on the re-holding action detected; and

determine that a hand having a shorter distance from the input device is the holding hand in a case where both user's hands can be determined to be the holding hand,

wherein detection of the re-holding action and determination of the holding hand are performed based on a position of the input device and a position of a user's hand tracked by image recognition using a reality image from a user's viewpoint or a third person's viewpoint, and

wherein the detection of the re-holding action and the determination of the holding hand are performed by comparing a distance from the input device to the user's hand with a threshold.

2. The information processing apparatus according to claim 1 , wherein the at least one processor executes instructions in the memory device to use a position of a gravity center of the user's hand or a position of a joint of the user's hand as the position of the user's hand tracked by the image recognition.

3. The information processing apparatus according to claim 1 , wherein the image recognition is performed by using infrared light.

4. The information processing apparatus according to claim 1 , wherein detection of the re-holding action and determination of the holding hand are performed based on an obtained result of an acceleration or a speed of the input device.

5. The information processing apparatus according to claim 4 , wherein the detection of the re-holding action and the determination of the holding hand are performed by detecting a characteristic of an acceleration change or a speed change occurred when the input device collides with a palm or a finger of the user from the obtained result of the acceleration or the speed of the input device.

6. The information processing apparatus according to claim 5 , wherein the characteristic of the acceleration change or the speed change of the input device occurred when the input device collides with the palm or the finger of the user is detected using machine learning or deep learning.

7. The information processing apparatus according to claim 5 , wherein the at least one processor executes instructions in the memory device to treat an acceleration change or a speed change of the input device in end of holding of the input device by the user as the characteristic of the acceleration change or the speed change of the input device occurred when the input device collides with the palm or the finger of the user.

8. The information processing apparatus according to claim 5 , wherein the at least one processor executes instructions in the memory device to treat an acceleration change or a speed change of the input device from start of holding to end of holding of the input device by the user as the characteristic of the acceleration change or the speed change of the input device occurred when the input device collides with the palm or the finger of the user.

9. An information processing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to:

detect an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality; and

determine the holding hand based on the re-holding action detected,

wherein detection of the re-holding action and determination of the holding hand are performed based on an obtained result of an angular speed or an angle of the input device, and

wherein the detection of the re-holding action and the determination of the holding hand are performed by detecting a characteristic of an angular speed change or an angular change of the input device occurred when the input device is rotated by the user from an obtained result of the angular speed or the angle.

10. The information processing apparatus according to claim 9 , wherein the at least one processor executes instructions in the memory device to detect the characteristic of the angular speed change or the angular change of the input device occurred when the user rotates the input device using machine learning or deep learning.

11. The information processing apparatus according to claim 1 , wherein the at least one processor executes instructions in the memory device to:

determine a use status of the input device; and

allocate input functions to input members of the input device according to the holding hand determined and the use status determined.

12. The information processing apparatus according to claim 11 , wherein the use status includes information regarding to a use form of the input device in the cross reality.

13. A control method for an information processing apparatus, comprising:

detecting an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality; and

determining the holding hand based on the re-holding action detected; and

determining that a hand having a shorter distance from the input device is the holding hand in a case where both user's hands can be determined to be the holding hand,

wherein detection of the re-holding action and determination of the holding hand are performed based on a position of the input device and a position of a user's hand tracked by image recognition using a reality image from a user's viewpoint or a third person's viewpoint, and

wherein the detection of the re-holding action and the determination of the holding hand are performed by comparing a distance from the input device to the user's hand with a threshold.

14. The control method for the information processing apparatus according to claim 13 , further comprising:

determining a use status of the input device; and

allocating input functions to input members of the input device in accordance with the holding hand determined and the use status determined.

15. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute the control method according to claim 13 .

16. The non-transitory computer readable medium according to claim 15 , wherein the control method further comprises:

determining a use status of the input device; and

allocating input functions to input members of the input device in accordance with the holding hand determined and the use status determined.