Information processing apparatus information processing method and storage medium
An information processing apparatus includes a first identification unit that identifies an input device to be used to execute a task, the input device lying in a field of view range of a user wearing a display device, a second identification unit that identifies an operation medium with which the user operates the input device, the operation medium lying in the field of view range of the user, a determination unit that determines processing to be executed based on the identified input device and the identified operation medium, and a display control unit that causes the display device to display an image corresponding to the determined processing.
1. An information processing apparatus comprising:
a first identification unit configured to identify a type of an input device to be used to execute a task, the input device lying in a field of view range of a user wearing a display device;
a second identification unit configured to identify an operation medium with which the user operates the input device, the operation medium lying in the field of view range of the user;
a distance obtaining unit configured to obtain a first distance from the display device to the input device and a second distance from the display device to the operation medium;
a referring unit configured to refer to respective execution conditions for a plurality of tasks, wherein an execution condition for each task prescribes a type of an input device and an operation medium to be used and permissible ranges of a distance from the display device to the input device and a distance from the display device to the operation medium to execute the task;
a determination unit configured to determine a task for which the identified type of the input device, the identified operation medium, the first distance, and the second distance satisfy an execution condition for the task; and
a display control unit configured to cause the display device to display an image corresponding to the determined task.
2. The information processing apparatus according to claim 1 , further comprising a detection unit configured to detect a position of the display device,
wherein the distance obtaining unit obtains the distances based on the position of the display device.
3. The information processing apparatus according to claim 1 , further comprising an image obtainment unit configured to obtain a captured image of the field of view range of the user,
wherein the first identification unit identifies the type of the input device by performing template matching processing to the image.
4. The information processing apparatus according to claim 1 , further comprising an image obtainment unit configured to obtain a captured image of the field of view range of the user,
wherein the second identification unit identifies a region having predetermined color information in the image as the operation medium.
5. The information processing apparatus according to claim 1 , wherein the input device is a keyboard and the operation medium is the user's hand.
6. The information processing apparatus according to claim 1 , wherein the processing is processing for inputting a character.
7. The information processing apparatus according to claim 1 , wherein the display device is an optical see-through type display device or a video see-through type display device.
8. An information processing method comprising:
identifying a type of an input device to be used to execute a task, the input device lying in a field of view range of a user wearing a display device;
identifying an operation medium with which the user operates the input device, the operation medium lying in the field of view range of the user;
obtaining a first distance from the display device to the input device and a second distance from the display device to the operation medium;
referring to respective execution conditions for a plurality of tasks, wherein an execution condition for each task prescribes a type of an input device and an operation medium to be used and permissible ranges of a distance from the display device to the input device and a distance from the display device to the operation medium to execute the task;
determining a task for which the identified type of the input device, the identified operation medium, the first distance, and the second distance satisfy an execution condition for the task; and
causing the display device to display an image corresponding to the determined task.
9. The information processing method according to claim 8 , further comprising detecting a position of the display device,
wherein the obtaining obtains the distances based on the position of the display device.
10. The information processing method according to claim 8 , further comprising obtaining a captured image of the field of view range of the user,
wherein the identifying identifies the type of the input device by performing template matching processing to the image.
11. The information processing method according to claim 8 , further comprising obtaining a captured image of the field of view range of the user,
wherein the identifying identifies a region having predetermined color information in the image as the operation medium.
12. The information processing method according to claim 8 , wherein the input device is a keyboard and the operation medium is the user's hand.
13. The information processing method according to claim 8 , wherein the display device is an optical see-through type display device or a video see-through type display device.
14. A non-transitory computer-readable storage medium storing computer executable instructions for causing a computer to implement an information processing method, the information processing method comprising:
identifying a type of an input device to be used to execute a task, the input device lying in a field of view range of a user wearing a display device;
identifying an operation medium with which the user operates the input device, the operation medium lying in the field of view range of the user;
obtaining a first distance from the display device to the input device and a second distance from the display device to the operation medium;
referring to respective execution conditions for a plurality of tasks, wherein an execution condition for each task prescribes a type of an input device and an operation medium to be used and permissible ranges of a distance from the display device to the input device and a distance from the display device to the operation medium to execute the task;
determining a task for which the identified type of the input device, the identified operation medium, the first distance, and the second distance satisfy an execution condition for the task; and
causing the display device to display an image corresponding to the determined task.
15. The non-transitory computer-readable storage medium according to claim 14 , further comprising detecting a position of the display device,
wherein the obtaining obtains the distances based on the position of the display device.
16. The non-transitory computer-readable storage medium according to claim 14 , further comprising obtaining a captured image of the field of view range of the user,
wherein the identifying identifies the type of the input device by performing template matching processing to the image.
17. The non-transitory computer-readable storage medium according to claim 14 , further comprising obtaining a captured image of the field of view range of the user,
wherein the identifying identifies a region having predetermined color information in the image as the operation medium.
18. The non-transitory computer-readable storage medium according to claim 14 , wherein the input device is a keyboard and the operation medium is the user's hand.
19. The non-transitory computer-readable storage medium according to claim 14 , wherein the display device is an optical see-through type display device or a video see-through type display device.