Control method, controller, and recording medium

1. A control method of a controller connected to a first device, a second device, a camera, and a microphone,

the controller storing information that identifies the first device and the second device,

the first device being installed at a first location in a first space,

the second device being installed at a second location in a second space,

the camera detecting a line-of-sight direction of a user,

the microphone detecting speech of the user,

the first space being visible to the user, and

the second space not being visible to the user,

the control method comprising:

acquiring, from the camera, line-of-sight information indicating the line-of-sight direction of the user;

determining whether the line-of-sight direction of the user indicates a third location other than the first location in the first space, based on the line-of-sight information;

acquiring sound data indicating the speech of the user, from the microphone, which does not indicate the first device or the second device;

selecting, in a case where the sound data is acquired and the line-of-sight direction of the user indicates the third location, a second dictionary corresponding to the second device to control the second device, from a plurality of dictionaries including a first dictionary corresponding to the first device and the second dictionary;

generating a control command corresponding to the sound data, using the second dictionary; and

transmitting the control command to the second device.

2. The control method according to claim 1 , further comprising:

determining whether the line-of-sight direction of the user indicates the first location, based on the line-of-sight information;

selecting, in a case where the line-of-sight direction of the user indicates the first location, the first dictionary corresponding to the first device to control the first device, from the plurality of dictionaries;

generating a second control command corresponding to the sound data, using the first dictionary; and

transmitting the generated second control command to the first device.

3. The control method according to claim 1 ,

wherein the third location is where the controller is installed.

4. The control method according to claim 1 ,

wherein the controller is provided with the camera.

5. The control method according to claim 1 ,

wherein the third location is where the microphone is installed.

6. The control method according to claim 1 ,

wherein the microphone is provided with the camera.

7. The control method according to claim 1 ,

wherein an object is disposed in the first space,

and wherein the third position is where the object is disposed.

8. The control method according to claim 7 ,

wherein the object is provided with the camera.

9. The control method according to claim 8 ,

wherein the object includes a doll.

10. The control method according to claim 1 ,

wherein a virtual object is projected in the first space,

and wherein the third position is where the virtual object is projected.

11. The control method according to claim 10 ,

wherein the virtual object includes one of an avatar and a hologram.

12. The control method according to claim 1 , further comprising:

notifying the user of contents of operation by the control command.

13. The control method according to claim 1 , further comprising:

requesting the user to input supplemental information necessary to generate the control command, in a case where the control command could not be generated using the second dictionary.

14. The control method according to claim 1 , further comprising:

generating a second control command using a third dictionary, the third dictionary included in the plurality of dictionaries and indicating a correlation between a plurality of devices and a plurality of commands corresponding to the plurality of devices, the plurality of devices including the first device and the second device, and the plurality of commands including the second command, in a case where the second control command can be generated using the second dictionary and also the second control command can be generated using the third dictionary.

15. A non-transitory computer-readable recording medium storing a program that causes a computer to execute the control method according to claim 1 .

16. The control method according to claim 1 ,

wherein the first space and the second space each include at least one room in a home.

17. The control method according to claim 1 ,

wherein the first space and the second space are each included in a corporation or an organization.

18. The control method according to claim 1 , further comprising:

in a case where the second device includes two or more second devices installed in the second space, querying the user to identify one of the two or more second devices,

wherein the control command is transmitted to the one of the two or more second devices.

19. The control method according to claim 1 ,

wherein the second device is visible to the user.

20. A controller connected to a first device, a second device, a camera, and a microphone,

wherein the first device is installed at a first location in a first space,

wherein the second device is installed at a second location in a second space,

wherein the camera detects a line-of-sight direction of a user,

wherein the microphone detects speech of the user,

wherein the first space is visible to the user,

wherein the second space is not visible to the user,

and wherein the controller

stores information that identifies the first device and the second device,

acquires, from the camera, line-of-sight information indicating the line-of-sight direction of the user which does not indicate the first device or the second device,

determines whether the line-of-sight direction of the user indicates a third location other than the first location in the first space, based on the line-of-sight information,

acquires sound data indicating the speech of the user from the microphone,

selects, in a case where the sound data is acquired and the line-of-sight direction of the user indicates the third location, a second dictionary corresponding to the second device to control the second device, from a plurality of dictionaries including a first dictionary corresponding to the first device and the second dictionary,

generates a control command corresponding to the sound data, using the second dictionary, and

transmits the control command to the second device.