Information processing device and digital assistant system
A digital assistant function is provided to individual users even when a primary device having the digital assistant function is at a location away from a hand of a user. An information processing device that relays sound data to a primary device that executes a digital assistant process includes: a sound acquiring unit that acquires surrounding sounds as sound data; a destination device determination unit that determines a destination primary device which is the primary device that is a destination of the sound data; a transmitting and receiving unit that transmits the sound data to the destination primary device and receives, from the destination primary device, a result of a digital assistant process executed depending on the sound data as a reply; and a reply presentation unit that presents the reply received at the transmitting and receiving unit.
1. An information processing device that relays acquired sound data to a primary device of a plurality of registered primary devices configured to execute a digital assistant process, the information processing device comprising:
a control circuit;
a camera that captures an environment surrounding the information processing device and that outputs picture data;
a microphone that acquires surrounding sound and outputting sound data; and
at least one of a communication interface and a proximity communication interface, wherein
the control circuit is configured to:
analyze the sound data to determine whether or not personal information is necessary to execute the digital assistant process, wherein
only on condition that the personal information is unnecessary, execute the digital assistant process and present a result of the digital assistant process, and
on condition that the personal information is necessary,
analyze the sound data and the picture data to identify a speaker,
on condition the speaker is identified and cooperation of the primary device is established, determine a primary device registered in association with the speaker as a destination primary device,
transmit the sound data to the destination primary device and receive a result of a digital assistant process executed by the destination primary device based on the sound data as a reply via the communication interface or the proximity communication interface, and
present the reply as received from the destination primary device without executing the digital assistant process,
wherein cooperation of the primary device is on condition that the primary device stops directly communicating with a device that is other than the information processing device.
2. The information processing device according to claim 1 , wherein
the control circuit is configured to
separate the sound data for each sound source;
determine the destination primary device on each piece of the separated sound data;
transmit the separated sound data to the determined destination primary device respectively and receive the reply from each of the destination primary devices; and
output the reply received from each of the destination primary devices.
3. The information processing device according to claim 1 ,
wherein when a plurality of the primary devices is registered in association with the speaker, the control circuit is configured to accept, from the speaker, a selection of a primary device that is the destination primary device among the plurality of primary devices associated with the speaker.
4. The information processing device according to claim 1 ,
wherein the control circuit is further configured to output information that identifies the destination primary device.
5. The information processing device according to claim 1 , further comprising an assistant circuit configured to execute the digital assistant process,
wherein the assistant circuit is configured to analyze the sound data to extract information that identifies the primary device from the sound data; and
the control circuit is configured to determine, as the destination primary device, the primary device identified by information extracted by the assistant circuit.
6. The information processing device according to claim 1 ,
wherein the information processing device is a video display device including a speaker and a display.
7. The information processing device according to claim 6 , wherein when a plurality of the primary devices is registered in association with the speaker, the control circuit is configured to
display, on the display, the plurality of primary devices registered with the speaker; and
accept, from the speaker, a selection of a primary device that is the destination primary device among the plurality of primary devices associated with the speaker.
8. The information processing device according to claim 7 , wherein the display includes a primary device information display region that displays identification information of the destination primary device and a reply display region that displays the result of the digital assistant process or the reply as received from the destination primary device.
9. The information processing device according to claim 8 , wherein, in response to a current speaker being identified who is not associated with the destination primary device, the control circuit is configured to
determine a current primary device registered in association with the current speaker as a destination primary device; and
output information for the current primary device to the reply display region of the display.
10. The information processing device according to claim 8 , wherein, in response to no primary device being associated with the identified speaker, the control circuit is configured to
output information that no primary display device is associated with the speaker to the reply display region.
11. The information processing device according to claim 1 ,
wherein the information processing device is a smart speaker; and
when the reply includes video data, the control circuit is configured to transfer the video data to a device including a display associated in advance to cause the device to display the video data.
12. The information processing device according to claim 1 , wherein the device that is other than the information processing device is a wearable device.
13. An information processing device that relays acquired sound data to a primary device of a plurality of registered primary devices configured to execute a digital assistant process, the information processing device comprising:
a camera capturing an environment surrounding the information processing device and outputting picture data;
a control circuit;
a microphone acquiring surrounding sound and outputting sound data; and
at least one of a communication interface and a proximity communication interface, wherein
the control circuit is configured to:
analyze the sound data to determine whether or not personal information is necessary to execute the digital assistant process, wherein
only on condition that the personal information is unnecessary, execute the digital assistant process and present a result of the digital assistant process, and
on condition that the personal information is necessary,
analyze the sound data and the picture data to identify a speaker,
on condition the speaker is identified and cooperation of the primary device is established, determine a primary device registered in association with the speaker as a destination primary device,
transmit a command to the destination primary device to execute a digital assistant process and receive a result of the digital assistant process as a reply from the destination primary device via the communication interface or the proximity communication interface, and
present the reply as received from the destination primary device without executing the digital assistant process,
wherein cooperation of the primary device is on condition that the primary device stops directly communicating with a device that is other than the information processing device.
14. The information processing device according to claim 13 , the device that is other than the information processing device is a wearable device.
15. A digital assistant system that includes a secondary device and a primary device of a plurality of registered primary devices and provides a result of a digital assistant process executed, through the secondary device,
wherein the secondary device includes:
a control circuit;
a camera that captures a surrounding environment and outputting picture data;
a microphone that acquires surrounding sound and outputting sound data; and
at least one of a communication interface and a proximity communication interface,
wherein
the control circuit is configured to:
analyze the sound data to determine whether or not personal information is necessary to execute the digital assistant process, wherein
only on condition that the personal information is unnecessary, execute the digital assistant process and present a result of the digital assistant process, and
on condition that the personal information is necessary,
analyze the sound data and the picture data to identify a speaker,
on condition the speaker is identified and cooperation of the primary device is established, determine a primary device registered in association with the speaker as a destination primary device determine the destination primary device from among primary devices to which cooperation of the digital assistant process is established,
transmit the sound data to the destination primary device and receive a result of a digital assistant process executed by the destination primary device based on the sound data as a reply from the destination primary device via the communication interface or the proximity communication interface, and
present the reply as received from the destination primary device without executing the digital assistant process; and
each primary device includes:
a cooperation management circuit configured to establish cooperation of the secondary device on condition that the primary device stops directly communicating with a device that is other than secondary device;
a data receiving circuit configured to receive the sound data from the secondary device via the communication interface or the proximity communication interface;
an assistant circuit configured to execute the digital assistant process depending on the sound data received and output a processed result as the reply; and
a reply circuit configured to transmit the reply output from the assistant circuit to the secondary device which is a source of the sound data.
16. The digital assistant system according to claim 15 ,
wherein the cooperation management circuit configured to establish cooperation of the digital assistant process further on condition that a connection of the primary device to a predetermined access point is recognized; and
the predetermined access point is an access point to which the secondary device is connected.
17. The digital assistant system according to claim 15 ,
wherein the cooperation management circuit configured to establish cooperation of the digital assistant process further on condition that the primary device detects that the primary device is connected to a predetermined charging base.
18. The digital assistant system according to claim 15 ,
wherein the cooperation management circuit configured to establish cooperation of the digital assistant process further on condition that the cooperation management circuit detects that a present location of the primary device is a predetermined region.
19. The digital assistant system according to claim 15 , wherein the device that is other than the secondary device is a wearable device.
20. The digital assistant system according to claim 15 , further comprising a display that includes a primary device information display region that displays identification information of the destination primary device and a reply display region that displays the result of the digital assistant process or the reply as received from the destination primary device, wherein in response to a current speaker being identified who is not associated with the destination primary device, the control circuit is configured to
determine a current primary device registered in association with the current speaker as a destination primary device; and
output information for the current primary device to the primary device information display region of the display.