IP Library Granted Patent US 12,067,332
Granted Patent B2
US 12,067,332 · App. 17/729,956 · Granted Aug 20, 2024

Information processing device, information processing method, information processing program, and terminal device

Inventors: Takashi Onohara (Tokyo, JP); Roka Ueda (Tokyo, JP); Keishi Daini (Kanagawa, JP); Taichi Yoshio (Kanagawa, JP); Yuji Kawabe (Tokyo, JP); Seizi Iwayagano (Chiba, JP); Takuma Higo (Tokyo, JP); Eri Sakai (Saitama, JP)
Assignee: Sony Group Corporation
G06F3/167G06F3/0482G10L15/20G10L2015/223H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,067,332
App. No.
17/729,956
Granted
Aug 20, 2024
Kind
B2
Abstract

An apparatus includes a receiver, a shared information unit, a transmitter, a voice recognition unit, and an application execution unit. The receiver is configured to receive a voice signal and information from a second apparatus. The shared information unit is configured to create shared information shared by both the apparatus and the second apparatus based on the information received from the second apparatus. The transmitter is configured to transmit the shared information to the second apparatus. The voice recognition unit is configured to analyze the voice signal. The application execution unit is configured to execute an application based on a result generated by the voice recognition unit.

Claims (87)

1. An in-vehicle device capable of communicating with a terminal device, the in-vehicle device comprising:

a transceiver configured to:

receive an audio signal from a microphone;

establish bidirectional communication with the terminal device;

transmit, to the terminal device, first information relating to a first application installed on the in-vehicle apparatus;

receive, from the terminal device, shared application information related to the first application and a second application installed on the terminal device;

wherein the second application is different from the first application, and the first application is installed on the in-vehicle device but is not installed on the terminal device, and the second application is installed on the terminal device but is not installed on the in-vehicle device;

transmit, to the terminal device, a processed signal;

receive, from the terminal device, a voice-recognition result indicating a shared application is activated, based on the processed signal; and

a computer processor configured to:

display at least a portion of the shared application information related to the first application and the second application;

receiving input from a user from the display of the at least a portion of the shared application information, the input selecting one or more of the first application and the second application;

perform noise cancelling processing on the received audio signal to generate the processed signal; and

display voice-recognition result information indicating that the first application or the second application included in the shared application is activated in response to the transceiver receiving the voice-recognition result.

2. The in-vehicle device according to claim 1 , further comprising a display configured to display an icon representing the shared application.

3. The in-vehicle device according to claim 2 , wherein at least a portion of the display is synchronized with at least a portion of a display of the terminal device.

4. The in-vehicle device according to claim 1 , further comprising:

a storage device configured to store an associated information associated with the shared application.

5. The in-vehicle device according to claim 4 , wherein the shared application is shared between the in-vehicle device and the terminal device.

6. The in-vehicle device of claim 1 , wherein the noise cancelling processing reduces noises from sounds other than a voice present in the audio signal.

7. The in-vehicle device of claim 1 , further comprising an input apparatus configured to generate a control signal wherein the input apparatus is a keyboard, a touch screen, or a microphone.

8. The in-vehicle device of claim 7 , wherein:

the transceiver is configured to:

transmit, to the terminal device, the control signal; and

wherein, the control signal is configured to transition the terminal device to a voice recognition mode;

receive, from the terminal device, a notification indicating the terminal device is in voice recognition mode; and

the in-vehicle device is further configured to activate the microphone in response to the notification.

9. A system comprising:

an in-vehicle device capable of communicating with a terminal device, the in-vehicle device comprising:

a transceiver configured to:

receive an audio signal from a microphone;

establish bidirectional communication with the terminal device;

transmit, to the terminal device, first information relating to a first application installed on the in-vehicle apparatus;

receive, from the terminal device, shared application information related to the first application and a second application installed on the terminal device;

wherein the second application is different from the first application, and the first application is installed on the in-vehicle device but is not installed on the terminal device, and the second application is installed on the terminal device but is not installed on the in-vehicle device;

display at least a portion of the shared application information related to the first application and the second application;

receiving input from a user from the display of the at least a portion of the shared application information, the input selecting one or more of the first application and the second application;

transmit, to the terminal device, a processed signal;

receive, from the terminal device, a voice-recognition result indicating a shared application is activated based on the processed signal; and

a computer processor configured to:

perform noise cancelling processing on the received audio signal to generate the processed signal; and

display voice-recognition result information indicating that the first application or the second application included in the shared application is activated in response to the transceiver receiving the voice-recognition result.

10. The system according to claim 9 , further comprising:

the terminal device comprising:

a terminal transceiver configured to:

establish bidirectional communication with the in-vehicle device;

receive, from the in-vehicle device, first information related to the first application;

transmit, to the in-vehicle device, shared application information related to the first application and the second application;

receive, from the in-vehicle device, the processed signal; and

transmit, to the terminal device a voice-recognition result indicating a shared application is activated; and

a computer processor configured to:

perform voice recognition on the processed signal and generate the voice-recognition result.

11. The system according to claim 10 , wherein the terminal device further comprises a terminal display configured to display an icon representing the shared application.

12. The system according to claim 9 , wherein the in-vehicle device further comprises an in-vehicle display configured to display an icon representing the shared application.

13. The system according to claim 9 , wherein the in-vehicle device further comprises:

a storage device configured to store the shared application, wherein the shared application is shared between the in-vehicle device and the terminal device.

14. The system of claim 9 , wherein the noise cancelling processing reduces noises from sounds other than a voice present in the audio signal.

15. The system of claim 9 , further comprising an input apparatus configured to generate a control signal wherein the input apparatus is a keyboard, a touch screen, or a microphone.

16. The system of claim 15 , wherein:

the transceiver is configured to:

transmit, to the terminal device, the control signal; and

wherein, the control signal is configured to transition the terminal device to a voice recognition mode;

receive, from the terminal device, a notification indicating the terminal device is in voice recognition mode; and

the in-vehicle device is further configured to activate the microphone in response to the notification.

17. A method of operating an in-vehicle device, the method comprising:

establishing bidirectional communication with a terminal device;

transmitting, to the terminal device, first information relating to a first application installed on the in-vehicle apparatus;

receiving, from the terminal device, shared application information related to the first application and a second application installed on the terminal device;

wherein the second application is different from the first application, and the first application is installed on the in-vehicle device but is not installed on the terminal device, and the second application is installed on the terminal device but is not installed on the in-vehicle device;

display at least a portion of the shared application information related to the first application and the second application;

receiving input from a user from the display of the at least a portion of the shared application information, the input selecting one or more of the first application and the second application;

receiving an audio signal from a microphone;

performing noise cancellation on the audio signal to generate a processed signal;

transmitting, to the terminal device, the processed signal; and

receiving, from the terminal device, a voice-recognition result indicating a shared application is activated based on the processed signal.

18. The method according to claim 17 , further comprising displaying an icon representing the shared application.

19. The method according to claim 18 , further comprising synchronizing at least a portion of an in-vehicle display of the in-vehicle device with at least a portion of a terminal display of the terminal device.

20. The method according to claim 17 , further comprising:

storing the shared application on a storage device.

21. The method according to claim 20 , wherein the shared application is shared between the in-vehicle device and the terminal device.

22. The method of claim 17 , wherein performing noise cancellation on the audio signal involves reducing noises from sounds other than a voice present in the audio signal.

23. The method of claim 17 , further comprising receiving, from an input apparatus, a control signal wherein the input apparatus is a keyboard, a touch screen, or a microphone.

24. The method of claim 23 , further comprising:

transmitting, to the terminal device, the control signal;

wherein, the control signal is configured to transition the terminal to a voice recognition mode;

receiving, from the terminal device, a notification indicating the terminal device is in voice recognition mode; and

activating the microphone in response to the notification.

Assignments (2)
CHANGE OF NAME Recorded Jul 29, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 061006/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: ONOHARA, TAKASHI; UEDA, ROKA; DAINI, KEISHI; YOSHIO, TAICHI; KAWABE, YUJI; IWAYAGANO, SEIZI; HIGO, TAKUMA; SAKAI, ERI
To: SONY CORPORATION
Reel/Frame 061179/0124 →
Priority Claims (1)
JP 2012-065840 · Mar 22, 2012 · national
Continuity (3)
Continuation 16044640 · Jul 25, 2018
Continuation 14379888
Related Publication 20220253278A1 · Aug 11, 2022