IP Library Granted Patent US 11,950,300
Granted Patent B2
US 11,950,300 · App. 17/372,123 · Granted Apr 2, 2024

Using a smartphone to control another device by voice

Inventor: Keisuke Tsuchida (Tokyo, JP)
H04W76/11G10L15/08H04W4/50G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,950,300
App. No.
17/372,123
Granted
Apr 2, 2024
Kind
B2
Abstract

A method and system for implementing a speech-enabled interface of a host device via an electronic mobile device in a network are provided. The method includes establishing a communication session between the host device and the mobile device via a session service provider. According to some embodiments, a barcode can be adopted to enable the pairing of the host device and mobile device. Furthermore, the present method and system employ the voice interface in conjunction with speech recognition systems and natural language processing to interpret voice input for the hosting device, which can be used to perform one or more actions related to the hosting device.

Claims (65)

1. A computer-implemented method, comprising:

receiving, at a session service provider, a pin request from a host device to generate a pin code;

generating, by the session service provider, the pin code associated with the host device and the session service provider, wherein the pin code is displayed on the host device and further accessed by a mobile device;

receiving, at the session service provider, a session request from the mobile device to interact with the host device, wherein the session request comprises at least identification information of the mobile device and the host device;

generating, by the session service provider, a session ID at least based on the session request;

transmitting, by the session service provider, the session ID to the host device and the mobile device; and

managing, by the session service provider, a communication session associated with the session ID between the host device and the mobile device, wherein the host device is configured to receive a voice command from the mobile device.

2. The computer-implemented method of claim 1 , wherein the session service provider is configured to manage the communication session by initiating, maintaining, and terminating the communication session between the host device and the mobile device.

3. The computer-implemented method of claim 1 , further comprising:

prior to receiving the session request, receiving, at the session service provider, a barcode request from the host device to generate a barcode associated with the host device and the session service provider; and

generating the barcode by the session service provider, wherein the barcode is displayed on the host device and further accessed by the mobile device.

4. The computer-implemented method of claim 3 , wherein the barcode at least comprises a bonding ID associated with the host device and access information of the session service provider.

5. The computer-implemented method of claim 1 , wherein the session request is initiated when the mobile device and the host device are located within a predetermined distance.

6. The computer-implemented method of claim 1 , wherein a speech recognition application in communication with the session service provider is configured to infer at least one semantic meaning of the voice command.

7. The computer-implemented method of claim 1 , further comprising: inferring, using a speech recognition system subscribed to the session ID, at least one semantic meaning of the voice command;

generating a query output in response to the voice command; and

displaying the query output on at least one display associated with the host device and the mobile device.

8. The computer-implemented method of claim 1 , further comprising: inferring, using a speech recognition system subscribed to the session ID, at least one semantic meaning of the voice command; and

performing, by the host device, one or more actions based on the semantic meaning of the voice command.

9. The computer-implemented method of claim 1 , wherein one or more host devices and mobile devices are subscribed to the session ID.

10. The computer-implemented method of claim 1 , further comprising: terminating the communication session via one or more termination parameters.

11. A computer-implemented method, comprising:

receiving, at a session service provider, a pin request from a host device to generate a pin code;

generating, by the session service provider, the pin code associated with the host device and the session service provider, wherein the pin code encodes a bonding ID of the host device and access information of the session service provider, and wherein the pin code is displayed on the host device and further accessed by a mobile device;

receiving, at the session service provider, a session request from the mobile device;

generating, by the session service provider, a session ID at least partially based on the session request; and

managing, by the session service provider, a communication session associated with the session ID between the host device and the mobile device.

12. The computer-implemented method of claim 11 , wherein the session request comprises at least the bonding ID based on one or more parameters of the host device.

13. The computer-implemented method of claim 12 , wherein the session request further comprises at least a mobile ID based on one or more parameters of the mobile device.

14. The computer-implemented method of claim 11 , further comprising:

transmitting, by the session service provider, the pin code to the host device;

transmitting, by the session service provider, the session ID to the host device and the mobile device.

15. The computer-implemented method of claim 11 , wherein the communication session enables a voice input from the mobile device to interact with the host device.

16. The computer-implemented method of claim 11 , further comprising:

inferring, using a speech recognition system subscribed to the session ID, at least one semantic meaning of the voice input;

generating an output in response to the voice input; and

displaying the output on at least one display associated with the host device and the mobile device.

17. The computer-implemented method of claim 11 , further comprising: inferring, using a speech recognition system subscribed to the session ID, at least one semantic meaning of the voice input; and

performing, by the host device, one or more actions based on the semantic meaning of the voice input.

18. A computer system, comprising:

at least one processor; and

memory including instructions that, when executed by the at least one processor, cause the computer system to:

receive, at a session service provider, a pin request from a host device to generate a pin code;

generate, by the session service provider, the pin code associated with the host device and the session service provider, wherein the pin code is displayed on the host device and further accessed by a mobile device;

receive, at the session service provider, a session request from the mobile device to interact with the host device, wherein the session request comprises at least identification information of the mobile device and the host device;

generate, by the session service provider, a session ID at least based on the session request;

transmit, by the session service provider, the session ID to the host device and the mobile device; and

manage, by the session service provider, a communication session associated with the session ID between the host device and the mobile device, wherein the mobile device is configured to interact with the host device during the communication session.

19. The computer system of claim 18 , wherein the instructions when executed further cause the computer system to:

receive, at the session service provider, a barcode request from the host device to generate a barcode associated with the host device and the session service provider; and

generate the barcode by the session service provider, wherein the barcode is displayed on the host device and further accessed by the mobile device.

20. The computer system of claim 19 , wherein the barcode at least comprises a bonding ID associated with the host device and access information of the session service provider.

21. The computer system of claim 18 , wherein the instructions when executed further cause the computer system to:

inferring, using a speech recognition system subscribed to the session ID, at least one semantic meaning of a voice command for the host device;

generating a query output in response to the voice command; and

displaying the query output on at least one display associated with the host device and the mobile device.

22. The computer system of claim 18 , wherein the instructions when executed further cause the computer system to:

inferring, using a speech recognition system subscribed to the session ID, at least one semantic meaning of a voice command for the host device; and

performing, by the host device, one or more actions based on the semantic meaning of the voice command.

23. The computer system of claim 18 , wherein one or more host devices and mobile devices are subscribed to the session ID.

24. The computer system of claim 18 , wherein the instructions when executed further cause the computer system to:

terminate the communication session via one or more termination parameters.

25. The computer system of claim 18 , wherein the session service provider is configured to manage the communication session by initiating, maintaining, and terminating the communication session between the host device and the mobile device.

26. The computer system of claim 18 , wherein the session request is initiated when the mobile device and the host device are located within a predetermined distance.

27. The computer system of claim 18 , wherein a speech recognition application in communication with the session service provider is configured to infer at least one semantic meaning of the voice command.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2021
From: TSUCHIDA, KEISUKE
To: SOUNDHOUND, INC.
Reel/Frame 056829/0013 →