IP Library › Granted Patent US 12,596,762
Granted Patent B2
US 12,596,762 · App. 18/662,973 · Granted Apr 7, 2026

Method for providing information, method for generating database, and program

Inventors: Masaki Naito (Nagano, JP); Keisuke Tsuchida (Tokyo, JP); Jun Yoneyama (Tokyo, JP); Kaku Sawada (Tokyo, JP)
Assignee: SoundHound AI IP, LLC
G06F16/9566G06F16/3344G06F40/40G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,596,762
App. No.
18/662,973
Granted
Apr 7, 2026
Kind
B2
Abstract

As audio (1) is input to an extension of a browser, the extension transmits the audio (1) to a language processing server. A speech recognition unit obtains a text (1) corresponding to the audio (1), and transmits the text (1) to a natural language understanding unit. In the natural language understanding unit, an information processing unit identifies a URL (1) corresponding to the text (1), and transmits the URL (1) to the browser. The extension passes the URL (1) to a browsing function. The browsing function uses the URL (1) to access a web server. The web server transmits a web page (1) corresponding to the URL (1) to the browser. The browsing function shows a screen corresponding to the web page (1) on a display.

Claims (51)

1 . A computer-implemented method for providing

information, the method comprising:

receiving inquiry information associated with an inquiry intent through a user terminal, the inquiry information including at least one of audio and a text;

obtaining a conversation state, using a previous URL corresponding to a web page displayed to the user terminal, the conversation state including a common intent identified in an intent-URL database, wherein the common intent is the inquiry intent;

identifying an inquiry grammar conforming to the inquiry information;

filling a placeholder included in a response URL, wherein the response URL includes a URL slot corresponding to a slot included in the inquiry grammar;

obtaining a response URL corresponding to the inquiry intent, in accordance with a relationship, defined in the intent-URL database, between one or more intents and respectively corresponding one or more URLs; and

providing the response URL to a browser installed in the user terminal.

2 . The computer-implemented method of claim 1 , further comprising:

identifying a slot in the inquiry grammar associated with the inquiry intent; and

determining a value of a URL slot included in the inquiry information.

3 . The computer-implemented method of claim 1 , further comprising

obtaining a previous URL, the previous URL corresponding to a web page which is displayed by the browser at a time of input of the inquiry information to the user terminal.

4 . The computer-implemented method of claim 3 , further comprising

obtaining the response URL includes generating the response URL by combining the previous URL and a basic URL, which is associated with the inquiry intent in the intent-URL database.

5 . The computer-implemented method of claim 4 , wherein the response URL is generated in response to the inquiry information including a request for narrowing down information shown on the web page.

6 . The computer-implemented method of claim 1 , further comprising

obtaining a previous URL, the previous URL corresponding to a web page displayed by the browser at a time of input of the inquiry information to the user terminal, and the inquiry intent is obtained in response to the previous URL being a predetermined URL.

7 . The computer-implemented method of claim 1 , further comprising:

obtaining the response URL includes filling a placeholder, included in a URL associated with the inquiry intent in the intent-URL database, with at least a portion of the inquiry information.

8 . The computer-implemented method of 1 , further comprising

updating the relationship in the intent-URL database.

9 . The computer-implemented method of claim 1 , prior to obtaining an inquiry intent using speech recognition via a browser installed in a user terminal, further comprising:

displaying an audio input feature via a browser installed in a user terminal.

10 . The computer-implemented method of claim 1 , further comprising:

retrieving data associated with the response URL; and

displaying the retrieved data on the browser installed in the user terminal.

11 . A computer system, comprising:

at least one processor; and

memory including instructions that, when executed by the at least one processor, cause the computer system to:

receiving inquiry information associated with an inquiry intent through a user terminal, the inquiry information including at least one of audio and a text;

obtain a conversation state, using a previous URL corresponding to a web page displayed to the user terminal, the conversation state including a common intent identified in an intent-URL database, wherein the inquiry intent is the common intent;

identify an inquiry grammar conforming to the inquiry information;

fill a placeholder included in a response URL, wherein the response URL includes a URL slot corresponding to a slot included in the inquiry grammar;

obtain a response URL corresponding to the inquiry intent, in accordance with a relationship, defined in the intent-URL database, between one or more intents and respectively corresponding one or more URLs; and

provide the response URL to a browser installed in the user terminal.

12 . The computer system of claim 11 , wherein the instructions when executed further cause the computer system to:

identify a slot in the inquiry grammar associated with the inquiry intent; and

determine a value of a URL slot included in the inquiry information.

13 . The computer system of claim 11 , wherein the instructions when executed further cause the computer system to:

obtain a previous URL, the previous URL corresponding to a web page which is displayed by the browser at a time of input of the inquiry information to the user terminal.

14 . The computer system of claim 13 , wherein the instructions when executed further cause the computer system to:

obtain the response URL includes generating the response URL by combining the previous URL and a basic URL, which is associated with the inquiry intent in the intent-URL database.

15 . The computer system of claim 11 , wherein the response URL is generated in response to the inquiry information including a request for narrowing down information shown on the web page.

16 . The computer system of claim 11 , wherein the instructions when executed further cause the computer system to:

obtain a previous URL, the previous URL corresponding to a web page displayed by the browser at a time of input of the inquiry information to the user terminal, and the inquiry intent is obtained in response to the previous URL being a predetermined URL.

17 . The computer system of claim 11 , wherein the instructions when executed further cause the computer system to:

obtain the response URL includes filling a placeholder, included in a URL associated with the inquiry intent in the intent-URL database, with at least a portion of the inquiry information.

18 . The computer system of claim 11 , wherein the instructions when executed further cause the computer system to:

retrieve data associated with the response URL; and

display the retrieved data on the browser installed in the user terminal.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 067564/0293 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2024
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 067453/0259 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2024
From: NAITO, MASAKI; TSUCHIDA, KEISUKE; YONEYAMA, JUN; SAWADA, KAKU
To: SOUNDHOUND, INC.
Reel/Frame 067409/0470 →
Priority Claims (1)
JP 2021-091752 · May 31, 2021 · national
Continuity (2)
Continuation 17649052 · Jan 26, 2022
Related Publication 20240296197A1 · Sep 5, 2024
References Cited (23)
US 10855627B2 · Eidem · 2020 [cited by examiner]
US 20130018944A1 · Shyamsunder · 2013 [cited by examiner]
US 20140372119A1 · Parada et al. · 2014 [cited by applicant]
US 20180007201A1 · Kurganov · 2018 [cited by applicant]
US 20220159094A1 · Aoki · 2022 [cited by applicant]
JP 2000132473A · 2000 [cited by applicant]
JP 2015148910A · 2015 [cited by applicant]
WO 2015146017A1 · 2015 [cited by applicant]
Contexts, Handsfree for Web—Voice Control—Browse using your voice, https://www.handsfreeforweb.com/en/. [cited by applicant]
Han, Sungjae, Geunseong Jung, Minsoo Ryu, Byung-Uk Choi, and Jaehyuk Cha. “A voice-controlled web browser to navigate hierarchical hidden menus of web pages in a smart-tv environment.” In Proceedings of the 23rd Interna… [cited by applicant]
Implement your own voice commands, Handsfree for Web—Voice Control—Browse using your voice, https://www.handsfreeforweb.com/en/. [cited by applicant]
Libby, Alex. Introducing the HTML5 Web Speech API: Your Practical Introduction to Adding Browser-Based Speech Capabilities to your Websites and Online Applications. Apress, 2020. [cited by applicant]
Modules, Handsfree for Web—Voice Control—Browse using your voice, https://www.handsfreeforweb.com/en/. [cited by applicant]
Patel, Meetkumar. “Weboice: Voice Enabled Web Browser.” PhD diss., California State University, Sacramento, 2017. [cited by applicant]
Pérez, Javier. “Navegación web dirigida por comandos de voz.” PhD diss., Universidad Nacional de La Plata, 2019. [cited by applicant]
Su, Yu, Ahmed Hassan Awadallah, Madian Khabsa, Patrick Pantel, Michael Gamon, and Mark Encarnacion. “Building natural language interfaces to web apis.” In Proceedings of the 2017 ACM on Conference on Information and Kno… [cited by applicant]
Uday, Gobbur, Kale Ketan, Umbarkar Dipak, and Neharkar Swapnil. “Voice based Internet Browser.” International Journal of Computer Applications 66, No. 8 (2013). [cited by applicant]
Voice Access app, Google Play. [cited by applicant]
Voice commands guide, Handsfree for Web—Voice Control—Browse using your voice, https://www.handsfreeforweb.com/en/. [cited by applicant]
Web Speech API: Draft Community Group Report, https://wicg.github.io/speech-api/#introduction, Aug. 18, 2020. [cited by applicant]
Website voice commands, Handsfree for Web—Voice Control—Browse using your voice, https://www.handsfreeforweb.com/en/. [cited by applicant]
, , and . “ Web .” 75 2013, No. 1 (2013): 525-526. [cited by applicant]
JPO office action of counterpart JP patent application No. 2021-091752, dated Dec. 24, 2024. [cited by applicant]