IP Library Granted Patent US 11,176,938
Granted Patent B2
US 11,176,938 · App. 16/511,414 · Granted Nov 16, 2021

Method, device and storage medium for controlling game execution using voice intelligent interactive system

Inventors: Binyuan Du (Beijing, CN); Yan Zhang (Beijing, CN); Peng Yuan (Beijing, CN); Longlong Tian (Beijing, CN); Liangyu Chang (Beijing, CN)
Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
G10L15/22G10L15/1815G10L15/1822G10L15/30G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,176,938
App. No.
16/511,414
Granted
Nov 16, 2021
Kind
B2
Abstract

Embodiments provide a voice interaction method, a device, and a storage medium. The method includes: transmitting obtained audio data of a user to a server for semantic understanding, to obtain structured data; receiving the structured data returned by the server; and controlling, according to a running game and the structured data, the game to perform a corresponding operation. In the embodiments, voice recognition and semantic understanding technologies are used to enable a user to complete an operation of a game under a dialogue interaction through a communication between a terminal device and a server, thus enhancing game experience of the user and improving entertainment and convenience.

Claims (35)

1. A voice interaction method, comprising:

establishing a connection between a game and a voice intelligent interactive system when the game is detected to be started, to complete a binding between the game and the voice intelligent interactive system;

transmitting obtained audio data of a user to a server;

receiving structured data returned by the server, wherein the structured data is obtained by the server through performing recognition processing on the audio data to obtain text information corresponding to the audio data, performing natural language processing and semantic interpretation on the text information to obtain a parsed content, and classifying the parsed content through model processing, wherein the structured data represents machine instruction information corresponding to a content that the user intends to express, and wherein the natural language processing comprises information filtering, automatic abstracting, information extracting, and text mining;

determining an operation instruction corresponding to the structured data according to the currently running game and the structured data in the voice intelligent interactive system; and

controlling, according to the operation instruction, the currently running game to perform the corresponding operation.

2. The method according to claim 1 , wherein the transmitting the obtained audio data of the user to the server comprises:

transmitting the audio data to the server for semantic understanding through the voice intelligent interactive system.

3. The method according to claim 1 , further comprising:

receiving the audio data input by the user and transmitted by an intelligent remote controller or an intelligent terminal device.

4. The method according to claim 1 , wherein before the transmitting the obtained audio data of the user to the server, the method further comprises:

performing echo cancellation and/or noise reduction on the audio data to obtain processed audio data.

5. A terminal device, comprising: a receiver, a transmitter, at least one processor, a memory and a computer program; wherein

the memory stores a computer executable instruction; and

the at least one processor executes the computer executable instruction stored in the memory so that the at least one processor performs the voice interaction method according to claim 1 .

6. A non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores a computer executable instruction, and implements the voice interaction method according to claim 1 when the computer executable instruction is executed by a processor.

7. The method according to claim 1 , wherein the voice intelligent interactive system is a Duer Operating System (DuerOS) and the game is mahjong game.

8. A terminal device, comprising: a processor and a computer-readable medium for storing program codes, which, when executed by the processor, cause the processor to:

establish a connection between a game and a voice intelligent interactive system when the game is detected to be started, to complete a binding between the game and the voice intelligent interactive system;

transmit obtained audio data of a user to a server;

receive structured data returned by the server, wherein the structured data is obtained by the server through performing recognition processing on the audio data to obtain text information corresponding to the audio data, performing natural language processing and semantic interpretation on the text information to obtain a parsed content, and classifying the parsed content through model processing, wherein the structured data represents machine instruction information corresponding to a content that the user intends to express, and wherein the natural language processing comprises information filtering, automatic abstracting, information extracting, and text mining;

determine an operation instruction corresponding to the structured data according to the currently running game and the structured data in the voice intelligent interactive system; and

control, according to the operation instruction, the currently running game to perform the corresponding operation.

9. The device according to claim 8 , wherein the program codes further cause the processor to:

transmit the audio data to the server for semantic understanding through the voice intelligent interactive system.

10. The device according to claim 8 , wherein the program codes further cause the processor to:

receive the audio data input by the user and transmitted by an intelligent remote controller or an intelligent terminal device.

11. The device according to claim 8 , wherein the program codes further cause the processor to:

perform echo cancellation and/or noise reduction on the audio data to obtain processed audio data.

12. A server, comprising: a processor and a computer-readable medium for storing program codes, which, when executed by the processor, cause the processor to:

receive audio data transmitted by a terminal device;

perform recognition processing on the audio data to obtain text information corresponding to the audio data;

perform natural language processing and semantic interpretation on the text information to obtain a parsed content;

classify the parsed content through model processing to obtain structured data, wherein the structured data represents machine instruction information corresponding to a content that the user intends to express, and wherein the natural language processing comprises information filtering, automatic abstracting, information extracting, and text mining; and

return the structured data to the terminal device for enabling the terminal device to determine an operation instruction corresponding to the structured data according to a currently running game and the structured data in a voice intelligent interactive system, and control, according to the operation instruction, the currently running game to perform the corresponding operation, wherein the voice intelligent interactive system has been established a connection with the game when the game is detected to be started to complete a binding between the game and the voice intelligent interactive system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.; SHANGHAI XIAODU TECHNOLOGY CO. LTD.
Reel/Frame 056811/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2019
From: DU, BINYUAN; ZHANG, YAN; YUAN, PENG; TIAN, LONGLONG; CHANG, LIANGYU
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 049752/0043 →
Priority Claims (1)
CN 201811053135.9 · Sep 10, 2018 · national
Continuity (1)
Related Publication 20190341047A1 · Nov 7, 2019