IP Library › Granted Patent US 12,458,878
Granted Patent B2
US 12,458,878 · App. 18/043,617 · Granted Nov 4, 2025

Method and apparatus for controlling AR game, electronic device and storage medium

Inventors: Wenqiang Cai (Beijing, CN); Lingjiang Wu (Beijing, CN); Guanyu Chen (Beijing, CN); Bo Lin (Beijing, CN); Zhehao Li (Beijing, CN)
Assignee: Beijing Bytedance Network Technology Co., Ltd.
A63F13/424A63F13/213A63F13/533A63F13/65A63F13/837A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,458,878
App. No.
18/043,617
Granted
Nov 4, 2025
Kind
B2
Abstract

Provided are a method and apparatus for controlling an AR game, an electronic device and a storage medium. In the provided method for controlling an AR game, a game control instruction is determined, according to a voice instruction obtained during running of the AR game and a preset instruction mapping relationship, and then the AR game is controlled according to the game control instruction.

Claims (63)

1 . A method for controlling an augmented reality (AR) game, comprising:

acquiring a voice instruction during running of the AR game;

determining a game control instruction, according to the voice instruction and a preset instruction mapping relationship;

controlling a virtual object in the AR game according to the game control instruction, wherein the virtual object is a game element that is superimposed and displayed on an image of a real environment; and

displaying prompt information if a current holding mode is inconsistent with a target holding mode, wherein the prompt information is used to instruct the current holding mode of a device to be adjusted.

2 . A method for controlling an augmented reality (AR) game, comprising:

acquiring a voice instruction during running of the AR game;

determining a game control instruction, according to the voice instruction and a preset instruction mapping relationship;

controlling a virtual object in the AR game according to the game control instruction, wherein the virtual object is a game element that is superimposed and displayed on an image of a real environment;

acquiring video information through a camera apparatus of a device, during the running of the AR game;

determining a current holding mode of the device, according to the video information; and

displaying prompt information if the current holding mode is inconsistent with a target holding mode, wherein the prompt information is used to instruct the current holding mode of the device to be adjusted.

3 . The method for controlling an AR game according to claim 2 , wherein the acquiring a voice instruction comprises:

acquiring the voice instruction, wherein the voice instruction is used to instruct a target object in the AR game to execute a target action, and the virtual object comprises the target object.

4 . The method for controlling an AR game according to claim 3 , wherein before controlling the virtual object in the AR game according to the game control instruction, the method further comprises:

determining the target object according to the voice instruction, wherein the target object has been displayed in an interface of the AR game before the voice instruction is input.

5 . The method for controlling an AR game according to claim 3 , wherein before controlling the virtual object in the AR game according to the game control instruction, the method further comprises:

determining the target object according to the voice instruction; and

generating and displaying the target object in an interface of the AR game.

6 . The method for controlling an AR game according to claim 5 , wherein the generating and displaying the target object in an interface of the AR game comprises:

determining position information of the target object according to the voice instruction; and

generating and displaying the target object at a position corresponding to the position information in the interface.

7 . The method for controlling an AR game according to claim 6 , wherein an interface trigger control corresponding to the target object is located in a secondary interface of the interface, and the secondary interface is an interface that is invoked and displayed after a specific control is triggered in the interface.

8 . The method for controlling an AR game according to claim 3 , wherein the target object comprises a game prop in an interface of the AR game, and the controlling a virtual object in the AR game according to the game control instruction comprises:

determining a frequency of voice input according to the voice instruction, wherein the frequency of voice input is used to represent an input speed of a target audio in the voice instruction; and

determining, according to the frequency of voice input, a frequency at which the game prop executes the target action.

9 . The method for controlling an AR game according to claim 8 , wherein the target audio comprises an onomatopoeic word corresponding to execution of the target action by the game prop.

10 . The method for controlling an AR game according to claim 3 , wherein the target object comprises a game prop in an interface of the AR game, and the controlling a virtual object in the AR game according to the game control instruction comprises:

determining a volume of voice input according to the voice instruction, wherein the volume of voice input is used to represent a sound intensity of a target audio in the voice instruction; and

determining, according to the volume of voice input, at least one of an area of effect and intensity of the target action executed by the game prop.

11 . The method for controlling an AR game according to claim 2 , wherein the determining a game control instruction according to the voice instruction and a preset instruction mapping relationship comprises:

converting the voice instruction into a text instruction;

determining, from a preset keyword set, a target keyword matching the text instruction; and

determining the game control instruction, according to the target keyword and the preset instruction mapping relationship.

12 . The method for controlling an AR game according to claim 3 , wherein the target object comprises a plurality of game characters in an interface of the AR game, and the controlling a virtual object in the AR game according to the game control instruction comprises:

determining a voice characteristic according to the voice instruction; and

determining, according to the voice characteristic, a target game character of the plurality of game characters that is to be controlled by the voice instruction, so as to control the target game character according to the game control instruction.

13 . A non-transitory computer-readable storage medium storing computer-executable instructions thereon, wherein when a processor executes the computer-executable instructions, the method for controlling an augmented reality (AR) game according to claim 2 is implemented.

14 . An electronic device, comprising:

a processor,

a memory, configured to store a computer program; and

a display, configured to display an augmented reality (AR) game interface processed by the processor;

wherein the computer program, when being executed by the processor, causes the processor to:

acquire a voice instruction during running of an AR game;

determine a game control instruction, according to the voice instruction and a preset instruction mapping relationship;

control a virtual object in the AR game according to the game control instruction, wherein the virtual object is a game element that is superimposed and displayed on an image of a real environment;

acquire video information through a camera apparatus of a device, during the running of the AR game;

determine a current holding mode of the device, according to the video information; and

display prompt information if the current holding mode is inconsistent with a target holding mode, wherein the prompt information is used to instruct the current holding mode of the device to be adjusted.

15 . The electronic device according to claim 14 , wherein the voice instruction is used to instruct a target object in the AR game to execute a target action, and the virtual object comprises the target object.

16 . The electronic device according to claim 15 , wherein before the virtual object in the AR game is controlled according to the game control instruction, the computer program, when being executed by the processor, further causes the processor to:

determine the target object according to the voice instruction, wherein the target object has been displayed in the AR game interface before the voice instruction is input.

17 . The electronic device according to claim 15 , wherein before the virtual object in the AR game is controlled according to the game control instruction, the computer program, when being executed by the processor, further causes the processor to:

determine the target object according to the voice instruction;

determine position information of the target object according to the voice instruction; and

generate and display the target object at a position corresponding to the position information in the AR game interface.

18 . The electronic device according to claim 17 , wherein an interface trigger control corresponding to the target object is located in a secondary interface of the AR game interface, and the secondary interface is an interface that is invoked and displayed after a specific control is triggered in the AR game interface.

19 . The electronic device according to claim 15 , wherein the target object comprises a game prop in the AR game interface, and the computer program, when being executed by the processor, further causes the processor to:

determine a frequency of voice input according to the voice instruction, wherein the frequency of voice input is used to represent an input speed of a target audio in the voice instruction; and

determine, according to the frequency of voice input, a frequency at which the game prop executes the target action.

20 . The electronic device according to claim 19 , wherein the computer program, when being executed by the processor, further causes the processor to:

determine a volume of voice input according to the voice instruction, wherein the volume of voice input is used to represent a sound intensity of the target audio in the voice instruction; and

determine, according to the volume of voice input, at least one of an area of effect and intensity of the target action executed by the game prop.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2025
From: CAI, WENQIANG; WU, LINGJIANG; CHEN, GUANYU; LIN, BO
To: SHENZHEN JINRITOUTIAO TECHNOLOGY CO., LTD.
Reel/Frame 072425/0565 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2025
From: LEMON TECHNOLOGY(SHENZHEN)CO., LTD.; SHENZHEN JINRITOUTIAO TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 072425/0867 →
Priority Claims (1)
CN 202011182612.9 · Oct 29, 2020 · national
Continuity (1)
Related Publication 20230271083A1 · Aug 31, 2023
References Cited (18)
US 20180108349A1 · Hutchings · 2018 [cited by applicant]
US 20200101383A1 · Hwang · 2020 [cited by examiner]
US 20200384362A1 · Shah · 2020 [cited by examiner]
US 20210275905A1 · Doucet · 2021 [cited by examiner]
CN 106681683A · 2017 [cited by applicant]
CN 107274891A · 2017 [cited by applicant]
CN 107608649A · 2018 [cited by applicant]
CN 107773982A · 2018 [cited by applicant]
CN 108465238A · 2018 [cited by applicant]
CN 108479075A · 2018 [cited by applicant]
CN 109589603A · 2019 [cited by applicant]
CN 109847348A · 2019 [cited by applicant]
CN 110327622A · 2019 [cited by applicant]
CN 111228791A · 2020 [cited by applicant]
CN 111530079A · 2020 [cited by applicant]
CN 112295220A · 2021 [cited by applicant]
ISA China National Intellectual Property Administration, International Search Report and Written Opinion Issued in Application No. PCT/CN2021/111872, Sep. 28, 2021, WIPO, 12 pages. [cited by applicant]
China National Intellectual Property Administration, Office Action and Search Report Issued in Application No. 202011182612.9, Feb. 26, 2024, 12 pages. (Submitted with partial English translation). [cited by applicant]