IP Library Granted Patent US 12,434,145
Granted Patent B2
US 12,434,145 · App. 17/992,491 · Granted Oct 7, 2025

Controlling a virtual vehicle using auxiliary control function

Inventor: Tao Wang (Shenzhen, CN)
Assignee: Tencent Technology (Shenzhen) Company Limited
A63F13/56A63F13/533A63F13/5375A63F13/803A63F2300/5553
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,434,145
App. No.
17/992,491
Granted
Oct 7, 2025
Kind
B2
Abstract

A method for controlling a virtual vehicle includes displaying, on a graphical user interface, a virtual vehicle in a virtual environment, and controlling the virtual vehicle to drive in the virtual environment in response to a control operation input into the graphical user interface. The method further includes determining whether movement of the virtual vehicle in the graphical user interface based on the control operation meets a predefined condition, and, in response to a determination that the movement of the virtual vehicle in response to the control operation meets the predefined condition, controlling the virtual vehicle independently of the control operation to move away from a road boundary.

Claims (61)

1. A method for controlling a virtual vehicle, the method comprising:

controlling display, on a graphical user interface, of the virtual vehicle in a virtual environment;

controlling the virtual vehicle to drive in the virtual environment in response to a control operation that is input by a user into the graphical user interface;

determining whether movement of the virtual vehicle in the graphical user interface based on the control operation meets a control failure condition, the control failure condition indicating a predicted control failure of the virtual vehicle based on the movement of the virtual vehicle; and

in response to a determination that the movement of the virtual vehicle in response to the control operation meets the control failure condition, automatically controlling a driving parameter of the virtual vehicle independently of the control operation that is input by the user into the graphical user interface to control the driving parameter, the automatically controlling being performed irrespective of the control operation that is input by the user, the automatically controlling including (i) performing data processing based on a position and a speed of the virtual vehicle using an auxiliary steering model to obtain a target position and a target speed of the virtual vehicle, and (ii) controlling the virtual vehicle to steer according to the target position and the target speed of the virtual vehicle.

2. The method according to claim 1 , wherein

the control failure of the virtual vehicle in response to the control operation is predicted when the speed of the virtual vehicle reaches a speed threshold, a distance between the virtual vehicle and a road bend boundary is less than a distance threshold, and an angle between a movement direction of the virtual vehicle and a tangent line of the road bend boundary reaches an angle threshold.

3. The method according to claim 2 , wherein the automatically controlling the driving parameter of the virtual vehicle independently of the control operation comprises:

automatically adjusting, based on the speed of the virtual vehicle, the speed of the virtual vehicle to the target speed by using an auxiliary control function, wherein

the target speed is determined according to the angle between the movement direction of the virtual vehicle and the tangent line of the road bend boundary.

4. The method according to claim 2 , wherein the automatically controlling the driving parameter of the virtual vehicle independently of the control operation comprises:

automatically adjusting, based on the distance between the virtual vehicle and the road bend boundary, the distance between the virtual vehicle and the road bend boundary to a target distance by using an auxiliary control function.

5. The method according to claim 2 , wherein the automatically controlling the driving parameter of the virtual vehicle independently of the control operation comprises:

automatically adjusting, based on the angle between the movement direction of the virtual vehicle and the tangent line of the road bend boundary, the angle between the movement direction of the virtual vehicle and the tangent line of the road bend boundary to a target angle by using an auxiliary control function.

6. The method according to claim 2 , wherein

a road bend in the virtual environment comprises an inner bend boundary and an outer bend boundary; and

the method further comprises:

obtaining a first distance between the virtual vehicle and the inner bend boundary, and obtaining a second distance between the virtual vehicle and the outer bend boundary; and

determining a smaller one of the first distance and the second distance as the road bend boundary.

7. The method according to claim 1 , wherein the automatically controlling the driving parameter of the virtual vehicle independently of the control operation comprises:

in response to the determination that the movement of the virtual vehicle in response to the control operation meets the control failure condition, controlling display of an auxiliary control function control; and

controlling the virtual vehicle to steer independently of the control operation in response to a trigger operation on the auxiliary control function control.

8. The method according to claim 1 , further comprising:

controlling display of an auxiliary identifier on the graphical user interface, wherein the auxiliary identifier indicates that the virtual vehicle is being automatically controlled independently of the control operation.

9. The method according to claim 8 , wherein the controlling the display of the auxiliary identifier comprises:

controlling the display of the auxiliary identifier at a peripheral position with respect to the virtual vehicle; or

controlling the display of the auxiliary identifier at a peripheral position with respect to a driver avatar in the virtual vehicle.

10. The method according to claim 1 , wherein

a direction control is controlled to be displayed on the graphical user interface; and

the method further comprises:

controlling display of control of the virtual vehicle on the direction control when automatically controlling the driving parameter of the virtual vehicle independently of the control operation.

11. The method according to claim 1 , further comprising:

controlling display of an operation prompt on the graphical user interface, wherein the operation prompt displays a reason for the predicted control failure of the virtual vehicle and feedback for adjusting the driving parameter of the virtual vehicle.

12. The method according to claim 1 , further comprising:

obtaining a sample steering video;

extracting a first position and a first speed of a sample virtual vehicle at a first moment from the sample steering video, and

extracting a second position and a second speed of the sample virtual vehicle at a second moment, the second moment being later than the first moment, the first position, the first speed, the second position, and the second speed being used to determine the auxiliary steering model.

13. An apparatus for controlling a virtual vehicle, comprising:

processing circuitry configured to

control display, on a graphical user interface, of the virtual vehicle in a virtual environment;

control the virtual vehicle to drive in the virtual environment in response to a control operation that is input by a user into the graphical user interface;

determine whether movement of the virtual vehicle in the graphical user interface based on the control operation meets a control failure condition, the control failure condition indicating a predicted control failure of the virtual vehicle based on the movement of the virtual vehicle; and

in response to a determination that the movement of the virtual vehicle in response to the control operation meets the control failure condition, automatically control a driving parameter of the virtual vehicle independently of the control operation that is input by the user into the graphical user interface to control the driving parameter, the automatic control being performed irrespective of the control operation that is input by the user, the automatic control including (i) data processing performed based on a position and a speed of the virtual vehicle using an auxiliary steering model to obtain a target position and a target speed of the virtual vehicle, and (ii) control of the virtual vehicle to steer according to the target position and the target speed of the virtual vehicle.

14. The apparatus according to claim 13 , wherein

the control failure of the virtual vehicle in response to the control operation is predicted when the speed of the virtual vehicle reaches a speed threshold, a distance between the virtual vehicle and a road bend boundary is less than a distance threshold, and an angle between a movement direction of the virtual vehicle and a tangent line of the road bend boundary reaches an angle threshold.

15. The apparatus according to claim 14 , wherein the processing circuitry is further configured to:

automatically adjust, based on the speed of the virtual vehicle, the speed of the virtual vehicle to the target speed by using an auxiliary control function, wherein

the target speed is determined according to the angle between the movement direction of the virtual vehicle and the tangent line of the road bend boundary.

16. The apparatus according to claim 14 , wherein the processing circuitry is further configured to: automatically adjust, based on the distance between the virtual vehicle and the road bend boundary, the distance between the virtual vehicle and the road bend boundary to a target distance by using an auxiliary control function.

17. The apparatus according to claim 14 , wherein the processing circuitry is further configured to:

automatically adjust, based on the angle between the movement direction of the virtual vehicle and the tangent line of the road bend boundary, the angle between the movement direction of the virtual vehicle and the tangent line of the road bend boundary to a target angle by using an auxiliary control function.

18. The apparatus according to claim 14 , wherein

a road bend in the virtual environment comprises an inner bend boundary and an outer bend boundary; and

the processing circuitry is further configured to

obtain a first distance between the virtual vehicle and the inner bend boundary, and obtain a second distance between the virtual vehicle and the outer bend boundary; and

determine a smaller one of the first distance and the second distance as the road bend boundary.

19. A non-transitory computer-readable storage medium storing computer-readable instructions thereon, which, when executed by a computer, cause the computer to perform a method for controlling a virtual vehicle, the method comprising:

controlling display, on a graphical user interface, of the virtual vehicle in a virtual environment;

controlling the virtual vehicle to drive in the virtual environment in response to a control operation that is input by a user into the graphical user interface;

determining whether movement of the virtual vehicle in the graphical user interface based on the control operation meets a control failure condition, the control failure condition indicating a predicted control failure of the virtual vehicle based on the movement of the virtual vehicle; and

in response to a determination that the movement of the virtual vehicle in response to the control operation meets the control failure condition, automatically controlling a driving parameter of the virtual vehicle independently of the control operation that is input by the user into the graphical user interface to control the driving parameter, the automatically controlling being performed irrespective of the control operation that is input by the user, the automatically controlling including (i) performing data processing based on a position and a speed of the virtual vehicle using an auxiliary steering model to obtain a target position and a target speed of the virtual vehicle, and (ii) controlling the virtual vehicle to steer according to the target position and the target speed of the virtual vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: WANG, TAO
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 061856/0713 →
Priority Claims (1)
CN 202110454401.4 · Apr 26, 2021 · national
Continuity (2)
Continuation PCTCN2022082037 · Mar 21, 2022
Related Publication 20230082510A1 · Mar 16, 2023
References Cited (14)
US 10449451B2 · Utsugi · 2019 [cited by examiner]
US 20070265087A1 · Akahori · 2007 [cited by examiner]
US 20150339854A1 · Adler · 2015 [cited by examiner]
US 20160210382A1 · Alaniz et al. · 2016 [cited by applicant]
US 20200289933A1 · Seropian · 2020 [cited by examiner]
CN 105807762A · 2016 [cited by applicant]
CN 108579079A · 2018 [cited by applicant]
CN 108885152A · 2018 [cited by applicant]
CN 109991015A · 2019 [cited by applicant]
CN 111228804A · 2020 [cited by applicant]
CN 112148622A · 2020 [cited by applicant]
CN 113041619A · 2021 [cited by applicant]
International Search Report and Written Opinion in PCT/CN2022/082037, mailed Jun. 23, 2022, 12 pages. [cited by applicant]
Chinese Office Action in 202110454401.4, mailed Oct. 21, 2022, 13 pages. [cited by applicant]