IP Library Granted Patent US 12664723
Granted Patent B2
US 12664723 · App. 18/255,003 · Granted Jun 23, 2026

VR interaction method and apparatus

Inventors: Yintang Ni (Shenzhen, CN); Bingjie Huang (Shanghai, CN); Baotai Shao (Shanghai, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
G06T17/00G04G9/007G06F1/163G06F3/011G06F3/04815G06F3/04886
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12664723
App. No.
18/255,003
Granted
Jun 23, 2026
Kind
B2
Abstract

A method, implemented by a terminal, includes sending, to a wearable device, a virtual reality (VR) start instruction when the terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode, receiving, from the wearable device and in response to a first operation by a user on a VR basic operation interface, a first instruction, starting running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application, selecting, from preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application, configuring the first VR operation interface for the wearable device for display, receiving, from the wearable device, a second instruction; and controlling, based on the second instruction, the first VR sub-application to execute a first control function.

Claims (77)

1 . A virtual reality (VR) interaction method comprising:

sending, to a wearable device, a VR start instruction when a terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode such that the wearable device displays a VR basic operation interface;

receiving, from the wearable device, a first instruction associated with a first operation by a user on the VR basic operation interface;

starting running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application;

selecting, from a plurality of preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application when the terminal runs the first VR sub-application;

configuring the first VR operation interface for the wearable device to display;

coupling the terminal with VR glasses;

performing synthesis and rendering on a first interface of the first VR application and the VR basic operation interface and sending a first synthesized image of the first interface and the VR basic operation interface to the VR glasses when the terminal runs the first VR application;

receiving, from the wearable device, a second instruction associated with a second operation by the user on the first VR operation interface;

controlling, based on the second instruction, the first VR sub-application to execute a first control function; and

performing synthesis and rendering on a second interface of the first VR sub-application and the first VR operation interface and sending a second synthesized image of the second interface and the first VR operation interface to the VR glasses when the terminal runs the first VR sub-application, wherein a change by the user of an operated function control on the first VR operation interface is displayed in a VR field of view.

2 . The VR interaction method of claim 1 , wherein the first VR operation interface comprises a function control, wherein the configuration information comprises the first control function of the first VR sub-application, and wherein selecting the first VR operation interface comprises selecting the first VR operation interface that comprises a mapping relationship between the function control and the first control function.

3 . The VR interaction method of claim 2 , further comprising:

receiving, from the wearable device, a first update instruction; and

updating, based on the first update instruction, the mapping relationship.

4 . The VR interaction method of claim 3 , further comprising:

performing synthesis and rendering on a first interface of the first VR sub-application and the first VR operation interface; and

zooming in the first VR operation interface relative to the first interface when the first VR operation interface is in a configurable state.

5 . The VR interaction method of claim 4 , further comprising weakening the first interface when the first VR operation interface is in the configurable state.

6 . The VR interaction method of claim 2 , further comprising:

receiving, from the wearable device, a second update instruction; and

updating, based on the second update instruction, a layout of an area in which the function control is located.

7 . The VR interaction method of claim 2 , further comprising:

displaying a first interface of the first VR sub-application and the first VR operation interface through screen splitting;

switching, in response to a configuration trigger operation on the first VR operation interface, the first VR operation interface to a configurable state; and

updating, in response to a first update operation by the user on the first VR operation interface in the configurable state, the mapping relationship.

8 . The VR interaction method of claim 7 , further comprising updating, in response to a second update operation by the user on the first VR operation interface in the configurable state, a layout of an area in which the function control is located.

9 . The VR interaction method of claim 1 , further comprising:

receiving a first location relationship of a finger of the user relative to the VR basic operation interface; and

generating a first virtual finger in the first synthesized image based on the first location relationship.

10 . The VR interaction method of claim 1 , further comprising:

receiving a second location relationship of a finger of the user relative to the first VR operation interface; and

generating a second virtual finger in the second synthesized image based on the second location relationship.

11 . The VR interaction method of claim 1 , comprising:

receiving a video image in which the user holds the wearable device in hand and that is captured by a camera;

performing synthesis and rendering on a first interface of the first VR application and the video image and sending a first synthesized image of the first interface and the video image to the VR glasses when the terminal runs the first VR application; and

performing synthesis and rendering on a second interface of the first VR sub-application and the video image and sending a second synthesized image of the second interface and the video image to the VR glasses when the terminal runs the first VR sub-application.

12 . The VR interaction method of claim 1 , wherein the terminal comprises a configuration interface for configuring a preset VR operation interface, and wherein the VR interaction method further comprises:

displaying, in response to a selection operation by the user on the configuration interface, the preset VR operation interface; and

updating, in response to a first update operation by the user on the preset VR operation interface, a mapping relationship between the first control function of the first VR sub-application and a function control comprised in the preset VR operation interface.

13 . The VR interaction method of claim 12 , further comprising updating, in response to a second update operation by the user on the preset VR operation interface, a layout of an area in which the function control is located.

14 . The VR interaction method of claim 1 , further comprising:

receiving, from the wearable device, a switching instruction; and

switching the first VR operation interface that matches the configuration information to a second VR operation interface based on the switching instruction.

15 . The VR interaction method of claim 1 , wherein configuring the first VR operation interface comprises sending, to the wearable device, interface configuration information of the first VR operation interface, or sending, to the wearable device, a picture corresponding to the first VR operation interface to the wearable device, and wherein the picture comprises identification information of a function control comprised in the first VR operation interface.

16 . The VR interaction method of claim 15 , wherein the wearable device comprises a watch or a band, and wherein the VR interaction method further comprises:

sending, to the wearable device, the interface configuration information when the wearable device is the watch; and

sending, to the wearable device, the picture when the wearable device is the band.

17 . The VR interaction method of claim 15 , further comprising sending, to the wearable device, a mapping relationship between the function control and the first control function of the first VR sub-application.

18 . The VR interaction method of claim 1 , wherein the wearable device comprises a first wearable device and a second wearable device, and wherein configuring the first VR operation interface comprises:

splitting the first VR operation interface into a first sub-interface and a second sub-interface;

configuring the first sub-interface for the first wearable device for display; and

configuring the second sub-interface for the second wearable device for display.

19 . A terminal comprising:

a memory configured to store instructions; and

one or more processors coupled to the memory and configured to:

send, to a wearable device, a virtual reality (VR) start instruction when the terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode such that the wearable device displays a VR basic operation interface;

receive, from the wearable device, a first instruction associated with a first operation by a user on the VR basic operation interface;

start running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application;

select, from a plurality of preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application when the terminal runs the first VR sub-application;

couple the terminal with VR glasses;

perform synthesis and rendering on a first interface of the first VR application and the VR basic operation interface and sending a first synthesized image of the first interface and the VR basic operation interface to the VR glasses when the terminal runs the first VR application;

configure the first VR operation interface for the wearable device to display;

receive, from the wearable device, a second instruction associated with a second operation by the user on the first VR operation interface;

control, based on the second instruction, the first VR sub-application to execute a first control function; and

perform synthesis and rendering on a second interface of the first VR sub-application and the first VR operation interface and sending a second synthesized image of the second interface and the first VR operation interface to the VR glasses when the terminal runs the first VR sub-application, wherein a change by the user of an operated function control on the first VR operation interface is displayed in a VR field of view.

20 . A computer program product comprising instructions stored on a non-transitory computer-readable medium that, when executed by one or more processors, cause a terminal to:

send, to a wearable device, a virtual reality (VR) start instruction when the terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode such that the wearable device displays a VR basic operation interface;

receive, from the wearable device, a first instruction associated with a first operation by a user on the VR basic operation interface;

start running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application;

select, from a plurality of preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application when the terminal runs the first VR sub-application;

couple the terminal with VR glasses;

perform synthesis and rendering on a first interface of the first VR application and the VR basic operation interface and sending a first synthesized image of the first interface and the VR basic operation interface to the VR glasses when the terminal runs the first VR application;

configure the first VR operation interface for the wearable device to display;

receive, from the wearable device, a second instruction associated with a second operation by the user on the first VR operation interface;

control, based on the second instruction, the first VR sub-application to execute a first control function; and

perform synthesis and rendering on a second interface of the first VR sub-application and the first VR operation interface and sending a second synthesized image of the second interface and the first VR operation interface to the VR glasses when the terminal runs the first VR sub-application, wherein a change by the user of an operated function control on the first VR operation interface is displayed in a VR field of view.