VR interaction method and apparatus
A method, implemented by a terminal, includes sending, to a wearable device, a virtual reality (VR) start instruction when the terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode, receiving, from the wearable device and in response to a first operation by a user on a VR basic operation interface, a first instruction, starting running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application, selecting, from preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application, configuring the first VR operation interface for the wearable device for display, receiving, from the wearable device, a second instruction; and controlling, based on the second instruction, the first VR sub-application to execute a first control function.
1 . A virtual reality (VR) interaction method comprising:
sending, to a wearable device, a VR start instruction when a terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode such that the wearable device displays a VR basic operation interface;
receiving, from the wearable device, a first instruction associated with a first operation by a user on the VR basic operation interface;
starting running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application;
selecting, from a plurality of preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application when the terminal runs the first VR sub-application;
configuring the first VR operation interface for the wearable device to display;
coupling the terminal with VR glasses;
performing synthesis and rendering on a first interface of the first VR application and the VR basic operation interface and sending a first synthesized image of the first interface and the VR basic operation interface to the VR glasses when the terminal runs the first VR application;
receiving, from the wearable device, a second instruction associated with a second operation by the user on the first VR operation interface;
controlling, based on the second instruction, the first VR sub-application to execute a first control function; and
performing synthesis and rendering on a second interface of the first VR sub-application and the first VR operation interface and sending a second synthesized image of the second interface and the first VR operation interface to the VR glasses when the terminal runs the first VR sub-application, wherein a change by the user of an operated function control on the first VR operation interface is displayed in a VR field of view.
2 . The VR interaction method of claim 1 , wherein the first VR operation interface comprises a function control, wherein the configuration information comprises the first control function of the first VR sub-application, and wherein selecting the first VR operation interface comprises selecting the first VR operation interface that comprises a mapping relationship between the function control and the first control function.
3 . The VR interaction method of claim 2 , further comprising:
receiving, from the wearable device, a first update instruction; and
updating, based on the first update instruction, the mapping relationship.
4 . The VR interaction method of claim 3 , further comprising:
performing synthesis and rendering on a first interface of the first VR sub-application and the first VR operation interface; and
zooming in the first VR operation interface relative to the first interface when the first VR operation interface is in a configurable state.
5 . The VR interaction method of claim 4 , further comprising weakening the first interface when the first VR operation interface is in the configurable state.
6 . The VR interaction method of claim 2 , further comprising:
receiving, from the wearable device, a second update instruction; and
updating, based on the second update instruction, a layout of an area in which the function control is located.
7 . The VR interaction method of claim 2 , further comprising:
displaying a first interface of the first VR sub-application and the first VR operation interface through screen splitting;
switching, in response to a configuration trigger operation on the first VR operation interface, the first VR operation interface to a configurable state; and
updating, in response to a first update operation by the user on the first VR operation interface in the configurable state, the mapping relationship.
8 . The VR interaction method of claim 7 , further comprising updating, in response to a second update operation by the user on the first VR operation interface in the configurable state, a layout of an area in which the function control is located.
9 . The VR interaction method of claim 1 , further comprising:
receiving a first location relationship of a finger of the user relative to the VR basic operation interface; and
generating a first virtual finger in the first synthesized image based on the first location relationship.
10 . The VR interaction method of claim 1 , further comprising:
receiving a second location relationship of a finger of the user relative to the first VR operation interface; and
generating a second virtual finger in the second synthesized image based on the second location relationship.
11 . The VR interaction method of claim 1 , comprising:
receiving a video image in which the user holds the wearable device in hand and that is captured by a camera;
performing synthesis and rendering on a first interface of the first VR application and the video image and sending a first synthesized image of the first interface and the video image to the VR glasses when the terminal runs the first VR application; and
performing synthesis and rendering on a second interface of the first VR sub-application and the video image and sending a second synthesized image of the second interface and the video image to the VR glasses when the terminal runs the first VR sub-application.
12 . The VR interaction method of claim 1 , wherein the terminal comprises a configuration interface for configuring a preset VR operation interface, and wherein the VR interaction method further comprises:
displaying, in response to a selection operation by the user on the configuration interface, the preset VR operation interface; and
updating, in response to a first update operation by the user on the preset VR operation interface, a mapping relationship between the first control function of the first VR sub-application and a function control comprised in the preset VR operation interface.
13 . The VR interaction method of claim 12 , further comprising updating, in response to a second update operation by the user on the preset VR operation interface, a layout of an area in which the function control is located.
14 . The VR interaction method of claim 1 , further comprising:
receiving, from the wearable device, a switching instruction; and
switching the first VR operation interface that matches the configuration information to a second VR operation interface based on the switching instruction.
15 . The VR interaction method of claim 1 , wherein configuring the first VR operation interface comprises sending, to the wearable device, interface configuration information of the first VR operation interface, or sending, to the wearable device, a picture corresponding to the first VR operation interface to the wearable device, and wherein the picture comprises identification information of a function control comprised in the first VR operation interface.
16 . The VR interaction method of claim 15 , wherein the wearable device comprises a watch or a band, and wherein the VR interaction method further comprises:
sending, to the wearable device, the interface configuration information when the wearable device is the watch; and
sending, to the wearable device, the picture when the wearable device is the band.
17 . The VR interaction method of claim 15 , further comprising sending, to the wearable device, a mapping relationship between the function control and the first control function of the first VR sub-application.
18 . The VR interaction method of claim 1 , wherein the wearable device comprises a first wearable device and a second wearable device, and wherein configuring the first VR operation interface comprises:
splitting the first VR operation interface into a first sub-interface and a second sub-interface;
configuring the first sub-interface for the first wearable device for display; and
configuring the second sub-interface for the second wearable device for display.
19 . A terminal comprising:
a memory configured to store instructions; and
one or more processors coupled to the memory and configured to:
send, to a wearable device, a virtual reality (VR) start instruction when the terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode such that the wearable device displays a VR basic operation interface;
receive, from the wearable device, a first instruction associated with a first operation by a user on the VR basic operation interface;
start running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application;
select, from a plurality of preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application when the terminal runs the first VR sub-application;
couple the terminal with VR glasses;
perform synthesis and rendering on a first interface of the first VR application and the VR basic operation interface and sending a first synthesized image of the first interface and the VR basic operation interface to the VR glasses when the terminal runs the first VR application;
configure the first VR operation interface for the wearable device to display;
receive, from the wearable device, a second instruction associated with a second operation by the user on the first VR operation interface;
control, based on the second instruction, the first VR sub-application to execute a first control function; and
perform synthesis and rendering on a second interface of the first VR sub-application and the first VR operation interface and sending a second synthesized image of the second interface and the first VR operation interface to the VR glasses when the terminal runs the first VR sub-application, wherein a change by the user of an operated function control on the first VR operation interface is displayed in a VR field of view.
20 . A computer program product comprising instructions stored on a non-transitory computer-readable medium that, when executed by one or more processors, cause a terminal to:
send, to a wearable device, a virtual reality (VR) start instruction when the terminal starts running a first VR application, wherein the VR start instruction instructs the wearable device to switch from a normal running mode to a VR mode such that the wearable device displays a VR basic operation interface;
receive, from the wearable device, a first instruction associated with a first operation by a user on the VR basic operation interface;
start running, based on the first instruction, a first VR sub-application of VR sub-applications comprised in the first VR application;
select, from a plurality of preset VR operation interfaces, a first VR operation interface that matches configuration information of the first VR sub-application when the terminal runs the first VR sub-application;
couple the terminal with VR glasses;
perform synthesis and rendering on a first interface of the first VR application and the VR basic operation interface and sending a first synthesized image of the first interface and the VR basic operation interface to the VR glasses when the terminal runs the first VR application;
configure the first VR operation interface for the wearable device to display;
receive, from the wearable device, a second instruction associated with a second operation by the user on the first VR operation interface;
control, based on the second instruction, the first VR sub-application to execute a first control function; and
perform synthesis and rendering on a second interface of the first VR sub-application and the first VR operation interface and sending a second synthesized image of the second interface and the first VR operation interface to the VR glasses when the terminal runs the first VR sub-application, wherein a change by the user of an operated function control on the first VR operation interface is displayed in a VR field of view.