Control method for movable platform, head-mounted device, system, and storage medium
A method for controlling a movable platform includes: displaying a first image and/or a second image on a display device of a head-mounted device, where the first image is captured by a first photographing device on the head-mounted device and the second image is captured by a second photographing device on the movable platform; when switching from displaying the second image to displaying the first image on the display device, sending a safety operation instruction to the movable platform to make the movable platform perform a corresponding safety operation. This disclosure ensures the safety of the movable platform during interactions between the head-mounted device and the movable platform, particularly when the content displayed by the head-mounted device changes. The disclosure also provides a terminal device and a head-mounted device.
1 . A control method for a movable platform, comprising:
controlling a display device of a head-mounted device to display at least one of a first image or a second image, wherein the head-mounted device is in communication with the movable platform, the first image is captured by a first photographing device on the head-mounted device, and the second image is captured by a second photographing device on the movable platform; and
in response to occurrence of a viewpoint switching operation to the head-mounted device, switching the display device from displaying the second image to displaying the first image and rendering the movable platform to perform a corresponding safety operation.
2 . The control method according to claim 1 , wherein the corresponding safety operation comprises at least one of maintaining a position of the movable platform, maintaining an attitude of the movable platform, stopping, or returning.
3 . The control method according to claim 1 , wherein the rendering of the movable platform to perform the corresponding safety operation comprises:
in response to the movable platform being in a cruising state or a returning state and the display device switching from displaying the second image to displaying the first image, generating a safety operation instruction for the movable platform to perform the corresponding safety operation.
4 . The control method according to claim 1 , further comprising:
in response to occurrence of the viewpoint switching operation, controlling the display device to switch from displaying the first image to displaying the second image.
5 . The control method according to claim 4 , wherein the viewpoint switching operation comprises at least one of a preset head position adjustment, an operation on a preset control element, a preset gesture, or a preset voice.
6 . The control method according to claim 1 , wherein the controlling of the displaying device of the head-mounted device to display at least one of the first image or the second image comprises:
during a cruising state or a returning state of the movable platform, controlling the display device to display at least one of the first image or the second image based at least in part on a distance between the movable platform and the head-mounted device.
7 . The control method according to claim 6 , wherein the controlling of the display device to display at least one of the first image or the second image based at least in part on the distance between the movable platform and the head-mounted device comprises:
in response to the distance between the movable platform and the head-mounted device being greater than a first distance threshold, displaying the second image; or
in response to the distance between the movable platform and the head-mounted device being less than or equal to a first distance threshold, displaying the first image.
8 . The control method according to claim 1 , wherein the controlling of the displaying device of the head-mounted device to display at least one of the first image or the second image comprises:
during a cruising state or a returning state of the movable platform, in response to determining that a preset target area is present in the first image, controlling the display device to switch from displaying the second image to displaying the first image, wherein
the preset target area indicates a target object within a field of view of the first photographing device on the head-mounted device.
9 . The control method according to claim 8 , wherein in response to determining that the preset target area is present in the first image, the controlling of the display device to switch from displaying the second image to displaying the first image comprises:
in response to determining that the preset target area is present in the first image and that a distance between the target object indicated by the preset target area and the head-mounted device is less than or equal to a second distance threshold, controlling the display device to switch from displaying the second image to displaying the first image.
10 . The control method according to claim 1 , wherein the controlling of the displaying device of the head-mounted device to display at least one of the first image or the second image comprises:
outputting a prompt message based at least in part on at least one of: a distance between the movable platform and the head-mounted device, a presence of a preset target area in the first image, or a distance between a target object indicated by the preset target area and the head-mounted device, so as to facilitate performing a viewpoint switching operation based at least in part on the prompt message.
11 . The control method according to claim 10 , wherein the outputting of the prompt message based at least in part on at least one of: the distance between the movable platform and the head-mounted device, the presence of the preset target area in the first image, or the distance between the target object indicated by the preset target area and the head-mounted device comprises:
outputting the prompt message upon determining that the preset target area is present in the first image and the distance between the target object indicated by the preset target area and the head-mounted device is greater than or equal to a third distance threshold.
12 . The control method according to claim 1 , wherein the controlling of the displaying device of the head-mounted device to display at least one of the first image or the second image comprises:
controlling the display device to display the second image, when the movable platform is in a cruising state or a return state, a distance between the movable platform and the head-mounted device is greater than a first distance threshold, and no preset target area is present in the first image.
13 . The control method according to claim 1 , further comprising:
determining an operational state of the movable platform, wherein the controlling of the displaying device of the head-mounted device to display at least one of the first image or the second image comprises:
controlling the display device to display at least one of the first image or the second image based at least in part on the operational state of the movable platform.
14 . The control method according to claim 13 , wherein the determining of the operational state of the movable platform comprises:
determining the operational state of the movable platform based at least in part on at least one of the first image, the second image, or sensor data collected by at least a sensor on the movable platform.
15 . The control method according to claim 13 , wherein the controlling of the display device to display at least one of the first image or the second image based at least in part on the operational state of the movable platform comprises:
when the movable platform is in a stationary state, controlling the display device to display the first image; or
when the movable platform is in a starting state, controlling the display device to display the second image.
16 . The control method according to claim 13 , wherein the controlling of the display device to display at least one of the first image or the second image based at least in part on the operational state of the movable platform comprises:
when the movable platform is in the starting state, in response to the viewpoint switching operation, controlling the display device to switch from displaying the second image to displaying the first image, or from displaying the first image to displaying the second image.
17 . The control method according to claim 1 , wherein the controlling of the displaying device of the head-mounted device to display at least one of the first image or the second image comprises at least one of:
adjusting a transparency of the first image or a transparency of the preset target area, controlling the display device to display the second image, and overlaying the first image with adjusted transparency or the preset target area with adjusted transparency on top of the second image; or
controlling the display device to display the second image, and overlaying the preset target area on top of the second image; or
respectively displaying the first image and the second image in different display areas of the display device.
18 . The control method according to claim 17 , wherein
during the adjusting of the transparency of the first image or the transparency of the preset target area, the adjusted transparency is inversely correlated with a distance between the target object indicated by the preset target area and the head-mounted device; or
during the respectively displaying of the first image and the second image in different display areas of the display device, a size of the display area of the first image is inversely correlated with a distance between the target object indicated by the preset target area and the head-mounted device.
19 . A terminal device, comprising:
a communication device configured to communicate with a head-mounted device, wherein the head-mounted device is configured to communicate with a movable platform;
at least one storage medium storing at least one set of instructions; and
at least one processor in communication with the at least one storage medium, wherein during operation, the at least one processor executes the at least one set of instructions to cause the terminal device to at least:
control a display device of the head-mounted device to display at least one of a first image or a second image, wherein the first image is captured by a first photographing device on the head-mounted device, and the second image is captured by a second photographing device on the movable platform, and
in response to occurrence of a viewpoint switching operation to the head-mounted device, switching the display device from displaying the second image to displaying the first image and rendering the movable platform to perform a corresponding safety operation.
20 . A head-mounted device, comprising:
a first photographing device on the head-mounted device, configured to capture a first image;
a communication device, configured to communicate with a movable platform to receive a second image captured by a second photographing device on the movable platform;
a display device, configured to display at least one of the first image or the second image;
at least one storage medium storing at least one set of instructions; and
at least one processor in communication with the at least one storage medium, wherein during operation, the at least one processor executes the at least one set of instructions to cause the head-mounted device to at least:
control the display device of the head-mounted device to display at least one of the first image or the second image, and
in response to occurrence of a viewpoint switching operation to the head-mounted device, switching the display device from displaying the second image to displaying the first image and rendering the movable platform to perform a corresponding safety operation.