IP Library Granted Patent US 12688662
Granted Patent B2
US 12688662 · App. 18/468,063 · Granted Jul 21, 2026

Display method, apparatus, electronic device and storage medium for a virtual input device

Inventor: Chin-Wei Liu (Beijing, CN)
Assignee: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
G06T19/20G06F3/017G06V10/761G06T2219/2012G06T2219/2016G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12688662
App. No.
18/468,063
Granted
Jul 21, 2026
Kind
B2
Abstract

The present disclosure relates to a display method, apparatus, electronic device, and storage medium for a virtual input device, which are suitable to an extended reality device. The method comprises: acquiring at least one object in the environment where a user is currently located; determining a target object from the at least one object; and displaying a virtual input device in an extended reality space, the virtual input device being attached to the target object.

Claims (50)

1 . A display method for a virtual input device suitable for an extended reality device, comprising:

acquiring at least one object in an environment where a user is currently located;

determining a target object from the at least one object;

displaying a virtual input device in an extended reality space, the virtual input device being attached to the target object,

wherein a distance between the target object and the user is less than a first distance, the target object comprises a plane, and the virtual input device is attached to the plane of the target object; and

in response to a number of virtual input devices comprised in the extended reality space being greater than or equal to two, keeping the last displayed virtual input device, and closing the rest of the virtual input devices.

2 . The method according to claim 1 , wherein determining the target object from the at least one object comprises:

determining the target object from the at least one object based on at least one of relevant information of the at least one object or user intention information; the user intention information being obtained based on at least one of gesture information, voice information, operation information on a controller, which are input by the user, or an interaction record between the user and the extended reality device.

3 . The method according to claim 1 , further comprising:

determining a target parameter of the virtual input device based at least one of relevant information of the at least one object or user intention information, so that a parameter of the virtual input device displayed in the extended reality space is consistent with the target parameter; the user intention information being obtained based on at least one of gesture information, voice information, operation information on a controller, which are input by the user, or an interaction record between the user and the extended reality device.

4 . The method according to claim 3 , wherein the target parameter comprises at least one of: displaying position coordinates of the virtual input device, a size of the virtual input device, a number of keys comprised in the virtual input device, a type of keys comprised in the virtual input device, or an arrangement of keys of the virtual input device.

5 . The method according to claim 1 , further comprising:

displaying information for prompting that a key is selected in response to an instruction that the key is selected in the virtual input device.

6 . The method according to claim 5 , wherein displaying the information for prompting that the key is selected in response to the instruction that the key is selected in the virtual input device comprises:

changing at least one of a background color, an outline color, or a size of the key in response to the instruction that the key is selected in the virtual input device.

7 . The method according to claim 1 , further comprising:

closing the virtual input device in response to no operation on the virtual input device being detected within a preset time period.

8 . An electronic device, comprises:

one or more processors; and

a storage for storing one or more programs;

wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement following display operations for a virtual input device:

acquiring at least one object in an environment where a user is currently located;

determining a target object from the at least one object;

displaying a virtual input device in an extended reality space, the virtual input device being attached to the target object,

wherein a distance between the target object and the user is less than a first distance, the target object comprises a plane, and the virtual input device is attached to the plane of the target object; and

in response to a number of virtual input devices comprised in the extended reality space being greater than or equal to two, keeping the last displayed virtual input device, and closing the rest of the virtual input devices.

9 . The electronic device according to claim 8 , wherein determining the target object from the at least one object comprises:

determining the target object from the at least one object based on at least one of relevant information of the at least one object or user intention information; the user intention information being obtained based on at least one of gesture information, voice information, operation information on a controller, which are input by the user, or an interaction record between the user and the extended reality device.

10 . The electronic device according to claim 8 , wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to further implement a following operation:

determining a target parameter of the virtual input device based at least one of relevant information of the at least one object or user intention information, so that a parameter of the virtual input device displayed in the extended reality space is consistent with the target parameter; the user intention information being obtained based on at least one of gesture information, voice information, operation information on a controller, which are input by the user, or an interaction record between the user and the extended reality device.

11 . The electronic device according to claim 10 , wherein the target parameter comprises at least one of: displaying position coordinates of the virtual input device, a size of the virtual input device, a number of keys comprised in the virtual input device, a type of keys comprised in the virtual input device, or an arrangement of keys of the virtual input device.

12 . The electronic device according to claim 8 , wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to further implement a following operation:

displaying information for prompting that a key is selected in response to an instruction that the key is selected in the virtual input device.

13 . The electronic device according to claim 12 , wherein displaying the information for prompting that the key is selected in response to the instruction that the key is selected in the virtual input device comprises:

changing at least one of a background color, an outline color, or a size of the key in response to the instruction that the key is selected in the virtual input device.

14 . A non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements following display operations for a virtual input device:

acquiring at least one object in an environment where a user is currently located;

determining a target object from the at least one object;

displaying a virtual input device in an extended reality space, the virtual input device being attached to the target object,

wherein a distance between the target object and the user is less than a first distance, the target object comprises a plane, and the virtual input device is attached to the plane of the target object; and

in response to a number of virtual input devices comprised in the extended reality space being greater than or equal to two, keeping the last displayed virtual input device, and closing the rest of the virtual input devices.

15 . The non-transitory computer-readable storage medium according to claim 14 , wherein determining the target object from the at least one object comprises:

determining the target object from the at least one object based on at least one of relevant information of the at least one object or user intention information; the user intention information being obtained based on at least one of gesture information, voice information, operation information on a controller, which are input by the user, or an interaction record between the user and the extended reality device.

16 . The non-transitory computer-readable storage medium according to claim 14 , wherein the computer program, when executed by the processor, further implements a following operation:

determining a target parameter of the virtual input device based at least one of relevant information of the at least one object or user intention information, so that a parameter of the virtual input device displayed in the extended reality space is consistent with the target parameter; the user intention information being obtained based on at least one of gesture information, voice information, operation information on a controller, which are input by the user, or an interaction record between the user and the extended reality device.

17 . The non-transitory computer-readable storage medium according to claim 16 , wherein the target parameter comprises at least one of: displaying position coordinates of the virtual input device, a size of the virtual input device, a number of keys comprised in the virtual input device, a type of keys comprised in the virtual input device, or an arrangement of keys of the virtual input device.

18 . The non-transitory computer-readable storage medium according to claim 14 , wherein the computer program, when executed by the processor, further implements a following operation:

displaying information for prompting that a key is selected in response to an instruction that the key is selected in the virtual input device.

19 . The non-transitory computer-readable storage medium according to claim 18 , wherein displaying the information for prompting that the key is selected in response to the instruction that the key is selected in the virtual input device comprises:

changing at least one of a background color, an outline color, or a size of the key in response to the instruction that the key is selected in the virtual input device.