Extended AR display
A virtual display visible via extended reality equipment (XR equipment) is controlled by user input to a physical controller that also controls a physical display. The physical controller may be a keyboard, a trackpad, a mouse, a joystick, a gaming controller, gaming console, or an appliance remote controller. The virtual display may be generated by a movement of a graphical user interface element on the physical display beyond a display area of the physical display or in other ways. The virtual display may be anchored to the physical display so as to move in response to movement of the physical device. A second virtual display may be similarly generated in response to further user input via the physical device and may be automatically positioned so as to be visible via the XR equipment on a same vertical plane or arc as the first virtual display.
1 . A method comprising:
controlling a physical display in response to a first user input received via a physical controller logically connected to the physical display;
generating a first virtual display based at least in part on a second user input via the physical controller, wherein the first virtual display is visible via extended reality equipment (XR equipment) different from the physical display and from the physical controller;
selecting the first virtual display as a display of focus based at least in part on a user focus input via the XR equipment or via the physical controller;
receiving indication of a third user input via the physical controller requesting cursor movement off the first virtual display; and
based at least in part on the selecting the first virtual display as the display of focus, preventing the cursor movement off the first virtual display.
2 . The method of claim 1 , wherein the physical controller is one or more of a keyboard, a trackpad, a mouse, a joystick, a gaming controller, gaming console, or an appliance remote controller.
3 . The method of claim 1 , further comprising:
generating a second virtual display based at least in part on a further user input, wherein the second virtual display is positioned so as to be visible via the XR equipment on a same virtual plane as the first virtual display.
4 . The method of claim 1 , further comprising:
moving a position of the first virtual display in relation to the physical display based at least in part on receiving, via the physical controller, a position change user input.
5 . The method of claim 1 , further comprising:
moving the first virtual display to a second position based at least in part on a detection of a movement of the physical display, such that a relative position of the first virtual display in relation to a position of the physical display remains unchanged.
6 . The method of claim 1 , further comprising:
selecting the first virtual display as the display of focus based at least in part on receiving a user input via the XR equipment comprising one or more of a head movement or an eye movement; and
in response to the selecting of the first virtual display as the display of focus, controlling the first virtual display based at least in part on a further user input received via the physical controller.
7 . The method of claim 6 , further comprising:
based at least in part on the selecting of the first virtual display as the display of focus, repositioning the first virtual display.
8 . The method of claim 1 , further comprising:
selecting the first virtual display as the display of focus based at least in part on receiving, via the physical controller, a user input repositioning a cursor; and
based at least in part on the selecting of the first virtual display as the display of focus, controlling the first virtual display by a further user input received via the physical controller.
9 . The method of claim 1 , further comprising:
receiving a subsequent user focus input via the XR equipment or via the physical controller, wherein the subsequent user focus input indicates selecting of the physical display as the display of focus;
receiving, concurrent with or after the subsequent user focus input, a fourth user input via the physical controller requesting a second cursor movement off the first virtual display; and
based at least in part on the fourth user input, enabling the second cursor movement off the first virtual display.
10 . The method of claim 1 , further comprising:
based at least in part on receiving a subsequent user focus input via the XR equipment or via the physical controller, resuming a previous cursor position on the physical display, wherein the subsequent user focus input indicates selecting of the physical display as the display of focus.
11 . The method of claim 1 , further comprising:
receiving a subsequent user focus input via the XR equipment or via the physical controller that indicates selecting of the physical display as the display of focus;
based at least in part on the receiving the subsequent user focus input, displaying a cursor as it moves between the first virtual display and the physical display.
12 . A system comprising:
communication circuitry configured to receive a first user input via a physical controller logically connected to a physical display;
processing circuitry configured:
to control the physical display in response to the first user input;
to generate a first virtual display based at least in part on a second user input via the physical controller, wherein the first virtual display is visible via extended reality equipment (XR equipment) different from the physical display;
to select the first virtual display as a display of focus based at least in part on a user focus input via the XR equipment or via the physical controller;
to receive indication of a third user input via the physical controller requesting cursor movement off the first virtual display; and
to prevent, based at least in part on the selecting the first virtual display as the display of focus, the cursor movement off the first virtual display.
13 . The system of claim 12 , wherein the physical controller is one or more of a keyboard, a trackpad, a mouse, a joystick, a gaming controller, gaming console, or an appliance remote controller.
14 . The system of claim 12 , wherein the processing circuitry is further configured:
to generate a second virtual display based at least in part on a further user input, wherein the second virtual display is positioned so as to be visible via the XR equipment on a same virtual plane as the first virtual display.
15 . The system of claim 12 , wherein the processing circuitry is further configured:
to move a position of the first virtual display in relation to the physical display based at least in part on receiving, via the physical controller, a position change user input.
16 . The system of claim 12 , wherein the processing circuitry is further configured:
to move the first virtual display to a second position based at least in part on a detection of a movement of the physical display, such that a relative position of the first virtual display in relation to a position of the physical display remains unchanged.
17 . The system of claim 12 , wherein the processing circuitry is further configured:
to select the first virtual display as a display of focus based at least in part on receiving a user input via the XR equipment comprising one or more of a head movement or an eye movement; and
in response to the selecting of the first virtual display as the display of focus, to control the first virtual display based at least in part on a further user input received via the physical controller.
18 . The system of claim 17 , wherein the processing circuitry is further configured:
to reposition, based at least in part on the selecting of the first virtual display as the display of focus, the first virtual display.
19 . The system of claim 12 , wherein the processing circuitry is further configured:
to select the first virtual display as the display of focus in response to receiving, via the physical controller, a user input repositioning a cursor; and
based at least in part on the selecting of the first virtual display as the display of focus, to control the first virtual display by a further user input received via the physical controller.
20 . The system of claim 12 , wherein the processing circuitry is configured to cause resuming, based at least in part on receiving of a subsequent user focus input via the XR equipment or via the physical controller that indicates selecting of the physical display as the display of focus, a previous cursor position on a user interface area of the physical display.