IP Library Granted Patent US 12,093,440
Granted Patent B2
US 12,093,440 · App. 17/709,946 · Granted Sep 17, 2024

Direction of user input to virtual objects based on command metadata

Inventors: Peter Wetsel (Apex, NC); Alec Hoffman (Morrisville, NC); Mayan Shay May-Raz (Morrisville, NC); Andrew Hansen (Morrisville, NC)
Assignee: Lenovo (Singapore) Pte. Ltd.
G06F3/011G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,440
App. No.
17/709,946
Granted
Sep 17, 2024
Kind
B2
Abstract

In one aspect, a device includes a processor and storage accessible to the processor. The storage includes instructions executable by the processor to receive input from a user. The instructions are also executable to determine to which of first and second virtual objects to direct the input based on metadata for the first and second virtual objects indicating respective commands related to the first and second virtual objects.

Claims (44)

1. A headset, comprising:

at least one processor;

a display accessible to the at least one processor; and

storage accessible to the at least one processor and comprising instructions executable by the at least one processor to:

present, on the display, first and second virtual objects;

receive input of a user command;

access first metadata related to the first virtual object, the first metadata indicating whether the first virtual object supports the user command;

based on the first metadata indicating that the first virtual object supports the user command, direct the user command to the first virtual object;

based on the first metadata not indicating that the first virtual object supports the user command, access second metadata indicating whether the second virtual object supports the user command; and

based on the second metadata indicating that the second virtual object supports the user command, direct the user command to the second virtual object;

wherein the first metadata and the second metadata are accessed based on the first and second virtual objects being both within a current field of view of a wearer of the headset and within a threshold virtual distance of the headset.

2. The headset of claim 1 , wherein the first and second virtual objects are three-dimensional (3D) objects presented, via the display, in virtual reality space.

3. The headset of claim 1 , wherein the first and second virtual objects are three-dimensional (3D) objects presented, via the display, in one or more of: augmented reality space, mixed reality space.

4. The headset of claim 1 , wherein the user command comprises a voice command.

5. The headset of claim 4 , wherein the voice command comprises a command to scroll a web browser, the web browser establishing one of the first and second virtual objects.

6. The headset of claim 1 , wherein the first metadata and the second metadata are accessed based on the wearer being identified by the headset as not looking at either of the first and second virtual objects.

7. The headset of claim 1 , wherein the second metadata is accessed despite the wearer being identified by the headset as looking at the first virtual object.

8. A method, comprising:

receiving, at a device, a user command;

accessing first data related to a first virtual object presented on a display, the first data indicating whether the first virtual object supports the user command;

based on the first data indicating that the first virtual object supports the user command, directing the user command to the first virtual object;

based on the first data not indicating that the first virtual object supports the user command, accessing second data related to a second virtual object, the second data indicating whether the second virtual object supports the user command; and

based on the second data indicating that the second virtual object supports the user command, directing the user command to the second virtual object;

wherein the first data and the second data are accessed based on the first and second virtual objects being both within a current field of view of a user and within a threshold virtual distance of the user.

9. The method of claim 8 , wherein the display is one or more of: a handset display, a headset display.

10. The method of claim 8 , comprising:

based on determining that the user command should not be directed to either of the first and second virtual objects, accessing third data for a third virtual object, the third data indicating whether the third virtual object supports the user command;

based on the third data indicating that the third virtual object supports the user command, directing the user command to the third virtual object.

11. The method of claim 10 , wherein the third data is accessed based on the third virtual object being, within virtual space, a next-closest virtual object to the user after the first and second virtual objects.

12. The method of claim 11 , wherein the third data is accessed based on the third virtual object being outside the current field of view.

13. The method of claim 8 , wherein the first and second virtual objects are three-dimensional (3D) objects.

14. The method of claim 8 , wherein the first data and the second data are accessed based on the user being identified as not looking at either of the first and second virtual objects.

15. At least one computer readable storage medium (CRSM) that is not a transitory signal, the at least one computer readable storage medium comprising instructions executable by at least one processor to:

receive a user command;

access first data related to a first virtual object, the first data indicating whether the first virtual object supports the user command;

based on the first data indicating that the first virtual object supports the user command, direct the user command to the first virtual object;

based on the first data not indicating that the first virtual object supports the user command, access second data related to a second virtual object, the second data indicating whether the second virtual object supports the user command; and

based on the second data indicating that the second virtual object supports the user command, direct the user command to the second virtual object;

wherein the first data and the second data are accessed based on a user being identified as not looking at either of the first and second virtual objects.

16. The CRSM of claim 15 , wherein the first data is accessed based on the first virtual object being a nearest virtual object to the user within virtual space that is within the user's field of view.

17. The CRSM of claim 16 , wherein the second data is accessed based on the second virtual object being both: a next-nearest virtual object to the user within virtual space, and within the user's field of view.

18. The at least one CRSM of claim 15 , wherein the first data and the second data are accessed based on the first and second virtual objects being within a current field of view of the user.

19. The at least one CRSM of claim 15 , wherein the first data and the second data are accessed based on the first and second virtual objects being within a threshold virtual distance of a device being used by the user.

20. The at least one CRSM of claim 15 , wherein the first data and the second data are accessed based on the first and second virtual objects being both within a current field of view of the user and within a threshold virtual distance of a device being used by the user.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: LENOVO (SINGAPORE) PTE LTD.
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 070266/0977 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 070269/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2022
From: LENOVO (UNITED STATES) INC.
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 061880/0110 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2022
From: WETSEL, PETER; HOFFMAN, ALEC; MAY-RAZ, MAYAN SHAY; HANSEN, ANDREW
To: LENOVO (UNITED STATES) INC.
Reel/Frame 059575/0019 →
Continuity (1)
Related Publication 20230315193A1 · Oct 5, 2023