IP Library Granted Patent US 11,693,476
Granted Patent B2
US 11,693,476 · App. 17/348,466 · Granted Jul 4, 2023

Menu navigation in a head-mounted display

Inventor: Justin Moravetz (Foster City, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
G06F3/013G02B27/017G02B27/0172G02B27/0179G06F3/012G06F3/0346G06F3/0482G02B2027/014G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,693,476
App. No.
17/348,466
Granted
Jul 4, 2023
Kind
B2
Abstract

A wearable computing device includes a head-mounted display (HMD) that generates a virtual reality environment. Through the generation and tracking of positional data, a focal point may be tracked with respect to one or menu navigation elements. Following the fixated positioning of the focal point over the menu navigation element for a predetermined amount of time, a process corresponding to the menu navigation element is executed.

Claims (41)

1. A method for navigation in virtual environments, the method comprising:

storing information in memory regarding a plurality of virtual elements, wherein each of the virtual elements is associated with a functionality;

generating a virtual environment that corresponds to a three-dimensional space associated with a field of view of a user, wherein the virtual environment includes one or more of the virtual elements;

tracking data indicative of one or more movements associated with the user within the virtual environment via one or more sensors;

identifying a location of a focal point in the virtual environment, wherein the focal point corresponds to a line-of-sight from an eye of the user, wherein the location of the focal point overlaps an identified one of the virtual elements;

identifying that the tracked data is translatable into a selection of the identified virtual element when an operational range extending from the location of the focal point overlaps an operational range extending from the identified virtual element; and

implementing a function corresponding to the identified virtual element based on the selection of the identified virtual element.

2. The method of claim 1 , wherein the virtual environment is displayed on a head-mounted display, and wherein at least one of the sensors is associated with the head-mounted display.

3. The method of claim 1 , wherein the virtual environment is superimposed over a portion of a real-world environment, and wherein the portion of the real-world environment remains visible to the user.

4. The method of claim 1 , wherein a display of the virtual environment is adjustable to be moved closer or further away from the eye of the user.

5. The method of claim 1 , wherein identifying that the tracked data is translatable into the selection is further based on touchless input.

6. The method of claim 5 , wherein the touchless input includes gesture input.

7. The method of claim 5 , wherein the touchless input includes voice communications.

8. The method of claim 1 , wherein the generated virtual environment fills the field of view of the user in entirety.

9. The method of claim 1 , wherein the generated virtual environment corresponds to a screen image, and wherein the field of view of the user includes a portion of a real-world environment.

10. The method of claim 1 , further comprising storing information regarding a navigation menu associated with the virtual elements, wherein implementing the function is based on the stored information.

11. An apparatus for navigation in virtual environments, the apparatus comprising:

memory that stores information regarding a plurality of virtual elements, wherein each of the virtual elements is associated with a functionality;

one or more sensors that track data indicative of one or more movements associated with a user; and

a processor that executes instructions stored in memory, wherein the processor executes the instructions to:

generating a virtual environment that corresponds to a three-dimensional space associated with a field of view of the user, wherein the virtual environment includes one or more of the virtual elements;

determine that the tracking data is indicative of one or more movements associated with the user within the virtual environment via one or more sensors;

identify a location of a focal point in the virtual environment, wherein the focal point corresponds to a line-of-sight from an eye of the user, wherein the location of the focal point overlaps an identified one of the virtual elements;

identify that the tracked data is translatable into a selection of the identified virtual element when an operational range extending from the location of the focal point overlaps an operational range extending from the identified virtual element; and

implement a function corresponding to the identified virtual element based on the selection and the location of focal point overlapping of the identified virtual element.

12. The apparatus of claim 11 , further comprising a head-mounted display that displays the virtual environment, and wherein at least one of the sensors is associated with the head-mounted display.

13. The apparatus of claim 11 , wherein the virtual environment is superimposed over a portion of a real-world environment, and wherein the portion of the real-world environment remains visible to the user.

14. The apparatus of claim 11 , wherein a display of the virtual environment is adjustable to be moved closer or further away from the eye of the user.

15. The apparatus of claim 11 , wherein the processor identifies that the tracked data is translatable into the selection further based on touchless input.

16. The apparatus of claim 15 , wherein the touchless input includes gesture input.

17. The apparatus of claim 15 , wherein the touchless input includes voice communications.

18. The apparatus of claim 11 , wherein the generated virtual environment fills the field of view of the user in entirety.

19. The apparatus of claim 11 , wherein the generated virtual environment corresponds to a screen image, and wherein the field of view of the user includes a portion of a real-world environment.

20. The apparatus of claim 11 , wherein the memory further stores information regarding a navigation menu associated with the virtual elements, and wherein the processor implements the function based on the stored information.

21. A non-transitory, computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for navigation in virtual environments, the method comprising:

storing information in memory regarding a plurality of virtual elements, wherein each of the virtual elements is associated with a functionality;

generating a virtual environment that corresponds to a three-dimensional space associated with a field of view of a user, wherein the virtual environment includes one or more of the virtual elements;

tracking data indicative of one or more movements associated with the user within the virtual environment via one or more sensors;

identifying a location of a focal point in the virtual environment, wherein the focal point corresponds to a line-of-sight from an eye of the user, wherein the location of the focal point overlaps an identified one of the virtual elements;

identifying that the tracked data is translatable into a selection of the identified virtual element when an operational range extending from the location of the focal point overlaps an operational range extending from the identified virtual element; and

implementing a function corresponding to the identified virtual element based on the selection of the identified virtual element.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2021
From: MORAVETZ, JUSTIN
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 058086/0226 →
MERGER Recorded Nov 11, 2021
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 058086/0409 →
CHANGE OF NAME Recorded Nov 11, 2021
From: SONY COMPUTER ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
Reel/Frame 058861/0527 →
Continuity (5)
Continuation 16943694 · Jul 30, 2020
Continuation 15447342 · Mar 2, 2017
Continuation 14283032 · May 20, 2014
Provisional Application 61931582 · Jan 25, 2014
Related Publication 20210357028A1 · Nov 18, 2021
Cited By (1)
US 12,353,680