IP Library › Granted Patent US 10,596,478

Granted Patent B2

US 10,596,478 · App. 15/905,182 · Granted Mar 24, 2020

Head-mounted display for navigating a virtual environment

Inventors: Eric Justin Gould Bear (Austin, TX); Rachel M. Strickland (San Francisco, CA); Jim McKee (San Francisco, CA)

Assignee: MONKEYmedia, Inc.

A63H30/04 A63F13/213 A63F13/428 A63F13/45 A63F13/803 A63H33/22 G05D1/0016 G05D1/0038 G05D1/0094 G06F1/1688 G06F1/1694 G06F3/012 G06F3/0304 G06F3/0346 G06F3/046 G06F3/04815 G06F3/167 G06T15/10 G06T15/20 G06T19/003 H04N5/23203 H04N5/445 H04N5/44591 H04N7/15 H04N7/157 H04N13/204 H04N21/41407 H04N21/4223 H04N21/42202 H04N21/42224 H04N21/4312 H04N21/8106 A63F13/00 A63F13/211 A63F13/235 A63F13/525 A63F13/92 A63F2300/204 A63F2300/8082 A63H2200/00 G06F2200/1637 G06T2215/16 H04N7/142

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,596,478
App. No.: 15/905,182
Granted: Mar 24, 2020
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

In some embodiments, a head-mounted display apparatus with a visual display and one or more sensors may make navigation of virtual environments more natural. The invention enables a participant to pivot, tip and aim the apparatus to orient and move through virtual space hands-free.

Claims (132)

1. A virtual environment navigation system comprised of a head-mounted display apparatus, one or more microprocessors, one or more visual displays, and one or more sensors associated with the head-mounted display apparatus, wherein the system is configured to:

a. generate a virtual environment;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generate a signal to update the location of the virtual camera in the virtual environment wherein:

i. a forward velocity of the virtual camera increases as a pivot of the head-mounted display apparatus around its x-axis transitions from (a) a pivot angle corresponding with a pivot down neutral zone threshold to (b) a pivoted down angle corresponding with a maximum forward movement speed; and

ii. the forward velocity of the virtual camera decreases as the pivot of the head-mounted display apparatus around its x-axis transitions from (b) the pivoted down angle corresponding with the maximum forward movement speed to (a) the pivot angle corresponding with the pivot down neutral zone threshold.

2. The virtual environment navigation system of claim 1 , wherein the system is further configured to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

3. The virtual environment navigation system of claim 1 , wherein the system is further configured to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

4. The virtual environment navigation system of claim 1 , wherein the system is further configured to:

e. generate the signal to update the location of the virtual camera in the virtual environment wherein:

i. the backward velocity of the virtual camera increases as the pivot of the head-mounted display apparatus around its x-axis transitions from (d) a pivot angle corresponding with a pivot up neutral zone threshold to (e) a pivoted up angle corresponding with a maximum backward movement speed; and

ii. the backward velocity of the virtual camera decreases as the pivot of the head-mounted display apparatus around its x-axis transitions from (e) the pivoted up angle corresponding with the maximum backward movement speed to (d) the pivot angle corresponding with the pivot up neutral zone threshold.

5. The virtual environment navigation system of claim 4 , wherein the system is further configured to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

6. The virtual environment navigation system of claim 4 , wherein the system is further configured to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

7. The virtual environment navigation system of claim 4 , wherein the system is further configured to:

f. generate a signal to update the location of the virtual camera in the virtual environment wherein:

i. a leftward velocity of the virtual camera increases as a tip of the head-mounted display apparatus around its z-axis transitions from (g) a tip angle corresponding with a leftward-tip neutral zone threshold to (h) a tip angle corresponding with a maximum leftward movement speed;

ii. a leftward velocity of the virtual camera decreases as a tip of the head-mounted display apparatus around its z-axis transitions from (h) the tip angle corresponding with a maximum leftward movement speed to (g) the tip angle corresponding with the leftward-tip neutral zone threshold;

iii. a rightward velocity of the virtual camera increases as a tip of the head-mounted display apparatus around its z-axis transitions from (i) the tip angle corresponding with a rightward-tip neutral zone threshold to (j) a tip angle corresponding with a maximum rightward movement speed; and

iv. a rightward velocity of the virtual camera decreases as a tip of the head-mounted display apparatus around its z-axis transitions from (j) the tip angle corresponding with a maximum rightward movement speed to (i) the tip angle corresponding with the rightward-tip neutral zone threshold.

8. The virtual environment navigation system of claim 7 , wherein the system is further configured to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

9. The virtual environment navigation system of claim 7 , wherein the system is further configured to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

10. The virtual environment navigation system of claim 7 , wherein the system is further configured to:

g. generate a signal to update the orientation of the virtual camera in the virtual environment wherein:

i. a leftward change in aim angle of the virtual camera around its v-axis matches a leftward change in aim angle of the head-mounted display apparatus around its v-axis as a leftward aim of the head-mounted display apparatus transitions from (k) a forward-facing posture to (m) an aim angle corresponding with an aim left threshold for amplification;

ii. the leftward change in aim angle of the virtual camera around its v-axis increases at a greater rate of change than the leftward change in aim angle of the head-mounted display apparatus around its v-axis as the leftward aim of the head-mounted display apparatus transitions from (m) the aim angle corresponding with the aim left threshold for amplification to (n) a maximum leftward-facing aim posture;

iii. a rightward change in aim angle of the virtual camera around its v-axis matches a rightward change in aim angle of the head-mounted display apparatus around its v-axis as a rightward aim of the head-mounted display apparatus transitions from (k) a forward-facing posture to (p) an aim angle corresponding with an aim right threshold for amplification; and

iv. the rightward change in aim angle of the virtual camera around its v-axis increases at a greater rate of change than the rightward change in aim angle of the head-mounted display apparatus around its v-axis as the rightward aim of the head-mounted display apparatus transitions from (p) the aim angle corresponding with the aim right threshold for amplification to (q) a maximum rightward-facing aim posture.

11. The virtual environment navigation system of claim 10 , wherein the system is further configured to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

12. The virtual environment navigation system of claim 10 , wherein the system is further configured to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

13. The virtual environment navigation system of claim 10 , wherein the system is further configured to generate an orientation dampening signal, whereby the change in aim angle of the virtual camera in the virtual environment is dampened.

14. The virtual environment navigation system of claim 10 , wherein the system is further configured to generate an orientation lock signal, whereby the orientation of the virtual camera in the virtual environment is blocked from being updated.

15. A virtual environment navigation system comprised of a head-mounted display apparatus, one or more microprocessors, one or more visual displays, and one or more sensors associated with the head-mounted display apparatus, wherein the system is configured to:

a. generate a virtual environment;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generate a signal to update the orientation of the virtual camera in the virtual environment wherein:

16. The virtual environment navigation system of claim 15 , wherein the system is further configured to generate an orientation dampening signal, whereby the change in aim angle of the virtual camera in the virtual environment is dampened.

17. The virtual environment navigation system of claim 15 , wherein the system is further configured to generate an orientation lock signal, whereby the orientation of the virtual camera in the virtual environment is blocked from being updated.

18. One or more non-transitory computer readable storage media comprising instructions that, when executed by a computer having one or more sensors and associated with a head-mounted display apparatus for navigating a virtual environment, are capable of causing the computer to:

a. generate a virtual environment;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generate a signal to update the location of the virtual camera in the virtual environment wherein:

19. The computer readable storage media of claim 18 , wherein the instructions are further capable of causing the computer to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

20. The computer readable storage media of claim 18 , wherein the instructions are further capable of causing the computer to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

21. The computer readable storage media of claim 18 , wherein the instructions are further capable of causing the computer to:

e. generate the signal to update the location of the virtual camera in the virtual environment wherein:

22. The computer readable storage media of claim 21 , wherein the instructions are further capable of causing the computer to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

23. The computer readable storage media of claim 21 , wherein the instructions are further capable of causing the computer to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

24. The computer readable storage media of claim 21 , wherein the instructions are further capable of causing the computer to:

f. generate a signal to update the location of the virtual camera in the virtual environment wherein:

25. The computer readable storage media of claim 24 , wherein the instructions are further capable of causing the computer to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

26. The computer readable storage media of claim 24 , wherein the instructions are further capable of causing the computer to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

27. The computer readable storage media of claim 24 , wherein the instructions are further capable of causing the computer to:

g. generate a signal to update the orientation of the virtual camera in the virtual environment wherein:

28. The computer readable storage media of claim 27 , wherein the instructions are further capable of causing the computer to generate a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

29. The computer readable storage media of claim 27 , wherein the instructions are further capable of causing the computer to generate a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

30. The computer readable storage media of claim 27 , wherein the instructions are further capable of causing the computer to generate an orientation dampening signal, whereby the change in aim angle of the virtual camera in the virtual environment is dampened.

31. The computer readable storage media of claim 27 , wherein the instructions are further capable of causing the computer to generate an orientation lock signal, whereby the orientation of the virtual camera in the virtual environment is blocked from being updated.

32. One or more non-transitory computer readable storage media comprising instructions that, when executed by a computer having one or more sensors and associated with a head-mounted display apparatus for navigating a virtual environment, are capable of causing the computer to:

a. generate a virtual environment;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generate a signal to update the orientation of the virtual camera in the virtual environment wherein:

33. The computer readable storage media of claim 32 , wherein the instructions are further capable of causing the computer to generate an orientation dampening signal, whereby the change in aim angle of the virtual camera in the virtual environment is dampened.

34. The computer readable storage media of claim 32 , wherein the instructions are further capable of causing the computer to generate an orientation lock signal, whereby the orientation of the virtual camera in the virtual environment is blocked from being updated.

35. A method of navigating a virtual environment with a head-mounted display apparatus comprising the acts of:

a. generating a virtual environment;

b. generating a signal to establish a location of a virtual camera in the virtual environment;

c. generating a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generating a signal to update the location of the virtual camera in the virtual environment wherein:

36. The method of claim 35 , further comprising generating a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

37. The method of claim 35 , further comprising generating a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

38. The method of claim 35 , further comprising:

e. generating the signal to update the location of the virtual camera in the virtual environment wherein:

39. The method of claim 38 , further comprising generating a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

40. The method of claim 38 , further comprising generating a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

41. The method of claim 38 , further comprising:

f. generating a signal to update the location of the virtual camera in the virtual environment wherein:

42. The method of claim 41 , further comprising generating a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

43. The method of claim 41 , further comprising generating a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

44. The method of claim 41 , further comprising:

g. generating a signal to update the orientation of the virtual camera in the virtual environment wherein:

45. The method of claim 44 , further comprising generating a movement dampening signal, whereby the velocity of the virtual camera in the virtual environment is dampened.

46. The method of claim 44 , further comprising generating a movement lock signal, whereby the location of the virtual camera in the virtual environment is blocked from being updated.

47. The method of claim 44 , further comprising generating an orientation dampening signal, whereby the change in aim angle of the virtual camera in the virtual environment is dampened.

48. The method of claim 44 , further comprising generating an orientation lock signal, whereby the orientation of the virtual camera in the virtual environment is blocked from being updated.

49. A method of navigating a virtual environment with a head-mounted display apparatus comprising the acts of:

a. generating a virtual environment;

b. generating a signal to establish a location of a virtual camera in the virtual environment;

c. generating a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generating a signal to update the orientation of the virtual camera in the virtual environment wherein:

50. The method of claim 49 , further comprising generating an orientation dampening signal, whereby the change in aim angle of the virtual camera in the virtual environment is dampened.

51. The method of claim 49 , further comprising generating an orientation lock signal, whereby the orientation of the virtual camera in the virtual environment is blocked from being updated.

Continuity (6)

Continuation 15694210 · Sep 1, 2017

Continuation 15426697 · Feb 7, 2017

Continuation 15186793 · Jun 20, 2016

Continuation 13540695 · Jul 3, 2012

Provisional Application 61666216 · Jun 29, 2012

Related Publication 20180185763A1 · Jul 5, 2018

Cited By (1)

US 12,383,844