IP Library Granted Patent US 9,656,168
Granted Patent B1
US 9,656,168 · App. 15/426,828 · Granted May 23, 2017

Head-mounted display for navigating a virtual environment

Inventors: Eric Justin Gould Bear (Austin, TX); Rachel M. Strickland (San Francisco, CA); Jim McKee (San Francisco, CA)
Assignee: MONKEYmedia, Inc.
A63F13/525A63F13/211A63F13/428A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,656,168
App. No.
15/426,828
Granted
May 23, 2017
Kind
B1
Abstract

In some embodiments, a head-mounted apparatus with a visual display and one or more sensors may make navigation of virtual environments more natural. The invention enables a participant to pivot, tip and aim the apparatus to orient and move through virtual space hands-free.

Claims (52)

1. One or more non-transitory computer readable storage media comprising instructions that, when executed by a computer having one or more sensors and associated with a head-mounted display apparatus, are capable of causing the computer to:

a. generate a virtual environment with a ground plane structure;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment;

d. generate a signal to update the location of the virtual camera in the virtual environment in a direction of the orientation of the virtual camera on a plane parallel to the ground plane structure using x-axisometer data from at least one of the sensors indicating pivot up or pivot down of the head-mounted apparatus and an x-axisometer sensor reference data, wherein said use of x-axisometer sensor data to update the location of the virtual camera is effectively decoupled from use of v-axisometer sensor data, thereby enabling v-axisometer sensor data of the computer to be used independently of x-axisometer sensor data of the computer to update the orientation of the virtual camera; and

e. generate a signal to update the orientation of the virtual camera in the virtual environment using v-axisometer data from at least one of the sensors indicating pivot left or pivot right of the head-mounted apparatus and a v-axisometer sensor reference data, wherein said use of v-axisometer sensor data to update the orientation of the virtual camera is effectively decoupled from use of x-axisometer sensor data, thereby enabling x-axisometer sensor data of the computer to be used independently of v-axisometer sensor data of the computer to update the location of the virtual camera.

2. The computer readable storage media of claim 1 , wherein the virtual environment comprises a plurality of documents and/or images for browsing that are displayed simultaneously in distinct locations in the virtual environment.

3. The computer readable storage media of claim 1 , wherein the virtual environment comprises a street-view map transformed into a form of virtual environment.

4. The computer readable storage media of claim 1 , wherein:

a. the updated location of the virtual camera is established in a direction of the orientation of the virtual camera on a plane parallel to the ground plane structure if the x-axisometer data indicates a pivot down posture relative to the x-axisometer sensor reference data; and

b. the updated location of the virtual camera is established in an opposite direction of the orientation of the virtual camera on a plane parallel to the ground plane structure if the x-axisometer data indicates a pivot up posture relative to the x-axisometer sensor reference data.

5. The computer readable storage media of claim 1 , wherein the x-axisometer sensor reference data comprises one or more neutral zone thresholds.

6. The computer readable storage media of claim 1 , wherein the magnitude of virtual camera location change is based on the x-axisometer data relative to the x-axisometer sensor reference data.

7. The computer readable storage media of claim 1 , wherein:

a. the updated orientation of the virtual camera is established left if the v-axisometer data indicates an aim left posture relative to the v-axisometer sensor reference data; and

b. the updated orientation of the virtual camera is established right if the v-axisometer data indicates an aim right posture relative to the v-axisometer sensor reference data.

8. The computer readable storage media of claim 1 , wherein the v-axisometer sensor reference data comprises one or more neutral zone thresholds.

9. The computer readable storage media of claim 1 , wherein the instructions are further capable of causing the computer to generate a signal to update the location of the virtual camera in the virtual environment in a direction perpendicular to the axis of the orientation of the virtual camera on a plane parallel to the ground plane structure using z-axisometer data from at least one of the sensors indicating tip left or tip right of the apparatus and a z-axisometer sensor reference data.

10. The computer readable storage media of claim 9 , wherein:

a. the updated location of the virtual camera is established in a direction perpendicularly left of the orientation of the virtual camera on a plane parallel to the ground plane structure if the z-axisometer data indicates a tip left posture relative to the z-axisometer sensor reference data; and

b. the updated location of the virtual camera is established in a direction perpendicularly right of the orientation of the virtual camera on a plane parallel to the ground plane structure if the z-axisometer data indicates a tip right posture relative to the z-axisometer sensor reference data.

11. The computer readable storage media of claim 1 , wherein the instructions are further capable of causing the computer to generate a signal to jump the virtual camera to a viewing location in relation to content in the virtual environment.

12. The computer readable storage media of claim 1 , wherein the instructions are further capable of causing the computer to generate a signal to establish a view lock of the virtual camera in the virtual environment, wherein control of the location of the virtual camera is blocked or control of the orientation of the virtual camera is blocked, or control of both the location of the virtual camera and the orientation of the virtual camera is blocked.

13. One or more non-transitory computer readable storage media comprising instructions that, when executed by a computer having one or more sensors and associated with a head-mounted display apparatus, are capable of causing the computer to:

a. generate a virtual environment with a ground plane structure;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment; and

d. generate a signal to update the location of the virtual camera in the virtual environment using z-axisometer data from at least one of the sensors indicating tip left or tip right of the head-mounted apparatus and a z-axisometer sensor reference data, wherein said use of z-axisometer sensor data to update the location of the virtual camera is effectively decoupled from use of v-axisometer sensor data, thereby enabling v-axisometer sensor data of the computer to be used independently of z-axisometer sensor data of the computer to update the orientation of the virtual camera, and:

i. the location of the virtual camera is established in a direction perpendicularly left of the orientation of the virtual camera on a plane parallel to the ground plane structure if the z-axisometer data indicates a tip left posture of the head-mounted apparatus relative to the z-axisometer sensor reference data; and

ii. the location of the virtual camera is established in a direction perpendicularly right of the orientation of the virtual camera on a plane parallel to the ground plane structure if the z-axisometer data indicates a tip right posture of the head-mounted apparatus relative to the z-axisometer sensor reference data.

14. The computer readable storage media of claim 13 , wherein the virtual environment is produced to appear three-dimensional.

15. The computer readable storage media of claim 13 , wherein the z-axisometer sensor reference data comprises one or more neutral zone thresholds.

16. The computer readable storage media of claim 13 , wherein the magnitude of virtual camera location change is based on the z-axisometer data relative to the z-axisometer sensor reference data.

17. One or more non-transitory computer readable storage media storing instructions that, when executed by a computer having one or more sensors and associated with a head-mounted display apparatus, are capable of causing the computer to:

a. generate a three-dimensional virtual environment comprising a ground plane structure, a plurality of video panes and a plurality of virtual speakers, wherein:

i. a plurality of videos play simultaneously in distinct locations in the virtual environment; and

ii. a plurality of sounds are produced for display as if coming from distinct locations in the virtual environment;

b. generate a signal to establish a location of a virtual camera in the virtual environment;

c. generate a signal to establish an orientation of the virtual camera in the virtual environment;

d. generate a signal to update the location of the virtual camera in the virtual environment in a direction of the orientation of the virtual camera on a plane parallel to the ground plane structure using x-axisometer data from at least one of the sensors indicating pivot up or pivot down of the head-mounted apparatus and an x-axisometer sensor reference data, wherein said use of x-axisometer sensor data to update the location of the virtual camera is effectively decoupled from use of v-axisometer sensor data, thereby enabling v-axisometer sensor data of the computer to be used independently of x-axisometer sensor data of the computer to update the orientation of the virtual camera, and:

i. the location of the virtual camera is established in a direction of the orientation of the virtual camera on a plane parallel to the ground plane structure if the x-axisometer data indicates a pivot down posture relative to the x-axisometer sensor reference data;

ii. the location of the virtual camera is established in an opposite direction of the orientation of the virtual camera on a plane parallel to the ground plane structure if the x-axisometer data indicates a pivot up posture relative to the x-axisometer sensor reference data; and

iii. the magnitude of virtual camera location change is based on x-axisometer data relative to x-axisometer sensor reference data; and

e. generate a signal to update the orientation of the virtual camera in the virtual environment using v-axisometer data from at least one of the sensors indicating pivot left or pivot right of the head-mounted apparatus and a v-axisometer sensor reference data, wherein said use of v-axisometer sensor data to update the orientation of the virtual camera is effectively decoupled from use of x-axisometer sensor data, thereby enabling x-axisometer sensor data of the computer to be used independently of v-axisometer sensor data of the computer to update the location of the virtual camera, and:

i. the orientation of the virtual camera is established left if the v-axisometer data indicates an aim left posture relative to a v-axisometer sensor reference data; and

ii. the orientation of the virtual camera is established right if the v-axisometer data indicates an aim right posture relative to the v-axisometer sensor reference data.

18. The computer readable storage media of claim 17 , wherein the instructions are further capable of causing the computer to generate a signal to update the location of the virtual camera in the virtual environment using z-axisometer data from at least one of the sensors indicating tip left or tip right of the head-mounted apparatus and a z-axisometer sensor reference data, and:

i. the location of the virtual camera is established in a direction perpendicularly left of the orientation of the virtual camera on a plane parallel to the ground plane structure if the z-axisometer data indicates a tip left posture relative to the z-axisometer sensor reference data;

ii. the location of the virtual camera is established in a direction perpendicularly right of the orientation of the virtual camera on a plane parallel to the ground plane structure if the z-axisometer data indicates a tip right posture relative to the z-axisometer sensor reference data; and

iii. the magnitude of virtual camera location change is based on z-axisometer data relative to z-axisometer sensor reference data.

19. The computer readable storage media of claim 17 , wherein the instructions are further capable of causing the computer to generate a signal to jump the virtual camera to a viewing location in relation to content in the virtual environment in response to a movement sequence.

20. The computer readable storage media of claim 18 , wherein the virtual environment comprises a street-view map transformed into a form of virtual environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2017
From: BEAR, ERIC JUSTIN GOULD; STRICKLAND, RACHEL M.; MCKEE, JIM
To: MONKEYMEDIA, INC.
Reel/Frame 041593/0847 →
Continuity (6)
Continuation 15186776 · Jun 20, 2016
Continuation 13540695 · Jul 3, 2012
Continuation 15426828
Continuation 15186793 · Jun 20, 2016
Continuation 13540695 · Jul 3, 2012
Provisional Application 61666216 · Jun 29, 2012