IP Library Granted Patent US 10,248,307
Granted Patent B2
US 10,248,307 · App. 14/867,917 · Granted Apr 2, 2019

Virtual reality headset device with front touch screen

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,248,307
App. No.
14/867,917
Granted
Apr 2, 2019
Kind
B2
Abstract

This disclosure relates to systems, methods, and devices for interacting with a virtual reality environment via a virtual reality headset device. In particular, one or more embodiments include a display screen secured to a housing frame. One or more embodiments also include a touch interface positioned in a relative position with respect to the display screen. In addition, an area of the touch interface can be mapped to an area of the display screen. As such, one or more embodiments also detect a user interaction at the touch interface and provide a response to the display screen in accordance with a position of the user interaction at the touch interface.

Claims (66)

1. A virtual reality headset device, comprising:

a housing frame;

a display screen secured to the housing frame, the housing frame being opaque;

a pair of lenses secured to the housing frame on a first side of the display screen;

a touchpad interface secured to a front, outer surface of the housing frame on a second side of the display screen, wherein the second side is opposite the first side, and the front, outer surface of the housing frame obstructs a view through the housing frame, wherein the touchpad interface comprises a curved touchpad surface that extends to a periphery of vision corresponding to predetermined eye positions, wherein a curvature of the touchpad interface is different than a curvature of the display screen;

at least one processor; and

at least one non-transitory computer-readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the virtual reality headset device to:

display a plurality of selectable elements at a plurality of positions on the display screen;

calibrate, based the predetermined eye positions, a touch mapping between an area of the touchpad interface and an area of the display screen;

detect a user interaction at the touchpad interface, the user interaction being a touch gesture on the touchpad interface;

determine, based on the calibrated touch mapping, a coordinate position of the user interaction on a surface of the touchpad interface and a corresponding coordinate position on the display screen to determine a position of the user interaction relative to the display screen;

identify a selectable element on the display screen by determining that the position of the user interaction relative to the display screen corresponds to a position of the selectable element on the display screen; and

based on identifying the selectable element, generate a response on the display screen in accordance with the selectable element on the display screen.

2. The virtual reality headset device as recited in claim 1 , wherein calibrating the touch mapping between the area of the touchpad interface and the area of the display screen comprises determining a user configuration for the touch mapping based on a user input.

3. The virtual reality headset device as recited in claim 1 , further comprising instructions that, when executed by the at least one processor, cause the virtual reality headset device to generate the response by providing, in response to identifying the selectable element on the display screen, a visual indication of the position of the user interaction on the selectable element on the display screen.

4. The virtual reality headset device as recited in claim 1 , further comprising instructions that, when executed by the at least one processor, cause the virtual reality headset device to:

receive a first request to enter a password;

display, in response to the first request to enter the password, a plurality of selectable elements on the display screen;

identify a selectable element from the plurality of selectable elements in accordance with the position of the user interaction at the touchpad interface; and

display an indication of the identified selectable element on the display screen.

5. The virtual reality headset device as recited in claim 4 , further comprising instructions that, when executed by the at least one processor, cause the virtual reality headset device to:

determine a first random layout for the plurality of selectable elements in response to the first request to enter the password; and

display the plurality of selectable elements in the first random layout on the display screen.

6. The virtual reality headset device as recited in claim 4 , further comprising instructions that, when executed by the at least one processor, cause the virtual reality headset device to display the plurality of selectable elements in a predetermined layout from a plurality of predetermined layouts for password entry on the display screen.

7. The virtual reality headset device as recited in claim 1 , wherein the instructions that cause the virtual reality headset device to calibrate the touch mapping cause the virtual reality headset device to:

determine the predetermined eye positions by obtaining eye measurements from a user; and

calibrate the touch mapping between the area of the touchpad interface and the area of the display screen using the eye measurements from the user.

8. The virtual reality headset device as recited in claim 1 , wherein the instructions that cause the virtual reality headset device to calibrate the touch mapping cause the virtual reality headset device to:

determine average measurements corresponding to eye positions for a plurality of people; and

calibrate the touch mapping between the area of the touchpad interface and the area of the display screen using the average measurements for the plurality of people.

9. The virtual reality headset device as recited in claim 1 , further comprising instructions that, when executed by the at least one processor, cause the virtual reality headset device to control a location of a cursor on the display screen in accordance with the position of the user interaction at the touchpad interface.

10. The virtual reality headset device as recited in claim 1 , further comprising instructions that, when executed by the at least one processor, cause the virtual reality headset device to display the plurality of selectable elements in a first predetermined layout from a plurality of predetermined layouts for password entry on the display screen, the first predetermined layout comprising a different layout shape than a layout shape corresponding to a subsequent request to enter a password.

11. A method of providing user input using a virtual reality headset device, the method comprising:

calibrating, based on predetermined user eye positions, a touch mapping between an area of a touchpad interface and an area of a display screen, the touchpad interface positioned opposite of a pair of lenses secured to an opaque housing frame, the touchpad interface being secured to a front, outer surface of the housing frame and obstructing a view through the housing frame;

receiving a user interaction comprising a touch gesture on the touchpad interface in connection with a first request to enter a password;

providing, for display on a display screen that is positioned between the pair of lenses and the touchpad interface within the housing frame, a plurality of selectable elements at a plurality of positions on the display screen according to a first predetermined layout from a plurality of predetermined layouts for password entry, the first predetermined layout comprising a different layout shape than a layout shape corresponding to a subsequent request to enter a password;

determining, based on the calibrated touch mapping, a coordinate position of the user interaction on a surface of the touchpad interface and a corresponding coordinate position on the display screen to determine a position of the user interaction relative to the display screen;

identifying a selectable element on the display screen by determining that the position of the user interaction relative to the display screen corresponds to a position of the selectable element on the display screen; and

based on identifying the selectable element, generating a response on the display screen in accordance with the selectable element on the display screen.

12. The method as recited in claim 11 , further comprising generating the response by providing, in response to identifying the selectable element on the display screen, a visual indication of the position of the user interaction on the selectable element on the display screen.

13. The method as recited in claim 12 , wherein determining the position of the user interaction relative to the display screen is further based on a facial feature measurement of the user, comprising:

determining the predetermined eye positions by obtaining eye measurements from a user; and

providing, based on the calibrated touch mapping, the visual indication of the user interaction at a location on the display screen matching the position of the user interaction relative to the predetermined eye positions.

14. The method as recited in claim 12 , further comprising:

receiving the first request to enter a password;

displaying, in response to the first request to enter the password, the plurality of selectable elements in the first predetermined layout on the display screen;

selecting, in response to the user interaction, the identified selectable element based on the position of the user interaction relative to the display screen; and

displaying an indication of the selected element on the display screen.

15. The method as recited in claim 14 , wherein calibrating the touch mapping comprises:

determining average measurements corresponding to eye positions for a plurality of people; and

calibrating the touch mapping between the area of the touchpad interface and the area of the display screen using the average measurements for the plurality of people.

16. The method as recited in claim 11 , wherein the touchpad interface comprises a curved touchpad surface that extends to a periphery of vision corresponding to the predetermined eye positions, wherein a curvature of the touchpad interface is different than a curvature of the display screen.

17. A non-transitory computer readable storage medium comprising instructions that, when executed by at least one processor, cause a computer system to:

display, in connection with a first request to enter a password, a plurality of selectable elements at a plurality of positions on a display screen according to a first predetermined layout from a plurality of predetermined layouts for password entry, the first predetermined layout comprising a different layout shape than a layout shape corresponding to a subsequent request to enter a password, the display screen being secured to an opaque housing frame and the housing frame comprising a pair of lenses secured to the housing frame on a first side of the display screen and a touchpad interface secured to a front, outer surface of the housing frame on a second side of the display screen opposite the first side;

calibrate, based on predetermined eye positions, a touch mapping between an area of the touchpad interface and an area of the display screen;

detect a user interaction at the touchpad interface, the user interaction being a touch gesture on the touchpad interface;

determine, based on the calibrated touch mapping, a coordinate position of the user interaction on a surface of the touchpad interface and a corresponding coordinate position on the display screen to determine a position of the user interaction relative to the display screen;

identify a selectable element on the display screen by determining that the position of the user interaction relative to the display screen corresponds to a position of the selectable element on the display screen; and

based on identifying the selectable element, generate a response on the display screen in accordance with the selectable element on the display screen.

18. The non-transitory computer readable storage medium as recited in claim 17 , wherein the instructions that cause the computer system to calibrate the touch mapping cause the computer system to:

determine the predetermined eye positions by obtaining eye measurements from a user; and

calibrate the touch mapping between the area of the touchpad interface and the area of the display screen using the eye measurements from the user.

19. The non-transitory computer readable storage medium as recited in claim 17 , wherein the instructions that cause the computer system to calibrate the touch mapping cause the computer system to:

determine average measurements corresponding to eye positions for a plurality of people; and

calibrate the touch mapping between the area of the touchpad interface and the area of the display screen using the average measurements for the plurality of people.

20. The non-transitory computer readable storage medium as recited in claim 17 , wherein the touchpad interface comprises a curved touchpad surface that extends to a periphery of vision corresponding to predetermined eye positions, wherein a curvature of the touchpad interface is different than a curvature of the display screen.

Assignments (3)
CHANGE OF NAME Recorded Apr 8, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048867/0882 →
CHANGE OF NAME Recorded Jan 3, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048003/0672 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2015
From: KIM, BYUNGMOON
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 036673/0082 →