IP Library Granted Patent US 10,459,237
Granted Patent B2
US 10,459,237 · App. 15/886,549 · Granted Oct 29, 2019

System, head mounted device (HMD) and method for adjusting a position of an HMD worn by a user

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,459,237
App. No.
15/886,549
Granted
Oct 29, 2019
Kind
B2
Abstract

The present disclosure provides embodiments of improved systems, head mounted devices (HMDs) and methods for adjusting a position of an HMD with respect to a user based on one or more measurements, which are specific to the user. One embodiment of the improved method includes receiving data from an eye tracking system of an HMD worn by a user, where the data is generated by the eye tracking system in response to the user gazing upon a virtual image plane of the HMD; using the received data to calculate a distance between the virtual image plane of the HMD and a pupil plane of the user; and adjusting a position of the HMD with respect to the user based on the calculated distance.

Claims (68)

1. A method, comprising:

receiving data from an eye tracking system of a head mounted device (HMD) worn by a user, wherein the data is generated by the eye tracking system in response to the user gazing upon a virtual image plane of the HMD;

using the received data to calculate a distance between the virtual image plane of the HMD and a pupil plane of the user;

adjusting a physical position of a pad and/or an optical assembly of the HMD with respect to the user based on the calculated distance; and

controlling a stepper motor to extend the pad and/or the optical assembly toward or away from the user to adjust the physical position of the pad and/or the optical assembly of the HMD with respect to the user.

2. The method as recited in claim 1 , wherein said receiving data comprises receiving a gaze direction and an inter-pupillary distance (IPD) measurement from the eye tracking system, and wherein said distance is calculated using the gaze direction and the IPD measurement.

3. The method as recited in claim 1 , wherein said receiving data comprises receiving a gaze direction from the eye tracking system, and wherein the distance is calculated using the gaze direction received from the eye tracking system and an inter-pupillary distance (IPD) measurement received from a position sensor on the HMD.

4. The method as recited in claim 1 , wherein said receiving data from an eye tracking system comprises receiving a plurality of frames of image data from the eye tracking system, wherein each frame corresponds to an image of one of the user's eyes.

5. The method as recited in claim 4 , wherein the distance is calculated by:

using the plurality of frames of image data to measure an inter-pupillary distance (IPD) between the user's eyes and determine a gaze direction; and

using the IPD measurement and the gaze direction to calculate the distance.

6. The method as recited in claim 1 , wherein the optical assembly is configured to combine virtual images with what the user sees in their physical environment, and wherein the optical assembly comprises an eye box within which the virtual images are projected towards the user's eye and an eye box center plane located at a center point of the eye box.

7. The method as recited in claim 6 , wherein said adjusting a physical position comprises linearly translating the pad of the HMD toward or away from the user until the eye box center plane is substantially aligned with the pupil plane.

8. The method as recited in claim 6 , wherein said adjusting a physical position comprises linearly translating the optical assembly toward or away from the user until the eye box center plane is substantially aligned with the pupil plane.

9. The method as recited in claim 1 , comprising contacting a face of the user with the pad, and controlling the stepper motor to extend the pad toward or away from the user to adjust the physical position of the pad of the HMD with respect to the user.

10. A head mounted device (HMD) configured to be worn by a user, the HMD comprising:

a pad provided on the HMD, wherein the pad is configured to come in contact with at least a portion of the user's face;

at least one optical assembly provided within the HMD, wherein the at least one optical assembly is configured to combine virtual images on a virtual image plane of the HMD with real world images;

an eye tracking system configured to generate data in response to the user gazing upon the virtual image plane of the HMD;

a processing device coupled to receive the data from the eye tracking system and configured to execute program instructions to calculate a distance between the virtual image plane of the HMD and a pupil plane of the user using the received data; and

an adjustment component configured to adjust a physical position of the pad and/or the at least one optical assembly in a direction perpendicular to the pupil plane of the user based on the calculated distance.

11. The head mounted device as recited in claim 10 , wherein data received from the eye tracking system comprises a gaze direction and an inter-pupillary distance (IPD) measurement, and wherein the processing device is configured to execute the program instructions to calculate the distance using the gaze direction and the IPD measurement.

12. The head mounted device as recited in claim 10 , wherein data received from the eye tracking system comprises a gaze direction, and wherein the processing device is configured to execute the program instructions to calculate the distance using the gaze direction received from the eye tracking system and an IPD measurement received from a position sensor on the HMD.

13. The head mounted device as recited in claim 10 , wherein data received from the eye tracking system comprises a plurality of frames of image data from the eye tracking system, each frame corresponding to an image of one of the user's eyes, and wherein the processing device is configured to execute the program instructions to:

measure an inter-pupillary distance (IPD) between the user's eyes and determine a gaze direction from the plurality of frames of image data; and

calculate the distance using the IPD measurement and the gaze direction.

14. The head mounted device as recited in claim 10 ,

wherein the at least one optical assembly comprises an eye box within which the virtual images are projected towards the user's eye and an eye box center plane located at a center point of the eye box.

15. The head mounted device as recited in claim 14 , wherein the adjustment component is configured to adjust the physical position of the pad and/or the at least one optical assembly by linearly translating the pad and/or the at least one optical assembly toward or away from the user until the eye box center plane is substantially aligned with the pupil plane.

16. The head mounted device as recited in claim 15 , wherein the adjustment component comprises:

a stepper motor coupled to the pad; and

a stepper motor controller coupled to receive signals from the processing device for controlling the stepper motor, so as to perform the linear translation by extending the pad toward or away from the user.

17. The head mounted device as recited in claim 15 , wherein the adjustment component comprises:

a stepper motor coupled to the at least one optical assembly; and

a stepper motor controller coupled to receive signals from the processing device for controlling the stepper motor, so as to perform the linear translation by extending the at least one optical assembly toward or away from the user.

18. The head mounted device as recited in claim 15 , wherein the adjustment component comprises:

a display of the HMD; and

program instructions executable by the processing device for displaying guidance to the user on the display of the HMD, wherein the user uses the displayed guidance to perform the linear translation manually by extending the pad and/or the at least one optical assembly toward or away from the user.

19. A system, comprising:

a head mounted device (HMD) configured to be worn by a user, the HMD comprising:

an eye tracking system configured to generate eye tracking data in response to the user gazing upon a virtual image plane of the HMD; and

a communication interface configured to transmit the eye tracking data;

an information handling system comprising:

a communication interface configured to receive the eye tracking data transmitted from the communication interface of the HMD; and

a processing device configured to execute program instructions to:

calculate a distance between the virtual image plane of the HMD and a pupil plane of the user using the received eye tracking data; and

transmit signals, via the communication interface of the information handling system to the communication interface of the HMD, for adjusting a physical position of the at least one structural component of the HMD with respect to the user based on the calculated distance;

wherein the communication interface of the HMD is further configured to receive the signals transmitted from the communication interface of the information handling system; and

wherein the HMD further comprises an adjustment component configured to use the transmitted signals to adjust the physical position of the at least one structural component of the HMD with respect to the user based on the calculated distance.

20. The system as recited in claim 19 , wherein the HMD further comprises:

a pad provided on the HMD, wherein the pad is configured to come in contact with at least a portion of the user's face; and

at least one optical assembly configured to combine virtual images on the virtual image plane with real world images, and wherein the optical assembly comprises an eye box within which the virtual images are projected towards the user's eye and an eye box center plane located at a center point of the eye box; and

wherein the adjustment component is configured to use the transmitted signals to linearly translate the pad and/or the optical assembly in a direction perpendicular to the pupil plane until the eye box center plane is substantially aligned with the pupil plane.

21. The system as recited in claim 20 , wherein the adjustment component comprises:

a stepper motor coupled to the pad; and

a stepper motor controller coupled to receive the transmitted signals and configured to use the transmitted signals to control the stepper motor, so as to extend the pad toward or away from the user until the eye box center plane is substantially aligned with the pupil plane.

22. The system as recited in claim 20 , wherein the adjustment component comprises:

a stepper motor coupled to the at least one optical assembly; and

a stepper motor controller coupled to receive the transmitted signals and configured to use the transmitted signals to control the stepper motor, so as to extend the optical assembly toward or away from the user until the eye box center plane is substantially aligned with the pupil plane.

23. The system as recited in claim 20 , wherein the adjustment component comprises:

a display of the HMD, wherein the display is configured to display guidance to the user to manually extend the pad or the at least one optical assembly toward or away from the user until the eye box center plane is substantially aligned with the pupil plane, wherein the guidance displayed to the user on the display is determined by the transmitted signals.

24. A method, comprising:

receiving data from an eye tracking system of a head mounted device (HMD) worn by a user, wherein the data is generated by the eye tracking system in response to the user gazing upon a virtual image plane of the HMD;

using the received data to calculate a distance between the virtual image plane of the HMD and a pupil plane of the user;

determining a difference between the calculated distance and an eye box center plane of an optical assembly included within the HMD; and

linearly translating at least one structural component of the HMD in a direction perpendicular to the pupil plane of the user by an amount substantially equal to the difference between the calculated distance and the eye box center plane.

25. The method as recited in claim 24 , wherein said linearly translating at least one structural component of the HMD comprises linearly translating a pad of the HMD toward or away from the pupil plane of the user until the eye box center plane is substantially aligned with the pupil plane.

26. The method as recited in claim 24 , wherein said linearly translating at least one structural component of the HMD comprises linearly translating the optical assembly toward or away from the pupil plane of the user until the eye box center plane is substantially aligned with the pupil plane.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045482/0131) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 061749/0924 →
RELEASE OF SECURITY INTEREST AT REEL 045482 FRAME 0395 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0314 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 045482/0131 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 045482/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2018
From: SEIBERT, PHILIP M.; IYER, VIVEK VISWANATHAN
To: DELL PRODUCTS L.P.
Reel/Frame 045454/0572 →