IP Library Granted Patent US 9,754,415
Granted Patent B2
US 9,754,415 · App. 14/228,147 · Granted Sep 5, 2017

Display relative motion compensation

Inventors: Rod G. Fleck (Bellevue, WA); Marshall T. DePue (Redmond, WA); David D. Bohn (Fort Collins, CO)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006A61B5/1121A61B5/7445G02B27/0172G02B27/0179G06F3/011G06F3/012G06K9/00335G06T7/246G06T7/579G09G3/36H04N13/0014H04N13/0429G02B2027/0154G02B2027/0178G02B2027/0187G06T2207/20221G06T2219/016H04N2013/0085
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,754,415
App. No.
14/228,147
Granted
Sep 5, 2017
Kind
B2
Abstract

Embodiments that relate to displaying an image via a display device worn on a head of a user are disclosed. In one example embodiment, an image is displayed at an initial registration position with respect to a user's eye. Composite motion data is received from one or more sensors, with the composite motion data comprising a head motion component and a relative motion component which is relative motion between the head and the display device. The composite motion data is filtered to remove the head motion component and yield the relative motion component. Using the relative motion component, the initial registration position of the image is adjusted to an adjusted registration position that compensates for the relative motion component. The image is then displayed at the adjusted registration position.

Claims (52)

1. A method for displaying an image via a display device worn on a head of a user, the display device including one or more sensors, the method comprising:

displaying the image at an initial registration position with respect to an eye of the user;

receiving composite motion data from the one or more sensors, the composite motion data comprising a head motion component and a relative motion component which is relative motion between the head and the display device;

filtering the composite motion data to remove the head motion component and yield the relative motion component;

using the relative motion component, adjusting the initial registration position of the image to an adjusted registration position with respect to the eye of the user that compensates for the relative motion component;

displaying the image at the adjusted registration position by projecting the image onto a cornea of the eye;

at a stabilization frequency, performing subsequent adjustments of image registration positions using relative motion components;

displaying the image at adjusted registration positions corresponding to the subsequent adjustments of the image registration positions;

at a centering frequency that is slower than the stabilization frequency, performing centering adjustments of image registration positions that progressively locate the image closer to a reference location on the cornea; and

displaying the image at adjusted registration positions corresponding to the centering adjustments of the image registration positions.

2. The method of claim 1 , wherein the one or more sensors comprise two accelerometers.

3. The method of claim 1 , wherein the one or more sensors comprise an optical sensor.

4. The method of claim 1 , wherein filtering the composite motion data further comprises applying an adaptive filter or a high-pass filter to the composite motion data.

5. The method of claim 1 , further comprising using machine learning to adjust the initial registration position of the image.

6. The method of claim 1 , wherein adjusting the initial registration position of the image further comprises translating one or more pixels of the image.

7. The method of claim 1 , wherein adjusting the initial registration position of the image further comprises moving one or more optical components of the display device.

8. The method of claim 1 , wherein adjusting the initial registration position of the image further comprises moving a projector assembly of the display device.

9. The method of claim 1 , further comprising:

receiving companion sensor data from a companion device; and

using the companion sensor data, adjusting the initial registration position of the image to compensate for the relative motion component.

10. A display device configured to be worn on a head of a user and to display an image, the display device comprising:

a computing device;

one or more sensors communicatively coupled to the computing device;

a display system configured to display the image at an initial registration position with respect to an eye of the user; and

an image stabilization program stored in a mass storage of the computing device, the image stabilization program configured to:

receive composite motion data from the one or more sensors, the composite motion data comprising a head motion component and a relative motion component which is relative motion between the head and the display device;

filter the composite motion data to remove the head motion component and yield the relative motion component;

using the relative motion component, adjust the initial registration position of the image to an adjusted registration position with respect to the eye of the user that compensates for the relative motion component;

display the image at the adjusted registration position by projecting the image onto a cornea of the eye;

at a stabilization frequency, perform subsequent adjustments of image registration positions using relative motion components;

display the image at adjusted registration positions corresponding to the subsequent adjustments of the image registration positions;

at a centering frequency that is slower than the stabilization frequency, perform centering adjustments of image registration positions that progressively locate the image closer to a reference location on the cornea; and

display the image at adjusted registration positions corresponding to the centering adjustments of the image registration positions.

11. The display device of claim 10 , wherein the one or more sensors comprise two accelerometers.

12. The display device of claim 10 , wherein the one or more sensors comprise an optical sensor.

13. The display device of claim 10 , wherein the image stabilization program is further configured to filter the composite motion data by applying an adaptive filter or a high-pass filter to the composite motion data.

14. The display device of claim 10 , wherein the image stabilization program is further configured to adjust the initial registration position of the image using machine learning.

15. The display device of claim 10 , wherein the image stabilization program is further configured to adjust the initial registration position of the image by translating one or more pixels of the image.

16. The display device of claim 10 , wherein the image stabilization program is further configured to adjust the initial registration position of the image by moving one or more optical components of the display device.

17. The display device of claim 10 , wherein the image stabilization program is further configured to adjust the initial registration position of the image by moving a projector assembly of the display device.

18. A display device configured to be worn on a head of a user and operatively connected to a computing device, the display device configured to display an image on a cornea of an eye of the user, the display device comprising:

one or more sensors communicatively coupled to the computing device;

a display system configured to display the image at an initial registration position with respect to the cornea; and

an image stabilization program stored in a mass storage of the computing device, the image stabilization program configured to:

receive composite motion data from the one or more sensors, the composite motion data comprising a head motion component and a relative motion component which is relative motion between the head and the display device;

filter the composite motion data to remove the head motion component and yield the relative motion component;

using the relative motion component, adjust the initial registration position of the image to an adjusted registration position with respect to the cornea that compensates for the relative motion component;

display the image at the adjusted registration position;

at a stabilization frequency, perform subsequent adjustments of image registration positions using relative motion components;

display the image at adjusted registration positions corresponding to the subsequent adjustments of the image registration positions;

at a centering frequency that is slower than the stabilization frequency, perform centering adjustments of image registration positions that progressively locate the image closer to a reference location on the cornea; and

display the image at adjusted registration positions corresponding to the centering adjustments of the image registration positions.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2016
From: FLECK, ROD G.; DEPUE, MARSHALL T.; BOHN, DAVID D.
To: MICROSOFT CORPORATION
Reel/Frame 039056/0924 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
Continuity (1)
Related Publication 20150279102A1 · Oct 1, 2015