IP Library Patent Application 18809146
Patent Application
App. No. 18/809,146

EYE CENTER OF ROTATION DETERMINATION, DEPTH PLANE SELECTION, AND RENDER CAMERA POSITIONING IN DISPLAY SYSTEMS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/809,146
Filed
Aug 19, 2024
Examiner
GE, JIN
Art Unit
2619
USPC
345/633
Abstract

A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system that images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at or relative to the center of rotation of the eye.

Claims (30)

1 . A display system configured to project light to an eye of a user to display virtual image content in a vision field of the user, the eye having a cornea, an iris, a pupil, a lens, a retina, and an optical axis extending through the lens, pupil, and cornea, the display system comprising:

a head-mounted display configured to project light into the eye to present virtual image content to the vision field of the user at different amounts of at least one of divergence and collimation such that the displayed virtual image content appears to originate from different depths at different periods of time;

one or more eye tracking cameras configured to image the eye; and

processing electronics in communication with the display and the one or more eye tracking cameras, the processing electronics configured to:

determine a position estimate of a center of perspective of the eye based on images of the eye obtained with the one or more eye tracking cameras, the center of perspective being estimated to be proximal the pupil of the eye or between the cornea and the pupil of the eye; and

cause the display to present to the eye the virtual image content that is rendered based on a render camera located at a render camera position that is determined based on the position estimate of the center of perspective.

2 . The display system of claim 1 , wherein the render camera position is the position estimate of the center of perspective.

3 . The display system of claim 1 , wherein the render camera position is closer to the center of perspective than the retina.

4 . The display system of claim 1 , wherein the render camera position is closer to the center of perspective than a center of rotation of the eye.

5 . The display system of claim 1 , wherein the center of perspective is not located at the pupil of the eye.

6 . The display system of claim 1 , wherein the processing electronics are further configured to:

determine an eye pose of the eye over time; and

adjust the render camera position based at least in part on the eye pose.

7 . The display system of claim 6 , wherein determining the eye pose includes one or more of estimating the eye pose or tracking the eye pose.

8 . The display system of claim 1 , wherein determining the position estimate of the center of perspective includes filtering a plurality of position estimates of the center of perspective.

9 . The display system of claim 1 , wherein determining the position estimate of the center of perspective includes at least one of averaging a plurality of position estimates of the center of perspective or applying a Kalman filter to a plurality of position estimates of the center of perspective.

10 . The display system of claim 1 , wherein the center of perspective is within the anterior chamber of the eye.

11 . The display system of claim 1 , wherein the center of perspective is in front of the pupil of the eye.

12 . The display system of claim 1 , wherein the center of perspective is at a position on the optical axis of the eye and wherein the processing electronics are further configured to determine the position estimate of the center of perspective by determining a position estimate of the optical axis of the eye.

13 . The display system of claim 12 , wherein the center of perspective is between an outer surface of the cornea and the pupil of the eye.

14 . A method for using a head-mounted display to project light to an eye of a user of the head-mounted display to present virtual image content in a vision field of the user, the eye having a cornea, an iris, a pupil, a lens, a retina, and an optical axis extending through the lens, pupil, and cornea, the method comprising:

determining a position estimate of a center of perspective of the eye based on images of the eye obtained with one or more eye tracking cameras, the center of perspective being estimated to be proximal the pupil of the eye or between the cornea and the pupil of the eye; and

causing a display to present to the eye the virtual image content that is rendered based on a render camera located at a render camera position that is determined based on the position estimate of the center of perspective.

15 . The method of claim 14 , wherein the render camera position is the position estimate of the center of perspective.

16 . The method of claim 14 , wherein the render camera position is closer to the center of perspective than the retina.

17 . The method of claim 14 , wherein the render camera position is closer to the center of perspective than a center of rotation of the eye.

18 . The method of claim 14 , wherein the center of perspective is not located at the pupil of the eye.

19 . A computer-readable storage medium storing instructions which, when executed, instruct one or more processors to perform operations for using a head-mounted display to project light to an eye of a user of the head-mounted display to present virtual image content in a vision field of the user, the eye having a cornea, an iris, a pupil, a lens, a retina, and an optical axis extending through the lens, pupil, and cornea, the operations comprising:

determining a position estimate of a center of perspective of the eye based on images of the eye obtained with one or more eye tracking cameras, the center of perspective being estimated to be proximal the pupil of the eye or between the cornea and the pupil of the eye; and

causing a display to present to the eye the virtual image content that is rendered based on a render camera located at a render camera position that is determined based on the position estimate of the center of perspective.

Assignments (2)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073387/0487 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2024
From: MILLER, SAMUEL A.; AGARWAL, LOMESH; EDWIN, LIONEL ERNEST; YEOH, IVAN LI CHUEN; FARMER, DANIEL; PROKUSHKIN, SERGEY FYODOROVICH; MUNK, YONATAN; SELKER, EDWIN JOSEPH; SOMMERS, JEFFREY SCOTT; STUART, BRADLEY VINCENT
To: MAGIC LEAP, INC.
Reel/Frame 069597/0264 →