IP Library Granted Patent US 11,715,331
Granted Patent B1
US 11,715,331 · App. 17/220,774 · Granted Aug 1, 2023

Apparatuses, systems, and methods for mapping corneal curvature

Inventors: Alexander Jobe Fix (Seattle, WA); Dmitri Model (Fremont, CA); Mohammadhossein Daraeihajitooei (Seattle, WA); Javier San Agustin Lopez (Menlo Park, CA); Mohamed Hegazy (Sammamish, WA); Scott Robert Ramsby (Kirkland, WA); Sebastian Sztuk (Menlo Park, CA)
Assignee: Meta Platforms Technologies, LLC
G06V40/19G02B27/0093G02B27/0172G02B27/0179G06T7/246G06V10/141G02B2027/0138G02B2027/0178G02B2027/0187G06T2207/10048G06T2207/10152G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,715,331
App. No.
17/220,774
Granted
Aug 1, 2023
Kind
B1
Abstract

A disclosed computer-implemented method may include directing a display device included in a head-mounted display worn by a user to illuminate, via a projection of a line at an illumination time, a portion of a cornea of the user. The method may further include detecting, via an image sensor at a detection time, a portion of the projection of the line reflected by the portion of the cornea of the user and identifying a distortion of the projection of the line reflected by the portion of the cornea of the user. The method may also include determining a shape of the cornea of the user based on the illumination time, the detection time, and the distortion of the projection of the line reflected by the portion of the cornea. Various other methods, systems, apparatuses, and computer-readable media are also disclosed.

Claims (45)

1. A computer-implemented method comprising:

directing an infrared laser line source included in a head-mounted display worn by a user to illuminate, via a projection of a line generated by a vertical cavity surface emitting laser and a scanning micromirror included in the infrared laser line source, a portion of a cornea of the user by directing the scanning micromirror to scan the projection of the line across the cornea of the user such that the projection of the line illuminates the portion of the cornea of the user at an illumination time during a scan of the projection of the line across the cornea of the user;

detecting, via an image sensor at a detection time, a portion of the projection of the line reflected by the portion of the cornea of the user;

identifying a distortion of the projection of the line reflected by the portion of the cornea of the user; and

determining a shape of a surface of the cornea of the user based on the illumination time, the detection time, and the distortion of the projection of the line reflected by the portion of the cornea.

2. The computer-implemented method of claim 1 , wherein the image sensor comprises an event camera.

3. The computer-implemented method of claim 1 , wherein the image sensor comprises at least one of:

a global-shutter camera; or

a rolling-shutter camera.

4. The computer-implemented method of claim 1 , wherein the head-mounted display comprises a waveguide display.

5. The computer-implemented method of claim 1 , wherein the infrared line source comprises an infrared light source.

6. The computer-implemented method of claim 1 , wherein the infrared line source illuminates the portion of the cornea with the projection of the line via an optical pathway of a display device included in the head-mounted display.

7. The computer-implemented method of claim 1 , wherein directing the infrared line source to illuminate the portion of the cornea of the user comprises directing the infrared line source to pulse the projection of the line in a predetermined pattern.

8. The computer-implemented method of claim 1 , wherein:

the portion of the projection of the line reflected by the portion of the cornea of the user comprises a curve of light reflected by the portion of the cornea of the user; and

identifying the distortion of the projection of the line reflected by the portion of the cornea of the user comprises determining a curvature of the curve of light.

9. The computer-implemented method of claim 1 , further comprising tracking a position of the cornea based on the shape of the cornea.

10. The computer-implemented method of claim 1 , further comprising identifying the user based on the shape of the cornea.

11. An apparatus comprising:

an infrared laser line source included in a head-mounted display (HMD) and positioned to illuminate a portion of a cornea of a user when the HMD is worn by the user, the infrared laser line source comprising:

a vertical cavity surface emitting infrared laser; and

a scanning micromirror;

an image sensor positioned to receive light reflected by the cornea; and

a control device that:

directs the infrared line source to illuminate, via a projection of a line generated by the infrared laser line source, the portion of a cornea of the user by directing the scanning micromirror to scan the projection of the line across the cornea of the user such that the projection of the line illuminates the portion of the cornea of the user at an illumination time during a scan of the projection of the line across the cornea of the user;

detects, via the image sensor at a detection time, a portion of the projection of the line reflected by the portion of the cornea of the user;

identifies a distortion of the projection of the line reflected by the portion of the cornea of the user; and

determines a shape of a surface of the cornea of the user based on the illumination time, the detection time, and the distortion of the projection of the line reflected by the portion of the cornea.

12. The apparatus of claim 11 , wherein the image sensor comprises an event camera.

13. The apparatus of claim 11 , wherein the image sensor comprises at least one of:

a global-shutter camera; or

a rolling-shutter camera.

14. The apparatus of claim 11 , wherein the head-mounted display comprises a waveguide display.

15. The apparatus of claim 11 , wherein the infrared line source comprises an infrared light source.

16. The apparatus of claim 11 , wherein the infrared line source illuminates the portion of the cornea with the projection of the line via an optical pathway of a display device included in the head-mounted display.

17. The apparatus of claim 11 , wherein the control device directs the infrared line source to illuminate the cornea of the user by directing the infrared line source to pulse the projection of the line in a predetermined pattern.

18. The apparatus of claim 11 , wherein:

the portion of the projection of the line reflected by the portion of the cornea of the user comprises a curve of light reflected by the portion of the cornea of the user; and

the control device identifies the distortion of the projection of the line reflected by the portion of the cornea of the user by determining a curvature of the curve of light.

19. The apparatus of claim 11 , wherein the control device further tracks a position of the cornea based on the shape of the cornea.

20. A non-transitory computer-readable medium comprising computer-readable instructions that, when executed by at least one processor of a computing system, cause the computing system to:

direct an infrared laser line source included in a head-mounted display worn by a user to illuminate, via a projection of a line generated by a vertical cavity surface emitting infrared laser and a scanning micromirror included in the infrared laser line source, a portion of a cornea of the user by directing the scanning micromirror to scan the projection of the line across the cornea of the user such that the projection of the line illuminates the portion of the cornea of the user at an illumination time during a scan of the projection of the line across the cornea of the user;

detect, via an image sensor at a detection time, a portion of the projection of the line reflected by the portion of the cornea of the user;

identify a distortion of the projection of the line reflected by the portion of the cornea of the user; and

determine a shape of a surface of the cornea of the user based on the illumination time, the detection time, and the distortion of the projection of the line reflected by the portion of the cornea.

Assignments (2)
CHANGE OF NAME Recorded May 27, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060203/0228 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: FIX, ALEXANDER JOBE; MODEL, DMITRI; DARAEIHAJITOOEI, MOHAMMADHOSSEIN; LOPEZ, JAVIER SAN AGUSTIN; HEGAZY, MOHAMED; RAMSBY, SCOTT ROBERT; SZTUK, SEBASTIAN
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056623/0570 →
Continuity (1)
Continuation 16400975 · May 1, 2019