IP Library Granted Patent US 12,541,109
Granted Patent B2
US 12,541,109 · App. 18/952,703 · Granted Feb 3, 2026

Plenoptic camera measurement and calibration of head-mounted displays

Inventor: Miller Harry Schuck, III (Erie, CO)
Assignee: Magic Leap, Inc.
G02B27/0172G02B5/201G02B27/0081G02B27/283G02B2027/0138G02B2027/014G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,541,109
App. No.
18/952,703
Granted
Feb 3, 2026
Kind
B2
Abstract

A method for measuring performance of a head-mounted display module, the method including arranging the head-mounted display module relative to a plenoptic camera assembly so that an exit pupil of the head-mounted display module coincides with a pupil of the plenoptic camera assembly; emitting light from the head-mounted display module while the head-mounted display module is arranged relative to the plenoptic camera assembly; filtering the light at the exit pupil of the head-mounted display module; acquiring, with the plenoptic camera assembly, one or more light field images projected from the head-mounted display module with the filtered light; and determining information about the performance of the head-mounted display module based on acquired light field image.

Claims (24)

1 . A method for measuring performance of a head-mounted display module, the method comprising:

emitting light from the head-mounted display module while the head-mounted display module is arranged relative to a plenoptic camera assembly;

filtering the light at an exit pupil of the head-mounted display module;

acquiring, with the plenoptic camera assembly, one or more light field images projected from the head-mounted display module with the filtered light; and

determining information about the performance of the head-mounted display module based on acquired light field image.

2 . The method of claim 1 , comprising arranging the head-mounted display module relative to the plenoptic camera assembly so that the exit pupil of the head-mounted display module coincides with a pupil of the plenoptic camera assembly.

3 . The method of claim 1 , wherein the light is filtered by a plurality of spatially discrete filters positioned at a pupil of the plenoptic camera assembly.

4 . The method of claim 3 , wherein the spatially discrete filters comprise color filters.

5 . The method of claim 4 , wherein the color filters comprise X, Y, Z color matching function color filters.

6 . The method of claim 4 , wherein the spatially discrete filters comprise polarization filters, or neutral density filters.

7 . The method of claim 1 , wherein the light is filtered by a first set of spatially discrete filters and a second set of spatially discrete filters overlapping with the first set, the first and second sets of spatially discrete filters filtering different properties of the light.

8 . The method of claim 7 , wherein the properties of the light are selected from a group consisting of color, polarization, and intensity.

9 . The method of claim 1 , wherein acquiring the one or more light field images comprises reimaging a real image from the head-mounted display module to a multi-element sensor using a microlens array.

10 . The method of claim 9 , wherein the microlens array samples portions of an exit pupil of a lens of the plenoptic camera assembly to provide different angular views of the real image from the head-mounted display module.

11 . The method of claim 1 , wherein the plenoptic camera assembly defines a light path from a pupil of the plenoptic camera assembly to a sensor array, the plenoptic camera assembly comprising a camera lens assembly in the light path defining the pupil of the plenoptic camera assembly and defining an image plane, the plenoptic camera assembly further comprising an array of focusing elements in the light path between the image plane and the sensor array.

12 . The method of claim 1 , wherein the information about the performance of the head-mounted display module comprises information about at least one of a performance parameter selected from the group consisting of radiance, luminance, color, geometric distortion, virtual image distance, and field curvature.

13 . The method of claim 1 , wherein determining the information about the performance of the head-mounted display module comprises calculating two-dimensional images at multiple different depths over a three-dimensional volume of interest of the head-mounted display module.

14 . The method of claim 13 , wherein determining the information further comprises determining information about one or more properties of each of the two-dimensional images.

15 . The method of claim 1 , further comprising combining emitted light from multiple different locations of the exit pupil of the head-mounted display module to form multiple overlapping images at a sensor of the plenoptic camera assembly, each of the multiple overlapping images corresponding to a different user view for the head-mounted display module.

16 . The method of claim 1 , wherein acquiring, with the plenoptic camera assembly, one or more light field images comprises acquiring, with a multiplexing assembly and the plenoptic camera assembly, one or more light field images across multiple user pupil positions.

17 . The method of claim 16 , comprising arranging the multiplexing assembly relative to the plenoptic camera assembly so that an exit pupil of the multiplexing assembly coincides with a pupil of the plenoptic camera assembly.

18 . A method for calibrating a head-mounted display, comprising:

measuring a performance of the head-mounted display using the method of claim 1 ; and

adjusting an operation of the head-mounted display based on the measured performance.

Assignments (2)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2024
From: SCHUCK, MILLER HARRY, III
To: MAGIC LEAP, INC.
Reel/Frame 069346/0548 →
Continuity (4)
Continuation 18505437 · Nov 9, 2023
Continuation 18004413
Provisional Application 63048331 · Jul 6, 2020
Related Publication 20250076662A1 · Mar 6, 2025
References Cited (22)
US 20160225191A1 · Mullins · 2016 [cited by examiner]
US 20180130227A1 · Sato · 2018 [cited by examiner]
US 20180152697A1 · DeVaul · 2018 [cited by examiner]
US 20180173303A1 · Liu et al. · 2018 [cited by applicant]
US 20180210208A1 · Zhou · 2018 [cited by examiner]
US 20190162950A1 · Lapstun · 2019 [cited by applicant]
CN 110554511A · 2019 [cited by applicant]
JP 2019501564A · 2019 [cited by applicant]
JP 2019504292A · 2019 [cited by applicant]
JP 2019531769A · 2019 [cited by applicant]
WO WO2019157571A1 · 2019 [cited by examiner]
Notice of Allowance in Japanese Appln. No. 2022-578826, mailed on Feb. 6, 2025, 5 pages (with English translation). [cited by applicant]
Extended European Search Report in European Appln. No. 21838509.4, dated Jun. 27, 2024, 8 pages. [cited by applicant]
Georgiev and Lumsdaine, “Superresolution with plenoptic camera 2.0,” Adobe Tech. Report, Apr. 2009, 9 pages. [cited by applicant]
Georgiev et al., “Using focused plenoptic cameras for rich image capture,” IEEE Computer Graphics and Applications, Jan./Feb. 2011, pp. 50-61. [cited by applicant]
International Search Report and Written Opinion in PCT/US2021/040369, mailed on Sep. 29, 2021, 9 pages. [cited by applicant]
Lumsdaine and Georgiev, “Full resolution lightfield rendering,” Tech. Rep., Adobe Systems, Inc., Jan. 2008, 12 pages. [cited by applicant]
Manakov et al., “A reconfigurable camera add-on for high dynamic range, multispectral, polarization, and light-field imaging,” ACM Transactions on Graphics, Jul. 2013, 32(4):47, 12 pages. [cited by applicant]
Masuda et al., “Single-snapshot 2D color measurement by plenoptic imaging system,” Proc. SPIE, Photonic Inst. Engineering, Mar. 2014, 8992V: 9 pages. [cited by applicant]
Perwaß and Wietzke, “Single lens 3D-camera with extended depth-of-field,” Raytrix GmbH, Tech. Bulletin, Feb. 2012, 15 pages. [cited by applicant]
Su et al., “Spectrum Reconstruction of the Light-Field Multimodal Imager,” IEEE Access, Jan. 2019, 7:9688-9696. [cited by applicant]
Office Action in Chinese Appln. No. 202180048138.7, mailed on Dec. 4, 2025, 15 pages (with English Translation). [cited by applicant]