IP Library Granted Patent US 12,574,484
Granted Patent B2
US 12,574,484 · App. 18/528,795 · Granted Mar 10, 2026

Efficient, dynamic, high contrast lensing with applications to imaging, illumination and projection

Inventors: Gerwin Damberg (Vancouver, CA); James Gregson (Vancouver, CA); Wolfgang Heidrich (Thuwal, SA)
Assignee: Barco Visual Solutions, Inc.
H04N9/3161G02B26/06G02B27/0012G02B27/18G02B27/50G03B21/006G03B21/008H04N5/74H04N9/3126H04N9/3155H04N9/3167H04N9/3179H04N9/3185H04N9/3188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,574,484
App. No.
18/528,795
Granted
Mar 10, 2026
Kind
B2
Abstract

A new projector design combines one spatial light modulator that affects only the phase of the illumination, and one spatial light modulator that only affects its amplitude (intensity). The phase-only modulator curves the wavefront of light and acts as a pre-modulator for a conventional amplitude modulator. This approach works with both white light and laser illumination, generating a coarse image representation efficiently, thus enabling, within a single image frame, significantly elevated highlights as well as darker black levels while reducing the overall light source power requirements.

Claims (69)

1 . Apparatus for controlling a phase modulator to display an image defined by image data, the apparatus comprising a data processor in communication with the phase modulator, the data processor configured to:

determine an objective function based on the image data;

transform the objective function into a frequency space;

minimize the transformed objective function in the frequency space to obtain a phase function in the frequency space; and

inverse transform the phase function to obtain a solution phase function relating the phase of the phase modulator to a position in two dimensions.

2 . Apparatus according to claim 1 wherein the data processor being configured to transform the objective function comprises the data processor being configured to compute a Fourier transform of the objective function.

3 . Apparatus according to claim 2 wherein the data processor is configured to, before transforming, extend the image data to have periodic boundary conditions and base the objective function on the extended image data.

4 . Apparatus according to claim 3 wherein the data processor being configured to extend the image data comprises the data processor being configured to make a mirror image of the image data across each boundary of the image data.

5 . Apparatus according to claim 1 wherein the objective function is a least squares objective function.

6 . Apparatus according to claim 1 wherein the objective function includes a cost for deviating from an input argument.

7 . Apparatus according to claim 1 wherein the data processor is configured to iteratively determine the objective function, transform the objective function, and evaluate the transformed objective function, and in each of a plurality of iterations the input argument for the objective function is the solution phase function for a previous iteration.

8 . Apparatus according to claim 7 wherein the data processor is configured to cache a Fourier transform of the solution phase function for the previous iteration and apply the cached Fourier transform of the solution phase function in a current iteration.

9 . Apparatus according to claim 1 wherein the objective function comprises a proximal operator given by:

prox γF ( q )=(γ+ A T A ) −1 (γ q+A T b ).

10 . Apparatus according to claim 9 wherein the data processor being configured to evaluate the transformed objective function comprises the data processor being configured to determine

(

(

b

)

(

A

)

*

+

γ

(

q

)

(

1

+

α

)

(

A

)

2

+

γ

)

.

11 . Apparatus according to claim 10 wherein one or more of:

A={circumflex over (f)}∇ 2 ;

b=1−I p k (v); and

α>0 is a regularization parameter.

12 . Apparatus according to claim 1 wherein the data processor is configured to initialize the phase surface as a constant value.

13 . Apparatus according to claim 1 wherein the data processor is configured to evaluate the transformed objective function in parallel for different points.

14 . Apparatus according to claim 13 wherein the data processor comprises a graphics processing unit and the graphics processing unit evaluates the transformed objective function.

15 . Apparatus according to claim 1 comprising the phase modulator and a light source for projecting light on the phase modulator, the data processor configured to control the phase modulator to display the image by controlling pixels of the phase modulator according to the solution phase function while controlling the light source to illuminate the phase modulator.

16 . Apparatus according to claim 15 wherein the light source is configured to evenly illuminate the phase modulator with collimated light.

17 . Apparatus according to claim 15 wherein the phase modulator comprises an array of liquid crystal pixels and the data processor is configured to set control signals to the pixels according to the solution phase function.

18 . Apparatus according to claim 17 wherein the phase modulator is one of: a LCoS phase modulator; and a deformable mirror.

19 . Apparatus according to claim 15 wherein at least one of: a maximum numerical aperture for points on the phase modulator is 0.21 or less and the phase modulator has a maximum phase retardation and apparatus comprises subtracting a multiple of 2π from phase shifts of the phase function that exceed the maximum phase retardation of the phase modulator.

20 . A method for controlling a phase modulator to display an image defined by image data, the method comprising:

determining an objective function based on the image data;

transforming the objective function into a frequency space;

minimizing the transformed objective function in the frequency space to obtain a phase function in the frequency space; and

inverse transform the phase function to obtain a solution phase function relating the phase of the phase modulator to a position in two dimensions.

Assignments (2)
CHANGE OF NAME Recorded Nov 17, 2025
From: MTT INNOVATION INCORPORATED
To: BARCO VISUAL SOLUTIONS, INC.
Reel/Frame 072927/0626 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2023
From: DAMBERG, GERWIN; HEIDRICH, WOLFGANG; GREGSON, JAMES
To: MTT INNOVATION INCORPORATED
Reel/Frame 065780/0620 →
Continuity (9)
Continuation 18079802 · Dec 12, 2022
Continuation 17039503 · Sep 30, 2020
Continuation 16517325 · Jul 19, 2019
Continuation 15981069 · May 16, 2018
Continuation 15368021 · Dec 2, 2016
Continuation PCTCA2015050515 · Jun 3, 2015
Provisional Application 62118945 · Feb 20, 2015
Provisional Application 62007341 · Jun 3, 2014
Related Publication 20240179279A1 · May 30, 2024
References Cited (57)
US 6011874A · Gluckstad · 2000 [cited by applicant]
US 20050063032A1 · Igasaki et al. · 2005 [cited by applicant]
US 20070024999A1 · Crossland et al. · 2007 [cited by applicant]
US 20070084993A1 · Grier · 2007 [cited by examiner]
US 20090128875A1 · Christmas et al. · 2009 [cited by applicant]
US 20100171927A1 · Kitano et al. · 2010 [cited by applicant]
US 20120143506A1 · Routh · 2012 [cited by examiner]
US 20130021545A1 · Song et al. · 2013 [cited by applicant]
US 20150254810A1 · Heidrich · 2015 [cited by examiner]
US 20150304646A1 · Kompanets · 2015 [cited by applicant]
CN 101822043B · 2010 [cited by applicant]
CN 103325129A · 2013 [cited by applicant]
EP 0829747A1 · 1998 [cited by applicant]
GB 2482066A · 2012 [cited by applicant]
JP 2006227503A · 2006 [cited by applicant]
JP 2010152178A · 2010 [cited by applicant]
JP 2011528132A · 2011 [cited by applicant]
WO 2012145200A1 · 2012 [cited by applicant]
WO 2013094011A1 · 2013 [cited by applicant]
Berry, M., “Oriental magic mirrors and the Laplacian image”, European Journal of Physics 27 (2006) 109-118. [cited by applicant]
Bimber, O. et al., “Superimposing Dynamic Range”, The Eurographics Association 2009. [cited by applicant]
Buckley, E., “Invited Paper: Holographic Laser Projection Technology”, Proc. SID, vol. 39, 1074-1079, 2008. [cited by applicant]
Damberg, G. et al., “High Dynamic Range Projection Systems”, Proc. SID, vol. 38, Wiley Online Library, 4-7, 2007. [cited by applicant]
Damberg, G. et al., “High-Dynamic Range Projector”, Siggraph Emerging Technologies, 2007. [cited by applicant]
Finckh, M. et al., “Geometry Construction from Caustic Images”, Proc. ECCV, 464-477, 2010. [cited by applicant]
Haugen, P. R et al., “Image formation by multifacet holograms”, Applied Optics 22, 18, 2822-2829, 1983. [cited by applicant]
Holoeye, Photonics corporation, URL http://www. holoeye.com, Mar. 2015. [cited by applicant]
Hoskinson, R. et al., “Light Reallocation for High Contrast Projection Using an Analog Micromirror Array”, ACM Transactions on Graphics 29, 6, 165, 2010. [cited by applicant]
Hoskinson, R. et al., “Arrays of large-area, tip/tilt micromirrors for use in a high-contrast projector”, Sensors and Actuators A: Physical 173, 1, 172-179, 2012. [cited by applicant]
Hullin, M. B. et al., “State of the Art in Computational Fabrication and Display of Material Appearance”, Eurographics Annual Conference (STAR), 2013. [cited by applicant]
Kiser, T. et al., “Architectural Caustics—Controlling Light with Geometry”, Advances in Architectural Geometry 2012, Springer, 91-106, 2013. [cited by applicant]
Kusakabe, Y. et al., “A high-dynamic-range and high-resolution projector with dual modulation”, vol. 7241, 72410Q-72410Q-11, 2009. [cited by applicant]
Lesem, L. et al., “The Kinoform: A New Wavefront Reconstruction Device”, IBM Journal of Research and Development 13, 2, 150-155, 1969. [cited by applicant]
Menn, S. et al., “Advances in MEMS Deformable Mirror Technology for Laser Beam Shaping”, Proc. of SPIE, vol. 6663, 2007. [cited by applicant]
Minano, J. C. et al., “Free-Form Optics for Illumination”, Optical Review 16, 2, 99-102, 2009. [cited by applicant]
Ng, M. K. et al., “A Fast Algorithm for Deblurring Models with Neumann Boundary Conditions”, SIAM Journal on Scientific Computing 21, 3, 851-866, 1999. [cited by applicant]
docs.nvidia.com/cuda, Programming guide, cusparse, cublas, and cufft library user guides, Online, Mar. 2015. [cited by applicant]
Papas, M. et al., “Goal-based Caustics”, Eurographics, vol. 30, No. 2, 503-511, 2011. [cited by applicant]
Papas, M. et al., “The Magic Lens: Refractive Steganography”, ACM Transactions on Graphics (TOG) 31, 6, 186, 2012. [cited by applicant]
Parikh, N. et al., “Proximal algorithms”, Foundations and Trends in Optimization, vol. 1, No. 3, 2-7, 2014, pp. 142-143. [cited by applicant]
Pauly, M. et al., “Caustic Art”, EPFL Tech. rep, 2012. [cited by applicant]
Rempel, A.G. et al., “Video Viewing Preferences for HDR Displays Under Varying Ambient Illumination”, Proc. APGV, 45-52, 2009. [cited by applicant]
Rempel, A. et al., “The Role of Contrast in the Perceived Depth of Monocular Imagery”, Proc. APGV, 115, 2011. [cited by applicant]
Robinson, M. D. et al., Polarization Engineering for LCD Projection, vol. 4. John Wiley & Sons, 2005, pp. 105-128. [cited by applicant]
Schwartzburg, Y. et al., “High-contrast Computational Caustic Design”, ACM Trans. Graph. vol. 33, No. 4, 2014. [cited by applicant]
Seetzen, H. et al., “High Dynamic Range Display Systems”, ACM Trans. Graph., 760-768, 2004. [cited by applicant]
Seetzen, H., “High dynamic range display and projection systems”, PhD thesis, University of British Columbia, 2009. [cited by applicant]
Silvester, D. J. et al., “A Black-Box Multigrid Preconditioner for the Biharmonic Equation”, BIT Numerical Mathematics 44, 1, 151-163, 2004. [cited by applicant]
Slinger, C. et al., “Computer-Generated Holography as a Generic Display Technology”, IEEE Computer 38, 8, 46-53, 2005. [cited by applicant]
Tang, X. H. et al., “An Operator Splitting Scheme for Biharmonic Equation with Accelerated Convergence”, Proceedings of the 5th International Conference on Large-Scale Scientific Computing, Springer-Verlag, Berlin, Heid… [cited by applicant]
Yue, Y. et al., “Pixel Art with Refracted Light by Rearrangeable Sticks”, Eurographics, vol. 31, No. 2, 575-582, 2012. [cited by applicant]
Yue, Y. et al., “Poisson-Based Continuous Surface Generation for Goal-Based Caustics”, ACM Trans. Graph, vol. 33, No. 3, 2014. [cited by applicant]
Zhao, J., “Convergence of V-Cycle and F-Cycle Multigrid Methods for the Biharmonic Problem Using the Morley Element”, Electronic Transactions on Numerical Analysis 17, 112-132, 2004. [cited by applicant]
Lazarev, G. et al., “LCOS Spatial Light Modulators: Trends and Applications”, Optical Imaging and Metrology: Advanced Technologies, First Edition, 2012. [cited by applicant]
Hahn, J. et al., “Optical implementation of interative Fourier transform algorithm using spatial light modulator”, Proceedings Optical Diagnostics of Living Cells II, vol. 6310, Aug. 29, 2006, p. 63100B. [cited by applicant]
Zhu, et al., “Design and characterization of DOE microlens array for spatial light modulator”, Physics Procedia 19 (2011) 139-145. [cited by applicant]
Damberg, G. et al., “Efficient freeform lens optimization for computational caustic displays”, Optics Express, vol. 23, No. 8, Apr. 2015. [cited by applicant]