IP Library Granted Patent US 12,192,437
Granted Patent B2
US 12,192,437 · App. 17/508,798 · Granted Jan 7, 2025

Display for three-dimensional image

Inventor: Adrian Kaehler (Los Angeles, CA)
Assignee: Magic Leap, Inc.
H04N13/393G02B30/27G02B30/54G02B30/56G09G3/005H04N13/307H04N13/32H04N13/324H04N13/398H04N2213/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,437
App. No.
17/508,798
Granted
Jan 7, 2025
Kind
B2
Abstract

Apparatuses and methods for displaying a 3-D representation of an object are described. Apparatuses can include a rotatable structure, motor, and multiple light field sub-displays disposed on the rotatable structure. The apparatuses can store a light field image to be displayed, the light field image providing multiple different views of the object at different viewing directions. A processor can drive the motor to rotate the rotatable structure and map the light field image to each of the light field sub-displays based in part on the rotation angle, and illuminate the light field sub-displays based in part on the mapped light field image. The apparatuses can include a display panel configured to be viewed from a fiducial viewing direction, where the display panel is curved out of a plane that is perpendicular to the fiducial viewing direction, and a plurality of light field sub-displays disposed on the display panel.

Claims (23)

1. A display apparatus for displaying a 3-D representation of an object, comprising:

a display panel configured to be viewed from a plurality of different fiducial viewing directions, wherein the display panel is curved out of a plane that is perpendicular to at least one of the fiducial viewing directions;

a plurality of light field sub-displays disposed on the display panel, the light field sub-displays each configured to output light to form a plurality of pixels of an image, each light field sub-display comprising:

an array of light emitters comprising a plurality of light emitter subsets;

a micro-lens array comprising a plurality of micro-lenses spaced apart from the array of light emitters, wherein each micro-lens is configured to output light corresponding to a pixel of the image and different micro-lenses are configured to output light corresponding to different pixels of the image,

wherein each micro-lens of the micro-lens array is configured to receive light from pixels of a corresponding pixel subset, wherein light from different pixels of a pixel subset exit an associated microlens at different angles compared to the light from other pixels of the pixel subset;

a non-transitory memory configured to store a light field image to be displayed by the display apparatus, the light field image providing three or more different views of an object that are viewable from three or more different fiducial viewing directions, wherein each of the different views is viewable from a different associated fiducial viewing direction of the three or more different fiducial viewing directions; and

a processor operably coupled to the non-transitory memory and the light field sub-displays, the processor programmed with executable instructions to:

access the light field image,

map the light field image to the plurality of light field sub-displays based at least in part on the position of the light field sub-displays on the display panel, and

illuminate the plurality of light field sub-displays based at least in part on the mapped light field image,

wherein the display panel is convex about at least two axes relative to one or more of the fiducial viewing directions.

2. The apparatus of claim 1 , wherein the display panel comprises the at least two axes, including a first axis and a second axis that are perpendicular to at least one of the fiducial viewing directions.

3. The apparatus of claim 2 , wherein the first axis is horizontal and the display panel is curved about the first axis.

4. The apparatus of claim 2 , wherein the second axis is vertical and the display panel is curved about the second axis.

5. The apparatus of claim 2 , wherein the first and second axes are perpendicular and the display panel is curved about both of the first and second axes.

6. The apparatus of claim 2 , wherein the radius of curvature about the first axis is different than the radius of curvature about the second axis.

7. The apparatus of claim 2 , wherein the radius of curvature about the first axis is substantially the same as the radius of curvature about the second axis.

8. The apparatus of claim 1 , wherein to illuminate the plurality of light field sub-displays the processor is programmed to scale an intensity or duration of illumination of a light field sub-display based on the position of the light field sub-display on the display panel relative to the position of another light field sub-display.

9. The apparatus of claim 1 , wherein the light field image comprises a plurality of rendered frames, different rendered frames indicative of different views of the object, wherein individual rendered frames comprise a plurality of rendered pixels that, when combined, render the rendered frame, different rendered pixels having different positions within the rendered frame.

10. The apparatus of claim 1 , further comprising a proximity sensor configured to detect a presence or absence of an entity within a predetermined distance of the display apparatus, and wherein the processor is programmed with executable instructions to initiate an action based on the proximity sensor detecting the presence or absence of the entity.

11. The apparatus of claim 1 , wherein the display panel is shaped as a portion of a sphere that is convex relative to at least one of the fiducial view directions.

12. The apparatus of claim 1 , wherein one or more of the light field sub-displays are switched to present, at different times, different rendered frames of the different views of the object to be viewable from the different fiducial view directions to display the 3-D representation of the object.

Assignments (2)
PROPRIETARY INFORMATION AND INVENTIONS AGREEMENT Recorded Dec 4, 2022
From: KAEHLER, ADRIAN
To: MAGIC LEAP, INC.
Reel/Frame 062054/0418 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
Continuity (6)
Continuation 16694606 · Nov 25, 2019
Division 15410455 · Jan 19, 2017
Provisional Application 62343767 · May 31, 2016
Provisional Application 62343722 · May 31, 2016
Provisional Application 62288680 · Jan 29, 2016
Related Publication 20220046227A1 · Feb 10, 2022
References Cited (129)
US 5082422A · Wang · 1992 [cited by applicant]
US 5291560A · Daugman · 1994 [cited by applicant]
US 5825443A · Kawasaki et al. · 1998 [cited by applicant]
US 6037876A · Crouch · 2000 [cited by applicant]
US 6594630B1 · Zlokarnik et al. · 2003 [cited by applicant]
US 6850221B1 · Tickle · 2005 [cited by applicant]
US D514570S · Ohta · 2006 [cited by applicant]
US 8950867B2 · Macnamara · 2015 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US 9224366B1 · Park · 2015 [cited by examiner]
US D752529S · Loretan et al. · 2016 [cited by applicant]
US 9310559B2 · Macnamara · 2016 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US D758367S · Natsume · 2016 [cited by applicant]
US D759657S · Kujawski et al. · 2016 [cited by applicant]
US 9383587B2 · Balogh · 2016 [cited by applicant]
US 9398357B2 · Berkman et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US D794288S · Beers et al. · 2017 [cited by applicant]
US 9740006B2 · Gao et al. · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt et al. · 2017 [cited by applicant]
US D805734S · Fisher et al. · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski et al. · 2018 [cited by applicant]
US 10283093B2 · Zhou et al. · 2019 [cited by applicant]
US 10536690B2 · Kaehler et al. · 2020 [cited by applicant]
US 20040192430A1 · Burak et al. · 2004 [cited by applicant]
US 20050117294A1 · Hsieh · 2005 [cited by applicant]
US 20050230641A1 · Chun et al. · 2005 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20060109200A1 · Alden · 2006 [cited by applicant]
US 20060132497A1 · Biegelsen · 2006 [cited by applicant]
US 20060170644A1 · Ioki · 2006 [cited by examiner]
US 20070009222A1 · Koo · 2007 [cited by examiner]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20070109787A1 · Wu · 2007 [cited by applicant]
US 20070247832A1 · Barker · 2007 [cited by applicant]
US 20100097448A1 · Gilbert et al. · 2010 [cited by applicant]
US 20110157168A1 · Bennett · 2011 [cited by examiner]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller et al. · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz et al. · 2013 [cited by applicant]
US 20130155052A1 · Ko · 2013 [cited by examiner]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis et al. · 2013 [cited by applicant]
US 20130321394A1 · Fisher et al. · 2013 [cited by applicant]
US 20140071539A1 · Gao et al. · 2014 [cited by applicant]
US 20140152672A1 · Seder et al. · 2014 [cited by applicant]
US 20140168783A1 · Luebke et al. · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150049390A1 · Lanman et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150222883A1 · Welch et al. · 2015 [cited by applicant]
US 20150222884A1 · Cheng et al. · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · Tekolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20150379770A1 · Haley, Jr. et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao et al. · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20170134721A1 · Byrne · 2017 [cited by examiner]
US 20170140571A1 · Peterson · 2017 [cited by examiner]
US 20170184863A1 · Balachandreswaran et al. · 2017 [cited by applicant]
US 20170223344A1 · Kaehler et al. · 2017 [cited by applicant]
US 20170235134A1 · Border et al. · 2017 [cited by applicant]
US 20170266676A1 · Fateh · 2017 [cited by applicant]
US 20170310956A1 · Perdices-Gonzalez · 2017 [cited by examiner]
US 20180036703A1 · Mercer et al. · 2018 [cited by applicant]
US 20180136703A1 · Woods et al. · 2018 [cited by applicant]
US 20180348534A1 · Chen · 2018 [cited by examiner]
US 20190035317A1 · Rohena et al. · 2019 [cited by applicant]
US 20200033921A1 · Rohena et al. · 2020 [cited by applicant]
US 20200092538A1 · Kaehler · 2020 [cited by applicant]
US 20200383240A1 · Rohena et al. · 2020 [cited by applicant]
US 20220046227A1 · Kaehler · 2022 [cited by applicant]
CN 103336532A · 2013 [cited by applicant]
CN 203806889U · 2014 [cited by applicant]
CN 104469344A · 2015 [cited by applicant]
CN 204945946U · 2016 [cited by applicant]
CN 207609586U · 2018 [cited by applicant]
CN 108885352A · 2018 [cited by applicant]
JP 09230321A · 1997 [cited by applicant]
JP 2003216071A · 2003 [cited by applicant]
JP 2004177709A · 2004 [cited by applicant]
JP 2005308980A · 2005 [cited by applicant]
JP 2007071922A · 2007 [cited by applicant]
JP 2007226013A · 2007 [cited by applicant]
JP 2013064996A · 2013 [cited by applicant]
JP 2013161035A · 2013 [cited by applicant]
JP 2015501951A · 2015 [cited by applicant]
JP 6289320B2 · 2018 [cited by applicant]
WO 2011012913A1 · 2011 [cited by applicant]
WO 2013086046A1 · 2013 [cited by applicant]
WO 2015140578A1 · 2015 [cited by applicant]
WO 2017132050A1 · 2017 [cited by applicant]
WO 2019023489A1 · 2019 [cited by applicant]
3D Hologram No Glass No Cd case—YouTube, accessed Jul. 18, 2017, in 3 pages URL: https://www.youtube.com/watch?v=dwfYIRA8h-4. [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC—Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mit.edu raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
European Extended Search Report, re EP Application No. 17744712.5, dated Aug. 19, 2019. [cited by applicant]
European Extended Search Report, re EP Application No. 21205442.3, dated Feb. 21, 2022. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US2017/014166, dated Jul. 31, 2018. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US17/14166, dated Apr. 4, 2017. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Kinomo: “Kino-mo Holo Displays—the new holograms”, Kino-mo, printed Jan. 27, 2016, in 4 pages. URL: http://kinomo.com/displays. [cited by applicant]
Lanman, D. et al., “Near-Eye Light Field Displays”, Nvidia Research, Jul. 2013, in 10 pages. [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. ACM CHI 2000 Human Factors in Computin… [cited by applicant]
EP21205442.3 Examination Report dated Aug. 31, 2023. [cited by applicant]
KR2018-7024797 Office Action dated Sep. 7, 2023. [cited by applicant]
Office Action received for Chinese Patent Application No. 202111360771.8, mailed on Mar. 27, 2024, 17 pages (7 pages of English Translation and 10 pages of Original Document). [cited by applicant]
Cited By (1)
US 12,513,279