IP Library Granted Patent US 12,210,723
Granted Patent B2
US 12,210,723 · App. 17/636,549 · Granted Jan 28, 2025

Light field display system for consumer devices

Inventors: Jonathan Sean Karafin (San Jose, CA); Brendan Elwood Bevensee (San Jose, CA)
Assignee: Light Field Lab, Inc.
G06F3/04815G03H1/0005G06F3/016G06F3/0484G06F3/167G06F21/31H04L67/306G03H2001/0061G06F3/013G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,723
App. No.
17/636,549
Granted
Jan 28, 2025
Kind
B2
Abstract

A light field display system is implemented in a consumer device to present the user of the consumer device with holographic content, providing the user with an immersive operational experience. The system generates and presents holographic content for the user. The system receives a command from the user. In some embodiments, the presented holographic content may comprise a holographic user interface that is used by the system to receive the commands from the user. Subsequently, the system recognizes the received commands, determines one or more computational commands for execution by the system, and executes the determined computational command.

Claims (36)

1. A consumer device comprising:

a light field (LF) display system comprising:

a controller configured to generate holographic content;

an LF display assembly comprising one or more LF display modules that are configured to present the generated holographic content to a user of the consumer device; and

a command interface configured to recognize one or more commands from the user,

wherein the LF display assembly comprises:

an energy device layer comprising one or more displays operable to project modulated energy;

a waveguide layer operable to direct the modulated energy from a plurality of energy source locations on an energy surface along different propagation paths to a plurality of points of convergence in space that form holographic representations of objects in the holographic content, each of the different propagation paths being determined based on the respective energy source location on the energy surface.

2. The consumer device of claim 1 , wherein the controller is configured to update the generated holographic content in response to a change in an operating state of the consumer device.

3. The consumer device of claim 1 , wherein the generated holographic content comprises a holographic user interface (UI) with one or more holographic features to control an operation of the consumer device, and wherein the command interface is further configured to recognize the one or more commands received from the user through the generated holographic UI.

4. The consumer device of claim 3 , wherein the command interface is further configured to receive a command from the user through the holographic UI based on determining that the user is within a threshold distance of the one or more holographic features in the presented holographic UI.

5. The consumer device of claim 1 , wherein the one or more recognized commands cause a change in an operating state of the consumer device.

6. The consumer device of claim 1 , wherein the controller is further configured to modify holographic content based on one or more recognized commands from the user.

7. The consumer device of claim 1 , wherein the controller is further configured to:

retrieve at least a part of the holographic content from an online system over a network interface in a vectorized format; and

convert the vectorized format of the holographic content into a rasterized format for presentation by the LF display assembly.

8. The consumer device of claim 1 , wherein the LF display system is configured to modify the presentation of the holographic content based on environmental characteristics at a location where the holographic content is presented to the user.

9. The consumer device of claim 1 , wherein the LF display system is configured to modify the presentation of the holographic content based on a value of a parameter received at the LF display system.

10. The consumer device of claim 1 , the LF display system further comprising:

a security module comprising an authentication module that is configured to:

receive security credentials from a user; and

authenticate the received security credentials;

enable secure access to one or more functionalities of the consumer device; and

enable the generation of particular holographic content in response to the authentication.

11. The consumer device of claim 10 , wherein the security module is further configured to:

receive data captured by internal sensors within the consumer device; and

provide the received data to the controller.

12. The consumer device of claim 11 , wherein the controller is configured to generate the holographic content based on the received data from the internal sensors.

13. The consumer device of claim 12 , wherein the controller is configured to generate the holographic content in part using an artificial intelligence model.

14. A light field (LF) display system comprising:

a controller configured to generate holographic content;

an LF display assembly comprising one or more LF display modules that are configured to present the generated holographic content to a user; and

a command interface configured to recognize one or more commands from the user,

wherein the LF display assembly comprises:

an energy device layer comprising one or more displays operable to project modulated energy;

a waveguide layer operable to direct the modulated energy from a plurality of energy source locations on an energy surface along different propagation paths to a plurality of points of convergence in space that form holographic representations of objects in the holographic content, each of the different propagation paths being determined based on the respective energy source location on the energy surface.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2026
From: LIGHT FIELD LAB, INC.
To: CMBG FBC-LIGHT FIELD LAB, LLC
Reel/Frame 074987/0351 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2022
From: KARAFIN, JONATHAN SEAN; BEVENSEE, BRENDAN ELWOOD
To: LIGHT FIELD LAB, INC.
Reel/Frame 059842/0809 →
Continuity (1)
Related Publication 20220300143A1 · Sep 22, 2022
References Cited (84)
US 5374976A · Spannenburg · 1994 [cited by applicant]
US 8149265B2 · Smalley et al. · 2012 [cited by applicant]
US 8212768B2 · Fein · 2012 [cited by examiner]
US 10432919B2 · Lapstun · 2019 [cited by applicant]
US 10560689B2 · Lapstun · 2020 [cited by applicant]
US 20030222977A1 · Yoshino · 2003 [cited by applicant]
US 20060028400A1 · Lapstun et al. · 2006 [cited by applicant]
US 20080144174A1 · Lucente et al. · 2008 [cited by applicant]
US 20080170293A1 · Lucente et al. · 2008 [cited by applicant]
US 20090040294A1 · Smalley et al. · 2009 [cited by applicant]
US 20110012895A1 · Lucente et al. · 2011 [cited by applicant]
US 20110202553A1 · Salemann · 2011 [cited by examiner]
US 20120090005A1 · Marlow · 2012 [cited by examiner]
US 20120313839A1 · Smithwick et al. · 2012 [cited by applicant]
US 20130069933A1 · Smithwick et al. · 2013 [cited by applicant]
US 20130076930A1 · Border et al. · 2013 [cited by applicant]
US 20130163089A1 · Bohn · 2013 [cited by applicant]
US 20130195410A1 · Karbasivalashani et al. · 2013 [cited by applicant]
US 20130265485A1 · Kang · 2013 [cited by applicant]
US 20140035959A1 · Lapstun · 2014 [cited by applicant]
US 20140125574A1 · Scavezze et al. · 2014 [cited by applicant]
US 20140132694A1 · Shacham et al. · 2014 [cited by applicant]
US 20140184496A1 · Gribetz et al. · 2014 [cited by applicant]
US 20140192087A1 · Frost · 2014 [cited by applicant]
US 20140293385A1 · Smithwick · 2014 [cited by applicant]
US 20140300694A1 · Smalley et al. · 2014 [cited by applicant]
US 20140300695A1 · Smalley et al. · 2014 [cited by applicant]
US 20150000025A1 · Clements · 2015 [cited by examiner]
US 20150121287A1 · Fermon · 2015 [cited by examiner]
US 20150201186A1 · Smithwick · 2015 [cited by applicant]
US 20150277378A1 · Smithwick et al. · 2015 [cited by applicant]
US 20160139402A1 · Lapstun · 2016 [cited by applicant]
US 20160170372A1 · Smithwick · 2016 [cited by applicant]
US 20160274539A1 · Smithwick · 2016 [cited by applicant]
US 20160282614A1 · Zagolla et al. · 2016 [cited by applicant]
US 20160282808A1 · Smalley · 2016 [cited by applicant]
US 20160364003A1 · O'Brien · 2016 [cited by examiner]
US 20170214907A1 · Lapstun · 2017 [cited by applicant]
US 20170289530A1 · Smithwick et al. · 2017 [cited by applicant]
US 20170344222A1 · Katz · 2017 [cited by applicant]
US 20180063519A1 · Smithwick et al. · 2018 [cited by applicant]
US 20180084245A1 · Lapstun · 2018 [cited by applicant]
US 20180157398A1 · Kaehler et al. · 2018 [cited by applicant]
US 20180225860A1 · Conness et al. · 2018 [cited by applicant]
US 20190033780A1 · Bharti et al. · 2019 [cited by applicant]
US 20190156715A1 · James · 2019 [cited by examiner]
US 20190259320A1 · Lapstun · 2019 [cited by applicant]
US 20200368616A1 · Delamont · 2020 [cited by examiner]
CN 102231044A · 2011 [cited by applicant]
CN 102591124A · 2012 [cited by applicant]
CN 103616770A · 2014 [cited by applicant]
CN 103777455A · 2014 [cited by applicant]
CN 103959179A · 2014 [cited by applicant]
CN 105334690A · 2016 [cited by applicant]
CN 107924299A · 2018 [cited by applicant]
JP 2002092790A · 2002 [cited by applicant]
JP 2006145988A · 2006 [cited by applicant]
JP 2009530661A · 2009 [cited by applicant]
JP 2018014575A · 2018 [cited by applicant]
JP 2020513618A · 2020 [cited by applicant]
KR 20040036722A · 2004 [cited by applicant]
KR 20190053839A · 2019 [cited by applicant]
WO 2008048360A2 · 2008 [cited by applicant]
WO 2016189390A2 · 2016 [cited by applicant]
WO 2017127897A1 · 2017 [cited by applicant]
WO 2018106542A1 · 2018 [cited by applicant]
WO 2019140348A2 · 2019 [cited by applicant]
David Blinder, Tobias Birnbaum, Tomoyoshi Ito, Tomoyoshi Shimobaba. The state-of-the-art in computer generated holography for 3D display[J]. Light: Advanced Manufacturing 3, 35(2022). doi: 10.37188/lam.2022.035 (Year: 2… [cited by examiner]
EP-19942261.9 European Extended Search Report of European Patent Office dated Apr. 3, 2023. [cited by applicant]
Matsubayashi et al: “Direct Finger Manipulation of 3D Object Image with Ultrasound Haptic Feedback”, Human Factors in Computing Systems, ACM, 2 Penn Plaza, Suite 701New YorkNY10121-0701USA, May 2, 2019 (May 2, 2019), pp… [cited by applicant]
International Search Report and Written Opinion of PCT/US2019/047107 dated Nov. 6, 2019. [cited by applicant]
AU-2017297629 Notice of Acceptance dated Jul. 26, 2018. [cited by applicant]
AU-2018256628 Examination Report No. 1 dated Jul. 1, 2019. [cited by applicant]
CN201780043946.8 First Office Action of the Chinese Patent Office mailed Dec. 22, 2020. [cited by applicant]
CN201780043946.8 Second Office Action of the Chinese Patent Office mailed Sep. 15, 2021. [cited by applicant]
EA-201892637 Office Action of the Eurasian Patent Office dated Mar. 6, 2020. [cited by applicant]
EA-202193101 Notification of the Search Report of the Eurasian Patent Office dated Sep. 16, 2022. [cited by applicant]
EP-17828632.4 European Partial Search Report of European Patent Office dated Feb. 10, 2020. [cited by applicant]
International Search Report and Written Opinion of PCT/US2017/042470 dated Dec. 28, 2017. [cited by applicant]
NZ-743813 First Examination Report dated Sep. 14, 2018. [cited by applicant]
Blinder, et al., The state-of-the-art in computer generated holography for 3D display(J), Light: Advanced Manufacturing 3, 35 (2022). doi: 10.37188/lam.2022.035 (Year: 2022). [cited by applicant]
JP2022-510867 Non-Final Notice of Reasons for Rejection of the Japan Patent Office dated Sep. 5, 2023. [cited by applicant]
KR-10-2022-7009072 Notice of Preliminary Rejection mailed May 30, 2024. [cited by applicant]
CN2019801004833 First Office Action of the Chinese Patent Office mailed Apr. 1, 2024. [cited by applicant]