IP Library Granted Patent US 12,717,460
Granted Patent B2
US 12,717,460 · App. 18/738,484 · Granted Aug 25, 2026

Real-time preview of connectable objects in a physically-modeled virtual space

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,717,460
App. No.
18/738,484
Filed
Jun 10, 2024
Granted
Aug 25, 2026
Kind
B2
Examiner
HOANG, PHI
Art Unit
2619
USPC
715/757
Assignments (2)
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2024
From: BROWN, EDMUND GRAVES, IV; BUSTO, JAVIER ANTONIO; SCOTT, JEFFREY A.; VANHOOZER, JEREMY
To: MAGIC LEAP, INC.
Reel/Frame 067674/0382 →
Continuity (4)
Continuation 18308074 · Apr 27, 2023
Continuation 17308920 · May 5, 2021
Continuation 16508197 · Jul 10, 2019
Related Publication 20240329796A1 · Oct 3, 2024
References Cited (102)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 7439972B2 · Timcenko · 2008 [cited by examiner]
US 7979251B2 · Jakobsen et al. · 2011 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt et al. · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski · 2018 [cited by applicant]
US 10019131B2 · Welker et al. · 2018 [cited by applicant]
US 10942577B2 · Nguyen et al. · 2021 [cited by applicant]
US 11029805B2 · Brown, IV et al. · 2021 [cited by applicant]
US 11262899B2 · Wallington · 2022 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20070262984A1 · Pruss · 2007 [cited by applicant]
US 20110035802A1 · Arajujo, Jr. · 2011 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20120294539A1 · Lim · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · TeKolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20180045963A1 · Hoover · 2018 [cited by applicant]
US 20180181274A1 · Jung · 2018 [cited by applicant]
US 20180190020A1 · Mullins · 2018 [cited by applicant]
US 20190240581A1 · Walker et al. · 2019 [cited by applicant]
US 20190317718A1 · George et al. · 2019 [cited by applicant]
US 20200012107A1 · Greenberg · 2020 [cited by applicant]
US 20210011606A1 · Brown et al. · 2021 [cited by applicant]
US 20210335047A1 · Heun et al. · 2021 [cited by applicant]
US 20220172439A1 · Takamizawa · 2022 [cited by examiner]
Wolfartsberger, J., et al., “A Virtual Reality Supported 3D Environment for Engineering Design Review,” 2017 23rd International Conference on Virtual System & Multimedia, Apr. 26, 2018. [cited by applicant]
“Augmented Reality,” Wikipedia, Internet Archive, accessed at https://web.archive.org/web/20090918034414/https://en.wikipedia.org/wiki/Augmented_reality, Sep. 18, 2009. [cited by applicant]
Azuma, R., “A Survey of Augmented Reality,” Presence: Teleoperators and Virtual Environments, 6(4):355-385, Aug. 1997. [cited by applicant]
Barrilleaux, J., “Experiences and observations in applying augmented reality to live training,” VWSim'99: The Virtual Worlds and Simulation Conference, Society for Computer Simulation International, accessed at http://w… [cited by applicant]
Benford, S., et al., “Understanding and Constructing Shared Spaces with Mixed-Reality Boundaries,” ACM Transactions on Computer-Human Interaction, 5(3):185-223, Sep. 1998. [cited by applicant]
Billinghurst, M., et al., “The MagicBook: a transitional AR interface,” Computers & Graphics, 25(5):745-753, Oct. 2001. [cited by applicant]
Carmigniani, J., et al., “Augmented reality technologies, systems and applications,” Multimedia Tools and Applications, 51(1):341-377, Dec. 2010. [cited by applicant]
Edwards-Stewart, A., et al., “Classifying Different Types of Augmented Reality Technology,” Annual Review of Cyber Therapy and Telemedicine, vol. 14, pp. 199-202, Jan. 2016. [cited by applicant]
Hoste, L., and Signer, B., “Expressive Control of Indirect Augmented Reality During Live Music Performances,” Proceedings of NIME 2013, 13th International Conference on New Interfaces for Musical Expression, May 2013. [cited by applicant]
Milgram, P. and Kishino, F., “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information and Systems, E77-D(12):1321-1329, Dec. 1994. [cited by applicant]
Schmalstieg, D. and Höllerer, T., “Augmented Reality: Principles and Practice,” 2016. [cited by applicant]
Schmalstieg, D., et al., “The Studierstube Augmented Reality Project,” DBLP, 11(1):33-54, Feb. 2002 (“Studierstube Augmented Reality Project”). [cited by applicant]
Skarbez, R., et al., “Revisiting Milgram and Kishino's Reality-Virtuality Continuum,” Frontiers in Virtual Reality, vol. 2, Mar. 2021. [cited by applicant]
Hua, et al., “Depth-fused multi-focal plane displays enable accurate depth perception,” Proceedings of SPIE vol. 7849, 2010. [cited by applicant]
Liu, S., et al., “An optical see-through head mounted display with addressable focal planes,” In Mixed and Augmented Reality, ISMAR 2008, 7th IEEE/ACM International Symposium, pp. 33-42, 2008 (“Liu”). [cited by applicant]
Kramida, G., “Resolving the vergence-accommodation conflict in head-mounted displays,” IEEE Transactions on Visualization and Computer Graphics, 22(7), 2016. [cited by applicant]
Cutting, James E., and Peter M. Vishton, “Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth,” In Perception of space and motion, pp. 69-1… [cited by applicant]
Weier, Martin, “Perception-driven rendering: techniques for the efficient visualization of 3D scenes including view-and gaze-contingent approaches,” PhD diss., Universität des Saarlandes, 2019. [cited by applicant]
Puig et al., “Difference in Visual Processing Assessed by Eye Vergence Movements,” PLOS One, 8(9), Sep. 2013. [cited by applicant]
“Autorefractor,” https://en.wikipedia.org/wiki/Autorefractor, accessed at https://web.archive.org/web/20150930192812/en.wikipedia.org/wiki/Autorefractor. [cited by applicant]
Otero, J.M., “Measurement of Accommodation in Dim Light and in Darkness by Means of the Purkinje Images,” J. Opt. Soc. Am., vol. 43, pp. 925-925, 1953. [cited by applicant]
Orlosky, J., “Adaptive Display of Virtual Content for Improving Usability and Safety in Mixed and Augmented Reality,” Osaka University Knowledge Archive, 2016 (“Orlosky”). [cited by applicant]
Declaration of Dr. Joseph Gabbard Under 37 C.F.R. § 1.132 including Appendix A (List of Materials Considered) and Appendix B (Curriculum Vitae) and Incorporated Claim Charts CC-1-6. [cited by applicant]
Wolfartsberger, J., et al., “A Virtual Reality Supported 30 Environment for Engineering Design Review,” 2017 23rd International Conference on Virtual System & Multimedia, Apr. 26, 2018. [cited by applicant]
Milgram, P. and Kishino, F., “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information and Systems, E ??—O(12):1321-1329, Dec. 1994. [cited by applicant]
Weier, Martin, “Perception-driven rendering: techniques for the efficient visualization of 30 scenes including view-and gaze-contingent approaches,” PhD diss., Universitat des Saarlandes, 2019. [cited by applicant]
Reexamination Request and Supporting Documents for U.S. Pat. No. 11,029,805, assigned U.S. Appl. No. 90/019,575, filed Jul. 8, 2024 (769 pages). [cited by applicant]
Reexamination Grant Notice issued in U.S. Appl. No. 90/019,575 on Aug. 22, 2024 (32 pages). [cited by applicant]
Reexamination Non-Final Office Action issued in U.S. Appl. No. 90/019,575 on Feb. 3, 2025 (64 pages). [cited by applicant]
Reexamination Final Office Action issued in U.S. Appl. No. 90/019,575 on May 23, 2025 (39 pages). [cited by applicant]
Reexamination Notice of Intent to Issue Ex Parte Reexamination Certificate issued in U.S. Appl. No. 90/019,575 mail date Aug. 7, 2025 (8 pages). [cited by applicant]
Adams, et al., “Virtual Training for a Manual Assembly Task,” The Electronic Journal of Haptics Research, vol. 2, No. 2, Oct. 17, 2001. [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/~azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mitedu/ [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Sankar Jayaram, Hugh I Connacher, Kevin W Lyons, Virtual assembly using virtual reality techniques, Computer-Aided Design, vol. 29, Issue 8, 1997, pp. 575-584. (Year: 1997). [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. ACM CHI 2000 Human Factors in Computin… [cited by applicant]
Yuan, Miaolong & Ong, S K & Nee, Andrew. (2004). Assembly Guidance in Augmented Reality Environments Using a Virtual Interactive Tool. (Year: 2004). [cited by applicant]
USPTO Non-Final Office Action issued in U.S. Appl. No. 18/308,074 dated Nov. 22, 2023. [cited by applicant]
USPTO Non-Final Office Action issued in U.S. Appl. No. 17/308,920 dated Apr. 15, 2022. [cited by applicant]
USPTO Final Office Action issued in U.S. Appl. No. 17/308,920 dated Oct. 6, 2022. [cited by applicant]