IP Library › Granted Patent US 12,462,497
Granted Patent B2
US 12,462,497 · App. 18/411,947 · Granted Nov 4, 2025

Method for simulating natural perception in virtual and augmented reality scenes

Inventors: Terrence Edward McArdle (New York, NY); Benjamin Zeis Newhouse (San Francisco, CA)
Assignee: Dropbox, Inc.
G06T19/006G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,497
App. No.
18/411,947
Granted
Nov 4, 2025
Kind
B2
Abstract

A preferred method for dynamically displaying virtual and augmented reality scenes can include determining input parameters, calculating virtual photometric parameters, and rendering a VAR scene with a set of simulated photometric parameters.

Claims (51)

1 . A computer-implemented method comprising:

detecting a device orientation based on inputs from at least one of a gyroscope, a magnetometer, or an accelerometer;

determining a user's visual state by determining an eye dilation state of a user associated with an augmented reality device;

determining ambient light properties for an environment within which the augmented reality device is being used;

determining photometric parameters based on the device orientation, the eye dilation state of the user, and the ambient light properties;

based on the photometric parameters, applying a fragment shader to modify brightness properties of augmented reality elements to be provided within an augmented reality scene to generate modified augmented reality elements; and

generating the augmented reality scene comprising the modified augmented reality elements.

2 . The computer-implemented method of claim 1 , wherein the ambient light properties are based on a real light source from a real environment within which the augmented reality device is being used.

3 . The computer-implemented method of claim 1 , further comprising:

determining a visual locus associated with the augmented reality scene; and

wherein determining photometric parameters is further based on the visual locus.

4 . The computer-implemented method of claim 1 , wherein determining the device orientation further comprises determining a point that contains a vector through a center of the augmented reality scene as oriented by the inputs from at least one of the gyroscope, the magnetometer, or the accelerometer.

5 . The computer-implemented method of claim 1 , wherein modifying the brightness properties of the augmented reality elements to be provided within the augmented reality scene comprises updating a first set of pixel values for the augmented reality elements to a second set of pixel values for the modified augmented reality elements based on the photometric parameters.

6 . The computer-implemented method of claim 1 , further comprising:

determining updated photometric parameters based on determining an updated device orientation, an updated eye dilation state, or updated ambient light properties; and

generating an updated augmented reality scene based on the updated photometric parameters.

7 . The computer-implemented method of claim 1 , wherein the eye dilation state is measured via optical eye-tracking comprising sensors that track muscle contractions in eyes.

8 . A non-transitory computer readable storage medium comprising instructions that, when executed by at least one processor, cause an augmented reality device to:

detect a device orientation based on inputs from at least one of a gyroscope, a magnetometer, or an accelerometer;

determine a user's visual state by determining an eye dilation state of a user associated with the augmented reality device;

determine ambient light properties for an environment within which the augmented reality device is being used;

generate photometric parameters based on the device orientation, the eye dilation state of the user, and the ambient light properties;

based on the photometric parameters, apply a fragment shader to modify brightness properties of augmented reality elements to be provided within an augmented reality scene to generate modified augmented reality elements; and

generate the augmented reality scene comprising the modified augmented reality elements.

9 . The non-transitory computer readable storage medium of claim 8 , wherein the ambient light properties are based in part on a location of sunlight with respect to the augmented reality device.

10 . The non-transitory computer readable storage medium of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the augmented reality device to:

determine a visual locus associated with the augmented reality scene; and

wherein determining photometric parameters is further based on the visual locus.

11 . The non-transitory computer readable storage medium of claim 8 , wherein determining the device orientation further comprises determining a point that contains a vector through a center of the augmented reality scene as oriented by the inputs from at least one of the gyroscope, the magnetometer, or the accelerometer.

12 . The non-transitory computer readable storage medium of claim 8 , wherein modifying the brightness properties of the augmented reality elements to be provided within the augmented reality scene comprises updating a first set of pixel values for the augmented reality elements to a second set of pixel values for the modified augmented reality elements based on the photometric parameters.

13 . The non-transitory computer readable storage medium of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the augmented reality device to:

determine updated photometric parameters based on determining an updated device orientation, an updated eye dilation state, or updated ambient light properties; and

generate an updated augmented reality scene based on the updated photometric parameters.

14 . The non-transitory computer readable storage medium of claim 8 , wherein the eye dilation state is measured via optical eye-tracking comprising sensors that track eye orientation.

15 . An augmented reality device comprising:

at least one processor; and

at least one non-transitory computer readable medium storing instructions thereon that, when executed by the at least one processor, cause the augmented reality device to:

detect a device orientation based on inputs from at least one of a gyroscope, a magnetometer, or an accelerometer;

determine a user's visual state by determining an eye dilation state of a user associated with the augmented reality device;

determine ambient light properties for an environment within which the augmented reality device is being used;

generate photometric parameters based on the device orientation, the eye dilation state of the user, and the ambient light properties; and

based on the photometric parameters, apply a fragment shader to modify brightness properties of augmented reality elements to be provided within an augmented reality scene.

16 . The augmented reality device of claim 15 , wherein the ambient light properties are based in part on a location and a current time associated with the augmented reality device.

17 . The augmented reality device of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the augmented reality device to:

determine a visual locus associated with the augmented reality scene; and

wherein determining photometric parameters is further based on the visual locus.

18 . The augmented reality device of claim 15 , wherein determining the device orientation further comprises determining a point that contains a vector through a center of the augmented reality scene as oriented by the inputs from at least one of the gyroscope, the magnetometer, or the accelerometer.

19 . The augmented reality device of claim 15 , wherein modifying the brightness properties of the augmented reality elements to be provided within the augmented reality scene comprises updating a first set of pixel values for the augmented reality elements to a second set of pixel values to generate modified augmented reality elements based on the photometric parameters.

20 . The augmented reality device of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the augmented reality device to:

determine updated photometric parameters based on determining an updated device orientation, an updated eye dilation state, or updated ambient light properties; and

generate an updated augmented reality scene based on the updated photometric parameters.

Assignments (1)
SECURITY INTEREST Recorded Dec 12, 2024
From: DROPBOX, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 069604/0611 →
Continuity (5)
Continuation 17807101 · Jun 15, 2022
Continuation 17014965 · Sep 8, 2020
Continuation 14211786 · Mar 14, 2014
Provisional Application 61782392 · Mar 14, 2013
Related Publication 20240153218A1 · May 9, 2024
References Cited (197)
US 5287437A · Deering et al. · 1994 [cited by applicant]
US 5745126A · Jain et al. · 1998 [cited by applicant]
US 5841439A · Pose et al. · 1998 [cited by applicant]
US 5990941A · Jackson et al. · 1999 [cited by applicant]
US 6226669B1 · Huang et al. · 2001 [cited by applicant]
US 6389179B1 · Katayama et al. · 2002 [cited by applicant]
US 6760026B2 · Li et al. · 2004 [cited by applicant]
US 7133068B2 · Fisher et al. · 2006 [cited by applicant]
US 7136090B1 · Mcduffie et al. · 2006 [cited by applicant]
US 7224326B2 · Sefton et al. · 2007 [cited by applicant]
US 7389591B2 · Jaiswal et al. · 2008 [cited by applicant]
US 7424218B2 · Baudisch et al. · 2008 [cited by applicant]
US 7499586B2 · Agarwala et al. · 2009 [cited by applicant]
US 7564469B2 · Cohen · 2009 [cited by applicant]
US 7688346B2 · Richards et al. · 2010 [cited by applicant]
US 8041574B2 · Yano et al. · 2011 [cited by applicant]
US 8144232B2 · Larson et al. · 2012 [cited by applicant]
US 8154634B2 · Fukumoto et al. · 2012 [cited by applicant]
US 8301159B2 · Hamynen et al. · 2012 [cited by applicant]
US 8373573B2 · Chou et al. · 2013 [cited by applicant]
US 8384718B2 · Dahlke et al. · 2013 [cited by applicant]
US 8698902B2 · Kawamoto et al. · 2014 [cited by applicant]
US 8730156B2 · Weising et al. · 2014 [cited by applicant]
US 8907983B2 · McArdle et al. · 2014 [cited by applicant]
US 8953022B2 · McArdle et al. · 2015 [cited by applicant]
US 9017163B2 · Newhouse et al. · 2015 [cited by applicant]
US 9041743B2 · McArdle et al. · 2015 [cited by applicant]
US 9070219B2 · McArdle et al. · 2015 [cited by applicant]
US 9118970B2 · Newhouse et al. · 2015 [cited by applicant]
US 9223408B2 · McArdle et al. · 2015 [cited by applicant]
US 9271025B2 · McArdle et al. · 2016 [cited by applicant]
US 9418479B1 · Worley, III et al. · 2016 [cited by applicant]
US 9626799B2 · McArdle et al. · 2017 [cited by applicant]
US 9723226B2 · Newhouse et al. · 2017 [cited by applicant]
US 10068383B2 · McArdle et al. · 2018 [cited by applicant]
US 10769852B2 · McArdle et al. · 2020 [cited by applicant]
US 20010030693A1 · Fisher et al. · 2001 [cited by applicant]
US 20020140666A1 · Bradski et al. · 2002 [cited by applicant]
US 20020158873A1 · Williamson et al. · 2002 [cited by applicant]
US 20030065668A1 · Sowizral et al. · 2003 [cited by applicant]
US 20030174136A1 · Emberling et al. · 2003 [cited by applicant]
US 20040027330A1 · Bradski et al. · 2004 [cited by applicant]
US 20050219239A1 · Mashitani et al. · 2005 [cited by applicant]
US 20050232507A1 · Zimmer et al. · 2005 [cited by applicant]
US 20050286125A1 · Sundstrom et al. · 2005 [cited by applicant]
US 20050289590A1 · Cheok et al. · 2005 [cited by applicant]
US 20060050140A1 · Shin et al. · 2006 [cited by applicant]
US 20060082692A1 · Kamijima et al. · 2006 [cited by applicant]
US 20060232665A1 · Schowengerdt et al. · 2006 [cited by applicant]
US 20060239525A1 · Katayama et al. · 2006 [cited by applicant]
US 20070025723A1 · Baudisch et al. · 2007 [cited by applicant]
US 20070035562A1 · Azuma et al. · 2007 [cited by applicant]
US 20070076016A1 · Agarwala et al. · 2007 [cited by applicant]
US 20070103543A1 · Anderson et al. · 2007 [cited by applicant]
US 20070168418A1 · Ratnakar et al. · 2007 [cited by applicant]
US 20070236493A1 · Horiuchi et al. · 2007 [cited by applicant]
US 20080042973A1 · Zhao et al. · 2008 [cited by applicant]
US 20080071559A1 · Arrasvuori et al. · 2008 [cited by applicant]
US 20080082692A1 · Yano et al. · 2008 [cited by applicant]
US 20080094417A1 · Cohen et al. · 2008 [cited by applicant]
US 20080194323A1 · Merkli et al. · 2008 [cited by applicant]
US 20080266326A1 · Porwal et al. · 2008 [cited by applicant]
US 20080280676A1 · Distanik et al. · 2008 [cited by applicant]
US 20080292131A1 · Takemoto et al. · 2008 [cited by applicant]
US 20080309508A1 · Harmon et al. · 2008 [cited by applicant]
US 20080317376A1 · Kasperkiewicz · 2008 [cited by applicant]
US 20080320422A1 · Cazeaux et al. · 2008 [cited by applicant]
US 20090140887A1 · Breed et al. · 2009 [cited by applicant]
US 20090237564A1 · Kikinis et al. · 2009 [cited by applicant]
US 20090240431A1 · Chau et al. · 2009 [cited by applicant]
US 20090244097A1 · Estevez et al. · 2009 [cited by applicant]
US 20090284610A1 · Fukumoto et al. · 2009 [cited by applicant]
US 20090292774A1 · Box et al. · 2009 [cited by applicant]
US 20100001980A1 · Kim et al. · 2010 [cited by applicant]
US 20100002122A1 · Larson et al. · 2010 [cited by applicant]
US 20100007657A1 · Rurin et al. · 2010 [cited by applicant]
US 20100066763A1 · Macdougall et al. · 2010 [cited by applicant]
US 20100085356A1 · Nie et al. · 2010 [cited by applicant]
US 20100092079A1 · Aller et al. · 2010 [cited by applicant]
US 20100125816A1 · Bezos et al. · 2010 [cited by applicant]
US 20100161658A1 · Hamynen et al. · 2010 [cited by applicant]
US 20100169837A1 · Hyndman et al. · 2010 [cited by applicant]
US 20100171758A1 · Maassel et al. · 2010 [cited by applicant]
US 20100188397A1 · Tsai et al. · 2010 [cited by applicant]
US 20100208033A1 · Edge et al. · 2010 [cited by applicant]
US 20100214111A1 · Schuler et al. · 2010 [cited by applicant]
US 20100228633A1 · Guimaraes et al. · 2010 [cited by applicant]
US 20100287485A1 · Bertolami et al. · 2010 [cited by applicant]
US 20110041060A1 · Chien et al. · 2011 [cited by applicant]
US 20110069229A1 · Lord et al. · 2011 [cited by applicant]
US 20110090252A1 · Yoon et al. · 2011 [cited by applicant]
US 20110164116A1 · Gay et al. · 2011 [cited by applicant]
US 20110201362A1 · Bregman-Amitai et al. · 2011 [cited by applicant]
US 20110213861A1 · Fanelli et al. · 2011 [cited by applicant]
US 20110216060A1 · Weising · 2011 [cited by examiner]
US 20110234631A1 · Kim et al. · 2011 [cited by applicant]
US 20110242134A1 · Miller et al. · 2011 [cited by applicant]
US 20110248987A1 · Mitchell et al. · 2011 [cited by applicant]
US 20110273451A1 · Salemann et al. · 2011 [cited by applicant]
US 20120026166A1 · Takeda et al. · 2012 [cited by applicant]
US 20120105440A1 · Lieberman et al. · 2012 [cited by applicant]
US 20120105483A1 · Fedorovskaya et al. · 2012 [cited by applicant]
US 20120113264A1 · Moshrefi et al. · 2012 [cited by applicant]
US 20120194553A1 · Osterhout et al. · 2012 [cited by applicant]
US 20120212405A1 · Newhouse et al. · 2012 [cited by applicant]
US 20120214590A1 · Newhouse et al. · 2012 [cited by applicant]
US 20120246223A1 · Newhouse et al. · 2012 [cited by applicant]
US 20120293407A1 · Lee · 2012 [cited by examiner]
US 20130038609A1 · Tsai et al. · 2013 [cited by applicant]
US 20130124326A1 · Huang et al. · 2013 [cited by applicant]
US 20130215148A1 · Antonyuk et al. · 2013 [cited by applicant]
US 20140019166A1 · Swanson et al. · 2014 [cited by applicant]
US 20140098137A1 · Fein · 2014 [cited by examiner]
US 20150070347A1 · Hofmann et al. · 2015 [cited by applicant]
US 20150201133A1 · Newhouse et al. · 2015 [cited by applicant]
US 20150243085A1 · Newhouse et al. · 2015 [cited by applicant]
US 20150356788A1 · Abe et al. · 2015 [cited by applicant]
US 20160262608A1 · Krueger · 2016 [cited by applicant]
US 20170010469A1 · Samec et al. · 2017 [cited by applicant]
US 20170193709A1 · Mcardle et al. · 2017 [cited by applicant]
US 20170366758A1 · Newhouse et al. · 2017 [cited by applicant]
WO WO2008107553A2 · 2008 [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/539,076 mailed on Oct. 18, 2024, 8 pages. [cited by applicant]
Corrected Notice of Allowance for U.S. Appl. No. 14/582,017 mailed on Nov. 6, 2015, 4 pages. [cited by applicant]
Duckett J., “Beginning HTML, XHTML, CSS, and JavaScript®,” Dec. 30, 2009, Wrox, p. 234. [cited by applicant]
Easypano Holdings Inc, “Panoweaver 6.00 User Manual,” downloaded from http://web.archive.org/web/20090711113513/ http://www.easypano.com/download/doc/pw600-manual.pdf with an archive.org verified date of Jul. 11, 2009, … [cited by applicant]
Fauster L., et al., “Stereoscopic Techniques in Computer Graphics,” 2007, 10 pages. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/014,965, mailed Oct. 28, 2021, 26 pages. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/205,682, mailed Jan. 9, 2023, 49 pages. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/807,101, mailed May 18, 2023, 29 pages. [cited by applicant]
Hewlett Packard, “HP Photosmart R717 Digital Camera with HP Instant Share User's Manual,” Copyright 2005 Hewlett-Packard Development Company, downloaded from http://h10032.www1.hp.com/ctg/Manuals/c00298985.pdf on May 3,… [cited by applicant]
Hildenbrand J., “Yelp 2.0 brings Monocle and Checkins to its Android Client,” located at http://www.androidcentral.com/yelp-20-brings-monocle-andcheckins-its-android-client, Jul. 5, 2010, 10 pages. [cited by applicant]
Hwang J., et al., “Hand-held Virtual Reality: A Feasibility Study,” Proceedings of the ACM Symposium on Virtual Reality Software and Technology, ACM, 2006, pp. 356-363. [cited by applicant]
Kanbara M., et al., “A Stereoscopic Video See-through Augmented Reality System Based on Real-time Vision-based Registration,” Virtual Reality, 2000 Proceedings IEEE, 2000, 8 pages. [cited by applicant]
“Motion Control Simulation Applet,” available at http://ir.exp.sis.pitt.edu/res2/data/is/groups/, archived on Sep. 1, 2006, Retrieved from http://web.archive.org/web/20060901110520/ and http://ir.exp.sis.pitt.edu/res2/d… [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 13/302,977 mailed on Aug. 14, 2014, 6 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 13/302,977 mailed on May 15, 2013, 20 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 14/211,786 mailed on Oct. 23, 2015, 24 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 16/586,412, mailed May 7, 2020, 7 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/014,965, mailed Jul. 15, 2021, 20 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/138,562, mailed Nov. 17, 2021, 7 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/205,682, mailed Aug. 18, 2022, 41 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/807,101 mailed Feb. 17, 2023, 32 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 14/628,113, mailed Dec. 9, 2020, 9 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 16/586,412, mailed Sep. 25, 2020, 9 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/014,965, mailed Apr. 4, 2022, 2 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/014,965, mailed Mar. 22, 2022, 9 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/138,562, mailed May 26, 2022, 2 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/269,231 mailed on Aug. 1, 2014, 13 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/302,964 mailed on Mar. 30, 2015, 8 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/302,977 mailed on Jan. 13, 2015, 6 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/302,977 mailed on May 5, 2014, 10 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/347,273 mailed on Oct. 20, 2014, 5 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/410,176 mailed on Mar. 3, 2015, 5 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/411,347 mailed on May 19, 2015, 7 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 14/044,287 mailed on Dec. 6, 2016, 5 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 14/533,000 mailed on Aug. 12, 2015, 12 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 14/582,017 mailed on Oct. 14, 2015, 6 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 14/668,915 mailed on Mar. 21, 2017, 8 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/463,926 mailed on May 23, 2018, 8 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/138,562, mailed Mar. 4, 2022, 9 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/205,682, mailed Aug. 8, 2023, 9 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/807,101 mailed Oct. 25, 2023, 19 pages. [cited by applicant]
Notice Of Allowance for U.S. Appl. No. 15/640,858 mailed on Jun. 20, 2019, 9 pages. [cited by applicant]
Office Action for U.S. Appl. No. 15/640,858 mailed on Feb. 26, 2019, 12 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/269,231 mailed on Nov. 8, 2013, 34 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/302,964 mailed on Aug. 14, 2014, 12 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/302,964 mailed on Feb. 11, 2014, 17 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/302,964 mailed on Feb. 6, 2015, 19 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/302,964 mailed on Jun. 10, 2013, 26 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/347,273 mailed on Apr. 23, 2014, 13 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/410,176 mailed on Aug. 22, 2014, 13 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/410,176 mailed on Jun. 21, 2013, 15 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/410,176 mailed on Mar. 20, 2014, 19 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/411,347 mailed on Feb. 10, 2014, 13 pages. [cited by applicant]
Office Action for U.S. Appl. No. 13/411,347 mailed on Oct. 21, 2014, 14 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/044,287 mailed on Aug. 19, 2015, 21 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/044,287 mailed on Feb. 5, 2016, 16 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/044,287 mailed on Jun. 30, 2016, 15 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/211,786 mailed on Jan. 5, 2017, 30 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/211,786 mailed on Jun. 1, 2016, 29 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/211,786 mailed on May 3, 2017, 35 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/211,786 mailed on Jul. 17, 2019, 32 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/533,000 mailed on Jun. 11, 2015, 24 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/533,000 mailed on Mar. 5, 2015, 20 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/582,017 mailed on Jun. 19, 2015, 8 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/628,113 mailed on Apr. 13, 2017, 26 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/628,113 mailed on May 19, 2016, 28 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/628,113 mailed on May 31, 2018, 26 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/628,113 mailed on Oct. 18, 2017, 28 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/628,113 mailed on Sep. 23, 2016, 37 pages. [cited by applicant]
Office Action for U.S. Appl. No. 14/668,915 mailed on Sep. 29, 2016, 6 pages. [cited by applicant]
Office Action for U.S. Appl. No. 15/463,926 mailed on Oct. 6, 2017, 11 pages. [cited by applicant]
Office Action for U.S. Appl. No. 15/640,858 mailed on Aug. 16, 2018, 6 pages. [cited by applicant]
Parr B., “Easter Egg: Yelp Is the iPhone's First Augmented Reality App,” located at https://web.archive.org/web/20090829094113/ http://mashable.com/2009/08/2007/yelp-aug . . . , Aug. 27, 2009, 10 pages. [cited by applicant]
“Rotations and Euler angles,” Archived on Apr. 6, 2008, retrieved from https://web.archive.org/web/20080406234538/ http://www.easyspin.org/documentation/eulerangles.html on Nov. 5, 2013, 4 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 18/539,076 mailed Aug. 1, 2024, 21 pages. [cited by applicant]