IP Library › Granted Patent US 12,572,204
Granted Patent B1
US 12,572,204 · App. 18/983,997 · Granted Mar 10, 2026

Switching tracking modes in motion control

Inventor: Xiaoyong Ye (South San Francisco, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,572,204
App. No.
18/983,997
Granted
Mar 10, 2026
Kind
B1
Abstract

A method, system, and computer readable medium for switching between motion tracking mode. The method includes detecting a significant change in confidence level for motion tracking. A change from a first tracking mode to a second tracking mode is initiated when a significant change in confidence level is detected and the change is paused until a saccade or blink is detected. by eye tracking device. After a saccade or blink is detected the tracking mode switches from the first tracking mode to the second tracking mode.

Claims (34)

1 . A method for switching between motion tracking modes, comprising:

detecting a significant change in confidence level for motion tracking;

initiating a change from a first tracking mode to a second tracking mode when the significant change in confidence level is detected; and

pausing the change from the first tracking mode to the second tracking mode until a saccade or a blink is detected by an eye tracking device.

2 . The method of claim 1 further comprising changing from the first tracking mode to the second tracking mode in response to a signal from an eye tracking device indicating the saccade or the blink.

3 . The method of claim 1 wherein the significant change in confidence level includes a number of tracked landmarks and/or features in simultaneous localization and mapping reducing to below a threshold for tracked landmarks and/or features.

4 . The method of claim 1 wherein the significant change in confidence level includes a large negative derivative value for a number of landmarks and/or features in simultaneous localization and mapping.

5 . The method of claim 1 wherein the significant change in confidence level includes an increase in reprojection errors to above a reprojection error threshold.

6 . The method of claim 1 wherein the first tracking mode is a simultaneous localization and mapping scheme and the second tracking mode an inertial based movement tracking scheme.

7 . The method of claim 1 wherein the first tracking mode is an inertial based movement tracking scheme, and the second tracking mode is a simultaneous localization and mapping scheme.

8 . The method of claim 7 wherein the significant change in confidence level includes a number of tracked landmarks and/or features in simultaneous localization and mapping increase to above a threshold for tracked landmarks and/or features.

9 . The method of claim 7 wherein the significant change in confidence level includes sustained small derivative values for a number of landmarks and/or features in simultaneous localization and mapping.

10 . The method of claim 7 wherein the significant change in confidence level includes a decrease in reprojection errors to below a reprojection error threshold.

11 . The method of claim 7 further comprising adjusting a measurement window for the inertial based tracking scheme using acceleration information from the simultaneous localization and mapping scheme after changing the simultaneous localization and mapping scheme tracking mode.

12 . The method of claim 11 , wherein adjusting the window for the inertial based tracking scheme includes shrinking the measurement window when the simultaneous localization and mapping scheme tracking mode detects an increase in speed.

13 . The method of claim 11 wherein adjusting the window for the inertial based tracking scheme includes expanding the measurement window when the simultaneous localization and mapping scheme tracking mode detects a decrease in speed.

14 . The method of claim 1 wherein the detecting a significant change in confidence level for motion tracking includes using machine learning model trained to detect a change in accuracy of simultaneous localization and mapping data from optical tracking data.

15 . The method of claim 1 wherein either the first tracking mode or the second tracking mode is an inertial measurement tracking scheme and wherein the inertial based movement tracking scheme includes an inertial measurement machine learning model trained to predict six degrees of freedom data from inertial data and correct drift.

16 . A system for switching between motion tracking modes comprising:

a processor;

a memory communicatively coupled to the processor;

instructions embodied in the memory that when executed by the processor cause the processor to carry out one or more steps for switching between motion tracking modes comprising:

detecting a significant change in confidence level for motion tracking;

initiating a change from a first tracking mode to a second tracking mode when a significant change in confidence level is detected; and

pausing the change from the first tracking mode to a second tracking mode until a saccade or a blink is detected by an eye tracking device.

17 . The system of claim 16 further comprising an eye tracking device.

18 . The system of claim 17 wherein the eye tracking devices is part of a head mounted display.

19 . The system of claim 17 , wherein the one or more steps for switching between motion tracking modes further comprises changing from the first tracking mode to the second tracking mode in response to a signal from the eye tracking device indicating the saccade or the blink.

20 . The system of claim 16 further comprising one or more cameras and wherein either the first tracking mode or the second tracking mode is a simultaneous localization and mapping scheme.

21 . The system of claim 16 further comprising one or more inertial measurement units and wherein either the first tracking mode or the second tracking mode is an inertial movement tracking scheme.

22 . A non-transitory computer readable medium having instruction embodied therein that when executed by a computer cause the computer to carry out a method for switching between motion tracking mode comprising:

detecting a significant change in confidence level for motion tracking;

initiating a change from a first tracking mode to a second tracking mode when a significant change in confidence level is detected; and

pausing the change from the first tracking mode to a second tracking mode until a saccade or a blink is detected.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2025
From: YE, XIAOYONG
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 072701/0893 →
References Cited (222)
US 6637883B1 · Tengshe et al. · 2003 [cited by applicant]
US 7783061B2 · Zalewski et al. · 2010 [cited by applicant]
US 7809145B2 · Mao · 2010 [cited by applicant]
US 8437513B1 · Derakhshani et al. · 2013 [cited by applicant]
US 8793620B2 · Stafford · 2014 [cited by applicant]
US 8824779B1 · Smyth · 2014 [cited by applicant]
US 8854298B2 · Osman et al. · 2014 [cited by applicant]
US 8907891B2 · Zhu et al. · 2014 [cited by applicant]
US 8947347B2 · Mao et al. · 2015 [cited by applicant]
US 9030425B2 · Stafford · 2015 [cited by applicant]
US 9044675B2 · Stafford et al. · 2015 [cited by applicant]
US 9084938B2 · Osman et al. · 2015 [cited by applicant]
US 9094636B1 · Sanders et al. · 2015 [cited by applicant]
US 9116545B1 · Raffle et al. · 2015 [cited by applicant]
US 9183683B2 · Osman et al. · 2015 [cited by applicant]
US 9373320B1 · Lyon et al. · 2016 [cited by applicant]
US 9665171B1 · Skogö · 2017 [cited by examiner]
US 9773372B2 · Froy et al. · 2017 [cited by applicant]
US 9836816B2 · Cerny · 2017 [cited by applicant]
US 9857871B2 · Mallinson · 2018 [cited by examiner]
US 9922253B2 · Asbun et al. · 2018 [cited by applicant]
US 10032457B1 · Liu et al. · 2018 [cited by applicant]
US 10169846B2 · Stafford et al. · 2019 [cited by applicant]
US 10192528B2 · Young et al. · 2019 [cited by applicant]
US 10372205B2 · Young et al. · 2019 [cited by applicant]
US 10401952B2 · Young et al. · 2019 [cited by applicant]
US 10859830B2 · Norden · 2020 [cited by applicant]
US 11163358B2 · Marks et al. · 2021 [cited by applicant]
US 11181990B2 · Marks et al. · 2021 [cited by applicant]
US 11381888B2 · Krishnamurthy · 2022 [cited by applicant]
US 11501102B2 · Salamon et al. · 2022 [cited by applicant]
US 11615312B2 · Krishnamurthy · 2023 [cited by applicant]
US 12019795B2 · Osman et al. · 2024 [cited by applicant]
US 12145060B2 · Dorn et al. · 2024 [cited by applicant]
US 20030038818A1 · Tidwell · 2003 [cited by applicant]
US 20030194142A1 · Kortum et al. · 2003 [cited by applicant]
US 20040207632A1 · Miller et al. · 2004 [cited by applicant]
US 20060239471A1 · Mao et al. · 2006 [cited by applicant]
US 20070156391A1 · Guenthner et al. · 2007 [cited by applicant]
US 20070171367A1 · Sebastian et al. · 2007 [cited by applicant]
US 20070198982A1 · Bolan et al. · 2007 [cited by applicant]
US 20070271560A1 · Wahlert et al. · 2007 [cited by applicant]
US 20080188777A1 · Bedziouk et al. · 2008 [cited by applicant]
US 20090289895A1 · Nakada et al. · 2009 [cited by applicant]
US 20100056274A1 · Uusitalo et al. · 2010 [cited by applicant]
US 20110085700A1 · Lee · 2011 [cited by applicant]
US 20110298829A1 · Stafford et al. · 2011 [cited by applicant]
US 20120033132A1 · Chen et al. · 2012 [cited by applicant]
US 20120033673A1 · Goel · 2012 [cited by applicant]
US 20120035934A1 · Cunningham · 2012 [cited by applicant]
US 20120052954A1 · Zhu et al. · 2012 [cited by applicant]
US 20120068913A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120075062A1 · Osman et al. · 2012 [cited by applicant]
US 20120086630A1 · Zhu et al. · 2012 [cited by applicant]
US 20120086631A1 · Osman et al. · 2012 [cited by applicant]
US 20120122592A1 · Stafford et al. · 2012 [cited by applicant]
US 20120154277A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120256967A1 · Baldwin et al. · 2012 [cited by applicant]
US 20120272179A1 · Stafford · 2012 [cited by applicant]
US 20120276998A1 · Zhu et al. · 2012 [cited by applicant]
US 20120300061A1 · Osman et al. · 2012 [cited by applicant]
US 20130050432A1 · Perez et al. · 2013 [cited by applicant]
US 20130127980A1 · Haddick et al. · 2013 [cited by applicant]
US 20130135196A1 · Park et al. · 2013 [cited by applicant]
US 20130257751A1 · Stafford · 2013 [cited by applicant]
US 20130267317A1 · Aoki et al. · 2013 [cited by applicant]
US 20130279724A1 · Stafford et al. · 2013 [cited by applicant]
US 20140007097A1 · Chin et al. · 2014 [cited by applicant]
US 20140013437A1 · Anderson et al. · 2014 [cited by applicant]
US 20140043227A1 · Skogöet al. · 2014 [cited by applicant]
US 20140092006A1 · Boelter et al. · 2014 [cited by applicant]
US 20140096002A1 · Dey et al. · 2014 [cited by applicant]
US 20140178043A1 · Kritt et al. · 2014 [cited by applicant]
US 20140247277A1 · Guenter et al. · 2014 [cited by applicant]
US 20140292665A1 · Lathrop et al. · 2014 [cited by applicant]
US 20140300538A1 · Rijnders · 2014 [cited by applicant]
US 20140310256A1 · Olsson et al. · 2014 [cited by applicant]
US 20140313120A1 · Kamhi · 2014 [cited by applicant]
US 20140313198A1 · Keller et al. · 2014 [cited by applicant]
US 20140333535A1 · Stafford · 2014 [cited by applicant]
US 20140347265A1 · Aimone et al. · 2014 [cited by applicant]
US 20140354539A1 · Skogöet al. · 2014 [cited by applicant]
US 20140361971A1 · Sala · 2014 [cited by applicant]
US 20140361976A1 · Osman et al. · 2014 [cited by applicant]
US 20140361977A1 · Stafford et al. · 2014 [cited by applicant]
US 20140362110A1 · Stafford · 2014 [cited by applicant]
US 20150015486A1 · Osman et al. · 2015 [cited by applicant]
US 20150085097A1 · Larsen · 2015 [cited by applicant]
US 20150085250A1 · Larsen · 2015 [cited by applicant]
US 20150085251A1 · Larsen · 2015 [cited by applicant]
US 20150094142A1 · Stafford · 2015 [cited by applicant]
US 20150169053A1 · Bozarth et al. · 2015 [cited by applicant]
US 20150192776A1 · Lee et al. · 2015 [cited by applicant]
US 20150213634A1 · Karmarkar et al. · 2015 [cited by applicant]
US 20150241967A1 · Saripalle et al. · 2015 [cited by applicant]
US 20150254905A1 · Ramsby et al. · 2015 [cited by applicant]
US 20150258431A1 · Stafford et al. · 2015 [cited by applicant]
US 20150258432A1 · Stafford et al. · 2015 [cited by applicant]
US 20150338915A1 · Publicover et al. · 2015 [cited by applicant]
US 20160025971A1 · Crow et al. · 2016 [cited by applicant]
US 20160054837A1 · Stafford · 2016 [cited by applicant]
US 20160085302A1 · Publicover et al. · 2016 [cited by applicant]
US 20160091720A1 · Stafford et al. · 2016 [cited by applicant]
US 20160093105A1 · Rimon et al. · 2016 [cited by applicant]
US 20160116745A1 · Osterhout et al. · 2016 [cited by applicant]
US 20160210173A1 · Bookman et al. · 2016 [cited by applicant]
US 20160212538A1 · Fullam et al. · 2016 [cited by applicant]
US 20160235323A1 · Tadi et al. · 2016 [cited by applicant]
US 20160246652A1 · Herdrich et al. · 2016 [cited by applicant]
US 20160283455A1 · Mardanbegi et al. · 2016 [cited by applicant]
US 20160307297A1 · Akenine-Moller et al. · 2016 [cited by applicant]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170123489A1 · Guenter · 2017 [cited by applicant]
US 20170124760A1 · Murakawa et al. · 2017 [cited by applicant]
US 20170178408A1 · Bavor, Jr. et al. · 2017 [cited by applicant]
US 20170200252A1 · Nguyen et al. · 2017 [cited by applicant]
US 20170200308A1 · Nguyen et al. · 2017 [cited by applicant]
US 20170255259A1 · Mor · 2017 [cited by applicant]
US 20170285735A1 · Young · 2017 [cited by examiner]
US 20170285736A1 · Young · 2017 [cited by examiner]
US 20170287446A1 · Young et al. · 2017 [cited by applicant]
US 20180232451A1 · Lev-Tov et al. · 2018 [cited by applicant]
US 20180275753A1 · Publicover et al. · 2018 [cited by applicant]
US 20180299953A1 · Selker · 2018 [cited by examiner]
US 20190035431A1 · Attorre et al. · 2019 [cited by applicant]
US 20190126821A1 · Ho et al. · 2019 [cited by applicant]
US 20190156794A1 · Young et al. · 2019 [cited by applicant]
US 20190289372A1 · Merler et al. · 2019 [cited by applicant]
US 20190346922A1 · Young et al. · 2019 [cited by applicant]
US 20190361526A1 · Young et al. · 2019 [cited by applicant]
US 20190384381A1 · Stafford et al. · 2019 [cited by applicant]
US 20200104319A1 · Jati et al. · 2020 [cited by applicant]
US 20200160889A1 · Puri et al. · 2020 [cited by applicant]
US 20200242507A1 · Gan et al. · 2020 [cited by applicant]
US 20200301506A1 · Young et al. · 2020 [cited by applicant]
US 20200322377A1 · Lakhdhar et al. · 2020 [cited by applicant]
US 20200349921A1 · Jansen et al. · 2020 [cited by applicant]
US 20210035599A1 · Zhang et al. · 2021 [cited by applicant]
US 20210109590A1 · Gullicksen · 2021 [cited by examiner]
US 20220124242A1 · Gruhlke · 2022 [cited by examiner]
US 20220197381A1 · Young et al. · 2022 [cited by applicant]
US 20220221932A1 · Bathiche et al. · 2022 [cited by applicant]
US 20230071037A1 · Kim et al. · 2023 [cited by applicant]
US 20240111361A1 · Tibbling et al. · 2024 [cited by applicant]
“Lossy compression.” (Mar. 25, 2016). Retrieved from https://en.wikipedia.org/w/index.php?title=Lossy_compression&oldid=71892088. [cited by applicant]
“what is text complexity?” Available at: https://assets.pearsonschool.com/asset_mgr/current/201217/Text_Complexity_G1.pdf Accessed Sep. 26, 2023. [cited by applicant]
“3D Face Pose Estimation from a Monocular Camera” by Qiang Ji and Ruong Hu in Image and Vision Computing, vol. 20, Issue 7, Feb. 20, 2002, pp. 499-511. [cited by applicant]
“An Algorithm for Real-time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement”, by Yoshio Matsumoto and Alexander Zelinsky in FG '00 Proceedings of the Fourth IEEE International Conference on Auto… [cited by applicant]
“Facial feature extraction and pose determination”, by Athanasios Nikolaidis Pattern Recognition, vol. 33 (Jul. 7, 2000) pp. 1783-1791. [cited by applicant]
“Head Pose Estimation in Computer Vision: A Survey” by Erik Murphy, in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, No. 4, Apr. 2009, pp. 607-626. [cited by applicant]
B. Kang, Y. Kim and D. Kim, “Deep Convolutional Neural Network Using Triplets of Faces, Deep Ensemble, and Score-Level Fusion for Face Recognition,” 2017 IEEE Conference on Computer Vision and Pattern Recognition Worksh… [cited by applicant]
Bahill, A. Terry, and Jeffrey S. Kallman. “Predicting Final Eye Position Halfway Through a Saccade.” IEEE Transactions on Biomedical Engineering BME-30.12 (1983): 781-86. Web. [cited by applicant]
Böhme, Martin, Michael Dorr, Christopher Krause, Thomas Martinetz, and Erhardt Barth. “Eye Movement Predictions Enhanced Bysaccade Detection” Brain Inspired Cognitive Systems: Aug. 29-Sep. 1, 2004. Web. [cited by applicant]
Co-Pending U.S. Appl. No. 18/591,424, to Steven Osman, filed Feb. 29, 2024. [cited by applicant]
Di Hu et al., “Deep Multimodal Clustering for Unsupervised Audiovisual Learning”, arXiv:1807.03094v3 [cs. CV] Apr. 19, 2019. [cited by applicant]
Donghuo Zeng et al. “Deep Triplet Neural Networks with Cluster-CCA for Audio-Visual Cross-modal Retrieval” Arxiv.org, Cornell University Library, Dated Aug. 10, 2019, XP081459707. [cited by applicant]
Elad Hoffer and Nir Ailo, “Deep Metric Learning Using Triplet Network”, In: Feragen A., Pelillo M., Loog M. (eds) Similarity-Based Pattern Recognition. SIMBAD 2015. Lecture Notes in Computer Science, vol. 9370. Springer… [cited by applicant]
Extend European Search for European Application No. 21787592.1, dated Mar. 27, 2024. [cited by applicant]
Final Office Action dated Jul. 25, 2017 for U.S. Appl. No. 15/087,629. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/086,953, dated Jan. 4, 2019. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/086,953, dated Mar. 15, 2018. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/087,471, dated May 1, 2018. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/087,629, dated Apr. 5, 2018. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/523,791, dated Jan. 30, 2020. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/848,484, dated Nov. 18, 2022. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/848,512, dated Jul. 27, 2021. [cited by applicant]
Han, P., D. R. Saunders, R. L. Woods, and G. Luo. “Trajectory prediction of saccadic eye movements using a compressed exponential model.” Journal of Vision 13.8 (2013): 27. Web. [cited by applicant]
Hao, Zhu et al. “Deep Audio-Visual Learning: A Survey,” Arxiv.org, Cornell University Library, dated: Jan. 14, 2020, XP081578387. [cited by applicant]
Hochreiter & Schmidhuber. “Long Short-term memory.” Neural Computation 9(8):1735-1780 (1997). [cited by applicant]
Hung Sungeun et al. “CBVMR: Content-Based Video-Music Retrieval Using Soft Intramodal Structure Constraint,” Proceedings of the 2018 ACM on International Conference on Multimedia, Retrieved Jun. 5, 2018, pp. 353-361, XP… [cited by applicant]
International Search Report and Written Opinion dated Jul. 15, 2021 for International Patent Application Number PCT/US2021/026550. [cited by applicant]
International Search Report and Written Opinion dated Jul. 15, 2021 for International Patent Application Number PCT/US2021/026553. [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority for International Patent Application Number PCT/US2021/026554. [cited by applicant]
Japanese Office Action for Japanese Application No. 2022-562558, dated Mar. 14, 2024. [cited by applicant]
Japanese Office Action for Japanese Application No. 2022-562558, dated Oct. 18, 2023. [cited by applicant]
Kyosuke Rinsaka, Yoshinobu Kajikawa, Yasuo Nomura, Study on Mutual Search System for Heterogeneous Media: Music Matching Images, Technical Report of the Institute of Electronics, Information and Communication Engineers,… [cited by applicant]
Non-Final Office Action dated Feb. 23, 2017 for U.S. Appl. No. 15/087,629. [cited by applicant]
Non-Final Office Action dated Nov. 15, 2017 for U.S. Appl. No. 15/087,629. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/086,953, dated Aug. 29, 2018. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/087,471, dated Dec. 31, 2018. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/523,791, dated Sep. 19, 2019. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/533,659, dated Oct. 18, 2019. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/848,484, dated Jun. 24, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/848,499, dated Jun. 27, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/848,512, dated Mar. 15, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/691,656, dated Apr. 13, 2023. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/217,745, dated Sep. 30, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/591,424, dated Dec. 12, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/086,645, dated Oct. 11, 2017. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/086,953, dated Oct. 19, 2017. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/087,471, dated Oct. 10, 2017. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/087,629, dated Feb. 23, 2017. [cited by applicant]
Non-Final/Final Office Action for U.S. Appl. No. 16/235,727, dated Oct. 3, 2019. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/086,645, dated Mar. 13, 2018. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/086,953, dated Mar. 20, 2019. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/087,471, dated Apr. 17, 2019. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/087,629, dated Aug. 15, 2018. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/523,791, dated May 14, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/235,727, dated Apr. 6, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/261,476, dated Feb. 26, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/533,659, dated Jan. 29, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/848,484, dated Feb. 17, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/848,499, dated Nov. 21, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/848,512, dated Mar. 2, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/897,926, dated Jan. 27, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/347,173, dated Nov. 19, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/691,656, dated Jul. 28, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/527,350, dated Jul. 19, 2024. [cited by applicant]
Pagel, Max. “Trajectory-based prediction of saccade landing Points”, Bachelorarbeit am Institut fuer Neuro-und Bioinformatik Technisch Naturwissenschaftliche Fakultaet Universitaet zu Luebeck (2007). [cited by applicant]
Patent Cooperation Treaty; “International Search Report” issued in corresponding PCT Application No. PCT/US16/48736, dated Oct. 28, 2016, 2 pages. [cited by applicant]
Patent Cooperation Treaty; “Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration” issued in corresponding PCT Application No… [cited by applicant]
Patent Cooperation Treaty; “Written Opinion of the International Searching Authority” issued in corresponding PCT Application No. PCT/US16/48736, dated Oct. 28, 2016, 8 pages. [cited by applicant]
Pearson “What is Text Complexity?” Common Core 101, pp. 56-63 Dated Mar. 30, 2022. [cited by applicant]
Rayner et al. “How Psychological Science Informs the Teaching of Reading” American Psychological Society, Psych. Sci. in the Public Interest, vol. 2 No. 2 pp. 31-74. [cited by applicant]
Relja Arandjelovic and Andrew Zisserman, “Objects that Sound”, arXiv:1712.06651v2 [cs.CV] Jul. 25, 2018. [cited by applicant]
Second Notice of Allowance Dated Sep. 28, 2018 for U.S. Appl. No. 15/086,645. [cited by applicant]
Sereno et al. “Measuring Word Recognition in Reading: Eye Movements and Event-related Potentials” Trends in Cognitive Sci. vol. 7 No. 11 pp. 489-493, Nov. 2003. [cited by applicant]
Triesch, Jochen, Brian T. Sullivan, Mary M. Hayhoe, and Dana H. Ballard. “Saccade contingent updating in virtual reality.” Proceedings of the symposium on Eye tracking research & applications-ETRA '02 (2002): n. pag. We… [cited by applicant]
Wikipedia; “Eye tracking”, https://en.wikipedia.org/wiki/Eye-tracking, printed on Feb. 26, 2016, pp. 1-8. [cited by applicant]
Wikipedia; “Optical flow”, https://en.wikipedia.org/wiki/Optical-flow-sensor, printed on Feb. 26, 2016, pp. 1-4. [cited by applicant]
Wikipedia; “Saccade”, https://en.wikipedia.org/wiki/Saccades, printed on Feb. 26, 2016, pp. 1-5. [cited by applicant]
Xiang et al., “Person Re-identification Based on Feature Fusion and Triplet Loss Function” 2018 24th International Conference on Pattern Recognition, Aug. 20-24, 2018, pp. 2477-2482 (Year:2018). [cited by applicant]