US 5140530A
· Guha
· 1992
[cited by applicant]
US 5761381A
· Arci
· 1998
[cited by applicant]
US 5845266A
· Lupien et al.
· 1998
[cited by applicant]
US 5920848A
· Schutzer et al.
· 1999
[cited by applicant]
US 5930780A
· Hughes et al.
· 1999
[cited by applicant]
US 6240399B1
· Frank et al.
· 2001
[cited by applicant]
US 6249783B1
· Crone et al.
· 2001
[cited by applicant]
US 6941287B1
· Vaidyanathan
· 2005
[cited by applicant]
US 7013344B2
· Megiddo
· 2006
[cited by applicant]
US 7246075B1
· Testa
· 2007
[cited by applicant]
US 7370013B1
· Aziz et al.
· 2008
[cited by applicant]
US 7444309B2
· Branke et al.
· 2008
[cited by applicant]
US 8065244B2
· Chen et al.
· 2011
[cited by applicant]
US 8364519B1
· Basu
· 2013
[cited by applicant]
US 8527433B2
· Hodjat et al.
· 2013
[cited by applicant]
US 8639545B2
· Cases
· 2014
[cited by applicant]
US 8768811B2
· Hodjat et al.
· 2014
[cited by applicant]
US 8775341B1
· Commons
· 2014
[cited by applicant]
US 8825560B2
· Hodjat
· 2014
[cited by applicant]
US 8909570B1
· Hodjat et al.
· 2014
[cited by applicant]
US 8918349B2
· Hodjat et al.
· 2014
[cited by applicant]
US 8977581B1
· Hodjat et al.
· 2015
[cited by applicant]
US 9002759B2
· Hodjat et al.
· 2015
[cited by applicant]
US 9015093B1
· Commons
· 2015
[cited by applicant]
US 9053431B1
· Commons
· 2015
[cited by applicant]
US 9230211B1
· Basu
· 2016
[cited by applicant]
US 9466023B1
· Shahrzad et al.
· 2016
[cited by applicant]
US 9489630B2
· Achin et al.
· 2016
[cited by applicant]
US 9605529B1
· Venter
· 2017
[cited by applicant]
US 9678487B1
· Basu
· 2017
[cited by applicant]
US 9785886B1
· Andoni
· 2017
[cited by applicant]
US 20020019844A1
· Kurowski et al.
· 2002
[cited by applicant]
US 20020080169A1
· Diederiks
· 2002
[cited by applicant]
US 20030014379A1
· Saias
· 2003
[cited by applicant]
US 20030149603A1
· Ferguson et al.
· 2003
[cited by applicant]
US 20050033672A1
· Lasry et al.
· 2005
[cited by applicant]
US 20050136480A1
· Brahmachari
· 2005
[cited by applicant]
US 20050256760A1
· Siddhanti
· 2005
[cited by applicant]
US 20060218107A1
· Young
· 2006
[cited by applicant]
US 20060247973A1
· Mueller
· 2006
[cited by applicant]
US 20070094161A1
· Calabro
· 2007
[cited by applicant]
US 20070143759A1
· Ozgur et al.
· 2007
[cited by applicant]
US 20070185990A1
· Ono et al.
· 2007
[cited by applicant]
US 20080071588A1
· Eder
· 2008
[cited by applicant]
US 20080228644A1
· Birkestrand et al.
· 2008
[cited by applicant]
US 20090125370A1
· Blondeau et al.
· 2009
[cited by applicant]
US 20120239517A1
· Blondeau
· 2012
[cited by applicant]
US 20140229362A1
· Hodjat
· 2014
[cited by applicant]
US 20150046181A1
· Adjaoute
· 2015
[cited by applicant]
US 20150242760A1
· Miao
· 2015
[cited by applicant]
US 20150331908A1
· Duffy
· 2015
[cited by applicant]
US 20170103172A1
· Fink
· 2017
[cited by applicant]
US 20170132528A1
· Aslan
· 2017
[cited by applicant]
US 20180053092A1
· Hajizadeh
· 2018
[cited by applicant]
US 20180157972A1
· Hu
· 2018
[cited by applicant]
US 20180365557A1
· Kobayashi
· 2018
[cited by applicant]
US 20190065954A1
· Bittner, Jr.
· 2019
[cited by applicant]
EP 0762294A2
· 1997
[cited by applicant]
EP 2422276
· 2012
[cited by applicant]
EP 2422278
· 2012
[cited by applicant]
JP H0810804
· 1996
[cited by applicant]
JP 08110804
· 1996
[cited by applicant]
JP H09114797A
· 1997
[cited by applicant]
JP 2001325041
· 2001
[cited by applicant]
JP 2003044665
· 2003
[cited by applicant]
JP 2004240671
· 2004
[cited by applicant]
JP 2004302741
· 2004
[cited by applicant]
JP 2005190372A
· 2005
[cited by applicant]
JP 2007052247
· 2007
[cited by applicant]
JP 2007207173
· 2007
[cited by applicant]
JP 2007522547
· 2007
[cited by applicant]
JP 2008129984A
· 2008
[cited by applicant]
WO WO2005073854
· 2005
[cited by applicant]
WO 2010120440A2
· 2010
[cited by applicant]
WO WO2010127039
· 2010
[cited by applicant]
WO WO2010127042
· 2010
[cited by applicant]
WO 2017161233
· 2017
[cited by applicant]
WO 2018211138
· 2018
[cited by applicant]
WO 2018213840
· 2018
[cited by applicant]
WO 2018223822A1
· 2018
[cited by applicant]
WO 2019081705
· 2019
[cited by applicant]
WO WO2019217876
· 2019
[cited by applicant]
Yuan, F., Shou, L., Pei, J., Lin, W., Gong, M., Fu, Y., & Jiang, D. Reinforced MultiTeacher Selection for Knowledge Distillation. Proceedings of the AAAI Conference on Artificial Intelligence, 35(16), pp. 14284-14291. M…
[cited by examiner]
Grushka-Cohen, A framework for optimizing COVID-19 testing policy using a Multi Armed Bandit approach, pp. 1-9 , Jul. 2020.
[cited by examiner]
Lu, Evolutionary optimization with hierarchical surrogates, Swarm and Evolutionary Computation 47. pp. 21-32 (Year: 2019).
[cited by examiner]
Rowland, Model selection methodology in supervised learning with evolutionary computation, BioSystems 72, pp. 187-196. (Year: 2003).
[cited by examiner]
Utech, J., et al., “An evolutionary algorithm for drawing directed graphs,” Proc. of the Int. Conf. on Imaging Science, Systems and Technology, 8 pages, 1998.
[cited by applicant]
Valsalam, V.K., et al., “Using Symmetry and Evolutionary Search to Minimize Sorting Networks,” Journal of Machine Learning Research 14, The University of Texas at Austin, Department of Computer Science, Copyright Sep. 2…
[cited by applicant]
Wissner-Gross, et al., “Causal Entropic Forces,” Physical Review Letters, PRL 110.168702, American Physical Society, Apr. 19, 2013, 5 pages.
[cited by applicant]
Xu, et al., “Inference of Genetic Regulatory Networks With Recurrent Neural Network Models Using Particle Swarm Optimization,” Missouri University of Science and Technology, Oct. 2017, 36 pages, [retrieved on Feb. 14, 2…
[cited by applicant]
Yang et al., “Deep multi-task representation learning: A tensor factorisation approach,” arXiv preprint arXiv: 1605.06391 (2016), 12 pages.
[cited by applicant]
Yang Fan, et al., “Learning to Teach,” ICLR 2018, arXiv: 1805.03643vl, May 9, 2018, 16 pp.
[cited by applicant]
Yin et al., “ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs”, Transactions of the Association for Computational Linguistics, (Dec. 16, 2015), vol. 4, pp. 259-272, XP081355040
[cited by applicant]
Zhang, Loy, “Facial Landmark Detection by Deep Multi-Task Learning,” In Proceedings of ECCV'14, 2014, 15 pages.
[cited by applicant]
Yao & Islam, 2008, “Evolving Artificial Neural Network Ensembles” (Year: 2008).
[cited by applicant]
Oehmcke et al., “Knowledge Sharing for Population Based Neural Network Training,” Springer (2018) (Year: 2018).
[cited by applicant]
Ma et al., A multi-population differential evolution with best-random mutation strategy for large-scale global optimization (Jan. 2020) (Year: 2020).
[cited by applicant]
Extended EPO Search Report, App. No. 19878418.3-1203/3942483 PCT/US2019061198, May 27, 2022.
[cited by applicant]
Elsken Thomas et al., Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution, ICLR 2019, Feb. 26, 2019 (URL: https://arxiv.org/pdf/1804.09081.pdf).
[cited by applicant]
Lu Zhichao et al., NSGA-NET neural architecture search using multi-objective genetic algorithm, Proceedings of the Genetic and Evolutionary Computation Conference, ACMPUB27, NY, NY, Jul. 13, 2019.
[cited by applicant]
International Search Report and Written Opinion issued in App. No. PCT/US2022/032656, mailing date Nov. 4, 2022, 9 pages.
[cited by applicant]
Francon et al., “Effective Reinforcement Learning through Evolutionary Surrogate-Assisted Prescription”, ACM, Jul. 12, 2020, retrieved on [Nov. 10, 2022]. Retrieved from the internet <URL: https://dl.acm.org/doi/pdf/10.…
[cited by applicant]
Miikkulainen et al., “From Prediction to Prescription: Evolutionary Optimization of Non-Pharmaceutical Interventions in the COVID-19 Pandemic”, arxiv.org, Aug. 1, 2020, retrieved on [Nov. 10, 2022]. Retrieved from the i…
[cited by applicant]
“CS 224D: Deep Learning for NLP, Lecture Notes: Part IV”, 12 pp., Spring, 2015, 12 pages.
[cited by applicant]
“CS 224D: Deep Learning for NLP, Lecture Notes: Part V”, 6 pp., Spring, 2015, 6 pages.
[cited by applicant]
“Revisiting Knowledge Distillation: A Teacher-Free Framework,” ICLR 2020, 15 pp.
[cited by applicant]
“CS 224D: Deep Learning for NLP, Lecture Notes: Part III”. 14 pp., Spring, 2016.
[cited by applicant]
Jun. 22, 2011 Office Action in U.S. Appl. No. 12/267,287, 16 pp.
[cited by applicant]
Aug. 1, 2012 Office Action in U.S. Appl. No. 13/443,546, 12 pp.
[cited by applicant]
Ajad Abbasi, et al., “Modeling Teacher-Student Techniques in Deep Neural Networks for Knowledge Distillation,” Computer Science, 2020 International Conference on Machine Vision and Image Processing (MVTP), 2020, 6 pp.
[cited by applicant]
Al-Haj Baddar, “Finding Better Sorting Networks,” Dissertation to Kent State University for PhD, May 2009, 86 pages.
[cited by applicant]
Alex Castrounis, Innoarchtech, “Production vs. Development AI and Machine Learning,” published by O'Reilly Media, Copyright InnoArchiTech LLC 2020, 24 pages.
[cited by applicant]
Alex Castrounis, Innoarchtech, “Advanced Analytics Packages, Frameworks, and Platforms,” 29 pages, published by O'Reilly Media, Copyright InnoArchiTech LLC 2020.
[cited by applicant]
Alex Castrounis, Innoarchtech, “Python vs. R for AI, Machine Learning, and Data Science,” published by O'Reilly Media, Copyright InnoArchiTech LLC 2020, 27 pages.
[cited by applicant]
Anooj, “Clinical decision support system: Risk level prediction of heart disease using weighted fuzzy rules”, 2012 (Year: 2012). 14 pages.
[cited by applicant]
Ares “A soft computing framework for classifying time series based on fuzzy sets of events”, 2015 (Year: 2015). 20 pages.
[cited by applicant]
Atin Sood, et al., “NEUNETS: An Automated Synthesis Engine For Neural Network Design,” arXiv: 1901.06261vl, Jan. 17, 2019, 14 pp.
[cited by applicant]
AU 2010241594—Examination Report dated Oct. 8, 2013, 3 pages.
[cited by applicant]
AU 2010241597—Examination Report dated Nov. 4, 2013, 4 pages.
[cited by applicant]
Barret Zoph, et al., “Neural Architecture Search With Reinforcement Learning,” arXiv: 1611.01578v2, Feb. 15, 2017, 16 pp.
[cited by applicant]
Berg “Fuzzy Classification Using Probability-Based Rule Weighting”, IEEE, 2002 (Year: 2002). 6 pages.
[cited by applicant]
Bilen et al. “Integrated Perception with Recurrent Multi-Task Neural Networks”, NIPS, 2016, pp. 9.
[cited by applicant]
Bilen, et al., “Integrated perception with Reccurrent Multi-Task Neural Networks,”NIPS 2016 ,9 pp.
[cited by applicant]
Bredeche et al., “On-Line , On-Board Evolution of Robot Controllers”, Artifical Evolution: 9th International Conference, Evolution Artificielle , EA, Strasbourg, France, vol. 5975, (20090000), pp. 110-121, URL: https://…
[cited by applicant]
Bredeche, Nicolas, et al., “On-line, on-board evolution of robot controllers,” International Conference on Artificial Evolution, Springer, Berlin, Heidelberg, 13 pages, 2009.
[cited by applicant]
Canadian Examination Report issued in App. No. CA3129731, dated Oct. 24, 2022, 4 pages.
[cited by applicant]
Caruana, R. Multitask learning. In Learning to learn, pp. 95-133. Springer US, 1998, (Year: 1998).
[cited by applicant]
Chenglin Yang, et al., “Snapshot Distillation: Teacher-Student Optimization in One Generation,” arXiv: 1812.00123vl, Dec. 1, 2018, 10 pp.
[cited by applicant]
Cruz-Ramirez et al, 2011, “Selecting the Best Artificial Neural Network Model from a Multi-Objective Differential Evolution Pareto Front” (Year: 2011).
[cited by applicant]
Cruz-Ramirez, 2010, “Memetic pareto differential evolutionary artificial neural networks to determine growth multi-classes in predictive microbiology” (Year: 2010).
[cited by applicant]
Cui et al, Oct. 2018, “Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks” (Year: 2018).
[cited by applicant]
Davarynejad, “Fuzzy Fitness Granulation in Evolutionary Algorithms for complex optimization,” Master of Science Thesis, Ferdowsi Univ. of Mashhad, Jun. 2007, 30 pages.
[cited by applicant]
Deb, et al., “A fast and elitist multiobjective genetic algorithm: NSGA-II,” IEEE Transactions on Evolutionary Computation, 6(2), 2002, pp. 182-197.
[cited by applicant]
Derrick Mwiti, “Research Guide: Model Distillation Techniques For Deep Learning” [online], Nov. 20, 2019 [retrieved on Oct. 5, 2020], 17 pp., Retrieved From the Internet: https://heartbeat.fritz.ai/research-guide-model-…
[cited by applicant]
Devin, Coline, et al., “Learning Modular Neural Network Policies For Multi-Task and Multi-Robot Transfer,” arXiv: 1609.07088vl, Sep. 22, 2016, 8 pp.
[cited by applicant]
Di Gao, et al., “Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks,” arXiv: 2004.0463lvl, Apr. 5, 2020, 8 pp.
[cited by applicant]
Dong, “Multi-Task Learning for Multiple Language Translation,” In Proc. of ACL, pp. 1723-1732, 2015.
[cited by applicant]
E. Meyerson and R. Miikkulainen, “Beyond Shared Hierarchies: Deep Multitask Learning Through Soft Layer Ordering,” ICLR, 14 pages, 2018.
[cited by applicant]
Esparcia-Alcazar et al. “Evolving Recurrent Neural Network Architectures by Genetic Programming”, 1997, pp. 6, https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.40.226&rep=rep1&type=pdf.
[cited by applicant]
Fernando et al., “Pathnet: Evolution channels gradient descent in super neural networks,” arXiv preprint arXiv:1701.08734 (2017), 16 pages.
[cited by applicant]
Freitas, A. “A review of evolutionary algorithms for data mining.” Soft Computing for Knowledge Discovery and Data Mining. Springer US, 2008. 79-111.
[cited by applicant]
Galea, “Iterative vs Simultaneous Fuzzy Rule Induction”, IEEE, 2005 (Year: 2005). 6 pages.
[cited by applicant]
Garcia-Pedrajas et al., “COVNET: A Cooperative Coevolutionary Model for Evolving Artificial Neural Networks”, IEEE Transactions on Neural Networks, vol. 14, No. 3, (2003). (Year: 2003) 22 pages.
[cited by applicant]
Garcia-Pedrajas, et al., “Cooperative Coevolution of Artificial Neural Network Ensembles For Pattern Classification,” IEEE Transactions on Evolutionary Computation, vol. 9, No. 3, 32 pages,Jun. 3, 2005.
[cited by applicant]
Garcia-Pedrajas, et. al., “Cooperative-Coevolution-of-Artificial-Neural-Networks”, 2005, 32 pages.
[cited by applicant]
Garciarena et al., Jul. 2018, “Evolved GANs for generating Pareto set approximations” (Year: 2018).
[cited by applicant]
Gaurav Kumar Nayak, et al., “Zero-Shot Knowledge Distillation in Deep Networks,” arXiv: 1905.08114vl, May 20, 2019, 17 pp.
[cited by applicant]
Gomes et al., “Devising Effective Novelty Search Algorithms: A Comprehensive Empirical Study,” Madrid, Spain, Copyright Jul. 11-15, 2015, ACM, 8 pages.
[cited by applicant]
Gomes et al., “Evolution of Swarm Robotics Systems with Novelty Search,” published in Swarm Intelligence, vol. 7, Issue 2, ANTS Special Issue, Copyright Sep. 2013, pp. 115-144.
[cited by applicant]
Gomes et al., “Progressive Minimal Criteria Novelty Search,” Lisboa, Portugal, in Advances in Artificial Intelligence, Springer-Verlag Berlin Heidelberg, Copyright 2012, pp. 281-290.
[cited by applicant]
Gonzalez, et al., “Evolving Loss Functions With Multivariate Taylor Polynomial Parameterization,” Version 2, published arXiv: 2002.00059v2), Feb. 10, 2020, 8 pages.
[cited by applicant]
Gonzalez, et al., “Evolving Loss Functions With Multivariate Taylor Polynomial Parameterizations,” Version 1, published arXiv: 2002.00059v1, Jan. 31, 2020. 12 pages.
[cited by applicant]
Gonzalez, et al., “Optimizing Loss Functions Through Multivariate Taylor Polynomial Parameterization,” Version 3 (published arXiv:2002.00059v3), Jun. 6, 2020, 13 pages.
[cited by applicant]
Robinet et al (“Inducing High-Level Behaviors from Problem-Solving Traces Using Machine-Learning Tools” 2007) (Year: 2007).
[cited by applicant]
Gopalakrishnan, G. et al., “Optimal Sampling in a Noisy Genetic Algorithm for Risk-Based Remediation Design,” Bridging the gap: meeting the world's water and environmental resources challenges, Proc. World Water Congres…
[cited by applicant]
Gupta et al., “An Overview of methods maintaining Diversity in Generic Algorithms,” International Journal of Emerging Technology and Advanced Engineering, vol. 2, Issue 5, New Delhi, India, May 2012, pp. 56-60.
[cited by applicant]
H. Li, et al., “Visualizing the loss landscape of neural nets,” Advances in Neural Information Processing Systems 31, pp. 6389-6399 (Curran Associates, Inc., 2018), arXiv:1712.09913v3, Nov. 7, 2018.
[cited by applicant]
Haitong Li, “Exploring Knowledge Distillation of Deep Neural Networks for Efficient Hardware Solutions,” CS 230 Final Report, Department of Electrical Engineering, Stanford, CA, 6 pp., 2018.
[cited by applicant]
Hansen, et al., “Completely derandomized self-adaptation in evolution strategies,” Evolutionary Computation, vol. 9, No. 2, pp. 159-195, 2001.
[cited by applicant]
Hanting Chen, et al., “Data-Free Learning of Student Networks,” arXiv: 1904.01186v4, Dec. 31, 2019, 9 pp.
[cited by applicant]
Hodjat et al., “Maintenance of a Long Running Distributed Genetic Programming System for Solving Problems Requiring Big Data”,In: Riolo et al., Genetic Programming Theory and Practice XI, Mar. 10, 2014, Genetic and Evol…
[cited by applicant]
Hodjat et al., “nPool: Massively Distributed Simultaneous Evolution and Cross-Validation in EC-Star”, ppt at GPTP May 2015, 16 pages.
[cited by applicant]
Hornby, “ALPS: The Age-Layered Population Structure for Reducing the Problem of Premature Convergence,” GECCO '06, Seattle, WA, Jul. 2006, 8 pp.
[cited by applicant]
Ilya Loshchilov, “Surrogate-Assisted Evolutionary Algorithms,” https://tel.archives-ouvertes.fr/tel-00823881/document, 2013. 264 pages.
[cited by applicant]
International Preliminary Report on Patentability for PCT App. PCT/US2019/061198,dated Nov. 18, 2020, 24 pp.
[cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2018/064520, dated March 4. 2019. 8 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT App. No. PCT/US19/61198, dated Mar. 11, 2020, 15 pp.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US18/64428, dated Mar. 26, 2019, 12 pp.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US18/65472, dated Mar. 27, 2019, 8 pp.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US18/66610, dated Apr. 15, 2019, 8 pp.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/017175, dated Jun. 5, 2019, 10 pp.
[cited by applicant]
International Search Report mailed Jun. 29, 2010 in PCT/US 10/32841, 3 pages.
[cited by applicant]
Ishibuchi, “Three-objective genetics-based machine learning for linguistic rule extraction”, IEEE, 2005 (Year: 2005). 25 pages.
[cited by applicant]
J.T. Barron, “A General and Adaptive Robust Loss Function,” arXiv: 1701.03077, 2018, 19 pages.
[cited by applicant]
Jaemin Yoo, et al., “Knowledge Extraction With No Observable Data,” 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada, 2019, 10 pp.
[cited by applicant]
Jaimes & Coello, 2005, “MRMOGA: Parallel Evolutionary Multiobjective Optimization using Multiple Resolutions” (Year: 2005).
[cited by applicant]
James Bradbury, et al., “Quasi-Recurrent Neural Networks,” arXiv:1611.01576v2, Nov. 21, 2016, 11 pp.; Retrieved from the Internet: https//arxiv.org/pdf/1611.01576.pdf?fbclid=1wAR3hreOvBGmJZe54-631X49XedcbsQoDYIRu87BcCHE…
[cited by applicant]
Jason Liang, et al., “Evolutionary Neural AutoML for Deep Learning,” GECCO '19, Jul. 13-17, 2019, Prague, Czech Republic (https://arxiv.org/pdf/1902.06827.pdf).
[cited by applicant]
Jee-weon Jung, et al, “Distilling the Knowledge of Specialist Deep Neural Networks in Acoustic Scene Classification,” Detection and Classification of Acoustic Scenes and Events 2019, New York, New York, Oct. 25-26, 2019…
[cited by applicant]
Ji Wang, et al., “Private Model Compression via Knowledge Distillation,” arXiv: 1811.05072vl, Nov. 13, 2018, 9 pp.
[cited by applicant]
Jin & Sendhoff, 2008, “Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies” (Year: 2008).
[cited by applicant]
JP 2010-533295—Office Action, dated Apr. 16, 2013, 3 pp. (English translation). 3 pages.
[cited by applicant]
JP 2012-508660—Office Action dated Apr. 1, 2014, 8 pages.
[cited by applicant]
JP 2012-508663—Office Action dated Apr. 1, 2014, 6 pages.
[cited by applicant]
Jul. 27, 2012 Final Office Action in U.S. Appl. No. 12/267,287, 14 pp.
[cited by applicant]
Julian G. Zilly, Rupesh Kumar Srivastava, Jan ICoutnik, and Jurgen Schniidhuber, “Recurrent Hiehwav Networks.” CoRR abs/1607.03474. 2016 (Arxiv: 1607.03474} 13 pages.
[cited by applicant]
Jun. 16, 2011 Written Opinion from Singapore Patent Office in related application SG 201003127-68 pp.
[cited by applicant]
Jun. 16, 2011 Written Opinion from Singapore Patent Office in related application SG 201093127-6, 9 pp.
[cited by applicant]
K. Janocha and W. M. Czarnecki, “On Loss Functions for Deep Neural Networks in Classification,” arXiv: 1702.05659, 10 pages, 2017.
[cited by applicant]
Kang, Zhuoliang, et al., “Learning With Whom to Share in Multi-Task Feature Learning,” Proceedings of the 28th International Conference on Machine Learning, Bellevue, WA, USA, 2011, 8 pp.
[cited by applicant]
Kenneth O. Stanley and Risto Miikkulainen, “Evolving Neural Networks Through Augmenting Topologies,” Evolutionary Computation, 10(2):99-127, 2002.
[cited by applicant]
Kipfer et al., “UberFlow: A GPU-Based Particle Engine,” Computer Graphics and Visualization, The Eurographics Association, Copyright 2004, 9 pages.
[cited by applicant]
Krcah, P., et al., “Combination of Novelty Search and Fitness-Based Search Applied to Robot Body-Brain Co-Evolution,” Charles University, Prague Czech Republic, in Proceedings of the 13th Czech-Japan Seminar on Data Ana…
[cited by applicant]
Krizhevsky, Alex, et al., “ImageNet Classification with Deep Convolutional Neural Networks”, Advances in Neural Information Processing Systems 25 (NIPS 2012), Lake Tahoe, Nevada, Dec. 3-6, 2012, 9 pp.
[cited by applicant]
Kwedlo, “Learning Decision Rules Using a Distributed Evolutionary Algorithm”, 2002 (Year: 2002). 10 pages.
[cited by applicant]
Lahsasna, “Design of a Fuzzy-based Decision Support System for Coronary Heart Disease Diagnosis”, (Year: 2012). 14 pages.
[cited by applicant]
Lee, Chi-Ho, et al., “Evolutionary ordered neural network with a linked-list encoding scheme,” Proceedings of IEEE International Conference on Evolutionary Computation, IEEE, 5 pages, 1996.
[cited by applicant]
Lehman et al., “Evolving a Diversity of Creatures through Novelty Search and Local Competition,” Proceedings of the Genetic and Evolutionary Computation Conference, ACM, New York, NY, 2011, 8 pages.
[cited by applicant]
Lehman et al., “Abandoning Objectives: Evolution through the Search for Novelty Alone,” Evolutionary Computation journal, MIT Press, Copyright 2011, pp. 189-223.
[cited by applicant]
Lehman et al., “Efficiently Evolving Programs through the Search for Novelty,” Proceedings of the Genetic and Evolutionary Computation Conference, ACM, New York NY, Copyright 2010, 8 pages.
[cited by applicant]
Lehman et al., “Extinction Events Can Accelerate Evolution,” PLoS One, journal.pone.0132886, Aug. 12, 2015, 16 pages.
[cited by applicant]
Lehman et al., “Overcoming Deception in Evolution of Cognitive Behaviors,” University of Texas at Austin, ACM, Jul. 12-16, 2014, 8 pages.
[cited by applicant]
Lehman et al., “Revising the Evolutionary Computation Abstraction: Minimal Criteria Novelty Search,” Proceedings of the Genetic and Evolutionary Computation Conference, ACM, Copyright 2010, 8 pages.
[cited by applicant]
Lehman, Joel, et al., “Exploiting Open-Endedness to Solve Problems Through the Search for Novelty,” ALIFE, 8 pages, 2008.
[cited by applicant]
Pan et al (“A Classification-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Many-objective Optimization” Feb. 2019) (Year: 2019).
[cited by applicant]
Yousefi, N., Georgiopoulos, M. and Anagnostopoulos, G.C., 2015. Multi-task learning with group-specific feature space sharing. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 201…
[cited by applicant]
CS412 KL-divergence, computer science, Illinois university. 2017 (Year: 2017).
[cited by applicant]
U.S. Appl. No. 14/595,991—Final Office Action dated Feb. 27, 2018, 25 pages.
[cited by applicant]
U.S. Appl. No. 14/595,991—Response to Final Office Action dated Feb. 27, 2018, filed May 22, 2018, 32 pages.
[cited by applicant]
U.S. Appl. No. 14/595,991—Response to Final Office Action dated Feb. 27, 2018, filed Jul. 27, 2018, 41 pages.
[cited by applicant]
U.S. Appl. No. 13/184,307—Response dated Jan. 22, 2014, 19 pages.
[cited by applicant]
U.S. Appl. No. 13/184,307—Response dated Jun. 23, 2014, 32 pages.
[cited by applicant]
U.S. Appl. No. 13/358,381—Response dated Oct. 3, 2014, 21 pages.
[cited by applicant]
U.S. Appl. No. 13/358,381—Amendment After Allowance filed Feb. 13, 2015, 20 pages.
[cited by applicant]
U.S. Appl. No. 13/540,507—Response filed Oct. 15, 2014, 20 pages.
[cited by applicant]
U.S. Appl. No. 13/895,238—Office Action dated Jan. 2, 2014, 17 pages.
[cited by applicant]
U.S. Appl. No. 13/943,630—Amendment After Allowance dated Mar. 15, 2016, 16 pages.
[cited by applicant]
U.S. Appl. No. 13/943,630—Notice of Allowance dated Jan. 21, 2016, 28 pages.
[cited by applicant]
U.S. Appl. No. 13/943,630—Notice of Allowance dated May 19, 2016, 2 pages.
[cited by applicant]
U.S. Appl. No. 13/943,630—Office Action dated May 27, 2015, 42 pages.
[cited by applicant]
U.S. Appl. No. 13/943,630—Response to Office Action dated May 27, 2015 filed Sep. 23, 2015, 8 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Amendmend After Allowance dated Dec. 9, 2015, 7 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Final Office Action dated Aug. 4, 2015, 22 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Notice of Allowance dated Nov. 18, 2015, 8 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Office Action dated Mar. 12, 2015, 18 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Resonse to Office Action dated Mar. 12, 2015 filed Jul. 13, 2015, 9 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Response filed Nov. 4, 2015, 12 pp.
[cited by applicant]
U.S. Appl. No. 14/014,063—Office Action dated May 7, 2014, 19 pages.
[cited by applicant]
U.S. Appl. No. 14/539,908—Notice of Allowance dated Mar. 17, 2016, 15 pages.
[cited by applicant]
U.S. Appl. No. 14/539,908—Office Action dated Oct. 1, 2015, 33 pages.
[cited by applicant]
U.S. Appl. No. 14/539,908—Response filed Feb. 1, 2016, 18 pp.
[cited by applicant]
U.S. Appl. No. 14/595,991—Office Action, dated Feb. 27, 2018, 19 pp.
[cited by applicant]
U.S. Appl. No. 14/595,991—Response to Office Action dated May 10, 2017, filed Nov. 10, 2017, 29 pages.
[cited by applicant]
U.S. Appl. No. 15/794,905, titled Evolution of Deep Neural Network Structures, 46 pages, filed Oct. 26, 2017.
[cited by applicant]
U.S. Appl. No. 15/794,913 titled “Cooperative Evolution of Deep Neural Network Structures,” filed Oct. 26, 2017.
[cited by applicant]
U.S. Appl. No. 15/915,028, titled “Asynchronous Evaluation Strategy For Evolution of Deep Neural Networks,” filed Mar. 3, 2018.
[cited by applicant]
U.S. Appl. No. 62/468,224, titled “Asynchronous Evaluation Strategy For Evolution of Deep Neural Networks,” filed Mar. 7, 2017.
[cited by applicant]
U.S. Appl. No. 62/598,409, titled “Evolving Multitask Neural Network Structure,” filed Dec. 13, 2017.
[cited by applicant]
U.S. Appl. No. 62/627,161, titled “From Nodes to Networks: Evolving Recurrent Neural Networks,” filed Feb. 6, 2018.
[cited by applicant]
U.S. Appl. No. 62/627,658, titled “From Nodes to Networks: Evolving Recurrent Neural Networks,” filed Feb. 7, 2018.
[cited by applicant]
Unpublished Article, Modular Universal Reparameterization: Deep Multi-Task Learning Across Diverse Domains, 10 pp.
[cited by applicant]
U.S. Appl. No. 13/184,307—Office Action dated Mar. 21, 2014, 38 pages.
[cited by applicant]
U.S. Appl. No. 13/358,381—Office Action dated Jul. 8, 2014, 30 pages.
[cited by applicant]
U.S. Appl. No. 13/540,507—Office Action dated Sep. 9, 2014, 25 pages.
[cited by applicant]
U.S. Appl. No. 13/945,630—Response to Final Office Action dated Aug. 4, 2015 filed Nov. 4, 2015, 12 pages.
[cited by applicant]
U.S. Appl. No. 14/539,908—Response to Office Action dated Oct. 1, 2015 filed Feb. 1, 2016, 18 pages.
[cited by applicant]
U.S. Appl. No. 14/595,991—Office Action dated May 10, 2017, 32 pages.
[cited by applicant]
U.S. Appl. No. 15/794,905—Non Provisional Application filed Oct. 26, 2017, 60 pages.
[cited by applicant]
U.S. Appl. No. 15/794,913—Non-Provisional Application filed Oct. 28, 2017, 73 pages.
[cited by applicant]
Liang, et al, “Population-Based Training for Loss Function Optimization,” 10 pages, arXiv:2002.04225vl (Feb. 11, 2020).
[cited by applicant]
Lin Wang, et al., “Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlooks,” Journal of Latex Class Files, vol. 14, No. 8, Apr. 2020, 38 pp., arXiv: 2004/05937v3, May 4, 20…
[cited by applicant]
Lopez Haimes et al., “MRMOGA: parallel evolutionary multi-objective optimization using multiple resolutions,” In: Proceedings of IEEE Congress on Evolutionary Computation, 2294-2301, 2005.
[cited by applicant]
Meyerson, Elliot, “Discovering Multi-Purpose Modules Through Deep Multitask Learning,” Dissertation Presented to the Faculty of the Graduate School of The University of Texas at Austin, Dec. 2018, 275 pp.
[cited by applicant]
Miikkulainen et al., Mar. 3, 2017, “Evolving Deep Neural Networks” (Year: 2017).
[cited by applicant]
Miikkulainen et al., Ascend by Evolv: AI-Based Massively Multivariate Conversion Rate Optimization, AI Magazine (2020). 16 pages.
[cited by applicant]
Miikkulainen, Risto, et al., “Evolving Deep Neural Networks,” Mar. 4, 2017, 8 pp.
[cited by applicant]
Minsoo Kang, et al., “Towards Oracle Knowledge Distillation With Neural Architecture Search,” arXiv: 1911.13019vl, Nov. 29, 2019, 9 pp.
[cited by applicant]
Misra et al., “Cross-stitch networks for multi-task learning,” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3994-4003. 2016.
[cited by applicant]
Moriarty etal., “Hierarchical Evolution of Neural Networks”, IEEE (1998). (Year: 1998) 6 pages.
[cited by applicant]
Moriarty, David E., et al., “Forming neural networks through efficient and adaptive coevolution,” Evolutionary Computation 5.4, 28 pages, 1997.
[cited by applicant]
N. Hansen, et al, “Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation,” In Proceedings of IEEE International Conference on Evolutionary Computation, pp. 312-317, I…
[cited by applicant]
N. Hansen, et al., “Evaluating the CMA evolution strategy on multimodal test functions,” International Conference on Parallel Problem Solving from Nature, Springer, pp. 282-291, 2004.
[cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/358,381, dated Nov. 19, 2014, 5 pp.
[cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/540,507, dated Oct. 31, 2014, 9 pp.
[cited by applicant]
O'Reilly et al., “EC-Star: A Massive-Scale, Hub and Spoke, Distributed Genetic Programming System”, In: Riolo etal, Genetic Programming Theory and Practice X, Apr. 19, 2013, Genetic and Evolutionary Computation, pp. 73-…
[cited by applicant]
Pantridge et al., Evolution of Layer Based Neural Networks: Preliminary Report, GECCO '16, pp. 1015-1022, Jul. 2016. (Year: 2016).
[cited by applicant]
Paul Micaelli, et al., “Zero-Shot Knowledge Transfer via Adversarial Belief Matching,” 33rd Conference on Neural Information Processing Systems, (NEURIPS 2019), Vancouver, CA, arXiv: 1905.09768v4, Nov. 25, 2019, 13 pp.
[cited by applicant]
Pouya Bashivan, et al., “Teacher Guided Architecture Search,” arXiv: 1808.01405v3, Sep. 6, 2019, 15pp.
[cited by applicant]
R. Miikkulainen, J. Liang, E. Meyerson, et al., 2017, “Evolving Deep Neural Networks,” CoRR, abs/1703.00548, Mar. 2017. 73 pages.
[cited by applicant]
R. Poli, W. B. Langdon, N. F. Mcphee, J. R. Koza, “Genetic programming: An introductory tutorial and a survey of techniques and applications”, University of Essex, School of Computer Science and Electronic Engineering, …
[cited by applicant]
Raphael Gontijo Lopes, et al., “Data-Free Knowledge Distillation for Deep Neural Networks,” arXiv: 1710.07535v2, Nov. 23, 2017, 8 pp.
[cited by applicant]
Rennie, Annealed dropout training of deep networks, 2014 IEEE Spoken Language Technology Workshop (SLT) 2014 (Year: 2014) 6 pages.
[cited by applicant]
Risto Miikkulaiiien, “Evolving Multitask Neural Network Structure,” The University of Texas at Austin and Sentient Technologies. Inc . Aug. 26. 2013, 22 pages.
[cited by applicant]
Rosenbaum, et al., “Routing Networks: Adaptive Selection of Non-Linear Functions for Multi-Task Learning,” In: Cornell University Library/Computer Science/Machine Learning, Dec. 31, 2017 [online] [retrieved on Mar. 15, …
[cited by applicant]
Ruder, “An Overview of Multi-Task Learning in Deep Neural Networks,” In: Cornell University Library /Computer Science/Machine Learning, Jun. 15, 2017 [online] [retrieved on Mar. 15, 2019], Retrieved from the Internet: h…
[cited by applicant]
Salge, C., et al, “Empowerment—An Introduction,” published in Guided Self-Organization: Inception, Chap 4, University of Hertfordshire, Copyright 2014, pp. 67-114.
[cited by applicant]
Sanchez, “Advocating the Use of Imprecisely Observed Data in Genetic Fuzzy Systems”, IEEE, 2007 (Year: 2007). 12 pages.
[cited by applicant]
Santiago Gonzalez, “Loss Function Optimization Using Evolutionary Computation and Multivariate Function Approximators, Particularly Multivariate Taylor Expansions,” 5 pp., Aug. 22, 2019.
[cited by applicant]
Santiago Gonzalez, et al., “Improved Training Speed, Accuracy, and Data Utilization Through Loss Function Optimization,” Version 1, arXiv: 1905.11528v1, dated May 27, 2019. 10 pages.
[cited by applicant]
Santiago Gonzalez, et al., “Improved Training Speed, Accuracy, and Data Utilization Through Loss Function Optimization,” Version 2, arXiv: 1905.11528v2, dated Feb. 10, 2020. 7 pages.
[cited by applicant]
Santiago Gonzalez, et al., “Improved Training Speed, Accuracy, and Data Utilization Through Loss Function Optimization,” Version 3, arXiv: 1905.11528v3, dated Apr. 27, 2020. 7 pages.
[cited by applicant]
Scott, E. O., et al., “Understanding Simple Asynchronous Evolutionary Algorithms,” Jan. 17-20, 2015, 15 pp.
[cited by applicant]
Secretan, J., et al., “Picbreeder: A Case Study in Collaborative Evolutionary Exploration of Design Space,” Evolutionary Computation journal, MIT Press, Copyright 2011, 30 pages.
[cited by applicant]
Shahrzad, et al., “Tackling the Boolean Multiplexer Function Using a Highly Distributed Genetic Programming System,” in Genetic Programming Theory and Practice XII, 7 pp. , 2015.
[cited by applicant]
Shazeer et al., “Outrageously large neural networks: The sparsely-gated mixiure-of-experts layer,” arXiv preprint arXiv:1701.08538 (2017), 19 pages.
[cited by applicant]
Shi, 2008, “An Empirical Comparison of Evolution and Coevolution for Designing Artificial Neural Network Game Players” (Year: 2008).
[cited by applicant]
Snoek, et al., “Scalable Bayesian Optimization Using Deep Neural Networks”, 2015, 13 pages.
[cited by applicant]
Stanley et al. “Evolving neural networks through augmenting topologies.” Evolutionary computation 10.2, 29 pages (2002) (Year: 2002).
[cited by applicant]
Stanley et al., Why greatness cannot be planned: the myth of the objective, Genet. Program Evolvable Mach.,m 16:559-561, 2015.
[cited by applicant]
Stanley, 2002, “Evolving Neural Networks Through Augmenting Topologies” (Year: 2002).
[cited by applicant]
Stanley, et al., “Why Greatness Cannot Be Planned: The Myth of the Objective,” New York, NY, Springer (2015). 2 pages.
[cited by applicant]
Stanley, Kenneth O., et al., “Real-Time Evolution of Neural Networks in the Nero Video Game,” AAAI, vol. 6, 2006, 4 pp.
[cited by applicant]
Storsveen et al., 2008, “Evolving a 2D Model of an Eye using CPPNs” (Year: 2008).
[cited by applicant]
Supplementary European Search Report dated Oct. 12, 2012 in EP 10770288, 12 pages.
[cited by applicant]
Supplementary European Search Report dated Oct. 9, 2012 in EP 107702871, 11 pages.
[cited by applicant]
Timothy Hospedales, et al., “Meta-Learning in Neural Networks: A Survey,” arXiv: 2004.05439vl, Apr. 11, 2020, 23 pp.
[cited by applicant]
Torresen, “A Dynamic Fitness Function Applied to Improve the Generalisation when Evolving a Signal Processing Hardware Architecture,” Proc. EvoWorkshops 2002, 267-299 (12 pp).
[cited by applicant]
U.S. Appl. No. 13/184,307—Notice of Allowance dated Aug. 4, 2014, 9 pages.
[cited by applicant]
U.S. Appl. No. 13/184,307—Office Action dated Oct. 21, 2013, 16 pages.
[cited by applicant]
Deychakiwsky Normalized Cross-Entropy—Deylemma, github.i io 2020 (Year: 2020).
[cited by applicant]
Pan, L. et al., “A Classification-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Many-objective Optimization”, IEEE, https://ieeexplore.ieee.org/document/8281523, Feb. 1, 2019.
[cited by applicant]
Robinet, V. et al., “Inducing High-Level Behaviors from Problem-Solving Traces Using Machine-Learning Tools”, IEEE, https://ieeexplore.ieee.org/document/4287270, Aug. 13, 2007.
[cited by applicant]
Canadian Examination Report issued in App. No. CA 3,131,688, dated Sep. 12, 2023, 4 pages.
[cited by applicant]
Alejandro Barredo Arrietz, et al., “Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges Toward Responsible AI,” http://arxiv.org/pdf/1910.10045.pdf, 2019.
[cited by applicant]