Granted Patent
B2
US 12,293,440 · App. 18/422,404 · Granted May 6, 2025
Recommendation engine for combining images and graphics of sports content based on artificial intelligence generated game metrics
Inventors:
Patrick Joseph Lucey (Chicago, IL); Anthony Borsumato (Cambridge, GB); Kevin Allinson (Yarm, GB); Christian Marko (Graz, AT)
Assignee:
STATS LLC
View Patent ↗
Loading inventors, assignments & file history…
Abstract
A computing system receives data for a game. The data includes at least one of tracking data or event data. Based on the data for the game, the computing system determines that an event has occurred within the game. Based on the determining, the computing system generates a graphic responsive to the event. The graphic includes insights related to the event. The computing system recommends an image relevant to the event based on metatags associated with the event. The computing system generates a visual element by merging the image and the graphic.
Claims (52)
1. A method comprising:
receiving, by a computing system, video data for a game;
determining, by the computing system, tracking data based on the video data;
determining, by the computing system and using a prediction model, an artificial intelligence metric based on the tracking data;
generating, by the computing system, a graphic responsive to determining the artificial intelligence metric, wherein the graphic comprises the artificial intelligence metric and one or more artificial intelligence contextual features associated with a plurality of metadata tags;
recommending, by the computing system, an image including at least one metadata tag of the plurality of metadata tags responsive to generating the graphic; and
generating, by the computing system, a visual element by merging the image with the graphic.
2. The method of claim 1 , further comprising:
recommending, by the computing system and using the prediction model, an insight to be included in the visual element.
3. The method of claim 2 , wherein the insight includes a prediction of an outcome of the game.
4. The method of claim 1 , wherein the artificial intelligence metric is a single number or a combination of numbers.
5. The method of claim 1 , wherein recommending, by the computing system, the image including at least one metadata tag of the plurality of metadata tags, comprises:
generating a list of a plurality of images, wherein each image of the plurality of images includes at least one metadata tag of the plurality of metadata tags; and
selecting the recommended image from the plurality of images.
6. The method of claim 1 , wherein the recommended image includes a probability of a win, an expected goal value, an expected possession value, or a visual of a possession sequence.
7. The method of claim 1 , further comprising:
generating, by the computing system and using the prediction model, insights related to the artificial intelligence metric.
8. A non-transitory computer readable medium comprising instructions that, when executed by one or more processors, cause a computing system to:
receive, by the computing system, video data for a game;
determine, by the computing system, tracking data based on the video data;
determine, by the computing system and using a prediction model, an artificial intelligence metric based on the tracking data;
generate, by the computing system, a graphic responsive to determining the artificial intelligence metric, wherein the graphic comprises the artificial intelligence metric and one or more artificial intelligence contextual features associated with a plurality of metadata tags;
recommend, by the computing system, an image including at least one metadata tag of the plurality of metadata tags responsive to generating the graphic; and
generate, by the computing system, a visual element by merging the image with the graphic.
9. The non-transitory computer readable medium of claim 8 , wherein execution of the instructions further causes the computing system to:
recommend, by the computing system and using the prediction model, an insight to be included in the visual element.
10. The non-transitory computer readable medium of claim 9 , wherein the insight includes a prediction of an outcome of the game.
11. The non-transitory computer readable medium of claim 8 , wherein the artificial intelligence metric is a single number or a combination of numbers.
12. The non-transitory computer readable medium of claim 8 , wherein recommending, by the computing system, the image including at least one metadata tag of the plurality of metadata tags, comprises:
generating a list of a plurality of images, wherein each image of the plurality of images includes at least one metadata tag of the plurality of metadata tags; and
selecting the recommended image from the plurality of images.
13. The non-transitory computer readable medium of claim 8 , wherein the recommended image includes a probability of a win, an expected goal value, an expected possession value, or a visual of a possession sequence.
14. The non-transitory computer readable medium of claim 8 , wherein execution of the instructions further causes the computing system to:
generate, by the computing system and using the prediction model, insights related to the artificial intelligence metric.
15. A system, comprising:
a processor; and
a memory having programming instructions stored thereon, which, when executed by the processor, causes the system to perform operations comprising:
receiving video data for a game;
determining tracking data based on the video data;
determining, using a prediction model, an artificial intelligence metric based on the tracking data;
generating, a graphic responsive to determining the artificial intelligence metric, wherein the graphic comprises the artificial intelligence metric and one or more artificial intelligence contextual features associated with a plurality of metadata tags;
recommending an image including at least one metadata tag of the plurality of metadata tags responsive to generating the graphic; and
generating a visual element by merging the image with the graphic.
16. The system of claim 15 , wherein the operations further comprise:
recommending, using the prediction model, an insight to be included in the visual element.
17. The system of claim 16 , wherein the insight includes a prediction of an outcome of the game.
18. The system of claim 15 , wherein recommending the image including at least one metadata tag of the plurality of metadata tags, comprises:
generating a list of a plurality of images, wherein each image of the plurality of images includes at least one metadata tag of the plurality of metadata tags; and
selecting the recommended image from the plurality of images.
19. The system of claim 15 , wherein the recommended image includes a probability of a win, an expected goal value, an expected possession value, or a visual of a possession sequence.
20. The system of claim 15 , wherein the operations further comprise:
generating, using the prediction model, insights related to the artificial intelligence metric.
Assignments (2)
SECURITY INTEREST
Recorded Apr 14, 2026
From: STATS LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 075390/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST
Recorded Jan 26, 2024
From: LUCEY, PATRICK JOSEPH; BORSUMATO, ANTHONY; ALLINSON, KEVIN; MARKO, CHRISTIAN
To: STATS LLC
Reel/Frame 066264/0631 →
Continuity (3)
Provisional Application
63261971
· Oct 1, 2021
References Cited (297)
US 6616529B1
· Qian et al.
· 2003
[cited by applicant]
US 6710713B1
· Russo
· 2004
[cited by applicant]
US 6751343B1
· Ferrell et al.
· 2004
[cited by applicant]
US 9342785B2
· Lucey et al.
· 2016
[cited by applicant]
US 9442933B2
· Tzoukermann et al.
· 2016
[cited by applicant]
US 20020165697A1
· Min
· 2002
[cited by applicant]
US 20040148278A1
· Milo et al.
· 2004
[cited by applicant]
US 20050143198A1
· Charge
· 2005
[cited by applicant]
US 20060149674A1
· Cook et al.
· 2006
[cited by applicant]
US 20070293289A1
· Loeb
· 2007
[cited by applicant]
US 20080281444A1
· Krieger et al.
· 2008
[cited by applicant]
US 20090186679A1
· Irvine et al.
· 2009
[cited by applicant]
US 20090203447A2
· Hansen et al.
· 2009
[cited by applicant]
US 20100129780A1
· Homsi et al.
· 2010
[cited by applicant]
US 20100184495A1
· Levy et al.
· 2010
[cited by applicant]
US 20110173235A1
· Aman et al.
· 2011
[cited by applicant]
US 20130104870A1
· Rizzo et al.
· 2013
[cited by applicant]
US 20130225271A1
· Amaitis
· 2013
[cited by applicant]
US 20130267328A1
· Heisler et al.
· 2013
[cited by applicant]
US 20140236331A1
· Lehmann et al.
· 2014
[cited by applicant]
US 20140274245A1
· Stickel
· 2014
[cited by applicant]
US 20140302914A1
· Weinstein et al.
· 2014
[cited by applicant]
US 20150131845A1
· Forouhar et al.
· 2015
[cited by applicant]
US 20150248917A1
· Chang et al.
· 2015
[cited by applicant]
US 20160096071A1
· Ianni et al.
· 2016
[cited by applicant]
US 20160182415A1
· Ames et al.
· 2016
[cited by applicant]
US 20160220878A1
· Devathi
· 2016
[cited by applicant]
US 20170072321A1
· Thompson et al.
· 2017
[cited by applicant]
US 20170109015A1
· Krasadakis
· 2017
[cited by applicant]
US 20170132821A1
· Valliani et al.
· 2017
[cited by applicant]
US 20170330029A1
· Turcot et al.
· 2017
[cited by applicant]
US 20190221072A1
· Litman
· 2019
[cited by applicant]
US 20200170549A1
· Baykaner et al.
· 2020
[cited by applicant]
US 20210056458A1
· Savova et al.
· 2021
[cited by applicant]
US 20210134124A1
· Srinivasan
· 2021
[cited by applicant]
US 20220253679A1
· Power et al.
· 2022
[cited by applicant]
US 20220270004A1
· Ruiz et al.
· 2022
[cited by applicant]
US 20220284311A1
· Haynes et al.
· 2022
[cited by applicant]
US 20230106936A1
· Dinsdale et al.
· 2023
[cited by applicant]
CN 1386241A
· 2002
[cited by applicant]
CN 1708697A
· 2005
[cited by applicant]
CN 102819749A
· 2012
[cited by applicant]
CN 105833502A
· 2016
[cited by applicant]
KR 100986647B1
· 2010
[cited by applicant]
WO 0122270A2
· 2001
[cited by applicant]
WO 2013166456A2
· 2013
[cited by applicant]
WO 2014008134A1
· 2014
[cited by applicant]
WO 2015076682A1
· 2015
[cited by applicant]
WO 2017031356A1
· 2017
[cited by applicant]
WO 2017161167A1
· 2017
[cited by applicant]
WO 2020010040A1
· 2020
[cited by applicant]
Abdullah, M.R., et al., “Intelligent Prediction of Soccer Technical Skill on Youth Soccer Player's Relative Performance Using Multivariate Analysis and Artificial Neural Network Techniques,” International Journal on Adv…
[cited by applicant]
Abreu, P.H., et al., “Improving a Simulated Soccer Team's Performance Through a Memory-based Collaborative Filtering Approach,” Applied Soft Computing 23, 2014, pp. 180-193.
[cited by applicant]
Acuna, D., “Unsupervised Modeling of the Movement of Basketball Players Using a Deep Generative Model,” 31st Conference on Neural Information Processing Systems, 2017, 11 pages.
[cited by applicant]
Akhter, I., et al., “Bilinear Spatiotemporal Basis Models”, ACM Transactions on Graphics, vol. 31, No. 2, Article 17, Apr. 2012, 12 pages.
[cited by applicant]
Alahi, A., et al., “Social LSTM: Human Trajectory Prediction in Crowded Spaces”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 11 Pages.
[cited by applicant]
Alcorn, M.A., “(batter|pitcher) 2vec: Statistic-free Talent Modeling with Neural Player Embeddings”, MIT Sloan Sports Analytics Conference, 2018.
[cited by applicant]
Al-Shboul, A., et al., “Automated Player Selection for Sports Team using Competitive Neural Networks”, International Journal of Advanced Computer Science and Applications (IJACSA), vol. 8, No. 8, 2017, pp. 457-460.
[cited by applicant]
Anderson, C., et al., “The Numbers Game: Why Everything You Know About Soccer is Wrong”, 2013, Penguin Books.
[cited by applicant]
Arabzad, S.M., et al., Football Match Results Prediction Using Artificial Neural Networks; the Case of Iran Pro League, Journal Applied Research on Industrial Engineering, vol. 1(3) Oct. 9, 2014, pp. 159-179.
[cited by applicant]
Asif, M and McHale, I.G., “In-Play forecasting of win probability in One-Day International cricket: A dynamic logistic regression model”, International Journal of Forecasting 32, 2016, pp. 34-43.
[cited by applicant]
Bengio, Y., et al., “A Neural Probabilistic Language Model”, Journal of Machine Learning Research, vol. 3, 2003, pp. 1137-1155.
[cited by applicant]
Beuoy, “Updated NBA Win Probability Calculator”, InPredictable, http://www.inpredictable.com/2015/02/updated-nba-win-probability-calculator.html, dated Feb. 6, 2015, 4 pages.
[cited by applicant]
Bialkowski, A., et al., “Large-Scale Analysis of Soccer Matches using Spatiotemporal Tracking Data”, IEEE International Conference on Data Mining, 2014, 6 pages.
[cited by applicant]
Bishop, “Mixture Density Networks”, Neural Computing Research Group Report, NCRG/94/004, Dated Feb. 1994, 26 Pages.
[cited by applicant]
Blaikie, A.D., et al., “NFL & NCAA Football Prediction using Artificial Neural network,” Proceedings of the Midstates Conference for Undergraduate Research in Computer Science and Mathematics, 2011, 8 pages.
[cited by applicant]
Blei, D.M et al., “Latent Dirichlet Allocation”, Journal of Machine Learning Research, vol. 3, 2003, pp. 993-1022.
[cited by applicant]
Boice, “How Our Club Soccer Projections Work”, Five ThirtyEight, https://fivethirtyeight.com/features/how-our-club -soccer-projections-work/, Dated Jan. 19, 2017, 6 pages.
[cited by applicant]
Boshnakov, G. et al., “A Bivariate Weibull Count Model For Forecasting Association Football Scores”, dated Sep. 9, 2016, 13 pages.
[cited by applicant]
Bowman, S.M., et al., “Generating Sentences from a Continuous Space”, arXiv preprint arXiv: 1511.06349, May 12, 2016, 12 Pages.
[cited by applicant]
Butt, A.A and Collins, R.T., “Multi-target Tracking by Lagrangian Relaxation to Min-Cost Network Flow”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, 8 pages.
[cited by applicant]
Carney, M., et al., Predicting Probability Distributions for Surf Height Using an Ensemble of Mixture Density Networks, Proceedings of the 22nd International Conference on Machine Learning, 2005, 8 pages.
[cited by applicant]
Casal, C.A., et al., “Analysis of Corner Kick Success in Elite Football”, International Journal of Performance Analysis in Sport, 2015, vol. 15, pp. 430-451.
[cited by applicant]
Cervone, D., et al., “A Multiresolution Stochastic Process Model for Predicting Basketball Possession Outcomes,” Journal of American Statistical Association 111.514, 2016, pp. 585-599.
[cited by applicant]
Cervone, D., et al., “Pointwise: Predicting Points and Valuing Decisions in Real Time with NBA Optical Tracking Data”, 8th Annual MIT Sloan Sports Analytics Conference, Feb. 28-Mar. 1, 2014, 9 pages.
[cited by applicant]
Chandler, G. and Stevens, G., “An Exploratory Study of Minor League Baseball Statistics,” Journal of Quantitative Analysis in Sports 2012, 37 pages.
[cited by applicant]
Charles, J., et al., “Personalizing Human Video Pose Estimation”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 14 Pages.
[cited by applicant]
Chen, J., et al., “Learning Online Smooth Predictors for Realtime Camera Planning using Recurrent Decision Trees”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 14 pages.
[cited by applicant]
Cheng, H.T et al., “Wide & Deep Learning for Recommender Systems”, Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Sep. 2016.
[cited by applicant]
Chung, J et al., “Hierarchical Multiscale Recurrent Neural Networks”, ICLR 2017, arXiv: 1609.01704v7, dated Mar. 9, 2017, 13 pages.
[cited by applicant]
Covington, P., et al., “Deep Neural Networks for Youtube Recommendations”, Proceedings of the 10th ACM Conference on Recommender Systems, pp. 191-198, Sep. 2016.
[cited by applicant]
Cox, M., et al., “Least Squares Congealing for Unsupervised Alignment of Images”, CVPR, 2008, 8 pages.
[cited by applicant]
Deerwester, S., et al., “Indexing by Latent Semantic Analysis”, 1990, 34 pages.
[cited by applicant]
Deng, Z., et al., “Factorized Variational Autoencoders for Modeling Audience Reactions to Movies”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 10 pages.
[cited by applicant]
Dertat, et al., “Applied Deep Learning-part 4: Convolutional Neural Networks,” Towards Data Science 26, https://towardsdatascience.com/applied-deep-learning-part-4-convolutional-neural-networks-584bc134c1e2, Nov. 8, 201…
[cited by applicant]
Dinsdale, et al., “Interactive Gaming in Sports,” U.S. Appl. No. 17/934,756, filed Sep. 23, 2022, 39 pages.
[cited by applicant]
Dixon, et al., “Modelling Association Football Scores and Inefficiencies in the Football Betting Market”, Applied Statistics, vol. 46(2), Published 1997, pp. 265-280.
[cited by applicant]
Dubow, “San Antonio Spurs' Kawhi Leonard ruled out for Game 2 vs. Golden State Warriors”, http://www.nba.com/article/2017/05/15/san-antonio-spurs-kawhi-leonard-out-game-2, dated May 15, 2017, 4 pages.
[cited by applicant]
Edge AI and Vision Alliance, “Using Convolutional Neural Networks for Image Recognition,” https://www.edge-ai -vision.com/2015/11/using-convolutional-neural-networks-for-image-recognition/, Nov. 12, 2015, 20 pages.
[cited by applicant]
ESPN Staff, “Neymar from Barca to PSG for €222m: Timeline of the world's biggest transfer”, ESPN, http://www.espn. com/soccer/blog/soccer-transfers/613/post/3170513/neymar-from-barcelona-to-psg-for-222m-euros-timeline-a…
[cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2022201634 dated Mar. 7, 2023, 4 Pages.
[cited by applicant]
Extended European Search Report for Application No. 20801519.8, dated May 19, 2023, 7 pages.
[cited by applicant]
Extended European Search Report for European Application No. 16876628.5, mailed Jan. 29, 2020, 17 Pages.
[cited by applicant]
Extended European Search Report for European Application No. 19740811.5, mailed Sep. 21, 2021, 10 Pages.
[cited by applicant]
Extended European Search Report for European Application No. 19741311.5, mailed Sep. 15, 2021, 09 Pages.
[cited by applicant]
Extended European Search Report for European Application No. 19741603.5, mailed Jun. 2, 2022, 11 Pages.
[cited by applicant]
Extended European Search Report for European Application No. 19741793.4, mailed Jun. 28, 2022, 10 Pages.
[cited by applicant]
Extended European Search Report for European Application No. 20765556.4, mailed Oct. 7, 2022, 12 Pages.
[cited by applicant]
Far-El, M., “CD160 isoforms and regulation of CD4 and CD8 T-cell responses,”Journal of translational medicine, Sep. 2, 2014, vol. 12:217, pp. 16.
[cited by applicant]
Felsen, et al., “Body shots: Analyzing shooting styles in the NBA using body pose”, MIT Sloan, Sports Analytics Conference, Mar. 2017, 11 Pages.
[cited by applicant]
Felsen, P., et al., “What will Happen Next? Forecasting Player Moves in Sports Videos”, Proceedings of the IEEE International Conference on Computer Vision, 2017, 10 pages.
[cited by applicant]
Wang, et al., “Classifying NBA offensive plays using neural networks,” Proceedings of MIT Sloan Sports Analytics vol. 4, 2016, 9 pages.
[cited by applicant]
Wang, S and Fowlkes, C.C., “Learning Optimal Parameters For Multi-target Tracking”, International Journal of Computer Vision122(3), 2017, 17 pages.
[cited by applicant]
Wei X., et al., “Large-Scale Analysis of Formations in Soccer,” Proceedings of the Digital Image Computing: Techniques and Applications (DICTA), IEEE, Nov. 26, 2013, pp. 1-8, XP032536466, Doi: 10.1109/DICTA.2013.6691503.
[cited by applicant]
Wei, X., et al., “Predicting Serves in Tennis Using Style Priors,” Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, 9 pages.
[cited by applicant]
Wei, X et al., The Thin Edge of the Wedge: Accurately Predicting Shot Outcomes in Tennis Using Style and Context Priors,Proceedings of the 10th Annual MIT Sloan Sport Anal Conference, Mar. 2016.
[cited by applicant]
Wei, X., “Modelling and Predicting Adversarial Behaviors using Large Amounts of Spatiotemporal Data,” Queensland University of Technology, 2016, 164 pages.
[cited by applicant]
Wright, “Liverpool's set-piece problem exposed in 3-3 draw with Watford”, https://www.skysports.com/football/news/15117/10985307/liverpools-set-piece-problem-exposed-in-3-3-draw-with-watford, Dec. 8, 2017, 9 pages.
[cited by applicant]
Yamaguchi, K., et al., “Who are you with and Where are you going?”, CVPR 2011. IEEE, 2011, 8 pages.
[cited by applicant]
Yue, Y., et al., “Learning Fine-Grained Spatial Models for Dynamic Sports Play Prediction”, ICDM, 2014, 10 pages.
[cited by applicant]
Zhao, “Research and Application of Online Learning of Formation Strategy Based on Neural Network Information Collection of China Masters' Dissertations Full Text Database,” No. 2, 2014, pp. 38-40.
[cited by applicant]
Zhao, Y., et al., “Applying Deep Bidirectional LSTM and Mixture Density Network for Basketball Trajectory Prediction,” OPTIK, 2018, pp. 266-272.
[cited by applicant]
Zheng, S., et al., “Generating Long-term Trajectories Using Deep Hierarchical Networks”, Advances in Neural Information Processing Systems, 2016, 9 pages.
[cited by applicant]
Le, H.M., et al., “Data-Driven Ghosting using Deep Imitation Learning”, MIT Sloan Sports Analytics Conference, Mar. 3-4, 2017, 15 pages.
[cited by applicant]
Learned-Miller E.G., “DataDriven Image Models through Continuous Joint Alignment,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Feb. 2006, vol. 28, No. 2, pp. 236-250.
[cited by applicant]
Lee, N., et al., “Desire: Distant Future Prediction in Dynamic Scenes with Interacting Agents”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 10 pages.
[cited by applicant]
Liang, X., et al., “Dual Motion Gan for Future-flow Embedded Video Prediction,” Proceedings of the IEEE International Conference on Computer Vision, 2017, 9 pages.
[cited by applicant]
Lock, D and Nettleton D., “Using Random Forests to Estimate Win Probability Before Each Play of an NFL Game”, JQAS 2014; 10(2);2014, pp. 197-205.
[cited by applicant]
Lucey, P., et al., “Quality vs Quantity: Improved Shot Prediction in Soccer using Strategic Features from Spatiotemporal Data,” 9th Annual MIT Sloan Sports Analytics Conference, Feb. 2015, 9 pages.
[cited by applicant]
Lucey, P., et al., “Representing and Discovering Adversarial Team Behaviors using Player Roles”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, 8 pages.
[cited by applicant]
Maaten, LVD.,et al., “Visualizing Data Using t-SNE”, Journal of Machine Learning Research Sep. 2008, pp. 2579-2605, Nov. 2008.
[cited by applicant]
Machine Learning Notebook, “Convolutional Neural Networks—Basics,” https://mlnotebook.github.io/post/CNN1/, Apr. 7, 2017, 13 pages.
[cited by applicant]
Maher, “Modelling Association Football Scores”, Statistica Neerlandica, vol. 36(3), Sep. 1982, pp. 109-118.
[cited by applicant]
Maksai, A., et al., “What Players do with the Ball: A Physically Constrained Interaction Modeling”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 10 pages.
[cited by applicant]
McCabe, A and Trevathan, J., “Artificial Intelligence in Sports Prediction,” Fifth International Conference on Information Technology: New Generations, IEEE Computer Society, Apr. 9, 2008, 4 pages.
[cited by applicant]
Mehrotra, “Elements of Artificial Neural Networks,” MIT Press, 1997.
[cited by applicant]
Merhej, C., et al., “What Happened Next? Using Deep Learning to Value Defensive Actions in Football Event-Data,” KDD, Aug. 2021, pp. 3394-3403.
[cited by applicant]
Mikolov, T., et al., “Distributed Representations of Words and Phrases and their Compositionality”, 2013, 9 Pages.
[cited by applicant]
Mikolov, T., et al., “Efficient Estimation of Word Representations in Vector Space”, arXiv:1301.3781v3, dated Sep. 7, 2013, 12 pages.
[cited by applicant]
Miller, A., et al., “Factorized Point Process Intensities: A Spatial Analysis of Professional Basketball”, ICML, Jan. 8, 2014, 13 pages.
[cited by applicant]
Nakashima, T., et al., “Off-line Learning of Soccer Formations from Game Logs,” 2010 World Automation Congress, 2010, 6 Pages.
[cited by applicant]
Newton, “How Youtub Perfected The Feed”, The Verge, https://www.theverge.com/2017/8/30/16222850/youtube -google-brain-algorithm-video-recommendation-personalized-feed, Aug. 30, 2017.
[cited by applicant]
Nikolova, M.H, et al., “The CD160+ CD8high cytotoxic T cell subset correlates with response to HAART in HIV-1+ patients,” Cell Immunol . Oct. 2005 , vol. 237(2), pp. 96-105.
[cited by applicant]
Office Action for European Patent Application No. 20801519.8, mailed Jun. 6, 2023, 1 page.
[cited by applicant]
Paine, “The Pats' Comeback Was Incredible—Even If You Think The Falcons Blew It”, Five ThirtyEight, https://fivethirtyeight. com/features/patriots-falcons-comeback-super-bowl/, Dated Feb. 6, 2017, 4 pages.
[cited by applicant]
Partial Supplementary European Search Report for European Application No. 16876628.5, mailed Aug. 14, 2019, 16 Pages.
[cited by applicant]
Pathak, D., et al., “Context Encoders: Feature Learning by Inpainting”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 12 Pages.
[cited by applicant]
Pelechrinis, K., “iWinRNFL: A Simple, Interpretable & Well-Calibrated In-Game Win Probability Model for NFL”, arXiv:1704.00197v3, dated Mar. 14, 2018, 7 pages.
[cited by applicant]
Peng, A., et al., “RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images,” in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, No. 11, pp. 2233-2246, Nov. 201…
[cited by applicant]
Perricone, J., et al., “Predicting Results for Professional Basketball Using NBA API Data,” 2016, 6 pages.
[cited by applicant]
Pettersson, D and Nyquist, R., “Football Match Prediction Using Deep Learning,” Department of Electrical Engineering, Chalmers University of Technology, 2017, 72 pages.
[cited by applicant]
Pourmehr, S and Dadkhah, C., “An Overview on Opponent Modeling in RoboCup Soccer Simulation D,” Springer, 2011, 12 pages.
[cited by applicant]
Power, P., et al., “Not All Passes Are Created Equal: Objectively Measuring the Risk and Reward of Passes in Soccer from Tracking Data,” Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery…
[cited by applicant]
Preferred Networks, Inc., “Football Analytics using Deep Learning,” YouTube, https://www.youtube.com/watch? v=hs_v3dv6OUI, Jul. 25, 2019, 3 pages.
[cited by applicant]
Pulling, C., “Long Corner Kicks In The English Premier League: Deliveries Into The Goal Ara and Critical Area”, International Journal of Fundamental and Applied Kinesiology, vol. 47(2), 2015, pp. 193-201.
[cited by applicant]
Ross, L and Anderson, C.A., “Shortcomings in the Attribution Process: on the Origins and Maintenance of Erroneous Social Assessments,” Cambridge University Press, 1982, pp. 129-152.
[cited by applicant]
Ruiz, H., et al., “The Leicester City Fairytale?” Utilizing New Soccer Analytics Tools to Compare Performance in the 15/16 & 16/17 EPL Seasons, Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Di…
[cited by applicant]
Schechtman-Rock, “Introducing NFLWin: An Open Source Implementation of NFL Win Probability”, PhD Football, http://phdfootball.blogspot.com/2016/09/introducing-nflwin-open-source.html, Dated Sep. 1, 2016, 4 pages.
[cited by applicant]
Seidl, T., et al., “Bhostgusters: Realtime Interactive Play Sketching with Synthesized NBA defenses”, Proceeding of the 12th MIT Sloan Sports Analytics Conference, 2018, 14 Pages.
[cited by applicant]
Sha, L., et al., “Chalkboarding: A New Spatiotemporal Query Paradigm for Sports Play Retrieval”, IUI, 2016, 12 pages.
[cited by applicant]
Sha, L., et al., “Fine-Grained Retrieval of Sports Plays using Tree-Based Alignment of Trajectories”, arXiv preprint arXiv:1710.02255, Oct. 6, 2017, 10 pages.
[cited by applicant]
Sohn, K et al., “Learning Structured Output Representation using Deep Conditional Generative Models”, Advances in Neural Information Processing Systems, 2015, 9 pages.
[cited by applicant]
Srinivas, S., et al., “A Taxonomy of Deep Convolutional Neural Nets for Computer Vision,” Frontiers in Robotics and AI 2, 2016, 18 Pages.
[cited by applicant]
Stein, M et al. “Bring it to the pitch: Combining video and movement data to enhance team sport analysis,” IEEE Transactions on Visualization and Computer Graphics, vol. 24(1), 2018, pp. 13-22.
[cited by applicant]
Su, S., et al., “Social Behavior Prediction from First Person Videos”, arXiv preprint arXiv:1611.09464, Nov. 29, 2016, 10 Pages.
[cited by applicant]
Tian, et al., “Use of Machine Learning to Automate the Identification of Basketball Strategies Using Whole Team Player Tracking Data,” Applied Sciences, vol. 10(1), Dec. 18, 2019, 17 pages.
[cited by applicant]
Trainor, C., “Goalkeepers: How Repeatable Are Shot Saving Performances?”, STATSBOMB, https://statsbomb.com/2014/10/goalkeepers-how-repeatable-are-shot-saving-performances/, Oct. 21, 2014.
[cited by applicant]
Van Den Oord, A., et al., “Pixel Recurrent Neural Networks”, arXiv preprint arXiv: 1601.06759, Aug. 19, 2016, 11 pages.
[cited by applicant]
Van Den Oord, A., et al., “WaveNet: A Generative Model For Raw Audio”, arXiv:1609.03499v2, dated Sep. 19, 2016, 15 pages.
[cited by applicant]
Wagenaar, M., et al., “Using Deep Convolutional Neural Networks to Predict Goal-scoring Opportunities in Soccer,” International Conference on Pattern Recognition Applications and Methods, vol. 2, SCITEPRESS, 2017, 8 pag…
[cited by applicant]
Wagenaar, M., “Predicting Goal-Scoring Opportunities in Soccer by Using Deep Convolutional Neural Networks,” Department of Artificial Intelligence, University of Groningen, Nov. 16, 2016, 65 pages.
[cited by applicant]
Walker, J., et al., “An Uncertain Future: Forecasting from Static Images using Variational Autoencoders”, European Conference on Computer Vision, 2016, 17 pages.
[cited by applicant]
Walters, Virgil Van Dijk Transfer May Not Fix Liverpool's Dismal Defending of Set-pieces Warns Jurgen Klopp After Watford Woe, https://www.mirror.co.uk/sport/football/news/liverpool-klopp-van-dijk-setpiece-10981217, Aug…
[cited by applicant]
Felsen, P., et al., “Where Will They Go? Predicting Fine-grained Adversarial Multi-agent Motion Using Conditional Variational Autoencoders,” Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 76…
[cited by applicant]
Frey, B.J and Dueck, D. “Clustering by Passing Messages Between Data Points” Science Magazine, Feb. 15, 2007, 5 pages.
[cited by applicant]
Goddard, J., “Modelling Football Match Results and the Efficiency of Fixed-odds Betting”, Published 2004, 27 pages.
[cited by applicant]
Graves, A., “Generating Sequences with Recurrent Neural Networks”, arXiv:1308.0850v5, dated Jun. 5, 2014, 43 pages.
[cited by applicant]
Gregor, K., et al., “DRAW: A Recurrent Neural Network For Image Generation”, arXiv preprint arXiv:1502.04623, May 20, 2015, 10 pages.
[cited by applicant]
Gyarmati, L., et al., “Searching for a Unique Style in Soccer,” arXiv preprint arXiv:1409.0308, 2014, 4 pages.
[cited by applicant]
Hinton, G.E., et al. “A Fast Learning Algorithm for Deep Belief Nets”, Neural Comput, 18(7), 2006, pp. 1527-1554.
[cited by applicant]
Ho, T.K “Random decision forests,” Proceedings of 3rd International Conference on Document Analysis and Recognition, 1995, vol. 1 pp. 278-282. doi: 10.1109/ICDAR.1995.598994.
[cited by applicant]
Huang, et al., “Graph Analysis of Major League Soccer Networks: CS224W Final Project,” http://snap.stanford.edu/class/cs224w-2018/reports/CS224W-2018-46.pdf, Dec. 9, 2018, 9 pages.
[cited by applicant]
Huang, K.Y and Chang, W.L “A Neural Network Method for Prediction of 2006 World Cup Football Game,” IEEE, 2010, pp. 1-8.
[cited by applicant]
Hubacek, O., et al., “Lifted Relational Team Embeddings for Predictive Sports Analytics,” ILP Up-and-Coming/Short Papers, 2018, 7 pages.
[cited by applicant]
Insafutdinov, E., et al., “ArtTrack: Articulated Multi-Person Tracking in the Wild”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 9 pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2016/066733, mailed Jun. 28, 2018 9 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014608, mailed Jul. 30, 2020 10 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014609, mailed Jul. 30, 2020, 08 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014613, mailed Jul. 30, 2020, 07 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014614, mailed Jul. 30, 2020, 6 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2020/020432, mailed Sep. 16, 2021, 10 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2020/032053, mailed Nov. 18, 2021, 08 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2021/016583, mailed Aug. 18, 2022, 11 Pages.
[cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2021/034568 , mailed Dec. 15, 2022, 8 Pages.
[cited by applicant]
International Preliminary Report on Patentability for the Application No. PCT/US2021/053117, mailed Apr. 13, 2023, 8 pages.
[cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/018709, mailed on Jun. 24, 2022, 11 pages.
[cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/077383, mailed on Dec. 13, 2022, 18 pages.
[cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/17229, mailed on Jun. 9, 2022, 9 pages.
[cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/020432, mailed May 28, 2020, 11 Pages.
[cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/032053, mailed Sep. 29, 2020, 09 Pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2016/066733, dated Apr. 17, 2017, 11 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/014609, dated Apr. 12, 2019, 10 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/014613, dated Apr. 12, 2019, 9 Pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/014614,, dated Apr. 16, 2019, 9 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/14608, dated Apr. 15, 2019, 12 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2021/34568, dated Aug. 25, 2021, 9 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2021/53117, dated Jan. 14, 2022, 9 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2022/15240, dated May 11, 2022, 7 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2022/76934, dated Dec. 13, 2022, 10 pages.
[cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US21/16583, dated Apr. 23, 2021, 11 pages.
[cited by applicant]
Jain, A., et al., “Recurrent Neural Networks for Driver Activity Anticipation via Sensory-Fusion Architecture”, IEEE International Conference on Robotics and Automation (ICRA), 2016, 8 pages.
[cited by applicant]
Janetzko, H., et al., “Feature-driven Visual Analytics of Soccer Data,” IEEE Conference on Visual Analytics Science and (VAST), Nov. 2014, pp. 13-22.
[cited by applicant]
Ji, B. and Li, J., NBA All-Star Lineup Prediction Based on Neural Networks. International Conference on Information Science & Cloud Computing Companion, Dec. 2013, pp. 864-869.
[cited by applicant]
Kharrat, T., et al., “Plus-Minus Player Ratings for Soccer”, arXiv:1706.04943v1, dated Jun. 16, 2017, 17 pages.
[cited by applicant]
Kim, K., et al., “Motion Fields to Predict Play Evolution in Dynamic Sport Scenes”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, 8 pages.
[cited by applicant]
Kingma, D.P, and Lei Ba, J., “Adam: A Method for Stochastic Optimization”, arXiv:1412.6980v9, ICLR 2015, dated Jan. 30, 2017, 15 Pages.
[cited by applicant]
Kingma, D.P., et al., “Semi-supervised Learning with Deep Generative Models”, Advances in Neural Information Processing Systems, Oct. 31, 2014, 9 Pages.
[cited by applicant]
Kingman, D.P., et al., “Auto-Encoding Variational Bayes”, arXiv preprint arXiv:1312.6114, May 1, 2014, 14 pages.
[cited by applicant]
Kinoshita, K., et al., Deep Mixture Density Network for Statistical Model-based Feature Enhancement, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing ICASSP), Mar. 2017, pp. 251-255.
[cited by applicant]
Knauf, K., et al., “Spatio-temporal Convolution Kernels,” Machine learning, vol. 102, Jul. 2015, 28 pages.
[cited by applicant]
Koopman, S. J., and Lit, R., A Dynamic Bivariate Poisson Model for Analysing and Forecasting Match Results in the English Premier League. Journal of the Royal Statistical Society. Series a. Statistics in Society, 178(1)…
[cited by applicant]
Koren, Y., et al., “Matrix Factorization Techniques For Recommender Systems”, Computer, IEEE Computer Society, Aug. 2009, 8 pages.
[cited by applicant]
Le, H.M., et al., “Coordinated Multi-Agent Imitation Learning”, Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org, 2017, 13 pages.
[cited by applicant]