IP Library Granted Patent US 12,271,980
Granted Patent B2
US 12,271,980 · App. 17/937,156 · Granted Apr 8, 2025

Recommendation engine for combining images and graphics of sports content based on artificial intelligence generated game metrics

Inventors: Patrick Joseph Lucey (Chicago, IL); Anthony Borsumato (Cambridge, GB); Kevin Allinson (Yarm, GB); Christian Marko (Graz, AT)
Assignee: STATS LLC
G06T11/206G06V20/42G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,271,980
App. No.
17/937,156
Granted
Apr 8, 2025
Kind
B2
Abstract

A computing system receives data for a game. The data includes at least one of tracking data or event data. Based on the data for the game, the computing system determines that an event has occurred within the game. Based on the determining, the computing system generates a graphic responsive to the event. The graphic includes insights related to the event. The computing system recommends an image relevant to the event based on metatags associated with the event. The computing system generates a visual element by merging the image and the graphic.

Claims (58)

1. A method comprising:

receiving, by an organization computing system, data for a game, the data comprising at least one of tracking data or event data;

based on the data for the game, determining, by the organization computing system, that an event has occurred within the game;

based on the determining, generating, by the organization computing system, a graphic responsive to the event, wherein the graphic comprises insights related to the event;

recommending, by the organization computing system, an image relevant to the event based on metatags associated with the image, responsive to generating the graphic; and

generating, by the organization computing system, a visual element for display on a client device by merging the image with the graphic.

2. The method of claim 1 , further comprising:

recommending, by the organization computing system, an insight or artificial intelligence metric based on the event.

3. The method of claim 2 , wherein the insight or artificial intelligence metric is one of a single number, a combination of numbers, or a visualization of a key play.

4. The method of claim 1 , wherein recommending, by the organization computing system, the image relevant to the event based on the metatags associated with the image, responsive to generating the graphic, comprises:

generating a list of a plurality of images relevant to the event, the list of the plurality of images comprising the image.

5. The method of claim 1 , wherein recommending, by the organization computing system, the image relevant to the event based on the metatags associated with the image, responsive to generating the graphic, comprises:

identifying contextual features of the insights related to the event; and

mapping the contextual features to the metatags associated with the image.

6. The method of claim 1 , further comprising:

generating, by one or more prediction models of the organization computing system, the insights related to the event based on the data corresponding to the event.

7. The method of claim 6 , further comprising:

presenting, by the organization computing system, the insights related to the event to a user; and

receiving, by the organization computing system, a selection of at least one insight for inclusion in the visual element.

8. A non-transitory computer readable medium comprising one or more sequences of instructions, which, when executed by one or more processors, causes an organization computing system to perform operations comprising:

receiving, by the organization computing system, data for a game, the data comprising at least one of tracking data or event data;

based on the data for the game, determining, by the organization computing system, that an event has occurred within the game;

based on the determining, generating, by the organization computing system, a graphic responsive to the event, wherein the graphic comprises insights related to the event;

recommending, by the organization computing system, an image relevant to the event based on metatags associated with the image, responsive to generating the graphic; and

generating, by the organization computing system, a visual element for display on a client device by merging the image with the graphic.

9. The non-transitory computer readable medium of claim 8 , further comprising:

recommending, by the organization computing system, an insight or artificial intelligence metric based on the event.

10. The non-transitory computer readable medium of claim 9 , wherein the insight or artificial intelligence metric is one of a single number, a combination of numbers, or a visualization of a key play.

11. The non-transitory computer readable medium of claim 8 , wherein recommending, by the organization computing system, the image relevant to the event based on the metatags associated with the image, responsive to generating the graphic, comprises:

generating a list of a plurality of images relevant to the event, the list of the plurality of images comprising the image.

12. The non-transitory computer readable medium of claim 8 , wherein recommending, by the organization computing system, the image relevant to the event based on the metatags associated with the image, responsive to generating the graphic, comprises:

identifying contextual features of the insights related to the event; and

mapping the contextual features to the metatags associated with the image.

13. The non-transitory computer readable medium of claim 8 , further comprising:

generating, by one or more prediction models of the organization computing system, the insights related to the event based on the data corresponding to the event.

14. The non-transitory computer readable medium of claim 13 , further comprising:

presenting, by the organization computing system, the insights related to the event to a user; and

receiving, by the organization computing system, a selection of at least one insight for inclusion in the visual element.

15. An organization computing system, comprising:

a processor; and

a memory having programming instructions stored thereon, which, when executed by the processor, causes the organization computing system to perform operations comprising:

receiving data for a game, the data comprising at least one of tracking data or event data;

based on the data for the game, determining that an event has occurred within the game;

based on the determining, generating a graphic responsive to the event, wherein the graphic comprises insights related to the event;

recommending an image relevant to the event based on metatags associated with the image, responsive to generating the graphic; and

generating a visual element for display on a client device by merging the image with the graphic.

16. The organization computing system of claim 15 , wherein the operations further comprise:

recommending an insight or artificial intelligence metric based on the event.

17. The organization computing system of claim 15 , wherein recommending the image relevant to the event based on the metatags associated with the image, responsive to generating the graphic, comprises:

generating a list of a plurality of images relevant to the event, the list of the plurality of images comprising the image.

18. The organization computing system of claim 15 , wherein recommending the image relevant to the event based on the metatags associated with the image, responsive to generating the graphic, comprises:

identifying contextual features of the insights related to the event; and

mapping the contextual features to the metatags associated with the image.

19. The organization computing system of claim 15 , wherein the operations further comprise:

generating, by one or more prediction models, the insights related to the event based on the data corresponding to the event.

20. The organization computing system of claim 19 , wherein the operations further comprise:

presenting the insights related to the event to a user; and

receiving a selection of at least one insight for inclusion in the visual element.

Assignments (2)
SECURITY INTEREST Recorded Apr 14, 2026
From: STATS LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 075390/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2022
From: LUCEY, PATRICK JOSEPH; BORSUMATO, ANTHONY; ALLINSON, KEVIN; MARKO, CHRISTIAN
To: STATS LLC
Reel/Frame 061439/0576 →
Continuity (2)
Provisional Application 63261971 · Oct 1, 2021
Related Publication 20230104313A1 · Apr 6, 2023
References Cited (296)
US 6616529B1 · Qian et al. · 2003 [cited by applicant]
US 6710713B1 · Russo · 2004 [cited by applicant]
US 6711514B1 · Bibbee · 2004 [cited by examiner]
US 6751343B1 · Ferrell et al. · 2004 [cited by applicant]
US 9342785B2 · Lucey et al. · 2016 [cited by applicant]
US 9442933B2 · Tzoukermann · 2016 [cited by applicant]
US 9729784B2 · Petrescu · 2017 [cited by examiner]
US 10201752B2 · Lucey et al. · 2019 [cited by applicant]
US 10460176B2 · Chang et al. · 2019 [cited by applicant]
US 11157742B2 · Zhang et al. · 2021 [cited by applicant]
US 11182806B1 · Arfa et al. · 2021 [cited by applicant]
US 11232109B1 · Knoll et al. · 2022 [cited by applicant]
US 11430030B1 · Tagra · 2022 [cited by examiner]
US 20020165697A1 · Min · 2002 [cited by applicant]
US 20040148275A1 · Achlioptas · 2004 [cited by applicant]
US 20040148278A1 · Milo et al. · 2004 [cited by applicant]
US 20050143198A1 · Charge · 2005 [cited by applicant]
US 20060083304A1 · Pan et al. · 2006 [cited by applicant]
US 20060149674A1 · Cook et al. · 2006 [cited by applicant]
US 20060252476A1 · Bahou · 2006 [cited by applicant]
US 20070293289A1 · Loeb · 2007 [cited by applicant]
US 20080281444A1 · Krieger et al. · 2008 [cited by applicant]
US 20090186679A1 · Irvine et al. · 2009 [cited by applicant]
US 20090203447A2 · Hansen et al. · 2009 [cited by applicant]
US 20100129780A1 · Homsi et al. · 2010 [cited by applicant]
US 20100184495A1 · Levy et al. · 2010 [cited by applicant]
US 20100184563A1 · Molyneux et al. · 2010 [cited by applicant]
US 20100283630A1 · Alonso · 2010 [cited by applicant]
US 20100298958A1 · Connelly · 2010 [cited by applicant]
US 20110013087A1 · House et al. · 2011 [cited by applicant]
US 20110169959A1 · DeAngelis et al. · 2011 [cited by applicant]
US 20110173235A1 · Aman et al. · 2011 [cited by applicant]
US 20110267461A1 · Birenboim et al. · 2011 [cited by applicant]
US 20120162435A1 · Elangovan et al. · 2012 [cited by applicant]
US 20120214602A1 · Ahlstrom · 2012 [cited by applicant]
US 20130104870A1 · Rizzo et al. · 2013 [cited by applicant]
US 20130110271A1 · Fornell et al. · 2013 [cited by applicant]
US 20130225271A1 · Amaitis · 2013 [cited by applicant]
US 20130238106A1 · Ellis et al. · 2013 [cited by applicant]
US 20130267328A1 · Heisler et al. · 2013 [cited by applicant]
US 20140142921A1 · Gleadall et al. · 2014 [cited by applicant]
US 20140143183A1 · Sigal et al. · 2014 [cited by applicant]
US 20140206479A1 · Marty et al. · 2014 [cited by applicant]
US 20140236331A1 · Lehmann et al. · 2014 [cited by applicant]
US 20140274245A1 · Stickel · 2014 [cited by applicant]
US 20140302914A1 · Weinstein et al. · 2014 [cited by applicant]
US 20140309000A1 · Gustafson · 2014 [cited by applicant]
US 20140364976A1 · Wohl et al. · 2014 [cited by applicant]
US 20150031845A1 · McCauley et al. · 2015 [cited by applicant]
US 20150058730A1 · Dubin · 2015 [cited by examiner]
US 20150131845A1 · Forouhar et al. · 2015 [cited by applicant]
US 20150142716A1 · Lucey et al. · 2015 [cited by applicant]
US 20150148129A1 · Austerlade et al. · 2015 [cited by applicant]
US 20150248917A1 · Chang et al. · 2015 [cited by applicant]
US 20150258416A1 · Ianni et al. · 2015 [cited by applicant]
US 20150360134A1 · Rodriguez · 2015 [cited by applicant]
US 20160007054A1 · Polumbus et al. · 2016 [cited by applicant]
US 20160096071A1 · Ianni et al. · 2016 [cited by applicant]
US 20160182415A1 · Ames et al. · 2016 [cited by applicant]
US 20160203279A1 · Srinivas et al. · 2016 [cited by applicant]
US 20160220878A1 · Devathi · 2016 [cited by applicant]
US 20160260015A1 · Lucey et al. · 2016 [cited by applicant]
US 20160357406A1 · Lee · 2016 [cited by examiner]
US 20160375365A1 · Thompson et al. · 2016 [cited by applicant]
US 20170043260A1 · Austerlade et al. · 2017 [cited by applicant]
US 20170061314A1 · Schnurr et al. · 2017 [cited by applicant]
US 20170072321A1 · Thompson et al. · 2017 [cited by applicant]
US 20170080336A1 · Groset et al. · 2017 [cited by applicant]
US 20170109015A1 · Krasadakis · 2017 [cited by applicant]
US 20170132821A1 · Valliani et al. · 2017 [cited by applicant]
US 20170165570A1 · Lucey et al. · 2017 [cited by applicant]
US 20170166557A1 · Lucey et al. · 2017 [cited by applicant]
US 20170235848A1 · Van Dusen et al. · 2017 [cited by applicant]
US 20170238055A1 · Chang et al. · 2017 [cited by applicant]
US 20170246539A1 · Schwartz et al. · 2017 [cited by applicant]
US 20170255830A1 · Chen · 2017 [cited by applicant]
US 20170257653A1 · Farre Guiu et al. · 2017 [cited by applicant]
US 20170259178A1 · Aghdaie et al. · 2017 [cited by applicant]
US 20170291093A1 · Janssen · 2017 [cited by applicant]
US 20170330029A1 · Turcot et al. · 2017 [cited by applicant]
US 20180032858A1 · Lucey et al. · 2018 [cited by applicant]
US 20180056124A1 · Marty et al. · 2018 [cited by applicant]
US 20180084310A1 · Katz et al. · 2018 [cited by applicant]
US 20180099201A1 · Marty et al. · 2018 [cited by applicant]
US 20180137364A1 · Forouhar et al. · 2018 [cited by applicant]
US 20180157974A1 · Carr et al. · 2018 [cited by applicant]
US 20180158196A1 · Marks · 2018 [cited by applicant]
US 20180204111A1 · Zadeh et al. · 2018 [cited by applicant]
US 20180213033A1 · Subbian · 2018 [cited by applicant]
US 20180218243A1 · Felsen et al. · 2018 [cited by applicant]
US 20190087661A1 · Lee et al. · 2019 [cited by applicant]
US 20190205652A1 · Ray et al. · 2019 [cited by applicant]
US 20190221072A1 · Litman · 2019 [cited by applicant]
US 20190224556A1 · Ruiz et al. · 2019 [cited by applicant]
US 20190228290A1 · Ruiz et al. · 2019 [cited by applicant]
US 20190228306A1 · Power et al. · 2019 [cited by applicant]
US 20190251366A1 · Zhong et al. · 2019 [cited by applicant]
US 20190374839A1 · Wanke et al. · 2019 [cited by applicant]
US 20200004752A1 · Majumdar et al. · 2020 [cited by applicant]
US 20200043287A1 · Zhang et al. · 2020 [cited by applicant]
US 20200074181A1 · Chang et al. · 2020 [cited by applicant]
US 20200170549A1 · Baykaner et al. · 2020 [cited by applicant]
US 20200218902A1 · Chang et al. · 2020 [cited by applicant]
US 20200230501A1 · Schwartz et al. · 2020 [cited by applicant]
US 20200302181A1 · Bhanu et al. · 2020 [cited by applicant]
US 20200336802A1 · Russell et al. · 2020 [cited by applicant]
US 20200349611A1 · Publicover et al. · 2020 [cited by applicant]
US 20200353311A1 · Ganguly et al. · 2020 [cited by applicant]
US 20210056458A1 · Savova et al. · 2021 [cited by applicant]
US 20210134124A1 · Srinivasan · 2021 [cited by applicant]
US 20210142066A1 · Jayaram et al. · 2021 [cited by applicant]
US 20210240992A1 · Chan · 2021 [cited by examiner]
US 20210256265A1 · Gurpinar-Morgan et al. · 2021 [cited by applicant]
US 20210272599A1 · Patterson et al. · 2021 [cited by applicant]
US 20210304736A1 · Kothari et al. · 2021 [cited by applicant]
US 20210383123A1 · Hobbs et al. · 2021 [cited by applicant]
US 20210397846A1 · Chang et al. · 2021 [cited by applicant]
US 20220055689A1 · Mandlekar et al. · 2022 [cited by applicant]
US 20220067983A1 · Fidler et al. · 2022 [cited by applicant]
US 20220253679A1 · Power et al. · 2022 [cited by applicant]
US 20220270004A1 · Ruiz et al. · 2022 [cited by applicant]
US 20220284311A1 · Haynes et al. · 2022 [cited by applicant]
CN 1386241 · 2002 [cited by applicant]
CN 1708697A · 2005 [cited by applicant]
CN 102819749A · 2012 [cited by applicant]
CN 105833502 · 2016 [cited by applicant]
KR 100986647 · 2010 [cited by applicant]
WO 0122270A2 · 2001 [cited by applicant]
WO 2013166456A2 · 2013 [cited by applicant]
WO 2014008134 · 2014 [cited by applicant]
WO 2015076682 · 2015 [cited by applicant]
WO 2017031356 · 2017 [cited by applicant]
WO 2017161167 · 2017 [cited by applicant]
WO 2020010040 · 2020 [cited by applicant]
Dinsdale, et al., “Interactive Gaming in Sports,” U.S. Appl. No. 17/934,756, filed Sep. 23, 2022, 39 pages. [cited by applicant]
PCT International Application No. PCT/US22/17229, International Search Report and Written Opinion of the International Searching Authority, dated Jun. 9, 2022, 9 pages. [cited by applicant]
PCT International Application No. PCT/US22/18709, International Search Report and Written Opinion of the International Searching Authority, dated Jun. 24, 2022, 11 pages. [cited by applicant]
Huang, et al., “Graph Analysis of Major League Soccer Networks: CS224W Final Project,” http://snap.stanford.edu/class/cs224w-2018/reports/CS224W-2018-46.pdf, Dec. 9, 2018, 9 pages. [cited by applicant]
Tian, et al., “Use of machine learning to automate the identification of basketball strategies using whole team player tracking data,” Applied Sciences 10.1, Dec. 18, 2019, 17 pages. [cited by applicant]
Trainor, “Goalkeepers: How repeatable are shot saving performances?”, STATSBOMB, https://statsbomb.com/2014/10/goalkeepers-how-repeatable-are-shot-saving-performances/, Oct. 21, 2014. [cited by applicant]
Newton, “How Youtub Perfected The Feed”, The Verge, https://www.theverge.com/2017/8/30/16222850/youtube-google-brain-algorithm-video-recommendation-personalized-feed, Aug. 30, 2017. [cited by applicant]
Covington, et al., “Deep neural networks for youtube recommendations”, Proceedings of the 10th ACM conference on recommender systems, pp. 191-198, Sep. 2016. [cited by applicant]
Cheng, et al., “Wide & deep learning for recommender systems”, Proceedings of the 1st workshop on deep learning for recommender systems, Sep. 2016. [cited by applicant]
Alcorn, “(batter|pitcher) 2vec: statistic-free talent modeling with neural player embeddings”, MIT Sloan Sports Analytics Conference, 2018. [cited by applicant]
Wei, et al., “The thin edge of the wedge: Accurately predicting shot outcomes in tennis using style and context priors”, Proceedings of the 10th Annual MIT Sloan Sport Anal Conference, Mar. 2016. [cited by applicant]
Seidl, et al., “Bhostgusters: Realtime interactive play sketching with synthesized NBA defenses”, Proceeding of the 12th MIT Sloan Sports Analytics Conference, 2018. [cited by applicant]
Maaten, et al., “Visualizing data using t-SNE”, Journal of machine learning research Sep. 2008, pp. 2579-2605, Nov. 2008. [cited by applicant]
Felsen, et al., “Body shots: Analyzing shooting styles in the NBA using body pose”, MIT Sloan, Sports Analytics Conference, Mar. 2017. [cited by applicant]
Sha, et al., “Fine-Grained Retrieval of Sports Plays using Tree-Based Alignment of Trajectories”, arXiv preprint arXiv:1710.02255, Oct. 6, 2017, 10 pages. [cited by applicant]
Lee, et al., “Desire: Distant Future Prediction in Dynamic Scenes with Interacting Agents”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 10 pages. [cited by applicant]
Alahi, et al., “Social LSTM: Human Trajectory Prediction in Crowded Spaces”, Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 11 pages. [cited by applicant]
Jain, et al., “Recurrent Neural Networks for Driver Activity Anticipation via Sensory-Fusion Architecture”, IEEE International Conference on Robotics and Automation (ICRA), 2016, 8 pages. [cited by applicant]
Akhter, et al., “Bilinear Spatiotemporal Basis Models”, ACM Transactions on Graphics, vol. 30, No. 2, Article 17, Apr. 2012, 12 pages. [cited by applicant]
Lucey, et al., “Representing and Discovering Adversarial Team Behaviors using Player Roles”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, 8 pages. [cited by applicant]
Insafutdinov, et al., “ArtTrack: Articulated Multi-Person Tracking in the Wild”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 9 pages. [cited by applicant]
Le, et al., “Coordinated Multi-Agent Imitation Learning”, Proceedings of the 34th International Conference on Machine Learning—vol. 70. JMLR. org, 2017, 13 pages. [cited by applicant]
Yamaguchi, et al., “Who are you with and Where are you going?”, CVPR 2011. IEEE, 2011, 8 pages. [cited by applicant]
Butt, et al., “Multi-target Tracking by Lagrangian Relaxation to Min-Cost Network Flow”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, 8 pages. [cited by applicant]
Wang, et al., “Learning Optimal Parameters For Multi-target Tracking”, International journal of computer vision 122.3 , 2017, 13 pages. [cited by applicant]
Maksai, et al., “What Players do with the Ball: A Physically Constrained Interaction Modeling”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 10 pages. [cited by applicant]
Kim, et al., “Motion Fields to Predict Play Evolution in Dynamic Sport Scenes”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, 8 pages. [cited by applicant]
Chen, et al., “Learning Online Smooth Predictors for Realtime Camera Planning using Recurrent Decision Trees”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 14 pages. [cited by applicant]
Zheng, et al., “Generating Long-term Trajectories Using Deep Hierarchical Networks”, Advances in Neural Information Processing Systems, 2016, 9 pages. [cited by applicant]
Felsen, et al., “What will Happen Next? Forecasting Player Moves in Sports Videos”, Proceedings of the IEEE International Conference on Computer Vision, 2017, 10 pages. [cited by applicant]
Su, et al., “Social Behavior Prediction from First Person Videos”, arXiv preprint arXiv:1611.09464, Nov. 29, 2016, 10 pages. [cited by applicant]
Koren, et al., “Matrix Factorization Techniques For Recommender Systems”, Computer, IEEE Computer Society, Aug. 2009, 8 pages. [cited by applicant]
Deng, et al., “Factorized Variational Autoencoders for Modeling Audience Reactions to Movies”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 10 pages. [cited by applicant]
Charles, et al., “Personalizing Human Video Pose Estimation”, Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 14 pages. [cited by applicant]
Kingman, et al., “Auto-Encoding Variational Bayes”, arXiv preprint arXiv:1312.6114, May 1, 2014, 14 pages. [cited by applicant]
Gregor, et al., “DRAW: A Recurrent Neural Network For Image Generation”, arXiv preprint arXiv:1502.04623, May 20, 2015, 10 pages. [cited by applicant]
Bowman, et al., “Generating Sentences from a Continuous Space”, arXiv preprint arXiv:1511.06349, May 12, 2016, 12 pages. [cited by applicant]
Kingma, et al., “Semi-supervised Learning with Deep Generative Models”, Advances in neural information processing systems, Oct. 31, 2014, 9 pages. [cited by applicant]
Sohn, et al., “Learning Structured Output Representation using Deep Conditional Generative Models”, Advances in neural information processing systems, 2015, 9 pages. [cited by applicant]
Van den Oord, et al., “Pixel Recurrent Neural Networks”, arXiv preprint arXiv:1601.06759, Aug. 19, 2016, 11 pages. [cited by applicant]
Pathak, et al., “Contect Encoders: Feature Learning by Inpainting”, Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 12 pages. [cited by applicant]
Walker, et al., “An Uncertain Future: Forecasting from Static Images using Variational Autoencoders”, European Conference on Computer Vision, 2016, 17 pages. [cited by applicant]
Srinivas, et al., “A taxonomy of deep convolutional neural nets for computer vision,” Frontiers in Robotics and AI 2, Jan. 11, 2016, 13 pages. [cited by applicant]
Dertat, et al., “Applied deep learning-part 4: Convolutional neural networks,” Towards Data Science 26, https://towardsdatascience.com/applied-deep-learning-part-4-convolutional-neural-networks-584bc134c1e2, Nov. 8, 201… [cited by applicant]
Edge AI and Vision Alliance, “Using Cconvolutional Neural Networks fo Image Recognition,” https://www.edge-ai-vision.com/2015/11/using-convolutional-neural-networks-for-image-recognition/, Nov. 12, 2015, 20 pages. [cited by applicant]
Machine Learning Notebook, “Convolutional Neural Networks—Basics,” https://mlnotebook.github.io/post/CNN1/, Apr. 7, 2017, 13 pages. [cited by applicant]
Knauf, et al., “Spatio-temporal convolution kernels,” Machine learning 102.2, Jul. 2015, 28 pages. [cited by applicant]
Chandler, et al., “An exploratory study of minor league baseball statistics,” Journal of Quantitative Analysis in Sports 8.4, 2012, 37 pages. [cited by applicant]
Perricone, et al., “Predicting Results for Professional Basketball Using NBA API Data,” 2016, 6 pages. [cited by applicant]
Kinoshita, et al., “Deep mixture density network for statistical model-based feature enhancement,” 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Mar. 2017, pp. 251-255. [cited by applicant]
Wang, et al., “Classifying NBA offensive plays using neural networks,” Proceedings of MIT Sloan Sports Analytics Conference, vol. 4, 2016, 9 pages. [cited by applicant]
Zhao, “Research and Application of Online Learning of Formation Strategy Based on Neural Network Information Technology Collection of China Masters' Dissertations Full Text Database,” No. 2, 2014, pp. 38-40. [cited by applicant]
Liang, et al., “Dual motion GAN for future-flow embedded video prediction,” proceedings of the IEEE international conference on computer vision, 2017, 9 pages. [cited by applicant]
Mehrotra, “Elements of artifical neural networks,” MIT Press, 1997. [cited by applicant]
Arabzad, et al., “Football match results prediction using artificial neural networks; the case of Iran Pro League,” Journal of Applied Research on Industrial Engineering 1.3, Oct. 9, 2014, pp. 159-179. [cited by applicant]
PCT International Application No. PCT/US19/14614, International Search Report and Written Opinion of the International Searching Authority, dated Apr. 16, 2019, 9 pages. [cited by applicant]
PCT International Application No. PCT/US19/14608, International Search Report and Written Opinion of the International Searching Authority, dated Apr. 15, 2019, 12 pages. [cited by applicant]
PCT International Application No. PCT/US21/16583, International Search Report and Written Opinion of the International Searching Authority, dated Apr. 23, 2021, 11 pages. [cited by applicant]
Acuna, “Unsupervised modeling of the movement of basketball players using a deep generative model,” 31st Conference on Neural Information Processing Systems, 2017, 11 pages. [cited by applicant]
Felsen, et al., “Where will they go? predicting fine-grained adversarial multi-agent motion using conditional variational autoencoders,” Proceedings of the European conference on computer vision (ECCV), 2018, pp. 761-77… [cited by applicant]
Nakashima, et al., “Off-line learning of soccer formations from game logs,” 2010 World Automation Congress, 2010, 6 pages. [cited by applicant]
Janetzko, et al., “Feature-driven visual analytics of soccer data,” 2014 IEEE conference on visual analytics science and technology (VAST), Nov. 2014, pp. 13-22. [cited by applicant]
Wagenaar, “Predicting Goal-Scoring Opportunities in Soccer by Using Deep Convolutional Neural Networks,” Department of Artificial Intelligence, University of Groningen, Nov. 16, 2016, 65 pages. [cited by applicant]
Abreu, et al., “Improving a simulated soccer team's performance through a Memory-Based Collaborative Filtering approach,” Applied Soft Computing 23, 2014, pp. 180-193. [cited by applicant]
McCabe, et al., “Artificial intelligence in sports prediction,” Fifth International Conference on Information Technology: New Generations, IEEE Computer Society, Apr. 9, 2008, 4 pages. [cited by applicant]
Abdullah, et al., “Intelligent prediction of soccer technical skill on youth soccer player's relative performance using multivariate analysis and artificial neural network techniques,” International Journal on Advanced … [cited by applicant]
Preferred Networks, Inc., “Football Analytics using Deep Learning,” YouTube, https://www.youtube.com/watch?v=hs_v3dv6OUI, Jul. 25, 2019, 3 pages. [cited by applicant]
Power, et al., “Not all passes are created equal: Objectively measuring the risk and reward of passes in soccer from tracking data,” Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and… [cited by applicant]
Cervone, et al., “A multiresolution stochastic process model for predicting basketball possession outcomes,” Journal of the American Statistical Association 111.514, 2016, pp. 585-599. [cited by applicant]
Ruiz, et al., “The Leicester City Fairytale?” Utilizing New Soccer Analytics Tools to Compare Performance in the 15/16 & 16/17 EPL Seasons, Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discov… [cited by applicant]
Gyarmati, et al., “Searching for a unique style in soccer,” arXiv preprint arXiv:1409.0308, 2014, 4 pages. [cited by applicant]
PCT International Application No. PCT/US21/53117, International Search Report and Written Opinion of the International Searching Authority, dated Jan. 14, 2022, 9 pages. [cited by applicant]
Pourmehr, et al., “An overview on opponent modeling in RoboCup soccer simulation 2D,” Springer, 2011, pp. 402-414. [cited by applicant]
Hubácek, et al., “Lifted Relational Team Embeddings for Predictive Sports Analytics,” ILP Up-and-Coming/Short Papers, 2018, 7 pages. [cited by applicant]
Blaikie, et al., “NFL & NCAA Football Prediction using Artificial Neural network,” Proceedings of the Midstates Conference for Undergraduate Research in Computer Science and Mathematics, 2011, 8 pages. [cited by applicant]
Zhao, Yu, et al., “Applying deep bidirectional LSTM and mixture density network for basketball trajectory prediction,” Optik, 2018, pp. 266-272. [cited by applicant]
Wei, “Modelling and Predicting Adversarial Behaviors using Large Amounts of Spatiotemporal Data,” Queensland University of Technology, 2016, 164 pages. [cited by applicant]
Carney, et al., “Predicting probability distributions for surf height using an ensemble of mixture density networks,” Proceedings of the 22nd international conference on Machine learning, 2005, 8 pages. [cited by applicant]
Ji, et al., “NBA All-Star lineup prediction based on neural networks,” 2013 International Conference on Information Science and Cloud Computing Companion, 2013, pp. 864-869. [cited by applicant]
Pettersson, et al., “Football match prediction using deep learning,” Department of Electrical Engineering, Chalmers University of Technology, 2017, 72 pages. [cited by applicant]
Maher, “Modelling Association Football Scores”, Statistica Neerlandica 36, nr.3, Published 1982, pp. 109-118. [cited by applicant]
Dixon, et al., “Modelling Association Football Scores and Inefficiencies in the Football Betting Market”, Appl Statist 46. No. 2, Published 1997, pp. 265-280. [cited by applicant]
Koopman, et al., “A dynamic bivariate Poisson model for analysing and forecasting match results in the English Premier League”, Dated Sep. 24, 2012, 30 pages. [cited by applicant]
Boshnakov, et al., “A Bivariate Weibull Count Model For Forecasting Association Football Scores”, Dated Sep. 9, 2016, 13 pages. [cited by applicant]
Boice, “How Our Club Soccer Projections Work”, Five ThirtyEight, https://fivethirtyeight.com/features/how-our-club-soccer-projections-work/, Dated Jan. 19, 2017, 6 pages. [cited by applicant]
Goddard, et al., “Modelling football match results and the efficiency of fixed-odds betting”, Published 2004, 27 pages. [cited by applicant]
Huang, et al., “A Neural Network Method for Prediction of 2006 World Cup Football game”, Published 2010 IEEE, 8 pages. [cited by applicant]
Kharrat, et al., “Plus-Minus Player Ratings for Soccer”, arXiv:1706.04943v1, Dated Jun. 16, 2017, 17 pages. [cited by applicant]
Dubow, “San Antonio Spurs' Kawhi Leonard ruled out for Game 2 vs. Golden State Warriors”, http://www.nba.com/article/2017/05/15/san-antonio-spurs-kawhi-leonard-out-game-2, Dated May 15, 2017, 4 pages. [cited by applicant]
Beuoy, “Updated NBA Win Probability Calculator”, InPredictable, http://www.inpredictable.com/2015/02/updated-nba-win-probability-calculator.html, Dated Feb. 6, 2015, 4 pages. [cited by applicant]
Asif, et al., “In-Play forecasting of win probability in One-Day International cricket: A dynamic logistic regression model”, International Journal of Forecasting 32, Published 2016, pp. 34-43. [cited by applicant]
Pelechrinis, “iWinRNFL: A Simple, Interpretable & Well-Calibrated In-Game Win Probability Model for NFL”, arXiv:1704.00197v3, Dated Mar. 14, 2018, 7 pages. [cited by applicant]
Lock, et al., “Using random forests to estimate win probability before each play of an NFL game”, JQAS 2014; 10(2); Published 2014, pp. 197-205. [cited by applicant]
Schechtman-Rock, “Introducing NFLWin: An Open Source Implementation of NFL Win Probability”, PhD Football, http://phdfootball.blogspot.com/2016/09/introducing-nflwin-open-source.html, Dated Sep. 1, 2016, 4 pages. [cited by applicant]
Bishop, “Mixture Density Networks”, Neural Computing Research Group Report, NCRG/94/004, Dated Feb. 1994, 26 pages. [cited by applicant]
Kingma, et al., “Adam: A Method for Stochastic Optimization”, arXiv:1412.6980v9, ICLR 2015, Dated Jan. 30, 2017, 15 pages. [cited by applicant]
Paine, “The Pats' Comeback Was Incredible—Even If You Think The Falcons Blew It”, FiveThirtyEight, https://fivethirtyeight.com/features/patriots-falcons-comeback-super-bowl/, Dated Feb. 6, 2017, 4 pages. [cited by applicant]
Deerwester, et al., “Indexing by Latent semantic Analysis”, Published 1990, 34 pages. [cited by applicant]
Blei, et al., “Latent Dirichlet Allocation”, Journal of Machine Learning Research 3, Published 2003, pp. 993-1022. [cited by applicant]
Bengio, et al., “A Neural Probabilistic Language Model”, Journal of Machine Learning Research 3, Published 2003, pp. 1137-1155. [cited by applicant]
Mikolov, et al., “Efficient Estimation of Word Representations in Vector Space”, arXiv:1301.3781v3, Dated Sep. 7, 2013, 12 pages. [cited by applicant]
Mikolov, et al., “Distributed Representations of Words and Phrases and their Compositionality”, Published 2013, 9 pages. [cited by applicant]
Ho, “Random Decision Forests”, Published 1995 IEEE, pp. 278-282. [cited by applicant]
Van den Oord, et al., “WaveNet: A Generative Model For Raw Audio”, arXiv:1609.03499v2, Dated Sep. 19, 2016, 15 pages. [cited by applicant]
Chung, et al., “Hierarchical Multiscale Recurrent Neural Networks”, ICLR 2017, arXiv:1609.01704v7, Dated Mar. 9, 2017, 13 pages. [cited by applicant]
Graves, “Generating Sequences with Recurrent Neural Networks”, arXiv:1308.0850v5, Dated Jun. 5, 2014, 43 pages. [cited by applicant]
Al-Shboul, et al., “Automated Player Selection for Sports Team using Competitive Neural Networks”, International Journal of Advanced Computer Science and Applications (IJACSA), vol. 8, No. 8, 2017, pp. 457-460. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/014609, dated Apr. 12, 2019, 10 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/014613, dated Apr. 12, 2019, 9 pages. [cited by applicant]
Yue, et al., “Learning Fine-Grained Spatial Models for Dynamic Sports Play Prediction”, ICDM, 2014, 10 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2016/066733, dated Apr. 17, 2017, 11 pages. [cited by applicant]
Sha, et al., “Chalkboarding: A New Spatiotemporal Query Paradigm for Sports Play Retrieval”, IUI, 2016, 12 pages. [cited by applicant]
Cox, et al., “Least Squares Congealing for Unsupervised Alignment of Images”, CVPR, 2008, 8 pages. [cited by applicant]
Hinton, et al. “A Fast Learning Algorithm for Deep Belief Nets”, Neural Comput, 18(7), 2006, pp. 1527-1554. [cited by applicant]
Peng, et al., “RASL: Robust Alignment by Sparse and Low-rank Decomposition for Linearly Correlated Images”, PAMI, vol. 34, No. 11, 2012, 8 pages. [cited by applicant]
Miller, et al., “Factorized Point Process Intensities: A Spatial Analysis of Professional Basketball”, ICML, Jan. 8, 2014, 13 pages. [cited by applicant]
PCT International Application No. PCT/US22/77383, International Search Report and Written Opinion of the International Searching Authority, dated Dec. 13, 2022, 15 pages. [cited by applicant]
PCT International Application No. PCT/US22/76934, International Search Report and Written Opinion of the International Searching Authority, dated Dec. 13, 2022, 10 pages. [cited by applicant]
PCT International Application No. PCT/US21/34568, International Search Report and Written Opinion of the International Searching Authority, dated Aug. 25, 2021, 9 pages. [cited by applicant]
Wagenaar, et al. “Using deep convolutional neural networks to predict goal-scoring opportunities in soccer,” International Conference on Pattern Recognition Applications and Methods, vol. 2, SCITEPRESS, 2017, 8 pages. [cited by applicant]
Stein, et al. “Bring it to the pitch: Combining video and movement data to enhance team sport analysis,” IEEE transactions on visualization and computer graphics Jan. 24, 2017,, pp. 13-22. [cited by applicant]
Merhej, et al., “What Happened Next? Using Deep Learning to Value Defensive Actions in Football Event-Data,” KDD, Aug. 2021, pp. 3394-3403. [cited by applicant]
PCT International Application No. PCT/US22/15240, International Search Report and Written Opinion of the International Searching Authority, dated May 11, 2022, 7 pages. [cited by applicant]
CD160 isoforms and regulation of CD4 and CD8 T-cell responses, Authors: Mohamed El-Far, Charles Pellerin, Louise Pilote, Jean-Francois Fortin, Ivan A D Lessard, Yoav Peretz, Elizabeth Wardrop, Patrick Salois, Richard C … [cited by applicant]
Extended European Search Report for European Application No. 16876628.5, mailed Jan. 29, 2020, 17 Pages. [cited by applicant]
Extended European Search Report for European Application No. 19740811.5, mailed Sep. 21, 2021, 10 Pages. [cited by applicant]
Extended European Search Report for European Application No. 19741311.5, mailed Sep. 15, 2021, 09 Pages. [cited by applicant]
Extended European Search Report for European Application No. 19741603.5, mailed Jun. 2, 2022, 11 Pages. [cited by applicant]
Extended European Search Report for European Application No. 19741793.4, mailed Jun. 28, 2022, 10 Pages. [cited by applicant]
Extended European Search Report for European Application No. 20765556.4, mailed Oct. 7, 2022, 12 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2016/066733, mailed Jun. 28, 2018, 9 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014608, mailed Jul. 30, 2020, 10 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014609, mailed Jul. 30, 2020, 08 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014613, mailed Jul. 30, 2020, 07 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/014614, mailed Jul. 30, 2020, 6 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2020/020432, mailed Sep. 16, 2021, 10 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2020/032053, mailed Nov. 18, 2021, 08 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2021/016583, mailed Aug. 18, 2022, 11 Pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2021/034568 , mailed Dec. 15, 2022, 8 Pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/020432, mailed May 28, 2020, 11 Pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/032053, mailed Sep. 29, 2020, 09 Pages. [cited by applicant]
Learned-Miller E.G., “Data Driven Image Models through Continuous Joint Alignment,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Feb. 2006, vol. 28, No. 2, pp. 236-250. [cited by applicant]
Partial Supplementary European Search Report for European Application No. 16876628.5, mailed Aug. 14, 2019, 16 Pages. [cited by applicant]
The CD160^+ CD8^h^i^g^h cytotoxic T cell subset correlates with response to HAART in HIV-1+ patients, Authors: Nikolova, Muhtarova M H, Taskov M N, Kostov H B, Vezenkov K, Mihova L, Boumsell A, Bensussan L, A, Publicati… [cited by applicant]
Wei X., et al., “Large-Scale Analysis of Formations in Soccer,” Proceedings of the Digital Image Computing: Technqiues and Applications (DICTA), IEEE, Nov. 26, 2013, pp. 1-8, XP032536466, DOI:10.1109/DICTA.2013.6691503. [cited by applicant]
Wei X., et al., “Predicting Serves in Tennis Using Style Priors,” Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, 9 pages. [cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2022201634 dated Mar. 7, 2023, 4 Pages. [cited by applicant]
Extended European Search Report for Application No. 20801519.8, dated May 19, 2023, 7 pages. [cited by applicant]
International Preliminary Report on Patentability for the Application No. PCT/US2021/053117, mailed Apr. 13, 2023, 8 pages. [cited by applicant]
Office Action for European Patent Application No. 20801519.8, mailed Jun. 6, 2023, 1 page. [cited by applicant]
ESPN Staff, “Neymar from Barca to PSG for €222m: Timeline of the world's biggest transfer”, ESPN, http://www.espn.com/soccer/blog/soccer-transfers/613/post/3170513/neymar-from-barcelona-to-psg-for-222m-euros-timeline-as… [cited by applicant]
Pulling, “Long Corner Kicks In The English Premier League: Deliveries Into The Goal Ara And Critical Area”, Kinesiology: International journal of fundamental and applied kinesiology 47.2, 2015, pp. 193-201. [cited by applicant]
Casal, et al., “Analysis of Corner Kick Success in Elite Football”, International Journal of Performance Analysis in Sport 2015, pp. 430-451. [cited by applicant]
Bialkowski, et al., “Large-Scale Analysis of Soccer Matches using Spatiotemporal Tracking Data”, IEEE International Conference on Data Mining, 2014, 6 pages. [cited by applicant]
Lucey, et al., “Quality vs Quantity: Improved Shot Prediction in Soccer using Strategic Features from Spatiotemporal Data”, 9th Annual MIT Sloan Sports Analytics Conference, Feb. 27-28, 2015, 9 pages. [cited by applicant]
Le, et al., “Data-Driven Ghosting using Deep Imitation Learning”, MIT Sloan Sports Analytics Conference, Mar. 3-4, 2017, 15 pages. [cited by applicant]
Cervone, et al., “Pointwise: Predicting Points and Valuing Decisions in Real Time with NBA Optical Tracking Data”, 8th Annual MIT Sloan Sports Analytics Conference, Feb. 28-Mar. 1, 2014, 9 pages. [cited by applicant]
Ross, et al., “Shortcomings in the attribution process: On the origins and maintenance of erroneous social assessments”, Cambridge University Press, 1982, pp. 129-152. [cited by applicant]
Wright, “Liverpool's set-piece problem exposed in 3-3 draw with Watford”, https://www.skysports.com/football/news/15117/10985307/liverpools-set-piece-problem-exposed-in-3-3-draw-with-watford, Dec. 8, 2017, 9 pages. [cited by applicant]
Walters, “Virgil van Dijk transfer may not fix Liverpool's dismal defending of set-pieces warns Jurgen Klopp after Watford woe”, https://www.mirror.co.uk/sport/football/news/liverpool-klopp-van-dijk-setpiece-10981217, A… [cited by applicant]
Frey, et al., “Clustering by Passing Messages Between Data Points” Science Magazine, Feb. 15, 2007, 23 pages. [cited by applicant]
Anderson, et al., “The Numbers Game: Why Everything You Know About Soccer is Wrong”, 2013, Penguin Books. [cited by applicant]