IP Library Granted Patent US 11,310,418
Granted Patent B2
US 11,310,418 · App. 16/962,582 · Granted Apr 19, 2022

Computer-implemented method for automated detection of a moving area of interest in a video stream of field sports with a common object of interest

Inventors: Jesper Molbech Taxbol (Copenhagen S, DK); Henrik Bjorn Teisbæk (Copenhagen O, DK); Keld Reinicke (Copenhagen S, DK)
Assignee: VEO TECHNOLOGIES APS
H04N5/23238G06K9/00724G06T7/20G06T7/70H04N5/247G06T2207/10016G06T2207/30221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,310,418
App. No.
16/962,582
Granted
Apr 19, 2022
Kind
B2
Abstract

A computer-implemented method is provided for automated detection of a moving area of interest, such as a ball, in a video stream of filed sports with a common object of interest encompassing a plurality of players and the object of interest. Images of a sports ground are captured by means of a video camera system producing a video stream which is digitally processed to continuously identify a detected concentration of action within the boundaries of the field. The concentration of action in the field is determined based on an estimated position of the object of interest in at least one frame of the video stream. Players' postures or orientations may be detected to improve the accuracy of the determination of the object of interest.

Claims (36)

1. A computer-implemented method for automated detection of a moving area of interest in a video stream of field sports with a common object of interest encompassing a plurality of players and the object of interest, the method comprising the steps of:

(i) image capturing a sports ground by means of a video camera system to produce the video stream;

(ii) digitally processing the video stream to continuously identify the area of interest of the game within the boundaries of the sports ground, wherein the area of interest in the sports ground is determined on the basis of an estimated position of the object of interest in at least one frame of the video stream;

wherein the position of the object of interest is determined by use of a computer vision and machine learning module;

wherein the players' orientations and/or postures in the video stream are detected on the basis of a probability map of the position of the object of interest relative to each player.

2. The method according to claim 1 , wherein the machine learning module is configured to detect the players' orientations and/or postures in the video stream.

3. The method according to claim 1 , wherein the machine learning module is configured to carry out at least one of the following steps:

detect the ball in the video stream;

detect the players in the video stream;

detect one or more predetermined events based on the players' position in the video stream;

detect the area of interest in the video stream.

4. The method according to claim 3 , wherein the machine learning module outputs a single channel image presenting the probability of the object of interest being present in an input frame to the machine learning module.

5. The method according to claim 4 , further comprising the step of updating the probability of the position of the object of interest in the frame, and representing the particles in a digital output frame or in a stream of digital output frames, and automatically estimating the position of the object of interest on the basis of a detected density of a cloud of particles.

6. The method according to claim 3 , wherein the detection of players is carried out on the basis of:

pre-stored data representing the position of the video camera system relative to the sports ground; and

pre-stored information data representing characteristics of the players.

7. The method according to claim 6 , wherein the players are tracked in the digital video stream by use of linear quadratic estimation.

8. The method according to claim 1 , wherein estimated position of the object of interest is determined on the basis of a probability representation of the object of interest in the at least one frame of the video stream.

9. The method according to claim 1 , wherein at least 100 particles are modelled in the at least one frame of the video stream to determine each particle's probability of representing the object of interest.

10. The method according to claim 1 , wherein:

the machine learning module accesses and is thus trained using a database of uniformly sized pictures of players, each picture including one player, wherein in each of the pictures the position of the object of interest relative to the player is known; and

a probability of a direction of the object of interest is produced on runtime for each player.

11. The method according to claim 10 , further comprising the step of updating the probability of the position of the object of interest in the frame, and

representing the particles in a digital output frame or in a stream of digital output frames, and automatically estimating the position of the object of interest on the basis of a detected density of a cloud of particles;

wherein the probabilities of the presence of the object of interest as estimated are combined with said possible position of the object of interest relative to the player to estimate the position of the object of interest relative to the player.

12. The method according to claim 1 , wherein the concentration of action in the object of interest is detected on the basis of object of interest positions in a plurality of respective frames of the panoramic video stream captured between a first point in time and a second point in time.

13. The method according to claim 1 , wherein the concentration of action in the sports ground is detected on the basis of the detection of the players' positions relative to the sports ground in the plurality of frames of the panoramic video stream captured between a first point in time and a second point in time.

14. A computer-implemented method for automated detection of a moving area of interest in a video stream of field sports with a common object of interest encompassing a plurality of players and the object of interest, the method comprising the steps of:

(i) image capturing a sports ground by means of a video camera system to produce the video stream;

(ii) digitally processing the video stream to continuously identify the area of interest of the game within the boundaries of the sports ground, wherein the area of interest in the sports ground is determined on the basis of an estimated position of the object of interest in at least one frame of the video stream;

wherein the position of the object of interest is determined by use of a computer vision and machine learning module;

wherein at least 100 particles are modelled in the at least one frame of the video stream to determine each particle's probability of representing the object of interest;

wherein the step of modelling the particles comprises:

projecting each particle onto a point in each one of the at least one frame;

sampling the output of the machine learning module at that point in the said frame, onto which the particle is projected; and

updating the position of each particle by use of Newtonian dynamics.

Assignments (3)
CHANGE OF ADDRESS Recorded Mar 15, 2022
From: VEO TECHNOLOGIES APS
To: VEO TECHNOLOGIES APS
Reel/Frame 059366/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2020
From: TAXBOL, JESPER MOLBECH; TEISBÆK, HENRIK BJORN; REINICKE, KELD
To: SPORTCASTER APS
Reel/Frame 053270/0114 →
CHANGE OF NAME Recorded Jul 21, 2020
From: SPORTCASTER APS
To: VEO TECHNOLOGIES APS
Reel/Frame 053271/0636 →
Priority Claims (2)
EP 18152483 · Jan 19, 2018 · regional
EP 18152486 · Jan 19, 2018 · regional
Continuity (1)
Related Publication 20200404174A1 · Dec 24, 2020
Cited By (1)
US 12,496,524