IP Library Granted Patent US 11,605,225
Granted Patent B2
US 11,605,225 · App. 17/715,616 · Granted Mar 14, 2023

Automatic determination and monitoring of vehicles on a racetrack with corresponding imagery data for broadcast

Inventors: Jeroen B. Floor (San Jose, CA); Paulus Weemaes (Campbell, CA)
Assignee: SPORTSMEDIA TECHNOLOGY CORPORATION
G06V20/42G06T7/20G06V20/52G06V20/44H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,605,225
App. No.
17/715,616
Granted
Mar 14, 2023
Kind
B2
Abstract

Methods and systems for automatically tracking and analyzing imagery data of at least one vehicle on a racetrack comprising. A video event management system with a plurality of video cameras positioned around a racetrack determines the presence of the at least one vehicle and based on a weighted event score corresponding to dynamics for the at least one vehicle and other objects captures video imagery and stills and generates at least one subframe. Excess video imagery data and excess stills data are discarded based on metadata of linked subframes.

Claims (61)

1. A method for automatically tracking and analyzing imagery data and telemetry data of at least one vehicle on a racetrack comprising:

providing a plurality of video cameras positioned around the racetrack;

providing a video event management system including a processor, a memory, and a database;

the video event management system receiving video imagery from the plurality of video cameras and storing the video imagery and stills of the video imagery;

obtaining telemetry data from at least one vehicle;

selecting imagery data of the at least one vehicle based on the telemetry data of the at least one vehicle;

based on the imagery data, determining vehicle dynamics, including real-world positions, real-world velocities, camera image positions, and/or camera image velocities of both the at least one vehicle and at least one other object, wherein the at least one other object is at least one person, at least one other vehicle, or at least one group of vehicles;

deriving a quantified event score for the at least one vehicle through application of rules to the imagery data and/or the telemetry data of the at least one vehicle;

generating at least one floating subframe within a full frame of a first video camera of the plurality of video cameras encompassing the at least one vehicle and/or a vehicle path if the quantified event score of the at least one vehicle is greater than a threshold event score;

determining an imminent vehicle entry into a field of view of a second video camera of the plurality of video cameras and based on the telemetry data and the vehicle dynamics;

determining a direction and a point of entry of the at least one vehicle into the field of view of the second video camera of the plurality of video cameras;

generating at least one second floating subframe based on the imminent vehicle entry;

retrieving camera image velocity data and camera image position data of the at least one floating subframe and transforming the camera image velocity data and the camera image position data based on an angle and a position of the second video camera of the plurality of video cameras such that the at least one floating subframe is operable to continuously and smoothly track the at least one vehicle from the at least one floating subframe and the at least one second floating subframe;

adjusting subframe coordinates of the at least one floating subframe based on the vehicle dynamics, wherein the adjusting the subframe coordinates comprises setting a tracking velocity for the subframe coordinates to match a velocity and a direction of the at least one vehicle based on the camera image positions and the camera image velocities of the at least one vehicle;

linking the at least one floating subframe to the video imagery and the stills of the video imagery;

storing video imagery data and stills data for a specific subframe based on the quantified event score;

wherein the application of the rules includes adding a numerical value to the quantified event score upon a determination of a celebrity status of the at least one vehicle driver.

2. The method of claim 1 , further comprising detecting the imagery data, wherein the detecting the imagery data of the at least one vehicle further comprises using sound detection, magnetic object detection, near field electromagnetic detection, or image outline detection.

3. The method of claim 1 , wherein the determining the vehicle dynamics, including the real-world positions, the real-world velocities, the camera image positions, and the camera image velocities further comprises converting three-dimensional (3D) world coordinates to 3D camera image coordinates, converting the 3D camera image coordinates to two-dimensional (2D) camera image undistorted screen coordinates, and converting the 2D camera image undistorted screen coordinates to 2D distorted screen coordinates, and wherein the 2D distorted screen coordinates have been converted from the 2D camera image undistorted screen coordinates in order to account for camera or lens distortion using intrinsic and extrinsic sensors on the camera and/or reference marks.

4. The method of claim 1 , wherein the plurality of video cameras are unmanned and are fixed with stationary fields of view.

5. The method of claim 1 , further comprising constructing the subframe coordinates with the camera image positions of the at least one vehicle centered within the subframe coordinates.

6. The method of claim 1 , further comprising discarding excess video imagery data and excess stills data of the linked video imagery and the linked stills of the video imagery based on the quantified event score.

7. A system for automatically tracking and analyzing imagery data and telemetry data of at least one vehicle on a racetrack comprising:

a plurality of video cameras positioned around the racetrack with a combined field of view of the racetrack; and

a video event management system including a processor, a memory, and a database;

wherein the video event management system is operable to:

receive video imagery from the plurality of video cameras;

store the video imagery and stills of the video imagery;

obtain telemetry data of the at least one vehicle;

select imagery data of the at least one vehicle based on the telemetry data of the at least one vehicle;

based on the imagery data and the telemetry data, determine vehicle dynamics, including real-world positions, real-world velocities, camera image positions, and/or camera image velocities of both the at least one vehicle and at least one other object, wherein the at least one other object is at least one person, at least one other vehicle, or at least one group of vehicles;

derive a quantified event score for the at least one vehicle through application of rules to the imagery data and the telemetry data of the at least one vehicle, wherein the application of the rules includes comparing one or more first celebrity status attributes to one or more second celebrity status attributes of a second group of one or more objects of potential interest on the racetrack, wherein the second group of one or more objects of potential interest includes at least one second vehicle, and wherein the application of the rules includes adding a numerical value to the quantified event score upon a determination of a celebrity status of the at least one vehicle driver;

generate at least one floating subframe within a full frame of a video camera encompassing the at least one vehicle or vehicle path, wherein the video camera is selected from the plurality of video cameras;

adjust subframe coordinates based on the vehicle dynamics; and

link the at least one floating subframe to the video imagery and the stills of the video imagery.

8. The system of claim 7 , wherein the adjusting the subframe coordinates comprises setting a tracking velocity for the subframe coordinates to match a velocity and a direction of the at least one vehicle based on the camera image positions and the camera image velocities of the at least one vehicle.

9. The system of claim 7 , wherein the at least one floating subframe includes metadata indicating subframe metadata and vehicle metadata, including the quantified event score, the vehicle dynamics, a subframe resolution, and subframe coordinates.

10. The system of claim 7 , further comprising at least one data acquisition and positioning system including a Global Positioning System (GPS) antenna and a telemetry antenna attached to the at least one vehicle, wherein the video event management system provides the telemetry data of the at least one vehicle.

11. The system of claim 7 , wherein the video imagery and the stills of the video imagery includes video imagery data and stills data for a specific subframe based on the quantified event score.

12. The system of claim 7 , wherein the video event management system is further operable to

discard excess video imagery data and excess stills data of the linked video imagery and the linked stills of the video imagery based on the quantified event score.

13. A method for automatically tracking and analyzing imagery data and telemetry data of at least one vehicle on a racetrack comprising:

providing a plurality of video cameras positioned around the racetrack;

providing a video event management system including a processor, a memory, and a database;

the video event management system:

receiving video imagery from the plurality of video cameras;

storing the video imagery and stills of the video imagery;

obtaining telemetry data from at least one data acquisition and positioning system of the at least one vehicle;

selecting imagery data of the at least one vehicle based on the telemetry data of the at least one vehicle;

based on the imagery data and the telemetry data, determining vehicle dynamics, including real-world positions, real-world velocities, camera image positions, and/or camera image velocities of both the at least one vehicle and at least one other object, wherein the at least one other object is at least one person, at least one other vehicle, or at least one group of vehicles;

deriving a quantified event score for the at least one vehicle by application of an algorithm comprising rules to the imagery data and/or the telemetry data of the at least one vehicle on the racetrack, wherein the rules include adding a numerical value to the quantified event score upon a determination of a celebrity status of the at least one vehicle driver;

generating at least one floating subframe within a full frame of a video camera encompassing the at least one vehicle or vehicle path, wherein the video camera is selected from the plurality of video cameras;

adjusting subframe coordinates based on the vehicle dynamics;

linking the at least one floating subframe to the video imagery and the stills of the video imagery; and

storing video imagery data and stills data for a specific subframe based on the quantified event score.

14. The method of claim 13 , wherein the at least one data acquisition and positioning system includes a Global Positioning System (GPS) antenna and a telemetry antenna.

15. The method of claim 13 , wherein the plurality of video cameras are fixed with stationary fields of view.

16. The method of claim 13 , wherein the rules define an add, subtract, multiply, or divide operation for the quantified event score of the at least one vehicle, wherein the pre-set rules include weighted operations for each of the vehicle position, the vehicle operations status, the driver identity, and the events.

17. The method of claim 13 , wherein the adjusting the subframe coordinates further comprises setting a tracking velocity for the subframe coordinates to match a velocity and a direction of the at least one vehicle based on the camera image positions and the camera image velocities of the at least one vehicle.

18. The method of claim 13 , further comprising discarding excess video imagery data and excess stills data of the linked video imagery and the linked stills of the video imagery based on the quantified event score.

19. The method of claim 13 , wherein the at least one floating subframe includes metadata indicating subframe metadata and vehicle metadata, including the quantified event score, the vehicle dynamics, a subframe resolution, and subframe coordinates.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2022
From: FLOOR, JEROEN B.; WEEMAES, PAULUS
To: SPORTVISION, INC.
Reel/Frame 059555/0580 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2022
From: SPORTVISION, INC.
To: SPORTSMEDIA TECHNOLOGY CORPORATION
Reel/Frame 059555/0706 →
Continuity (3)
Continuation 16037403 · Jul 17, 2018
Continuation In Part 14677759 · Apr 2, 2015
Related Publication 20220230436A1 · Jul 21, 2022
Cited By (4)
US 12,212,892 US 12,712,987 US 12,720,014 US 12,720,015