IP Library Granted Patent US 11,676,639
Granted Patent B2
US 11,676,639 · App. 17/332,720 · Granted Jun 13, 2023

Intelligent sports video and data generation from AI recognition events

Inventors: William G. Near (Portsmouth, NH); Jason W. Evans (Somerville, MA)
G11B27/11G06V20/42G11B27/031G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,676,639
App. No.
17/332,720
Granted
Jun 13, 2023
Kind
B2
Abstract

An intelligent sports video and data generating system using AI detection engines in Sports Detection Devices, broadcasting commands that incorporate global time stamp information to a plurality of the Sports Detection Devices, such that the recorded sports action data can be time-aligned with video data, wherein an automatically spliced together video or data set can be generated based on the parameters of an input query.

Claims (47)

1. A method of coordinating time on a plurality of sports detection devices comprising the steps of:

broadcasting a session identification number to a plurality of sports detection devices, wherein each sports detection device is comprised of:

a sensor array system having a plurality of sensors and an AI recognition engine;

at least one CPU or MCU;

memory,

antenna; and

a power source,

wherein the AI recognition engine is configured to receive sensed data from the plurality of sensors from an associated individual performing sports actions and identify from the sensed data using an action detection model a specific sports action;

wherein the session identification number is associated with a global time stamp, a unique sports session, and at least one command code;

generating a plurality of local time stamps in response to the generated received session identification number;

receiving sensed data by at least one of the plurality of sports detection devices and determining using at least one of the sports detection devices whether a sports action has occurred during the unique sports session; and

associating a local time stamp with each determined sports action.

2. The method of coordinating time on a plurality of sports detection devices of claim 1 , further comprising the step of:

receiving video data associated with the sports session, wherein the video data includes a global time stamp.

3. The method of coordinating time on a plurality of sports detection devices of claim 2 , further comprising the step of:

time aligning the video data with each determined sports action.

4. The method of coordinating time on a plurality of sports detection devices of claim 3 , further comprising the step of:

automatically editing the time aligned video to portions wherein a determined sports action occurred.

5. The method of coordinating time on a plurality of sports detection devices of claim 4 , further comprising the step of:

automatically editing the time aligned video further to portions wherein a particular individual associated with the determined sports action occurred.

6. The method of time-aligning data on a plurality of sports detection devices of claim 1 , further comprising the step of:

sending a connectionless signal indicating a timed-trial mode is initiated.

7. The method of coordinating time data on a plurality of sports detection devices of claim 1 , further comprising the step of:

monitoring by the sports detection device for the beginning of a sports action to be timed;

identifying by the sports detection device the ending of the sports action to be timed; and

sending the timed sports action from the sports detection device to a computing device.

8. The method of coordinating time data on a plurality of sports detection devices of claim 1 , further comprising the step of generating one of the following commands: start, stop, update, timed-trial and annotation.

9. The method of coordinating time data on a plurality of sports detection devices of claim 8 , wherein the annotation command further includes inputting into a wireless device one of an audio input, visual input, and pre-determined marker to be associated with the local time stamp and configured to be retrievable later with the associated sensed data at or around the moment of the annotation command.

10. The method of coordinating time data on a plurality of sports detection devices of claim 1 , further comprising the step of receiving multiple sets of video data each having a global time stamp from a plurality of video sources associated with the sports detection session, and wherein each set of video data is automatically time-aligned to the sensed data from the sports detection device.

11. The method of coordinating time data on a plurality of sports detection devices of claim 1 , further comprising the step of periodically broadcasting a signal during the sports session that includes the original global time stamp sent and a local time offset.

12. The method of coordinating time data on a plurality of sports detection devices of claim 11 , wherein any sports detection device receiving the periodically broadcast signal after the original broadcasting of the global time stamp can then be associated with the same sports session.

13. The method of coordinating time data on a plurality of sports detection devices of claim 11 , wherein the global time stamp is in UTC form and the local time offset is in 1 second increments from the original global time stamp.

14. The method of coordinating time data on a plurality of sports detection devices of claim 2 , further comprising the steps of:

receiving an input query,

identifying sensed data based on the query,

automatically time-aligning the identified sensed data to the video data, and

generating an output of the time-aligned identified sensed data and video data in response to input query.

15. The method of coordinating time data on a plurality of sports detection devices of claim 14 , wherein the input query includes any of: type of sports action, player, play sequence, sports session, and type of video data.

16. The method of coordinating time data on a plurality of sports detection devices of claim 15 , further including associating with a player a player profile, and wherein the player profile is associated with one or more sports detection devices.

17. The method of coordinating time data on a plurality of sports detection devices of claim 1 , further comprising the step of receiving from an annotation device an annotation command.

18. A method of communicating with a plurality of sports detection devices comprising the steps of:

broadcasting from a mobile computing device a command that includes a session identification number that includes a global time stamp as part of the command to a plurality sports detection devices;

associating the session identification number with a unique sports session;

generating a plurality of local time stamps in response to the received session identification number;

sending an outbound broadcast from each of the plurality of sports detection devices indicative that each received the broadcast command from the mobile computing device;

rebroadcasting the command periodically from the mobile computing device or from one of the plurality of sports detection devices; and

receiving by at least one additional sports detection device the rebroadcast command or the outbound response, and generating a local time stamp based on the session identification associated with the sports session on the additional sports detection device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2022
From: NEAR, WILLIAM G; EVANS, JASON W
To: HELIOS SPORTS, INC.
Reel/Frame 061526/0403 →
Continuity (2)
Provisional Application 63030688 · May 27, 2020
Related Publication 20210375325A1 · Dec 2, 2021