IP Library Granted Patent US 10,482,319
Granted Patent B2
US 10,482,319 · App. 16/503,046 · Granted Nov 19, 2019

Tracking of handheld sporting implements using computer vision

Inventor: James G. Painter (Palo Alto, CA)
Assignee: SPORTSMEDIA TECHNOLOGY CORPORATION
G06K9/00348G06K9/00664G06K9/46G06T7/215G06T7/254G06T7/292H04N5/247G06K2009/4666G06T2207/10021G06T2207/30221G06T2207/30241H04N5/2625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,482,319
App. No.
16/503,046
Granted
Nov 19, 2019
Kind
B2
Abstract

A path and/or orientation of object approaching an athlete is tracked using two or more cameras. At least two sets of images of the object are obtained using at least two different cameras having different positions. Motion regions within images are identified, and candidate locations in 2D space of the object are identified within the motion region(s). Based thereon, a probable location in 3D space of the identifiable portion is identified, for each of a plurality of instants during which the object was approaching. A piecewise 3D trajectory of at least the identifiable portion of the object is approximated from the probable locations in 3D space of the object for multiple instants during which the object was approaching the athlete. A graphical representation of the 3D trajectory of the object is incorporated into at least one of the sets of images.

Claims (32)

1. A method for tracking a sporting implement during a sporting event, comprising:

at least one processor constructed and configured for receiving at least two different sets of images of the sporting implement;

the at least one processor identifying at least one motion region in the at least two different sets of images;

the at least one processor identifying a first location of at least one portion of the sporting implement within the at least one motion region;

the at least one processor identifying a second location of the at least one portion of the sporting implement based on the first location; and

the at least one processor superimposing a graphical representation of at least one part of a trajectory of the sporting implement over at least one of the at least two different sets of images.

2. The method of claim 1 , wherein the at least two different sets of images are received from at least two cameras.

3. The method of claim 1 , further comprising the at least one processor approximating the trajectory of the sporting implement based on a multiplicity of probable locations of the at least one portion of the sporting implement, wherein the multiplicity of probable locations includes the second location.

4. The method of claim 1 , further comprising the at least one processor filtering out at least one false positive candidate location of the at least one portion of the sporting implement.

5. The method of claim 1 , further comprising the at least one processor displaying the graphical representation of the at least one part of the trajectory of the sporting implement on a display.

6. The method of claim 1 , wherein the sporting implement is a handheld sporting implement, and wherein the at least two different sets of images comprise a movement of the handheld sporting implement.

7. The method of claim 1 , wherein the at least two different sets of images comprise an object moving toward the handheld sporting implement.

8. The method of claim 1 , further comprising the at least one processor identifying an approximate center of motion of the sporting implement and the at least one processor identifying the at least one first location based on the approximate center of motion of the sporting implement.

9. A system for tracking a sporting implement during a sporting event, comprising:

at least one processor constructed and configured for receiving at least two different sets of images of the sporting implement over a network;

wherein the at least one processor is operable to identify at least one motion region in the at least two different sets of images, identify a first location of at least one portion of the sporting implement within the at least one motion region, and identify a second location of the at least one portion of the sporting implement based on the first location;

wherein the at least one processor is further configured to approximate a trajectory of the sporting implement based on the second location of the at least one portion of the sporting implement; and

wherein the at least one processor is further configured to superimpose a graphical representation of the trajectory of the sporting implement over at least one of the at least two different sets of images.

10. The system of claim 9 , wherein the at least one processor is in communication with a display configured to display the graphical representation of the trajectory of the sporting implement.

11. The system of claim 9 , wherein the at least one processor is operable to identify the first location as at least one candidate location for the at least one portion of the sporting implement, determine a corresponding line of position in space for each of the at least one candidate location, and based on the corresponding lines of position in space for each of the at least one candidate location, identify the second location as a probable location in space of the at least one portion of the sporting implement.

12. The system of claim 11 , wherein the probable location includes a location from which distances to at least two of a multiplicity of lines of position are at a minimum.

13. The system of claim 9 , wherein the first location includes at least one candidate location, and wherein the second location includes at least one probable location.

14. The system of claim 9 , wherein the at least one processor is operable to filter out at least one false positive second location.

15. A system for tracking a sporting implement during a sporting event, comprising:

at least one processor constructed and configured for network communication with at least two cameras configured to capture at least two sets of images of the sporting implement;

wherein the at least one processor is configured to receive the at least two sets of images of the sporting implement, identify at least one motion region in the at least two sets of images, and approximate a trajectory of the sporting implement based on the at least two sets of images; and

wherein the at least one processor is further configured to superimpose a graphical representation of the trajectory of the sporting implement over at least one of the at least two sets of images.

16. The system of claim 15 , wherein the at least one processor is configured to approximate the trajectory of the sporting implement based on a multiplicity of locations of the at least one portion of the sporting implement using the at least two sets of images.

17. The system of claim 15 , wherein the at least one processor is configured to identify a first location of at least one portion of the sporting implement within the at least one motion region and identify a second location of the at least one portion of the sporting implement based on the first location.

18. The system of claim 15 , wherein the trajectory of the sporting implement comprises a path and an orientation of the sporting implement.

19. The system of claim 15 , wherein the at least one processor is operable to filter out at least one false positive location of the sporting implement.

20. The system of claim 15 , wherein the at least one processor is further operable to identify an approximate center of motion of the sporting implement, and the at least one processor is further operable to approximate the trajectory of the sporting implement based on the approximate center of motion of the sporting implement.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2021
From: PAINTER, JAMES G.
To: SPORTVISION, INC.
Reel/Frame 056387/0632 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2021
From: SPORTVISION, INC.
To: SPORTSMEDIA TECHNOLOGY CORPORATION
Reel/Frame 056387/0680 →