IP Library › Granted Patent US 12,423,834
Granted Patent B1
US 12,423,834 · App. 19/187,378 · Granted Sep 23, 2025

Systems and methods for monitoring user performance in launching an object at a sporting event

Inventors: Alan W. Marty (Menlo Park, CA); John Carter (Elkmont, AL)
Assignee: Pillar Vision, Inc.
G06T7/246G06T7/80H04N23/51G06T2207/10016G06T2207/30224G06T2207/30241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,423,834
App. No.
19/187,378
Granted
Sep 23, 2025
Kind
B1
Abstract

Methods and apparatus for monitoring user performance in launching objects at sporting events are described. A described method includes capturing, with a camera on glasses worn by a player participating in a sporting event, a plurality of two-dimensional (2-D) images of an object launched by a player participating in the sporting event. The launched object is identified and tracked with the camera for which an orientation is determined using an accelerometer. Based on the tracking, a position of the launched object at a point along a trajectory relative to a stationary object is determined, and an output indicative of user performance is provided based on the determined position of the launched object.

Claims (35)

1. A method, comprising:

capturing, with a camera on glasses worn by a player participating in a sporting event, a plurality of two-dimensional (2-D) images of an object launched by a player participating in the sporting event;

identifying the launched object in the plurality of 2-D images;

tracking the launched object based on the plurality of 2-D images, the tracking comprising determining positions of the launched object in three-dimensional (3-D) space;

determining an orientation of the camera based on at least one accelerometer and at least one of the plurality of 2-D images, wherein the determining the positions of the launched object in 3-D space is based on the determined orientation;

identifying a stationary object in the plurality of 2-D images;

determining a position of the launched object at a point along the trajectory relative to the stationary object based on the tracking;

providing an output based on the determined position of the launched object at the point along the trajectory relative to the stationary object; and

rendering a simulation of the trajectory based on the tracking.

2. The method of claim 1 , wherein the stationary object is a goal to which the launched object is shot in the sporting event.

3. The method of claim 1 , wherein the stationary object includes a marking for a boundary of a court or field on which the sporting event is played.

4. The method of claim 1 , wherein the determining the orientation of the camera is based on the stationary object.

5. The method of claim 1 , wherein launched object is a ball.

6. The method of claim 1 , wherein the determining the orientation of the camera based on the at least one accelerometer is performed for each of the plurality of 2-D images, and wherein the capturing is performed as the player wearing the glasses is moving.

7. The method of claim 6 , wherein the determining the orientation of the camera is based on the stationary object.

8. The method of claim 1 , wherein the determining the orientation of the camera comprises determining a reference plane based on the at least one accelerometer.

9. The method of claim 8 , wherein the determining the positions of the launched object in 3-D space is based on the reference plane.

10. A system, comprising:

a camera positioned on glasses to be worn by a player participating in a sporting event, the camera configured to capture a plurality of two-dimensional (2-D) images of an object launched by a player participating in the sporting event; and

at least one processor programmed with instructions that, when executed by the at least one processor, cause the at least one processor to:

identify the launched object in the plurality of 2-D images;

determine an orientation of the camera based on at least one accelerometer and at least one of the plurality of 2-D images;

track the launched object based on the plurality of 2-D images by determining positions of the launched object in three-dimensional (3-D) space based on the determined orientation;

identify a stationary object in the plurality of 2-D images;

determine a position of the launched object at a point along the trajectory relative to the stationary object;

provide an output based on the determined position of the launched object at the point along the trajectory relative to the stationary object; and

render a simulation of the trajectory based on tracking of the launched object by the at least one processor.

11. The system of claim 10 , wherein the stationary object is a goal to which the launched object is shot in the sporting event.

12. The system of claim 10 , wherein the stationary object includes a marking for a boundary of a court or field on which the sporting event is played.

13. The system of claim 10 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to determine the orientation of the camera based on the stationary object.

14. The system of claim 10 , wherein launched object is a ball.

15. The system of claim 10 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to determine the orientation of the camera based on the at least one accelerometer for each of the plurality of 2-D images, and wherein the plurality of 2-D images is captured as the player wearing the glasses is moving.

16. The system of claim 15 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to determine the orientation of the camera based on the stationary object.

17. The system of claim 10 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to determine a reference plane based on the at least one accelerometer, and wherein the determined orientation is based on reference plane.

18. The system of claim 17 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to determine the positions of the launched object in 3-D space based on the reference plane.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2025
From: MARTY, ALAN; CARTER, JOHN
To: PILLAR VISION, INC.
Reel/Frame 072675/0507 →
Continuity (7)
Continuation 18217264 · Jun 30, 2023
Continuation 16938601 · Jul 24, 2020
Continuation 16777838 · Jan 30, 2020
Continuation 15624527 · Jun 15, 2017
Continuation 14579916 · Dec 22, 2014
Continuation 13921162 · Jun 18, 2013
Provisional Application 61808061 · Apr 3, 2013
References Cited (38)
US 7094164B2 · Marty et al. · 2006 [cited by applicant]
US 7214138B1 · Stivers et al. · 2007 [cited by applicant]
US 7850552B2 · Marty et al. · 2010 [cited by applicant]
US 7854669B2 · Marty et al. · 2010 [cited by applicant]
US 8617008B2 · Marty et al. · 2013 [cited by applicant]
US 8622832B2 · Marty et al. · 2014 [cited by applicant]
US 8908922B2 · Marty · 2014 [cited by applicant]
US 8948457B2 · Marty et al. · 2015 [cited by applicant]
US 9283431B2 · Marty et al. · 2016 [cited by applicant]
US 9283432B2 · Marty et al. · 2016 [cited by applicant]
US 9345929B2 · Marty et al. · 2016 [cited by applicant]
US 9358455B2 · Marty et al. · 2016 [cited by applicant]
US 9694238B2 · Marty et al. · 2017 [cited by applicant]
US 9697617B2 · Marty et al. · 2017 [cited by applicant]
US 10360685B2 · Marty et al. · 2019 [cited by applicant]
US 10762642B2 · Marty et al. · 2020 [cited by applicant]
US 11715214B1 · Marty · 2023 [cited by examiner]
US 12288344B1 · Marty et al. · 2025 [cited by applicant]
US 20030073518A1 · Marty et al. · 2003 [cited by applicant]
US 20040017929A1 · Bramblet · 2004 [cited by applicant]
US 20080219509A1 · White et al. · 2008 [cited by applicant]
US 20080312010A1 · Marty · 2008 [cited by examiner]
US 20100020068A1 · House · 2010 [cited by examiner]
US 20100030350A1 · House · 2010 [cited by applicant]
US 20100151957A1 · Hohla · 2010 [cited by applicant]
US 20100316282A1 · Hope · 2010 [cited by applicant]
US 20110013087A1 · House · 2011 [cited by examiner]
US 20110090344A1 · Gefen · 2011 [cited by examiner]
US 20110143868A1 · Marty et al. · 2011 [cited by applicant]
US 20130039538A1 · Johnson · 2013 [cited by examiner]
US 20130274034A1 · Sawarti · 2013 [cited by applicant]
US 20140301601A1 · Marty · 2014 [cited by examiner]
US 20200167936A1 · Marty · 2020 [cited by examiner]
CN 111068287A · 2020 [cited by examiner]
DE 20104968U · 2013 [cited by examiner]
Li, Jing translation CN 111068287 A Dec. 5, 2019 (Year: 2019). [cited by examiner]
Karl Boehmert translation DE 20104968 U Jan. 1, 2013 (Year: 2013). [cited by examiner]
Marty, et al., U.S. Appl. No. 15/624,527, entitled “True Space Tracking of Axisymmetric Object Flight Using Diameter Measurement”, filed Jun. 15, 2017. [cited by applicant]
Cited By (1)
US 12,718,384