IP Library › Granted Patent US 12,370,429
Granted Patent B2
US 12,370,429 · App. 18/500,299 · Granted Jul 29, 2025

Computer vision and artificial intelligence applications for performance evaluation and/or skills development

Inventors: Todd Young (Austin, TX); Syed Saad Hussain (Lahore, PK)
Assignee: Ballogy, Inc.
A63B71/0605G06N3/044G06N3/08G06T7/74G06T7/90A63B71/0622A63B2071/0694A63B2220/806A63B2243/0037G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,370,429
App. No.
18/500,299
Granted
Jul 29, 2025
Kind
B2
Abstract

Example methods, apparatuses, and/or articles of manufacture are disclosed herein that may be utilized, in whole or in part, to facilitate and/or support one or more operations and/or techniques for computer vision and artificial intelligence applications, such as implemented, in whole or in part, for performance evaluation and/or skills development.

Claims (30)

1. A method of determining whether a scoreable task was performed or not performed, the method comprising: receiving a frame of video depicting digital content captured within a field of view of a camera; determining a reference frame based, at least in part, on the received frame; receiving a scoreable task attempt video; identifying a make area and at least one attempt area in the scoreable task attempt video; and determining whether the scoreable task attempt video depicts a make or a miss based, at least in part, on a detection of entry and exit of a scoreable task object into and out of the at least one attempt area of the scoreable task attempt video without entry of the scoreable task object into the make area of the scoreable task attempt video; and

wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on a relative change in pixels and/or pixel coordinates of the scoreable task object within the at least one attempt area in the scoreable task attempt video relative to that of the make area of the scoreable task attempt video.

2. The method of claim 1 , wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on at least one of the following: pixel coordinates of the scoreable task object in the scoreable task attempt video becoming lower or higher than that of the make area of the scoreable task attempt video after previously being respectively higher or lower than that of the make area of the scoreable task attempt video; or the pixel coordinates of the scoreable task object in the scoreable task attempt video becoming laterally displaced to the left or to the right of that of the make area of the scoreable task attempt video after previously being respectively to the right or to the left of that of the make area of the scoreable task attempt video; or any combination thereof.

3. The method of claim 1 , wherein the scoreable task object comprises a particular game object for use in a particular sport of a variety of different sports, or a non-game object for use outside of the particular sport of the variety of different sports.

4. The method of claim 3 , wherein the variety of different sports comprises one or more of the following: a ball sport; a net sport; a team sport; or a non-team sport; or any combination thereof.

5. The method of claim 1 , wherein the digital content comprises at least one of the following: a landmark; a player; a person; a game flow event; a user; a goal area; a scoreable zone; or any combination thereof.

6. The method of claim 1 , wherein the digital content comprises one or more keypoints/features.

7. The method of claim 1 , wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on an increase in scoreable task object-colored pixels in the make area of the scoreable task attempt video relative to the reference frame.

8. The method of claim 1 , wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on scoreable task object-colored pixels in the make area being interspersed with non-scoreable task object-colored pixels in the make area of the scoreable task attempt video.

9. The method of claim 1 , wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on a lack of interspersion of scoreable task object-colored pixels with non-scoreable task object-colored pixels in the make area of the scoreable task attempt video.

10. The method of claim 1 , wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on a variation in a shape of a goal area in the make area of the scoreable task attempt video.

11. An apparatus comprising:

a camera communicatively coupled to at least a processor, the camera to:

receive a first frame of video that depicts digital content captured within a field of view of the camera;

and receive one or more second frames of video that correspond to a scoreable task attempt; and

the processor communicatively coupled to at least one memory, the processor to:

determine a reference frame based, at least in part, on the first frame; identify a make area and at least one attempt area in the one or more second frames; and determine whether the scoreable task attempt is a make or a miss based, at least in part, on detection of entry and exit of a scoreable task object into and out of the at least one attempt area of the one or more second frames without entry of the scoreable task object into the make area of the one or more second frames; and

wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on a relative change in pixels and/or pixel coordinates of the scoreable task object within the at least one attempt area in the scoreable task attempt video relative to that of the make area of the scoreable task attempt video.

12. The apparatus of claim 11 , wherein the processor is further to determine whether the scoreable task attempt is the make or the miss based, at least in part, on at least one of the following: the pixel coordinates of the scoreable task object in the one or more second frames to become lower or higher than that of the make area of the one or more second frames after previously having been respectively higher or lower than that of the make area of the one or more second frames; or the pixel coordinates of the scoreable task object in the one or more second frames to become laterally displaced to the left or to the right of that of the make area of the one or more second frames after previously having been respectively to the right or to the left of that of the make area of the one or more second frames; or any combination thereof.

13. The apparatus of claim 11 , wherein the scoreable task object comprises a particular game object for use in a particular sport of a variety of different sports, or a non-game object for use outside of the particular sport of the variety of different sports, and wherein the variety of different sports comprises one or more of the following: a ball sport; a net sport; a team sport; or a non-team sport; or any combination thereof.

14. The apparatus of claim 11 , wherein the digital content comprises one or more keypoints/features, and further comprises at least one of the following: a landmark; a player; a person; a game flow event; a user; a goal area; a scoreable zone; or any combination thereof.

15. A non-transitory computer-readable storage device storing instructions thereon executable by a processor to:

receive a frame of video that depicts a digital content to be captured within a field of view of a camera;

determine a reference frame based, at least in part, on the received frame;

receive a scoreable task attempt video;

identify a make area and at least one attempt area in the scoreable task attempt video; and determine

whether the scoreable task attempt video depicts a make or a miss based, at least in part, on a detection of entry and exit of a scoreable task object into and out of the at least one attempt area of the scoreable task attempt video without entry of the scoreable task object into the make area of the scoreable task attempt video; and

wherein the determining whether the scoreable task attempt video depicts the make or the miss is based, at least in part, on a relative change in pixels and/or pixel coordinates of the scoreable task object within the at least one attempt area in the scoreable task attempt video relative to that of the make area of the scoreable task attempt video.

16. The non-transitory computer-readable storage device of claim 15 , wherein the instructions further to determine whether the scoreable task attempt is the make or the miss based, at least in part, on at least one of the following: the pixel coordinates of the scoreable task object in the one or more second frames to become lower or higher than that of the make area of the one or more second frames after previously having been respectively higher or lower than that of the make area of the one or more second frames; or the pixel coordinates of the scoreable task object in the one or more second frames to become laterally displaced to the left or to the right of that of the make area of the one or more second frames after previously having been respectively to the right or to the left of that of the make area of the one or more second frames; or any combination thereof.

17. The non-transitory computer-readable storage device of claim 15 , wherein the scoreable task object comprises a particular game object for use in a particular sport of a variety of different sports, or a non-game object for use outside of the particular sport of the variety of different sports, and wherein the variety of different sports comprises one or more of the following: a ball sport; a net sport; a team sport; or a non-team sport; or any combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2023
From: YOUNG, TODD; HUSSAIN, SYED SAAD
To: BALLOGY, INC.
Reel/Frame 065433/0864 →
Continuity (6)
Continuation 16588158 · Sep 30, 2019
Continuation In Part 16159436 · Oct 12, 2018
Provisional Application 62757058 · Nov 7, 2018
Provisional Application 62571724 · Oct 12, 2017
Provisional Application 62729232 · Sep 10, 2018
Related Publication 20240335725A1 · Oct 10, 2024
References Cited (94)
US 7092846B2 · Vock · 2006 [cited by applicant]
US 9381420B2 · Burroughs · 2016 [cited by applicant]
US 9914035B2 · Campbell · 2018 [cited by applicant]
US 11839805B2 · Young et al. · 2023 [cited by applicant]
US 20080015061A1 · Klein · 2008 [cited by applicant]
US 20080312010A1 · Marty · 2008 [cited by applicant]
US 20090048044A1 · Oleson · 2009 [cited by applicant]
US 20090099924A1 · Lensch · 2009 [cited by applicant]
US 20130095959A1 · Marty · 2013 [cited by examiner]
US 20130286004A1 · McCulloch · 2013 [cited by examiner]
US 20140222177A1 · Thurman et al. · 2014 [cited by applicant]
US 20140270375A1 · Canavan · 2014 [cited by applicant]
US 20140301598A1 · Marty · 2014 [cited by applicant]
US 20150170530A1 · Damman · 2015 [cited by applicant]
US 20150324751A1 · Orenstein · 2015 [cited by applicant]
US 20150332450A1 · Marty et al. · 2015 [cited by applicant]
US 20160027325A1 · Malhotra · 2016 [cited by applicant]
US 20160096067A1 · Ianni · 2016 [cited by applicant]
US 20160193518A1 · Baxter · 2016 [cited by applicant]
US 20170095716A1 · Lewis · 2017 [cited by applicant]
US 20180075392A1 · Surane · 2018 [cited by applicant]
US 20190111317A1 · Young et al. · 2019 [cited by applicant]
US 20190385477A1 · Young et al. · 2019 [cited by applicant]
US 20200023262A1 · Young et al. · 2020 [cited by applicant]
EP 3694616A1 · 2020 [cited by applicant]
WO WO2019075401A1 · 2019 [cited by applicant]
U.S. Appl. No. 62/729,232, filed Sep. 10, 2018, 68 pages, Doc 066. [cited by applicant]
U.S. Appl. No. 62/729,232: Filing Receipt dated Sep. 19, 2028, 3 pages, Doc 067. [cited by applicant]
U.S. Appl. No. 16/159,436, filed Oct. 12, 2018, 103 pages, Doc 001. [cited by applicant]
U.S. Appl. No. 16/159,436: Filing Receipt dated Nov. 2, 2018, 3 pages, Doc 002. [cited by applicant]
U.S. Appl. No. 16/159,436: Informational Notice dated Nov. 2, 2018, 1 page, Doc 003. [cited by applicant]
U.S. Appl. No. 16/159,436: Notice of Publication dated Apr. 18, 2019, 1 page, Doc 004. [cited by applicant]
U.S. Appl. No. 16/159,436: Non-final Office Action dated Dec. 11, 2019, 12 pages, Doc 005. [cited by applicant]
U.S. Appl. No. 16/159,436: Amendment filed Jun. 8, 2020, 12 pages, Doc 006. [cited by applicant]
U.S. Appl. No. 16/159,436: Final Office Action dated Jul. 17, 2020, 16 pages, Doc 007. [cited by applicant]
U.S. Appl. No. 16/159,436: Notice of Appeal filed Oct. 19, 2020, 2 pages, Doc 008. [cited by applicant]
U.S. Appl. No. 16/159,436: Appeal Brief filed Dec. 21, 2020, 28 pages, Doc 009. [cited by applicant]
U.S. Appl. No. 16/159,436: Examiner's Answer to Appeal Brief dated Feb. 25, 2001, 10 pages, Doc 010. [cited by applicant]
U.S. Appl. No. 16/159,436: Reply Brief filed Apr. 26, 2021, 30 pages, Doc 011. [cited by applicant]
U.S. Appl. No. 16/159,436: Patent Board Decision dated Jun. 15, 2022, 26 pages, Doc 012. [cited by applicant]
U.S. Appl. No. 16/159,436: RCE and Amendment filed Aug. 15, 2022, 13 pages, Doc 013. [cited by applicant]
U.S. Appl. No. 16/159,436: Nonfinal Office Action dated Sep. 8, 2022, 11 pages, Doc 014. [cited by applicant]
U.S. Appl. No. 16/159,436: Notice of Appeal filed Feb. 8, 2023, 4 pages, Doc 015. [cited by applicant]
U.S. Appl. No. 16/159,436: Appeal Brief filed Mar. 7, 2023, 15 pages, Doc 016. [cited by applicant]
U.S. Appl. No. 16/159,436: Examiner's Answer to Appeal Brief dated Apr. 17, 2023, 8 pages, Doc 017. [cited by applicant]
U.S. Appl. No. 16/159,436: Patent Board Decision dated Oct. 2, 2024, 15 pages, Doc 018. [cited by applicant]
U.S. Appl. No. 16/159,436: RCE and Amendment filed Dec. 2, 2024, 15 pages, Doc 019. [cited by applicant]
PCT Application No. PCT/US2018/055712: PCT Application filed Oct. 12, 2018, pages, Doc 020. [cited by applicant]
PCT Application No. PCT/US2018/055712: Notice of Transmittal of International Search Report and Written Opinion dated Jan. 8, 2019; 12 pages, Doc 021. [cited by applicant]
PCT Application No. PCT/US2018/055712: International Preliminary Report of Patentability dated Jun. 7, 2019, 46 pages, Doc 022. [cited by applicant]
EP Application No. 18866764: Request for EP Entry filed May 7, 2020, 6 pages, Doc 023. [cited by applicant]
EP Application No. 18866764: Amendment filed Nov. 25, 2020, 12 pages, Doc 024. [cited by applicant]
EP Application No. 18866764: EP Search Report and Opinion dated Jun. 8, 2021, 10 pages, Doc 025. [cited by applicant]
EP Application No. 18866764: Rule 70 Communication dated Jun. 25, 2021, 1 page, Doc 026. [cited by applicant]
EP Application No. 18866764: Notice of Loss of Rights dated Jan. 25, 2022, 2 pages, Doc 027. [cited by applicant]
U.S. Appl. No. 16/557,567: Patent Application filed Aug. 30, 2019, 56 pages, Doc 028. [cited by applicant]
U.S. Appl. No. 16/557,567: Filing Receipt and Informational Notice issued Sep. 12, 2019, 5 pages, Doc 029. [cited by applicant]
U.S. Appl. No. 16/557,567: Notice of Publication issued Dec. 19, 2019, 1 page, Doc 030. [cited by applicant]
U.S. Appl. No. 16/557,567: Nonfinal Office Action issued Oct. 22, 2021, 14 pages, Doc 031. [cited by applicant]
U.S. Appl. No. 16/557,567: Amendment filed Apr. 22, 2022, 7 pages, Doc 032. [cited by applicant]
U.S. Appl. No. 16/557,567: Final Office Action dated May 12, 2022, 12 pages, Doc 033. [cited by applicant]
U.S. Appl. No. 16/557,567: Notice of Appeal filed Nov. 14, 2022, 3 pages, Doc 034. [cited by applicant]
U.S. Appl. No. 16/557,567: Appeal Brief filed Jan. 12, 2023, 20 pages, Doc 035. [cited by applicant]
U.S. Appl. No. 16/557,567: Examiner's Answer Brief dated Mar. 30, 2023, 12 pages, Doc 036. [cited by applicant]
U.S. Appl. No. 16/557,567: Appeal Board Decision dated May 23, 2024, 14 pages, Doc 037. [cited by applicant]
U.S. Appl. No. 16/557,567: RCE and Amendment filed Jul. 23, 2024, 19 pages, Doc 038. [cited by applicant]
U.S. Appl. No. 16/557,567: Nonfinal Office Action dated Aug. 8, 2024, 22 pages, Doc 039. [cited by applicant]
U.S. Appl. No. 16/557,567: Amendment filed Dec. 9, 2024, 18 pages, Doc 040. [cited by applicant]
U.S. Appl. No. 16/588,158, filed Sep. 30, 2019, 68 pages, Doc 041. [cited by applicant]
U.S. Appl. No. 16/588,158: and dated Filing Receipt and Informational Notice dated Oct. 17, 2019, 5 pages, Doc 042. [cited by applicant]
U.S. Appl. No. 16/588,158: Notice of Publication dated Jan. 23, 2020, 1 page, Doc 043. [cited by applicant]
U.S. Appl. No. 16/588,158: Nonfinal Office Action dated May 27, 2020, 14 pages, Doc 044. [cited by applicant]
U.S. Appl. No. 16/588,158: Amendment filed Oct. 27, 2020, 15 pages, Doc 045. [cited by applicant]
U.S. Appl. No. 16/588,158: Final Office Action date Nov. 10, 2020, 17 pages, Doc 046. [cited by applicant]
U.S. Appl. No. 16/588,158: Notice of Appeal filed Apr. 12, 2021, 2 pages, Doc 047. [cited by applicant]
U.S. Appl. No. 16/588,158: Appeal Brief filed Jun. 14, 2021, 19 pages, Doc 048. [cited by applicant]
U.S. Appl. No. 16/588,158: Nonfinal Office Action dated Nov. 12, 2021, 12 pages, Doc 049. [cited by applicant]
U.S. Appl. No. 16/588,158: Amendment filed May 12, 2022, 10 pages, Doc 050. [cited by applicant]
U.S. Appl. No. 16/588,158: Final Office Action dated Sep. 9, 2022, 13 pages, Doc 051. [cited by applicant]
U.S. Appl. No. 16/588,158: RCE and Amendment filed Mar. 7, 2023, 14 pages, Doc 052. [cited by applicant]
U.S. Appl. No. 16/588,158: Nonfinal Office Action dated Mar. 30, 2023, 14 pages, Doc 053. [cited by applicant]
U.S. Appl. No. 16/588,158: Amendment filed Aug. 30, 2023, 12 pages, Doc 054. [cited by applicant]
U.S. Appl. No. 16/588,158: Notice of Allowance date Oct. 2, 2023, 12 pages, Doc 055. [cited by applicant]
U.S. Appl. No. 16/588,158: Issue Fee Payment and 312 Amendment filed Oct. 27, 2023, 3 pages, Doc 056. [cited by applicant]
U.S. Appl. No. 16/588,158: Response to 312 Amendment dated Nov. 9, 2023, 2 pages, Doc 057. [cited by applicant]
U.S. Appl. No. 16/588,158: Issue Notification dated Nov. 22, 2023, 2 pages, Doc 058. [cited by applicant]
U.S. Appl. No. 62/571,724, filed Oct. 12, 2017, 128 pages, Doc 068. [cited by applicant]
U.S. Appl. No. 62/571,724: Filing Receipt and Notice to File Missing Parts dated Oct. 24, 2017, 5 pages, Doc 069. [cited by applicant]
U.S. Appl. No. 62/571,724: Response to Notice of Missing Parts filed Dec. 21, 2017, 5 pages, Doc 070. [cited by applicant]
U.S. Appl. No. 62/571,724: Updated Filing Receipt dated Dec. 26, 2017, 3 pages, Doc 071. [cited by applicant]
U.S. Appl. No. 63/562,679, filed Mar. 7, 2024, 658 pages, Doc 072. [cited by applicant]
U.S. Appl. No. 63/562,679: Filing Receipt dated Mar. 15, 2024, 3 pages, Doc 073. [cited by applicant]
U.S. Appl. No. 63/719,816, filed Nov. 13, 2024, 351 pages, Doc 074. [cited by applicant]
U.S. Appl. No. 63/719,816: Filing Receipt dated Nov. 19, 2024, 3 pages, Doc 075. [cited by applicant]
Cited By (1)
US 12,431,038