IP Library Granted Patent US 11,170,885
Granted Patent B2
US 11,170,885 · App. 16/232,628 · Granted Nov 9, 2021

Selecting and correlating physical activity data with image data

Inventors: Brandon S. Burroughs (Portland, OR); Richard J. Engelberg (Portland, OR); Jordan M. Rice (Portland, OR); Bob Sweet (Beaverton, OR); Aaron B. Weast (Portland, OR); Wade Convay (New York, NY); Joshua Rooke-Ley (New York, NY)
Assignee: NIKE, Inc.
G16H20/30A63B24/0062A63B71/0622G06F19/00G09B19/0038G09G5/14H04N7/183A63B43/00A63B43/06A63B2225/50G09G2340/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,170,885
App. No.
16/232,628
Granted
Nov 9, 2021
Kind
B2
Abstract

Example embodiments may relate systems, methods, apparatuses, and computer readable media configured to correlate image data of a user performing physical activity with data collected during the user's performance. Data may include sensor data measuring, force, acceleration, speed, and/or processed sensor data from one or more sensors. Certain embodiments may determine whether the user is within a performance zone based on user attributes. Correlation of the image data with physical activity data may be based, at least in part, whether the user is within a performance zone.

Claims (67)

1. A computer-implemented method comprising:

receiving, by one or more computing devices, physical activity data corresponding to a first athletic performance and a second athletic performance by a plurality of players, the physical activity data comprising data generated by or derived from a plurality of sensors;

determining, by one or more computing devices, a portion of the physical activity data corresponding to the first athletic performance and a portion of the physical activity data corresponding to the second athletic performance that are indicative of one or more players, of the plurality of players, satisfying a first athletic performance criterion;

capturing, by the one or more computing devices, image data relating to the first athletic performance and the second athletic performance;

correlating the captured image data with the corresponding physical activity data;

determining a first plurality of segments of the captured image data indicative of the one or more players satisfying the first athletic performance criterion;

aggregating the first plurality of segments of the captured image data and the correlated portions of the physical activity data to generate a first collection of images indicating one or more athletic performances satisfying the first athletic performance criterion;

identifying a sporting device in at least one image of the first collection of images;

editing the visual appearance of the at least one image of the first collection of images based on the identified sporting device; and,

transmitting the first collection of images including the at least one edited image to a remote computing device.

2. The computer-implemented method of claim 1 , further comprising:

receiving an input selection identifying at least a first player of the plurality of players; and

in response to receiving the input selection, initiating the correlating of the captured image data with the corresponding physical activity data.

3. The computer-implemented method of claim 1 , wherein the captured image data comprises a plurality of frames, the computer-implemented method further comprising:

determining, by the one or more computing devices, a plurality of activity values for a first activity metric corresponding to the physical activity data; and

adjusting the plurality of activity values to be associated with at least a first frame of the captured image data.

4. The computer-implemented method of claim 1 , wherein the captured image data comprises a plurality of frames, and wherein the correlating the captured image data further comprises:

associating a first number of frames of the captured image data with a corresponding time period of a first portion of the physical activity data.

5. The computer-implemented method of claim 1 , wherein the captured image data and the corresponding physical activity data is limited to a predetermined time period of the one or more athletic performances.

6. The computer-implemented method of claim 1 , further comprising:

receiving user input selection indicating the first athletic performance criterion.

7. The computer-implemented method of claim 1 , further comprising:

determining, based on the received physical activity data, that at least a first player, of the one or more players, has satisfied a performance zone threshold; and

after determining the performance zone threshold is satisfied, aggregating one or more segments of the captured image data to generate a second collection of images indicative of the first player satisfying the performance zone threshold.

8. The computer-implemented method of claim 1 , further comprising:

receiving user input selection indicating a second athletic performance criterion;

determining a second plurality of segments of the captured image data indicative of the one or more players satisfying the second athletic performance criterion;

aggregating the second plurality of segments of the captured image data and the correlated portions of the physical activity data to generate an activity feed of athletic performances associated with the second athletic performance criterion; and

transmitting the activity feed to the remote computing device.

9. The computer-implemented method of claim 1 , wherein the sporting device comprises a ball.

10. The computer-implemented method of claim 1 , further comprising:

determining, by the one or more computing devices, that a portion of the physical activity data indicates that one or more players, of the plurality of players, performed a first type of athletic activity; and

categorizing the first collection of images based on the first type of athletic activity.

11. One or more non-transitory computer readable media storing instructions that, when executed by at least one processor, cause the at least one processor to:

receive physical activity data corresponding to at least a first athletic performance and a second athletic performance by a plurality of players, the physical activity data comprising data generated by or derived from a plurality of sensors;

determine a portion of the physical activity data corresponding to the first athletic performance and a portion of the physical activity data corresponding to the second athletic performance are indicative that one or more players, of the plurality of players, satisfied a first athletic performance criterion;

capture, by an image capturing device, image data relating to the first athletic performance and the second athletic performance;

correlate the captured image data with the corresponding physical activity data;

determine a first plurality of segments of the captured image data indicative of the one or more players satisfying the first athletic performance criterion;

aggregate the first plurality of segments of the captured image data and the portions of the physical activity data to generate a first collection of images indicating one or more athletic performances satisfying the first athletic performance criterion;

identify a sporting device in at least one image of the first collection of images;

edit the visual appearance of the at least one image of the first collection of images based on the identified sporting device;

and

transmit the first collection of images including the at least one edited image to a remote computing device.

12. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:

receive, via an input device, an input selection identifying at least a first player of the plurality of players; and

in response to receiving the input selection, initiate the correlating of the captured image data with the corresponding physical activity data.

13. The one or more non-transitory computer readable media of claim 11 , wherein the captured image data comprises a plurality of frames, and wherein the instructions, when executed, further cause the at least one processor to:

determine a plurality of activity values for a first activity metric corresponding to the physical activity data; and

adjust the plurality of activity values to be associated with at least a first frame of the captured image data.

14. The one or more non-transitory computer readable media of claim 11 , wherein the captured image data comprises a plurality of frames, and wherein the instructions, when executed, further cause the at least one processor to:

associate a first number of frames of the captured image data with a corresponding time period of a first portion of the physical activity data.

15. The one or more non-transitory computer readable media of claim 11 , wherein the captured image data and the corresponding physical activity data is limited to a predetermined time period of the one or more athletic performances.

16. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:

receive, via an input device, user input selection indicating the first athletic performance criterion.

17. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:

determine, based on the received physical activity data, that at least a first player, of the one or more players, has satisfied a performance zone threshold; and

after determining the performance zone threshold is satisfied, aggregating one or more segments of the captured image data to generate a second collection of images indicative of the first player satisfying the performance zone threshold.

18. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:

receive user input selection indicating a second athletic performance criterion;

determine a second plurality of segments of the captured image data indicative of the one or more players satisfying the second athletic performance criterion;

aggregate the second plurality of segments of the captured image data and the correlated portions of the physical activity data to generate an activity feed of athletic performances associated with the second athletic performance criterion; and

transmit the activity feed to the remote computing device.

19. The one or more non-transitory computer readable media of claim 11 , wherein the sporting device comprises a ball.

20. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:

determine that a portion of the physical activity data indicates that one or more players, of the plurality of players, performed a first type of athletic activity; and

categorize the first collection of images based on the first type of athletic activity.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: BURROUGHS, BRANDON S.; ENGELBERG, RICHARD J.; RICE, JORDAN M.; SWEET, BOB; WEAST, AARON B.
To: NIKE, INC.
Reel/Frame 053345/0991 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: CONVAY, WADE; ROOKE-LEY, JOSHUA
To: R/GA
Reel/Frame 053346/0063 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: R/GA
To: NIKE, INC.
Reel/Frame 053346/0095 →
Continuity (4)
Continuation 15197014 · Jun 29, 2016
Continuation 13399452 · Feb 17, 2012
Provisional Application 61443808 · Feb 17, 2011
Related Publication 20190184231A1 · Jun 20, 2019