IP Library Granted Patent US 10,179,263
Granted Patent B2
US 10,179,263 · App. 15/197,014 · Granted Jan 15, 2019

Selecting and correlating physical activity data with image data

Inventors: Brandon S. Burroughs (Portland, OR); Richard J. Engelberg (Portland, OR); Jordan M. Rice (Portland, OR); Bob Sweet (Beaverton, OR); Aaron B. Weast (Portland, OR); Wade Convay (New York, NY); Joshua Rooke-Ley (New York, NY)
Assignee: NIKE, Inc.
A63B24/0062A63B71/0622G06F19/00G06F19/3481G09B19/0038G09G5/14H04N7/183A63B43/00A63B43/06A63B2225/50G09G2340/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,179,263
App. No.
15/197,014
Granted
Jan 15, 2019
Kind
B2
Abstract

Example embodiments may relate systems, methods, apparatuses, and computer readable media configured to correlate image data of a user performing physical activity with data collected during the user's performance. Data may include sensor data measuring, force, acceleration, speed, and/or processed sensor data from one or more sensors. Certain embodiments may determine whether the user is within a performance zone based on user attributes. Correlation of the image data with physical activity data may be based, at least in part, whether the user is within a performance zone.

Claims (52)

1. A computer-implemented method comprising:

receiving a first set of physical activity data corresponding to an athletic performance comprising at least a first activity performed by a user, wherein the first set of physical activity data is generated by or derived from a first sensor, and wherein the first set of physical activity data further comprises at least one of: a shoe type, a shoe color, or a shoe size associated with the user during the athletic performance;

capturing, by an image capturing device, image data corresponding to at least the first activity performed by the user;

determining, by one or more processors, whether a portion of the first set of physical activity data indicates that the user has satisfied a first activity threshold;

correlating, in response to determining that the portion of the first set of physical activity data indicates that the user has satisfied the first activity threshold, the image data in accordance with the portion of the first set of physical activity data;

dynamically modifying, based on user input selections, the portion of the first set of physical activity data to be overlaid with the correlated image data;

joining the correlated image data and the portion of the first set of physical activity data into a single file; and

transmitting the file to a computing device for display to the user.

2. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of frames, and wherein the correlating the image data further comprises:

associating a first number of frames of the image data with a corresponding time period of the first set of physical activity data.

3. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of frames, the computer-implemented method further comprising:

determining, by the one or more processors, a plurality of activity values for a first activity metric corresponding to the portion of the first set of physical activity data; and

adjusting the plurality of activity values to be associated with at least a first frame of the image data.

4. The computer-implemented method of claim 1 , further comprising:

establishing a communication channel with the first sensor, wherein the first sensor comprises a force sensor; and

in response to establishing the communication channel, outputting, to a display device, a communication prompting the user to perform the first activity.

5. The computer-implemented method of claim 1 , further comprising:

generating, by the one or more processors, a summary video segment associated with the image data; and

outputting, to a display device, an overlay for the summary video segment, wherein the overlay comprises origination data for the first set of physical activity data.

6. The computer-implemented method of claim 1 , further comprising:

receiving an input selection identifying the user; and

in response to receiving the input selection, initiating the correlation of the image data in accordance with the portion of the first set of physical activity data.

7. The computer-implemented method of claim 1 , further comprising:

determining, based on the portion of the first set of physical activity data, a second activity performed by the user during the athletic performance; and

in response to the determining the second activity, initiating the correlation of the image data in accordance with the portion of the first set of physical activity data.

8. The computer-implemented method of claim 1 , further comprising:

receiving a second set of physical activity data corresponding to one or more previous athletic performances where the user performed the first activity; and

correlating the image data in accordance with the second set of physical activity data.

9. The computer-implemented method of claim 1 , further comprising:

determining, based on a second portion of the first set of physical activity data, that the user has satisfied a performance zone threshold; and

in response to the determining the performance zone threshold is satisfied, initiating the capturing of the image data in accordance with the second portion of the first set of physical activity data.

10. One or more non-transitory computer readable media storing instructions that, when executed by at least one processor, cause the at least one processor to:

receive a first set of physical activity data corresponding to an athletic performance comprising at least a first activity performed by a user, wherein the first set of physical activity data is generated by or derived from a first sensor, and wherein the first set of physical activity data further comprises at least one of: a shoe type, a shoe color, or a shoe size associated with the user during the athletic performance;

determine that one or more portions of the first set of physical activity data indicate that the user has satisfied a first activity threshold;

in response to the determining that the one or more portions of the first set of physical activity data indicates that the user has satisfied the first activity threshold, capture, by an image capturing device, image data corresponding to at least the first activity performed by the user;

determine, based on the one or more portions of the first set of physical activity data, a second activity performed by the user during the athletic performance;

in response to the determining that the user performed the second activity, initiate the correlation of the image data in accordance with the one or more portions of the first set of physical activity data;

dynamically modify, based on user input selections, the one or more portions of the first set of physical activity data to be overlaid with the correlated image data;

join the correlated image data and the one or more portions of the first set of physical activity data into a single file; and

transmit the file to a computing device for display to the user.

11. The one or more non-transitory computer readable media of claim 10 , wherein the instructions, when executed, further cause the at least one processor to:

receive a second set of physical activity data corresponding to one or more previous athletic performances where the user performed the first activity; and

correlate the image data in accordance with the second set of physical activity data.

12. The one or more non-transitory computer readable media of claim 10 , wherein the instructions, when executed, further cause the at least one processor to:

establish a communication channel with the first sensor, wherein the first sensor comprises a force sensor; and

in response to establishing the communication channel, output, to a display device, a communication prompting the user to perform the first activity.

13. The one or more non-transitory computer readable media of claim 12 , wherein the instructions, when executed, further cause the at least one processor to:

generate a summary video segment associated with the image data; and

output, to a display device, an overlay for the summary video segment, wherein the overlay comprises origination data for the first set of physical activity data.

14. The one or more non-transitory computer readable media of claim 10 , wherein the instructions, when executed, further cause the at least one processor to correlate the image data in accordance with the portion of the first set of physical activity data by:

determining that the portion of the physical activity data indicates the user performed a first type of athletic activity; and

in response to determining that the user performed the first type of athletic activity, initiate the correlating the image data with the portion of the first set of physical activity data.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: BURROUGHS, BRANDON S.; ENGELBERG, RICHARD J.; RICE, JORDAN M.; SWEET, BOB; WEAST, AARON B.
To: NIKE, INC.
Reel/Frame 053345/0991 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: CONVAY, WADE; ROOKE-LEY, JOSHUA
To: R/GA
Reel/Frame 053346/0063 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: R/GA
To: NIKE, INC.
Reel/Frame 053346/0095 →
Continuity (3)
Continuation 13399452 · Feb 17, 2012
Provisional Application 61443808 · Feb 17, 2011
Related Publication 20170014684A1 · Jan 19, 2017
Cited By (1)
US 12,539,454