IP Library Granted Patent US 12673251
Granted Patent B2
US 12673251 · App. 17/751,592 · Granted Jul 7, 2026

Method of controlling or augmenting a virtual environment or live video broadcast via sensed motion

Inventors: Christopher Andon (Portland, OR); Bobby LeGaye (Portland, OR); Hien Tommy Pham (Beaverton, OR); Adam Tenuta (Portland, OR)
Assignee: NIKE, Inc.
A63B71/0605A43B3/36A43B3/44A43B3/48A43B3/50A61B5/1118A63B24/0006A63B24/0021A63B71/0622A63B71/0669G06F3/011G06F3/017G06F16/635G06F16/683G06F16/739G06F16/786G06Q30/0209A63B2024/0012A63B2024/0025A63B2071/0625A63B2220/40A63B2220/833A63B2225/20A63B2225/50A63B2225/74A63B2244/22G06T13/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12673251
App. No.
17/751,592
Granted
Jul 7, 2026
Kind
B2
Abstract

A method of controlling or augmenting a virtual environment or a live video broadcast according includes receiving a data stream that is indicative of a monitored spatial motion of an article of footwear or apparel worn by a subject. The data stream is generated at least in part by an accelerometer or inertial measurement unit provided on the article of footwear or apparel. The method further includes identifying at least one motion primitive from the received data stream, augmenting the virtual reality (VR) environment or the live video broadcast with a visual effect in response to the identified motion primitive, and transmitting a view of the VR environment or the live video broadcast to a user for display on a display device.

Claims (22)

1 . A method of controlling or augmenting a virtual reality environment or a live video broadcast according to sensed real time motion of a subject, the method comprising:

receiving, from an accelerometer or inertial measurement unit provided on an article of footwear or apparel worn by the subject, a data stream indicative of a monitored spatial motion of the article of footwear or apparel;

identifying at least one motion primitive from the received data stream, wherein the motion primitive is a discrete motion of the article of footwear or apparel or a predefined ordered sequence of such discrete motions, the discrete motion comprising one of translation, rotation, acceleration, jerk, impact, or periodic translation;

augmenting the virtual reality (VR) environment or the live video broadcast with a visual effect in response to the identified motion primitive, wherein the visual effect is displayed at a location corresponding to the subject;

transmitting a view of the VR environment or the live video broadcast to a viewer for display on a display device; and

wherein the transmitted view of the VR environment or live video broadcast contains the visual effect; and

wherein the visual effect includes a virtual pyrotechnics, or a graphic emanating from the subject within the live video broadcast.

2 . The method of claim 1 , wherein the VR environment or the live video broadcast is a VR environment; and

wherein the VR environment includes a plurality of avatars including at least an avatar of the subject and an avatar of the viewer.

3 . The method of claim 2 , wherein the visual effect includes a motion or action of the avatar of the subject.

4 . The method of claim 1 , wherein the augmented VR environment or live video broadcast is a video broadcast of a sporting event.

5 . The method of claim 4 , wherein the subject is present within the video broadcast.

6 . The method of claim 5 , wherein the visual effect is a graphic emanating from the subject within the video broadcast.

7 . The method of claim 6 , further comprising receiving an indication of a preference or attribute of the viewer; and

altering the existence, nature, or color of the visual effect according to the preference or attribute of the viewer.

8 . The method of claim 4 , further comprising receiving an indication of one or more external triggers; and wherein the existence of the visual effect is further conditioned on the one or more external triggers being present.

9 . The method of claim 8 , wherein the one or more external triggers comprise a game time of the sporting event, recent scoring activity within the sporting event, or relative positioning of other players within the sporting event.

10 . The method of claim 1 , further comprising:

maintaining a correspondence table comprising a plurality of video effects, each video effect corresponding to a different predefined motion primitive or series of predefined motion primitives;

matching the identified motion primitive with one of the predefined motion primitives within the correspondence table; and

wherein the augmenting of the VR environment or live video broadcast with the visual effect comprises selecting the visual effect from the correspondence table that corresponds to the matched predefined motion primitives and overlaying the selected visual effect on the VR environment or the live video broadcast.

11 . The method of claim 10 , further comprising selecting the correspondence table from a plurality of correspondence tables according to an attribute or preference of the viewer.