IP Library Granted Patent US 10,782,929
Granted Patent B2
US 10,782,929 · App. 16/368,319 · Granted Sep 22, 2020

Cadence and media content phase alignment

Inventor: Tristan Jehan (Brooklyn, NY)
Assignee: SPOTIFY AB
G06F3/165A61B5/024A63B71/00A63B71/0622G06F3/011G06F16/632G06F16/636A63B2071/0625A63B2230/062
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,782,929
App. No.
16/368,319
Granted
Sep 22, 2020
Kind
B2
Abstract

Systems, devices, apparatuses, components, methods, and techniques for cadence and media content phase alignment are provided. An example media-playback device includes a content output device that operates to output media content, a cadence-acquiring device, a phase-delay calibration engine, a cadence-based media content selection engine, and a phase-aligned media playback engine. The cadence-acquiring device includes a movement-determining device and a cadence-determination engine configured to determine a cadence based on movement data captured by the movement-determining device. The phase-delay calibration engine configured to determine phase delay values for at least one cadence value. The cadence-based media content selection engine configured to identify a media content item based on the cadence determined by the cadence-acquiring device. The phase-aligned media playback engine configured to align the identified media content item to the repetitive-motion activity and cause the media-output device to output the aligned media content item.

Claims (44)

1. A media-playback device for aligning play back of media content for a user performing a repetitive motion activity, the repetitive-motion activity including a repetitive cycle of motion having a repetitive action point, the media-playback device comprising:

a content output device that operates to output media content;

a cadence-acquiring device comprising a movement-determining device and a cadence-determination engine configured to determine a cadence based on movement data captured by the movement-determining device;

a phase-delay calibration engine configured to determine phase delay values for at least one cadence value, wherein the phase-delay calibration engine determines the phase delay values based at least in part on a time required to detect the repetitive action point within the repetitive motion activity; and

a phase-aligned media playback engine configured to:

align a media content item to the repetitive motion activity using at least one of the determined phase-delay values; and

cause the media-output device to output the aligned media content item so that a beat of the media content item is output coincidentally with an expected repetitive action point.

2. The media-playback device of claim 1 , wherein the phase-aligned media playback engine is further configured to:

identify repetitive action points within the repetitive motion activity based on the movement data.

3. The media-playback device of claim 1 , wherein the phase-aligned media playback engine is further configured to:

identify a wave action position within an oscillation of a filtered sequence of measurements captured by the measurement-determining device corresponding to the repetitive action points based on calculating an orientation of the media-playback device.

4. The media-playback device of claim 1 , wherein the phase-aligned media playback engine is further configured to:

determine a phase delay value corresponding to the determined cadence; and

align the media content item to the repetitive motion activity based on the determined phase delay.

5. The media-playback device of claim 1 , wherein the measurement-determining device comprises three orthogonally-oriented accelerometers and the cadence-determination engine is configured to:

capture a sequence of measurements from each of the three accelerometers;

filter the sequences of measurements based on frequency to generate filtered sequences;

identify the sequence of measurements corresponding to cadence, wherein the sequence is identified based on calculating energy values for each of the sequences.

6. The media-playback device of claim 1 , wherein the media playback engine is configured to identify wave action positions corresponding to repetitive action points.

7. The media-playback device of claim 1 , wherein measurements are captured at a sample rate in the range of 20-200 Hz.

8. The media-playback device of claim 1 , wherein the media content item is stored locally on the media-playback device.

9. The media-playback device of claim 1 , wherein the media content item is streamed to the media-playback device by a media-delivery system based on a request for media content items that specifies the cadence.

10. The media-playback device of claim 1 , wherein the media-playback device is a smartphone.

11. A method of cadence-based media playback for use during repetitive-motion activities comprising:

determining a cadence associated with a repetitive-motion activity based on acceleration data captured by a plurality of accelerometers, wherein the acceleration data comprises sequences of acceleration sample data captured from each of the plurality of accelerometers over a duration of time, the repetitive-motion activity including a repetitive cycle of motion having a repetitive action point;

phase aligning the identified media content item to the repetitive-motion activity using a phase delay value, wherein the phase delay value is determined based at least in part on a time required to detect the repetitive action point within the repetitive-motion activity; and

playing back the aligned media content item so that a beat of the media content item is output coincidentally with an expected repetitive action point.

12. The method of claim 11 further comprising:

filtering the sequences of measurements based on frequency to generate filtered sequences;

identifying a cadence signal corresponding to the cadence of the repetitive-motion activity from the filtered sequences; and

analyzing the cadence signal to identify a wave action position corresponding to the repetitive action point within the repetitive-motion activity.

13. The method of claim 12 , wherein analyzing the cadence signal comprises:

identifying a portion of the cadence signal corresponding to an oscillation of the repetitive-motion activity;

determining an orientation of the cadence signal relative to the ground; and

selecting a point within the oscillation that corresponds to the acceleration towards the ground stopping as the wave action position.

14. The method of claim 11 , further comprising:

determining a phase delay value corresponding to the determined cadence; and

aligning the identified media content item to the repetitive-motion activity using the determined phase delay.

15. The method of claim 11 , wherein the repetitive-motion activity includes running.

16. The method of claim 11 , further comprising storing the phase delay value for use in phase aligning media content to a repetitive-motion activity for play back during the repetitive-motion activity.

17. A non-transitory computer-readable storage medium storing instructions which when read and executed by one or more processors, cause the one or more processors to:

determine a cadence associated with a repetitive-motion activity based on acceleration data captured by a plurality of accelerometers, wherein the acceleration data comprises sequences of acceleration sample data captured from each of the plurality of accelerometers over a duration of time, the repetitive-motion activity including a repetitive cycle of motion having a repetitive action point;

determine whether a tempo of a media output corresponds to the determined cadence; and

after determination that the tempo of the media output corresponds to the determined cadence, calculate a phase delay value for the determined cadence based on the repetitive action point within the repetitive-motion activity and a beat within the media output, wherein the phase delay is determined based at least in part on a time required to detect the repetitive action point within the repetitive-motion activity, and wherein the phase delay indicates a shift in playback of the media output that is needed so that a beat of the media output is output coincidentally with an expected repetitive action point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: JEHAN, TRISTAN
To: SPOTIFY AB
Reel/Frame 049848/0944 →
Continuity (4)
Continuation 15396253 · Dec 30, 2016
Continuation 14883318 · Oct 14, 2015
Provisional Application 62163856 · May 19, 2015
Related Publication 20190332348A1 · Oct 31, 2019