IP Library › Granted Patent US 10,672,173
Granted Patent B2
US 10,672,173 · App. 16/423,130 · Granted Jun 2, 2020

System and method for capturing and analyzing motions to be shared

Inventors: Joseph I. Chamdani (Santa Clara, CA); Pietro Garofalo (Forli, IT); Cecylia Wati (Hayward, CA); Jasmin Nakic (Sunnyvale, VA); Taufik Arifin (Santa Clara, CA); Limin He (Monte Sereno, CA)
Assignee: Turingsense Inc.
G06T13/40G06F3/011G06F3/014G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,672,173
App. No.
16/423,130
Granted
Jun 2, 2020
Kind
B2
Abstract

Techniques for storing attributes of motion and sharing the motion are described. The motion of a first user is captured and analyzed, where the attributes of motion are stored on a server or cloud. The attributes of motion are represented in a 3D anatomical coordinate system to ensure a reliable representation of an anatomy behind the motion. When accessed by a second user, an avatar is animated per the stored attributes of motion while capturing similar motion made by the second user. A stream of showing the differences in the motion by the second user and the avatar is provided to a device associated with the second user.

Claims (35)

1. A method for capturing motion performed by a user, the method comprising:

providing a plurality of sensor modules respectively attached to different body parts of a first user in accordance with a predefined activity;

receiving sensing signals from the sensor modules when the first user performs the motion related to the predefined activity, wherein the sensor modules are synchronized in time so that the sensor modules share identical timing of movement; and

determining a set of attributes of the motion from the sensing signals, the attributes being represented in a 3D anatomical coordinate system, where a vertical anatomical axis Y in the anatomical coordinate system is constructed by gravity direction, a mediolateral anatomical axis X in the anatomical coordinate system is constructed in order to be driven by the vertical direction, an anatomical axis Z in the anatomical coordinate system is constructed as a cross product of the axis X and the axis Y in complying with an orthogonal right-handed rule, respective predefined relations between the sensor modules and joints of the first user are used to represent the attributes of the motion in the anatomical coordinate system so as to have a reliable representation of an anatomy behind.

2. The method as recited in claim 1 , further comprising: identifying correlations between speeds and joint rotations from the sensing signals.

3. The method as recited in claim 2 , wherein the motion is repeated for taking into account of variability of movement in different people and gestures.

4. The method as recited in claim 3 , wherein said determining a set of attributes of the motion from the sensing signals comprises: calculating the attributes to characterize movements within each single phase previously extracted.

5. The method as recited in claim 1 , further comprising: storing the attributes of the motion in a database to be accessed by a second user.

6. The method as recited in claim 5 , further comprising:

receiving a request from the second user to access the motion per a selection; and

animating an avatar based on the stored attributes of the motion performed by the first user.

7. The method as recited in claim 6 , further comprising:

capturing motion of the second user;

deriving attributes of the motion of the second user; and

showing differences between the motion of the second user and the motion of the avatar.

8. The method as recited in claim 7 , wherein said showing differences between the motion of the second user and the avatar comprises streaming the differences to a device associated with the second user.

9. The method as recited in claim 1 , wherein the computing device is a mobile device, a server, or a laptop computer.

10. A system for capturing motion performed by a user, the system comprising:

a plurality of sensor modules respectively attached to different body parts of a first user in accordance with a predefined activity; and

a computing device receiving sensing signals from the sensor modules when the first user performs the motion related to the predefined activity, wherein the sensor modules are synchronized in time so that the sensor modules share identical timing of movement, and wherein the computing device is caused to determine a set of attributes of the motion from the sensing signals, the attributes being represented in a 3D anatomical coordinate system, where a vertical anatomical axis Y in the anatomical coordinate system is constructed by gravity direction, a mediolateral anatomical axis X in the anatomical coordinate system is constructed in order to be driven by the vertical direction, an anatomical axis Z in the anatomical coordinate system is constructed as a cross product of the axis X and the axis Y in complying with an orthogonal right-handed rule, respective predefined relation between the sensor modules and joints of the first user are used to represent the attributes of the motion in the anatomical coordinate system so as to have a reliable representation of an anatomy behind.

11. The system as recited in claim 10 , wherein the computing device is caused to further identify correlations between speeds and joint rotations from the sensing signals.

12. The system as recited in claim 11 , wherein the motion is repeated for taking into account of variability of movement in different people and gestures.

13. The system as recited in claim 12 , wherein the computing device is caused to further calculate the attributes to characterize movements within each single phase previously extracted.

14. The system as recited in claim 10 , wherein the computing device is caused to further store the attributes of the motion in a database to be accessed by a second user.

15. The system as recited in claim 14 , wherein the computing device is caused to:

receive a request from the second user to access the motion per a selection; and

animate an avatar based on the stored attributes of the motion performed by the first user.

16. The system as recited in claim 15 , further comprising:

another computing device associated with a second user, wherein the another computing device:

captures motion of the second user;

derive attributes of the motion of the second user;

access the computing device for the stored attributes of the motion performed by the first user; and

animate an avatar based on the stored attributes of the motion performed by the first user.

17. The system as recited in claim 16 , wherein the another computing device is configured to show differences between the motion of the second user and the motion of the avatar.

18. The system as recited in claim 17 , wherein either one of the computing device and the another computing device is a mobile device, a server, or a laptop computer.

Continuity (4)
Continuation 16219727 · Dec 13, 2018
Continuation 15271205 · Sep 20, 2016
Provisional Application 62221502 · Sep 21, 2015
Related Publication 20190295307A1 · Sep 26, 2019
Cited By (1)
US 12,198,243