IP Library › Granted Patent US 11,461,905
Granted Patent B2
US 11,461,905 · App. 16/577,940 · Granted Oct 4, 2022

Determining a kinematic sequence

Inventors: Jong Hwa Lee (San Diego, CA); Brent Faust (SanDiego, CA); Kenji Suzuki (Tokyo, JP); Arun Chandrasekar (San Diego, CA); Joseph Moon (Timnath, CO); Xihe Zhang (Santa Clara, CA)
Assignee: Sony Group Corporation
G06T7/246A63B24/0006A63B69/3623G06K9/6232G06T7/20G06V40/23G09B19/0038A63B71/0622A63B2024/0015A63B2071/0647A63B2102/32A63B2220/05A63B2220/806A63B2230/62G06T2207/10016G06T2207/30196G06T2207/30221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,461,905
App. No.
16/577,940
Granted
Oct 4, 2022
Kind
B2
Abstract

Implementations generally relate to determining a kinematic sequence. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, where the converting is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates.

Claims (34)

1. A system comprising:

one or more processors; and

logic encoded in one or more non-transitory computer-readable storage media for execution by the one or more processors and when executed operable to cause the one or more processors to perform operations comprising:

obtaining a video of a person performing an action;

determining from the video a plurality of points associated with the person, wherein the determining of the plurality of points is performed for each frame of the video;

converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, wherein the converting is performed for each frame of the video; and

determining movements of the plurality of points based at least in part on the 3D coordinates, wherein the movements are tracked independently, and wherein the movements comprise a direction and speed of a first point of the plurality of points and comprise a direction and speed of a second point of the plurality of points, and wherein the movements are tracked independently.

2. The system of claim 1 , wherein the action is a golf swing.

3. The system of claim 1 , wherein the video is captured by a two-dimensional camera.

4. The system of claim 1 , wherein the plurality of points comprises points of a body of the person.

5. The system of claim 1 , wherein the plurality of points comprises points of a golf club held by the person.

6. The system of claim 1 , wherein the 2D coordinates are pixel coordinates.

7. The system of claim 1 , wherein the 3D coordinates are Cartesian coordinates.

8. A non-transitory computer-readable storage medium with program instructions stored thereon, the program instructions when executed by one or more processors are operable to cause the one or more processors to perform operations comprising:

obtaining a video of a person performing an action;

determining from the video a plurality of points associated with the person, wherein the determining of the plurality of points is performed for each frame of the video;

converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, wherein the converting is performed for each frame of the video; and

determining movements of the plurality of points based at least in part on the 3D coordinates, wherein the movements are tracked independently, and wherein the movements comprise a direction and speed of a first point of the plurality of points and comprise a direction and speed of a second point of the plurality of points, and wherein the movements are tracked independently.

9. The computer-readable storage medium of claim 8 , wherein the action is a golf swing.

10. The computer-readable storage medium of claim 8 , wherein the video is captured by a two-dimensional camera.

11. The computer-readable storage medium of claim 8 , wherein the plurality of points comprises points of a body of the person.

12. The computer-readable storage medium of claim 8 , wherein the plurality of points comprises points of a golf club held by the person.

13. The computer-readable storage medium of claim 8 , wherein the 2D coordinates are pixel coordinates.

14. The computer-readable storage medium of claim 8 , wherein the 3D coordinates are Cartesian coordinates.

15. A computer-implemented method comprising:

obtaining a video of a person performing an action;

determining from the video a plurality of points associated with the person, wherein the determining of the plurality of points is performed for each frame of the video;

converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, wherein the converting is performed for each frame of the video; and

determining movements of the plurality of points based at least in part on the 3D coordinates, wherein the movements are tracked independently, and wherein the movements comprise a direction and speed of a first point of the plurality of points and comprise a direction and speed of a second point of the plurality of points, and wherein the movements are tracked independently.

16. The method of claim 15 , wherein the action is a golf swing.

17. The method of claim 15 , wherein the video is captured by a two-dimensional camera.

18. The method of claim 15 , wherein the plurality of points comprises points of a body of the person.

19. The method of claim 15 , wherein the plurality of points comprises points of a golf club held by the person.

20. The method of claim 15 , wherein the 2D coordinates are pixel coordinates.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2021
From: LEE, JONG HWE; FAUST, BRENT; SUZUKI, KENJI; ZHANG, XIHE
To: SONY CORPORATION
Reel/Frame 057839/0614 →
Continuity (3)
Provisional Application 62830869 · Apr 8, 2019
Provisional Application 62830845 · Apr 8, 2019
Related Publication 20200320719A1 · Oct 8, 2020
Cited By (2)
US 12,608,853 US 12,649,088