IP Library Granted Patent US 11,633,659
Granted Patent B2
US 11,633,659 · App. 17/361,447 · Granted Apr 25, 2023

Systems and methods for assessing balance and form during body movement

Inventors: Hemant Virkar (Darnestown, MD); Leah R. Kaplan (Honolulu, HI); Stephen Furlani (Gaithersburg, MD); Jacob Borgman (Ipswich, MA); Anil Bhave (Timonium, MD)
Assignee: MirrorAR LLC
A63B71/0622A63B24/0062A63B71/0669G06K9/6215G06T7/20G06T7/55G06T7/66G06T7/70G06T19/006G06V40/10H04N7/147A63B2024/0068A63B2071/0647A63B2220/05A63B2220/806A63B2225/20A63B2230/62G06T2207/10016G06T2207/10028G06T2207/20081G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,633,659
App. No.
17/361,447
Granted
Apr 25, 2023
Kind
B2
Abstract

The disclosure relates to a system for evaluating movement of a body of a user. The system may include a video display, one or more digital cameras, and a processor. The processor may control the one or more cameras to generate images of at least the part of the body over a period of time. The processor may estimate a position of a plurality of joints of the body. The processor may receive a selection of a tracked pose, and determine, from the plurality of joints, a set of joints associated with the tracked pose. The processor may generate at least one joint vector connecting joints in the set of joints, and assign, based on changes in the joint vector over the period of time, a form score to a performance of the tracked pose. The processor may then generate a user interface that depicts the form score.

Claims (37)

1. A system for evaluating physical balance of a user, comprising:

a video display;

one or more cameras configured to generate a visual video stream; and

a computing device comprising:

a memory storing computer executable instructions; and

a processor configured to execute the computer executable instructions to:

control the one or more cameras to generate images of at least a part of a body of the user over a period of time;

identify at least the part of the body within the images using a first trained learning machine;

isolate the identified part of the body from the images;

estimate a position of a plurality of joints of the body by applying a second trained learning machine to the isolated and identified part of the body within the images;

determine a center of mass of the user based on the position of the plurality of joints;

calculate a first balance threshold for the user based on dimensions of each foot of the user;

monitor changes in the center of mass as the user performs movements; and

calculate a balance score based on the changes in the center of mass, wherein the balance score is indicative of deviations of the center of mass from the first balance threshold;

generate, for display on the video display, a user interface that depicts the balance score.

2. The system of claim 1 , wherein the processor is further configured to calculate the balance score by:

determining a first amount of times that the center of mass was calculated over the period of time;

determining a second amount of times that the center of mass exceeded the first balance threshold; and

calculating a ratio between the second amount and the first amount, wherein the ratio is the balance score.

3. The system of claim 1 , wherein the first balance threshold is a predetermined value indicative of ideal balance, and wherein the processor is further configured to determine a second balance threshold indicative of a limit at which balance is lost.

4. The system of claim 3 , wherein the processor is configured to determine the second balance threshold by:

determining a length of each foot of the user, a distance between each foot, and a width of each foot;

generating, on the user interface, a visual representation of each foot and the distance; and

generating, on the user interface, a boundary around the visual representation, wherein the boundary is the second balance threshold, wherein the balance score is indicative of deviations of the center of mass from the first balance threshold and the second balance threshold.

5. The system of claim 3 , wherein the processor is further configured to calculate the balance score based on both the deviations of the center of mass from the first balance threshold and a proximity of the center of mass to the second balance threshold.

6. The system of claim 5 , wherein the processor is further configured to calculate the balance score by:

determining differences between the center of mass and points on the second balance threshold over the period of time; and

calculating the balance score based on a magnitude of the differences.

7. The system of claim 1 , wherein the processor is further configured to:

determine whether the balance score is less than a threshold balance score; and

in response to determining that the balance score is less than a threshold balance score, generate an alert on the user interface.

8. The system of claim 1 , wherein the processor is further configured to:

establish a network connection with a different computing device;

enable a video call between the computing device and the different computing device over the network connection, wherein a video stream of the video call is generated on the user interface;

transfer the balance score to the different computing device;

generate, for display, a plurality of historic balance scores on the user interface; and

transmit the plurality of historic balance scores to the different computing device for display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2021
From: VIRKAR, HEMANT; KAPLAN, LEAH R; FURLANI, STEPHEN; BORGMAN, JACOB; BHAVE, ANIL
To: MIRRORAR LLC
Reel/Frame 056698/0925 →
Continuity (3)
Continuation In Part 16570369 · Sep 13, 2019
Provisional Application 62731744 · Sep 14, 2018
Related Publication 20210322856A1 · Oct 21, 2021