IP Library › Granted Patent US 10,311,746
Granted Patent B2
US 10,311,746 · App. 15/622,542 · Granted Jun 4, 2019

Wearable apparatus and method for monitoring posture

Inventors: Yonatan Wexler (Jerusalem, IL); Amnon Shashua (Mevaseret Zion, IL)
Assignee: OrCam Technologies Ltd.
G09B19/00G06K9/00362G06K9/00369G06K9/00382G06K9/209G06K9/6202G06K9/6256G06K9/6267G06K9/78G08B21/0446G09B5/02G09B5/04G06K9/00671G08B7/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,311,746
App. No.
15/622,542
Filed
Jun 14, 2017
Granted
Jun 4, 2019
Kind
B2
Art Unit
2667
USPC
382/103
Abstract

The present disclosure relates to systems and methods for monitoring posture of a user of a wearable apparatus. In one implementation, the system may include an image sensor configured to capture one or more images from an environment of the user of the wearable apparatus and at least one processing device. The at least one processing device may be configured to analyze the one or more images to determine at least one indicator of the posture of the user, determine feedback for the user based on the at least one indicator of the posture of the user, and cause the feedback to be output to the user.

Claims (64)

1. A wearable apparatus for monitoring a posture of a user of the wearable apparatus, the wearable apparatus comprising:

an image sensor configured to capture images from an environment of the user of the wearable apparatus; and

at least one processor configured to:

analyze one or more images of the captured images that include a representation of at least a portion of the user to determine at least one indicator of the posture of the user;

analyze the one or more images to obtain motion information associated with the user;

determine, based on the motion information, whether to generate feedback for the user;

classify the at least one indicator of the posture of the user using a classification rule;

when the at least one indicator is classified into at least one first category:

generate a visual depiction of the posture of the user;

generate the feedback based on the at least one indicator of the posture of the user and apply the feedback to generate a visual depiction of a recommended posture;

overlay the visual depiction of the posture and the visual depiction of the recommended posture; and

cause the overlaid visual depictions to be output to the user; and

when the at least one indicator is classified into at least one second category:

refrain from generating the feedback.

2. The wearable apparatus of claim 1 , wherein the at least one indicator of the posture of the user includes an indicator of a posture of at least one hand of the user.

3. The wearable apparatus of claim 2 , wherein the feedback includes a recommended adjustment to a position of the at least one hand of the user.

4. The wearable apparatus of claim 1 , wherein the at least one indicator of the posture of the user includes an indicator of a posture of a neck of the user.

5. The wearable apparatus of claim 4 , wherein the feedback includes a recommended adjustment to a position of the neck of the user.

6. The wearable apparatus of claim 1 , wherein the feedback to the user includes audible feedback or visual feedback.

7. The wearable apparatus of claim 1 , further comprising a vibrating component, and wherein the causing the feedback to be output to the user includes causing the vibrating component to generate a vibration.

8. The wearable apparatus of claim 1 , wherein causing the feedback to be output to the user includes transmitting the feedback to a device paired with the wearable apparatus.

9. The wearable apparatus of claim 8 , wherein the paired device includes one of a smartphone, a tablet, or a smartwatch.

10. The wearable apparatus of claim 1 , wherein the at least one processor is further configured to:

receive a plurality of posture-related records; and

compare the posture-related information to the plurality of posture-related records, and

wherein the feedback for the user is determined based on the comparison.

11. The wearable apparatus of claim 1 , wherein the at least one first category includes a plurality of categories, and the feedback for the user is determined based on the classification of the at least one indicator of the posture of the user.

12. The wearable apparatus of claim 11 , wherein the classification rule is based on one or more machine learning algorithms trained on one or more training examples.

13. The wearable apparatus of claim 11 , wherein the classification rule is based on one or more outputs of at least one neural network.

14. The wearable apparatus of claim 1 , wherein the at least one processor is further configured to calculate a score associated with the posture of the user based on the at least one indicator of the posture of the user, and the feedback for the user is determined based on the score.

15. The wearable apparatus of claim 1 , wherein the at least one processor is further configured to:

analyze the one or more images to identify a plurality of body parts; and

classify at least one of the body parts as being associated with the user, and

wherein analyzing the one or more images to determine the at least one indicator of the posture of the user includes analyzing at least one image of the body part associated with the user.

16. A method for monitoring a posture of a user of a wearable apparatus, the method comprising:

capturing, via an image sensor included in the wearable apparatus, one or more images that include a representation of at least a portion of the user from an environment of the user of the wearable apparatus;

analyzing, via at least one processor included the wearable apparatus, the one or more images to determine at least one indicator of the posture of the user;

analyzing the one or more images to obtain motion information associated with the user;

determining, based on the motion information, whether to generate feedback for the user;

classifying the at least one indicator of the posture of the user using a classification rule;

when the at least one indicator is classified into at least one first category:

generate a visual depiction of the posture of the user;

generate the feedback based on the at least one indicator of the posture of the user and apply the feedback to generate a visual depiction of a recommended posture;

overlay the visual depiction of the posture and the visual depiction of the recommended posture; and

cause the overlaid visual depictions to be output to the user; and

when the at least one indicator is classified into at least one second category:

refrain from generating the feedback.

17. The method of claim 16 , wherein the at least one indicator of the posture of the user includes an indicator of a posture of at least one hand of the user.

18. The method of claim 17 , wherein the feedback includes a recommended adjustment to a position of the at least one hand of the user.

19. The method of claim 18 , wherein the at least one indicator of the posture of the user includes an indicator of a posture of a neck of the user.

20. The method of claim 19 , wherein the feedback includes a recommended adjustment to a position of the neck of the user.

21. The method of claim 16 , wherein the wearable apparatus includes a vibrating component, and causing the feedback to be output to the user includes causing the vibrating component to generate a vibration.

22. The method of claim 16 , wherein causing the feedback to be output to the user includes transmitting the feedback to a device paired with the wearable apparatus.

23. The method of claim 16 , further comprising:

receiving, via the at least one processor, a plurality of posture-related records; and

comparing, via the at least one processor, the posture-related information to the plurality of posture-related records, and

wherein the feedback for the user is determined based on the comparison.

24. The method of claim 16 , wherein the at least one first category includes a plurality of categories, and the feedback for the user is determined based on the classification of the at least one indicator of the posture of the user.

25. The method of claim 16 , further comprising calculating, via the at least one processor, a score associated with the posture of the user based on the at least one indicator of the posture of the user, and the feedback for the user is determined based on the score.

26. The method of claim 16 , further comprising:

analyzing, via the at least one processor, the one or more images to identify a plurality of body parts; and

classifying, via the at least one processor, at least one of the body parts as being associated with the user, and

wherein analyzing the one or more images to determine the at least one indicator of the posture of the user includes analyzing at least one image of the body part associated with the user.

27. A non-transitory computer readable medium storing instructions for carrying out the method of claim 16 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2017
From: WEXLER, YONATAN; SHASHUA, AMNON
To: ORCAM TECHNOLOGIES LTD.
Reel/Frame 042942/0366 →
Continuity (2)
Provisional Application 62350060 · Jun 14, 2016
Related Publication 20170358241A1 · Dec 14, 2017