IP Library Granted Patent US 12,474,365
Granted Patent B2
US 12,474,365 · App. 17/349,883 · Granted Nov 18, 2025

User posture transition detection and classification

Inventors: Aditya Sarathy (Santa Clara, CA); Umamahesh Srinivas (Milpitas, CA); Bharath Narasimha Rao (San Mateo, CA); Alexander Singh Alvarado (San Jose, CA); Xiaoyuan Tu (Sunnyvale, CA); Jonathan Michel Beard (San Jose, CA)
Assignee: Apple Inc.
G01P15/02G01P13/04G06N3/08G06N7/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,474,365
App. No.
17/349,883
Granted
Nov 18, 2025
Kind
B2
Abstract

Embodiments are disclosed for user posture transition detection and classification. In an embodiment, a method comprises: obtaining, using one or more processors, motion data from a headset worn by a user; determining, using the one or more processors, one or more windows of motion data that indicate biomechanics of one or more phases of a user's postural transition; and classifying, using the one or more processors, as the user's postural transition based on the one or more windows of data.

Claims (36)

1 . A method comprising:

training a classifier to detect human posture transition;

obtaining, with at least one processor, motion data from a headset reference frame associated with a headset worn by a user, the motion data including measurements of the user's inertial vertical acceleration and rotation about the user's torso in the headset reference frame;

transforming, with the at least one processor, the user's inertial vertical acceleration from the headset reference frame to a head/face reference frame;

determining, with the at least one processor, a dominant axis of the user's inertial vertical acceleration in the head/face reference frame;

determining, with the at least one processor, the user's face-forward inertial acceleration to be the dominant axis of the user's inertial vertical acceleration in the head/face reference frame;

determining, with the at least one processor, if the user's face-forward inertial acceleration meets or exceeds a minimum threshold;

in accordance with the user's face-forward inertial acceleration meeting or exceeding the minimum threshold, obtaining, with the at least one processor, one or more windows of motion data including the user's inertial vertical acceleration and the rotation about the user's torso;

detecting, with the trained classifier, a sit-to-stand or stand-to-sit posture transition of the user based on the one or more windows of motion data; and

determining, with the at least one processor, an activity of the user based on the user's posture transition.

2 . The method of claim 1 , wherein one or more phases of the user's posture transition include leaning, momentum and extension phases, and time boundaries of the extension phase are determined based on points of zero vertical inertial velocity derived from the user's inertial vertical acceleration, where the points of zero inertial vertical velocity correspond to maximum and minimum angles of the rotation about the user's torso.

3 . The method of claim 2 , wherein the user's posture transition is classified based on the one or more windows of motion data and additional motion data captured before and after each of the one or more windows of the motion data.

4 . The method of claim 1 , wherein the dominant axis is determined using principal component analysis.

5 . A system comprising:

one or more processors;

memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:

training a classifier to detect human posture transitions;

obtaining motion data from a headset reference frame associated with a headset worn by a user, the motion data including measurements of the user's inertial vertical acceleration and rotation about the user's torso in the headset reference frame;

transforming the user's inertial vertical acceleration from the headset reference frame to a head/face reference frame;

determining a dominant axis of the user's inertial vertical acceleration in the head/face reference frame;

determining the user's face-forward inertial acceleration to be the dominant axis of the user's inertial vertical acceleration in the head/face reference frame;

determining if the user's face-forward inertial acceleration meets or exceeds a minimum threshold;

in accordance with the user's face-forward inertial acceleration meeting or exceeding the minimum threshold, obtaining one or more windows of motion data including the user's inertial vertical acceleration and the rotation about the user's torso; and

detecting, with the trained classifier, a sit-to-stand or stand-to-sit posture transition of the user based on the one or more windows of motion data; and

determining an activity of the user based on the user's posture transition.

6 . The system of claim 5 , wherein one or more phases of the user's posture transition include leaning, momentum and extension phases, and time boundaries of the extension phase are determined based on points of zero vertical inertial velocity derived from the user's inertial vertical acceleration, where the points of zero inertial vertical velocity correspond to maximum and minimum angles of the rotation about the user's torso.

7 . The system of claim 6 , wherein the user's posture transition is classified based on the one or more windows of motion data and additional motion data captured before and after each of the one or more windows of the motion data.

8 . The system of claim 5 , wherein the dominant axis is determined using principal component analysis.

9 . The method of claim 1 , further comprising:

determining, by inertial sensors of the headset and a companion device coupled to the headset, a gravity vector during a quiescence condition;

estimating a head/face to headset rotation transform based on the gravity vector; and

transforming, with the head/face to headset rotation transform, the user's inertial vertical acceleration from the headset reference frame to the head/face reference frame.

10 . The system of claim 5 , where the operations further comprise:

determining, by inertial sensors of the headset and a companion device coupled to the headset, a gravity vector during a quiescence condition;

estimating a head/face to headset rotation transform using based on the gravity vector; and

transforming, with the head/face to headset rotation transform, the user's inertial vertical acceleration from the headset reference frame to the head/face reference frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2021
From: SARATHY, ADITYA; SRINIVAS, UMAMAHESH; RAO, BHARATH NARASIMHA; SINGH ALVARADO, ALEXANDER; TU, XIAOYUAN; BEARD, JONATHAN MICHEL
To: APPLE INC.
Reel/Frame 057510/0683 →
Continuity (2)
Provisional Application 63041907 · Jun 20, 2020
Related Publication 20210396779A1 · Dec 23, 2021
References Cited (52)
US 9142062B2 · Maciocci · 2015 [cited by examiner]
US 9459692B1 · Li · 2016 [cited by applicant]
US 10169917B2 · Chen et al. · 2019 [cited by applicant]
US 10339078B2 · Nair et al. · 2019 [cited by applicant]
US 11582573B2 · Tu et al. · 2023 [cited by applicant]
US 11586280B2 · Kriminger et al. · 2023 [cited by applicant]
US 11589183B2 · Tu et al. · 2023 [cited by applicant]
US 11647352B2 · Tam et al. · 2023 [cited by applicant]
US 11675423B2 · Akgul et al. · 2023 [cited by applicant]
US 20050281410A1 · Grosvenor et al. · 2005 [cited by applicant]
US 20120114132A1 · Abrahamsson et al. · 2012 [cited by applicant]
US 20140153751A1 · Wells · 2014 [cited by applicant]
US 20150081061A1 · Aibara · 2015 [cited by examiner]
US 20150302720A1 · Zhang · 2015 [cited by examiner]
US 20160119731A1 · Lester, III · 2016 [cited by applicant]
US 20160262608A1 · Krueger · 2016 [cited by applicant]
US 20160269849A1 · Riggs et al. · 2016 [cited by applicant]
US 20170188895A1 · Nathan · 2017 [cited by examiner]
US 20170295446A1 · Thagadur Shivappa · 2017 [cited by applicant]
US 20180091923A1 · Satongar et al. · 2018 [cited by applicant]
US 20180125423A1 · Chang · 2018 [cited by examiner]
US 20180176468A1 · Wang et al. · 2018 [cited by applicant]
US 20180220253A1 · Kärkkäine et al. · 2018 [cited by applicant]
US 20180242094A1 · Baek et al. · 2018 [cited by applicant]
US 20180343534A1 · Norris et al. · 2018 [cited by applicant]
US 20190121522A1 · Davis et al. · 2019 [cited by applicant]
US 20190166435A1 · Crow et al. · 2019 [cited by applicant]
US 20190224528A1 · Omid-Zohoor · 2019 [cited by examiner]
US 20190313201A1 · Torres et al. · 2019 [cited by applicant]
US 20190313915A1 · Tzvieli · 2019 [cited by examiner]
US 20190374161A1 · Ly · 2019 [cited by examiner]
US 20190379995A1 · Lee et al. · 2019 [cited by applicant]
US 20200037097A1 · Torres et al. · 2020 [cited by applicant]
US 20200059749A1 · Casimiro Ericsson et al. · 2020 [cited by applicant]
US 20200169828A1 · Liu et al. · 2020 [cited by applicant]
US 20200323727A1 · Agrawal · 2020 [cited by examiner]
US 20210044913A1 · Haussler et al. · 2021 [cited by applicant]
US 20210064132A1 · Rubin · 2021 [cited by examiner]
US 20210100480A1 · Kang · 2021 [cited by examiner]
US 20210211825A1 · Joyner et al. · 2021 [cited by applicant]
US 20210394020A1 · Killen · 2021 [cited by examiner]
US 20210397249A1 · Kriminger et al. · 2021 [cited by applicant]
US 20210397250A1 · Akgul et al. · 2021 [cited by applicant]
US 20210400414A1 · Tu et al. · 2021 [cited by applicant]
US 20210400418A1 · Tam et al. · 2021 [cited by applicant]
US 20210400419A1 · Turgut et al. · 2021 [cited by applicant]
US 20210400420A1 · Tam et al. · 2021 [cited by applicant]
US 20220103964A1 · Tu et al. · 2022 [cited by applicant]
US 20220103965A1 · Tu et al. · 2022 [cited by applicant]
US 20250133363A1 · Tu et al. · 2025 [cited by applicant]
Jolliffe et al., 2016 Principal component analysis: a review and recent developments. Phil. Trans. R. Soc. A 374: Feb. 2, 2015 (Year: 2016). [cited by examiner]
Zhang et al., “Template matching based motion classification for unsupervised post-stroke rehabilitation,” International Symposium on Bioelectronics and Bioinformations 2011 (Year: 2011). [cited by examiner]