IP Library Granted Patent US 12,306,993
Granted Patent B2
US 12,306,993 · App. 18/343,776 · Granted May 20, 2025

Privacy-preserving motion analysis

Inventors: Tian Hao (White Plains, NY); Umar Asif (Melbourne, AU); Stefan Harrer (Sandringham, AU); Jianbin Tang (Doncaster East, AU); Stefan von Cavallar (Sandringham, AU); Deval Samirbhai Mehta (Melbourne, AU); Jeffrey L. Rogers (Briarcliff Manor, NY); Erhan Bilal (Westport, CT); Stefan Renard Maetschke (Ascot Vale, AU)
Assignee: International Business Machines Corporation
G06F21/6263G06F18/24G06V40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,306,993
App. No.
18/343,776
Granted
May 20, 2025
Kind
B2
Abstract

A method, a structure, and a computer system for privacy-preserving motion analysis. Embodiments may include identifying one or more joints of a user based on collected data and generating one or more 3D representations of the one or more joints of the user. Embodiments may further include anonymizing the one or more 3D representations, classifying one or more actions of the user based on the one or more 3D representations, wherein the classifying outputs an action score, and exporting at least one of the one or more actions and the action score.

Claims (40)

1. A method for privacy-preserving motion analysis, the method comprising:

identifying one or more joints of a user based on collected data;

generating one or more 3D representations of the one or more joints of the user;

anonymizing the one or more 3D representations by applying thereto joint-centering and random shuffling;

classifying one or more actions of the user based on the one or more 3D representations, wherein the classifying outputs an action score; and

based on determining that an identity of the user cannot be reverse engineered from the anonymized one or more 3D representations, exporting at least one of the one or more actions and the action score.

2. The method of claim 1 , further comprising:

determining a severity of the one or more actions; and

based on the one or more actions and the action score, predicting one or more impending actions.

3. The method of claim 2 , further comprising:

based on at least one of the severity and the predicting the one or more impending actions, taking rehabilitative action.

4. The method of claim 3 , wherein the rehabilitative action is haptic feedback to the user.

5. The method of claim 1 , wherein the one or more actions are selected from a group consisting of general motion, posture, gait, a fall, a seizure, and anomalies.

6. A computer program product for privacy-preserving motion analysis, the computer program product comprising:

one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the program instructions including a method, the method comprising:

identifying one or more joints of a user based on collected data;

generating one or more 3D representations of the one or more joints of the user;

anonymizing the one or more 3D representations by applying thereto joint-centering and random shuffling;

classifying one or more actions of the user based on the one or more 3D representations, wherein the classifying outputs an action score; and

based on determining that an identity of the user cannot be reverse engineered from the anonymized one or more 3D representations, exporting at least one of the one or more actions and the action score.

7. The computer program product of claim 6 , further comprising:

determining a severity of the one or more actions; and

based on the one or more actions and the action score, predicting one or more impending actions.

8. The computer program product of claim 7 , further comprising:

based on at least one of the severity and the predicting the one or more impending actions, taking rehabilitative action.

9. The computer program product of claim 8 , wherein the rehabilitative action is haptic feedback to the user.

10. The computer program product of claim 6 , wherein the one or more actions are selected from a group comprising general motion, posture, gait, a fall, a seizure, and anomalies.

11. A computer system for privacy-preserving motion analysis, the computer system comprising:

one or more computer processors, one or more computer-readable storage media, and program instructions stored on one or more of the computer-readable storage media for execution by at least one of the one or more processors, the program instructions including a method, the method comprising:

identifying one or more joints of a user based on collected data;

generating one or more 3D representations of the one or more joints of the user;

anonymizing the one or more 3D representations by applying thereto joint-centering and random shuffling;

classifying one or more actions of the user based on the one or more 3D representations, wherein the classifying outputs an action score; and

based on determining that an identity of the user cannot be reverse engineered from the anonymized one or more 3D representations, exporting at least one of the one or more actions and the action score.

12. The computer system of claim 11 , further comprising:

determining a severity of the one or more actions; and

based on the one or more actions and the action score, predicting one or more impending actions.

13. The computer system of claim 12 , further comprising:

based on at least one of the severity and the predicting the one or more impending actions, taking rehabilitative action.

14. The computer system of claim 13 , wherein the rehabilitative action is haptic feedback to the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2023
From: HAO, TIAN; ASIF, UMAR; HARRER, STEFAN; TANG, JIANBIN; VON CAVALLAR, STEFAN; MEHTA, DEVAL SAMIRBHAI; ROGERS, JEFFREY L.; BILAL, ERHAN; MAETSCHKE, STEFAN RENARD
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 064107/0188 →
Continuity (2)
Continuation 17249132 · Feb 22, 2021
Related Publication 20230334180A1 · Oct 19, 2023
References Cited (29)
US 7857771B2 · Alwan · 2010 [cited by examiner]
US 9619891B2 · Bose · 2017 [cited by applicant]
US 9799096B1 · De la Torre · 2017 [cited by examiner]
US 10083233B2 · Kontschieder · 2018 [cited by examiner]
US 11534365B2 · Giacometti · 2022 [cited by examiner]
US 11688264B2 · Cheng · 2023 [cited by examiner]
US 11819344B2 · Stone · 2023 [cited by examiner]
US 20060056655A1 · Wen · 2006 [cited by examiner]
US 20140299775A1 · Kimmel · 2014 [cited by examiner]
US 20150213702A1 · Kimmel · 2015 [cited by applicant]
US 20200211154A1 · Ng · 2020 [cited by examiner]
US 20200349245A1 · Shila · 2020 [cited by examiner]
US 20210209734A1 · Simhadri · 2021 [cited by applicant]
US 20210232810A1 · Parsa · 2021 [cited by applicant]
US 20210365670A1 · Shuster · 2021 [cited by examiner]
US 20210374605A1 · Qian · 2021 [cited by examiner]
US 20220269824A1 · Hao · 2022 [cited by applicant]
EP 3528460A1 · 2019 [cited by applicant]
Emmanuel Aryee et al, Identifying protective and risk factors for injurious falls in patients hospitalized for acute care: a retrospective case-control study, BMC Geriatrics (Year: 2017). [cited by examiner]
IBM: List of IBM Patents or Patent Applications Treated as Related. Filed Herewith. 2 pages. [cited by applicant]
B. Zhu et al., “Deepfakes for Medical Video De-Identification: Privacy Protection and Diagnostic Information Preservation.” In Proceedings of the AAAI/ACM Conf. on AI, Ethics, and Society (AIES '20). ACM, pp. 414-420. [cited by applicant]
Chou et al., “Privacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images”, arXiv:1811.09950v1, [cs.CV], Nov. 25, 2018, pp. 1-6. [cited by applicant]
Dai et al., “Towards Privacy-Preserving Activity Recognition Using Extremely Low Temporal and Spatial Resolution Cameras”, https://www.cv-foundation.org/openaccess/content_cvpr_workshops_2015/W08/papers/Dai_Towards_Priv… [cited by applicant]
J. Dai et al., “Towards privacy-preserving recognition of human activities,” 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, 2015, pp. 4238-4242. [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing”, National Institute of Standards and Technology, Special Publication 800-145, Sep. 2011, pp. 1-7. [cited by applicant]
U. Asif et al., “DeepActsNet: Spatial and Motion features from Face, Hands, and Body Combined with Convolutional and Graph Networks for Improved Action Recognition.” [Submitted on Sep. 21, 2020], https://arxiv.org/abs/2… [cited by applicant]
U. Asif et al., “Privacy Preserving Human Fall Detection using Video Data,” 2020. Proceedings of Machine Learning Research 116: pp. 39-51. [cited by applicant]
Z. Wang et al., “Privacy-Preserving Action Recognition Using Coded Aperture Videos,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, 2019, pp. 1-10. [cited by applicant]
Z. Wu et al., “Towards privacy-preserving visual recognition via adversarial training: A pilot study.” In Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 606-624. [cited by applicant]