IP Library › Granted Patent US 12,242,672
Granted Patent B1
US 12,242,672 · App. 18/068,048 · Granted Mar 4, 2025

Triggering actions based on detected motions on an artificial reality device

Inventors: Shaik Shabnam Nizamudeen Basha (Mountain View, CA); Peter Ju (San Mateo, CA); Eric Leung (San Francisco, CA); Pierluigi Taddei (Zürich, CH); Jianhan Xu (Vancouver, CA)
Assignee: Meta Platforms Technologies, LLC
G06F3/017G06F3/012G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,242,672
App. No.
18/068,048
Granted
Mar 4, 2025
Kind
B1
Abstract

Aspects of the present disclosure can trigger an action based on a motion detected by an artificial reality (XR) device, such as a head-mounted display (HMD). The XR device can display an XR experience to a user. While displaying the XR experience, the XR device can detect a physical interaction with the XR device using one of more sensors (e.g., sensors of an inertial measurement unit (IMU)). The physical interaction can generate a movement profile captured by the one or more sensors. The XR device can identify the physical interaction as a particular motion (e.g., one or more taps on the XR device) by applying a machine learning model to the movement profile. In response to identifying the particular motion, the XR device can trigger an action on the XR device (e.g., activating pass-through on the XR device).

Claims (64)

1. A method for triggering an action based on a particular motion detected by an artificial reality device, the method comprising:

displaying an artificial reality experience to a user on the artificial reality device;

detecting, by one or more sensors, including at least an inertial measurement unit (IMU), integral with the artificial reality device, a physical interaction with the artificial reality device comprising one or more hand taps on the artificial reality device, the physical interaction generating a movement profile of the one or more hand taps on the artificial reality device;

identifying the physical interaction as the particular motion by applying a machine learning model to the movement profile, the machine learning model being trained on existing movement profiles associated with known motions of hand taps on artificial reality devices; and

in response to identifying the physical interaction as the particular motion, triggering the action on the artificial reality device based on a mapping of detected motions to actions which includes a mapping of one or more hand taps to the action.

2. The method of claim 1 ,

wherein the one or more hand taps includes a sequence of hand taps,

wherein the machine learning model is further trained to recognize each hand tap of the sequence of hand taps, and

wherein the method further comprises:

prior to triggering the action on the artificial reality device, determining that the sequence of hand taps is complete based on a lapse of a threshold period of time after a hand tap of the sequence of hand taps,

wherein the action is triggered on the artificial reality device further in response to determining that the sequence of hand taps is complete.

3. The method of claim 1 , wherein the mapping of detected motions to actions includes mappings of different numbers of hand taps to different actions.

4. The method of claim 1 , wherein the action includes activating pass-through of a real-world environment on the artificial reality device.

5. The method of claim 1 , wherein the action includes displaying an outline of a real-world environment, as an overlay on an artificial reality environment, on the artificial reality device.

6. The method of claim 1 ,

wherein the action includes activating intrusion detection on the artificial reality device, and

wherein the method further comprises:

in response to activating intrusion detection on the artificial reality device, detecting a movement in a real-world environment by the artificial reality device; and

displaying a notification of the detected movement on the artificial reality device.

7. The method of claim 1 , wherein the action includes pausing the artificial reality experience on the artificial reality device.

8. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for triggering an action based on a particular motion detected by an artificial reality device, the process comprising:

displaying an artificial reality experience to a user on the artificial reality device;

detecting, by one or more sensors integral with the artificial reality device, a physical interaction with the artificial reality device, the physical interaction generating a movement profile;

identifying the physical interaction as the particular motion by applying a machine learning model to the movement profile, the machine learning model being trained on existing movement profiles associated with known motions; and

in response to identifying the physical interaction as the particular motion, triggering the action on the artificial reality device.

9. The non-transitory computer-readable storage medium of claim 8 ,

wherein the particular motion is one or more hand taps on the artificial reality device, and

wherein the action is triggered on the artificial reality device based on a mapping of detected motions to actions which includes a mapping of one or more hand taps to the action.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the particular motion is a swiping motion on the artificial reality device.

11. The non-transitory computer-readable storage medium of claim 8 ,

wherein the particular motion includes a sequence of motions,

wherein the machine learning model is further trained to recognize each motion of the sequence of motions, and

wherein the process further comprises:

prior to triggering the action on the artificial reality device, determining that the sequence of motions is complete based on a lapse of a threshold period of time after a motion of the sequence of motions,

wherein the action is triggered on the artificial reality device further in response to determining that the sequence of motions is complete.

12. The non-transitory computer-readable storage medium of claim 8 ,

wherein the action is triggered on the artificial reality device based on a mapping of detected motions to actions which includes a mapping of the particular motion to the action,

wherein the particular motion includes one or more motions, and

wherein the mapping of detected motions to actions includes mappings of different numbers of motions in the one or more motions to different actions.

13. The non-transitory computer-readable storage medium of claim 8 , wherein the action includes activating pass-through of a real-world environment on the artificial reality device.

14. The non-transitory computer-readable storage medium of claim 8 , wherein the action includes displaying an outline of a real-world environment, as an overlay on an artificial reality environment, on the artificial reality device.

15. The non-transitory computer-readable storage medium of claim 8 ,

wherein the action includes activating intrusion detection on the artificial reality device, and

wherein the process further comprises:

in response to activating intrusion detection on the artificial reality device, detecting a movement in a real-world environment by the artificial reality device; and

displaying a notification of the detected movement on the artificial reality device.

16. The non-transitory computer-readable storage medium of claim 8 , wherein the action includes pausing the artificial reality experience on the artificial reality device.

17. A computing system for triggering an action based on a particular motion detected by an artificial reality device, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

displaying an artificial reality experience to a user on the artificial reality device;

detecting, by one or more sensors integral with the artificial reality device, a physical interaction with the artificial reality device, the physical interaction generating a movement profile;

identifying the physical interaction as the particular motion by applying a machine learning model to the movement profile, the machine learning model being trained on existing movement profiles associated with known motions; and

in response to identifying the physical interaction as the particular motion, triggering the action on the artificial reality device.

18. The computing system of claim 17 ,

wherein the particular motion is one or more hand taps on the artificial reality device, and

wherein the action is triggered on the artificial reality device based on a mapping of detected motions to actions which includes a mapping of one or more hand taps to the action.

19. The computing system of claim 17 , wherein the particular motion is a swiping motion on the artificial reality device.

20. The computing system of claim 17 ,

wherein the particular motion includes a sequence of motions,

wherein the machine learning model is further trained to recognize each motion of the sequence of motions, and

wherein the process further comprises:

prior to triggering the action on the artificial reality device, determining that the sequence of motions is complete based on a lapse of a threshold period of time after a motion of the sequence of motions,

wherein the action is triggered on the artificial reality device further in response to determining that the sequence of motions is complete.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2023
From: NIZAMUDEEN BASHA, SHAIK SHABNAM; JU, PETER; LEUNG, ERIC; TADDEI, PIERLUIGI
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 062560/0082 →
Continuity (1)
Provisional Application 63380410 · Oct 21, 2022
References Cited (140)
US 5649061A · Smyth · 1997 [cited by applicant]
US 6025608A · Harris et al. · 2000 [cited by applicant]
US 6028608A · Jenkins · 2000 [cited by applicant]
US 6070098A · Moore-Ede et al. · 2000 [cited by applicant]
US 9406211B2 · Sahiholnasab et al. · 2016 [cited by applicant]
US 9763614B2 · Geller et al. · 2017 [cited by applicant]
US 9767609B2 · Eade et al. · 2017 [cited by applicant]
US 9983665B2 · Hall · 2018 [cited by applicant]
US 10453431B2 · El-Ghoroury · 2019 [cited by applicant]
US 10567641B1 · Rueckner · 2020 [cited by applicant]
US 11158074B1 · Kantor et al. · 2021 [cited by applicant]
US 11238340B1 · Anderson et al. · 2022 [cited by applicant]
US 11327630B1 · Khan et al. · 2022 [cited by applicant]
US 11610376B1 · Smith et al. · 2023 [cited by applicant]
US 11875604B1 · Abad et al. · 2024 [cited by applicant]
US 11941830B2 · Kantor et al. · 2024 [cited by applicant]
US 11978169B2 · Smith et al. · 2024 [cited by applicant]
US 20060098865A1 · Yang et al. · 2006 [cited by applicant]
US 20070112277A1 · Fischer et al. · 2007 [cited by applicant]
US 20120056982A1 · Katz et al. · 2012 [cited by applicant]
US 20120143358A1 · Adams et al. · 2012 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20130084805A1 · Pasquero et al. · 2013 [cited by applicant]
US 20140171775A1 · Kilsgaard et al. · 2014 [cited by applicant]
US 20140240492A1 · Lee · 2014 [cited by applicant]
US 20140327626A1 · Harrison · 2014 [cited by examiner]
US 20150172622A1 · Yoon et al. · 2015 [cited by applicant]
US 20150220768A1 · Ronnecke et al. · 2015 [cited by applicant]
US 20150338915A1 · Publicover et al. · 2015 [cited by applicant]
US 20160057340A1 · You et al. · 2016 [cited by applicant]
US 20160116336A1 · Zhao et al. · 2016 [cited by applicant]
US 20160119523A1 · Egger et al. · 2016 [cited by applicant]
US 20160198949A1 · Spitzer · 2016 [cited by applicant]
US 20160335790A1 · Fleishman et al. · 2016 [cited by applicant]
US 20170113057A1 · Goodall et al. · 2017 [cited by applicant]
US 20170123492A1 · Marggraff et al. · 2017 [cited by applicant]
US 20170148215A1 · Aksoy et al. · 2017 [cited by applicant]
US 20170156192A1 · Chern et al. · 2017 [cited by applicant]
US 20170200266A1 · Podilchuk et al. · 2017 [cited by applicant]
US 20170277257A1 · Ota et al. · 2017 [cited by applicant]
US 20170285169A1 · Holz · 2017 [cited by applicant]
US 20170287447A1 · Barry et al. · 2017 [cited by applicant]
US 20170293356A1 · Khaderi et al. · 2017 [cited by applicant]
US 20170303847A1 · Drucker · 2017 [cited by applicant]
US 20180048880A1 · Trail et al. · 2018 [cited by applicant]
US 20180073873A1 · Takao et al. · 2018 [cited by applicant]
US 20180112862A1 · Gammons et al. · 2018 [cited by applicant]
US 20180125423A1 · Chang et al. · 2018 [cited by applicant]
US 20180131911A1 · Mizuno · 2018 [cited by applicant]
US 20180133507A1 · Malchano et al. · 2018 [cited by applicant]
US 20180134217A1 · Peterson et al. · 2018 [cited by applicant]
US 20180196511A1 · Chae · 2018 [cited by applicant]
US 20180297511A1 · Park et al. · 2018 [cited by applicant]
US 20180299953A1 · Selker et al. · 2018 [cited by applicant]
US 20180307303A1 · Powderly et al. · 2018 [cited by applicant]
US 20180348863A1 · Aimone et al. · 2018 [cited by applicant]
US 20190045173A1 · Hicks · 2019 [cited by applicant]
US 20190082112A1 · Qian · 2019 [cited by applicant]
US 20190174237A1 · Lunner et al. · 2019 [cited by applicant]
US 20190179526A1 · Yellen · 2019 [cited by examiner]
US 20190365272A1 · Sadeghian-Motahar et al. · 2019 [cited by applicant]
US 20200005026A1 · Andersen et al. · 2020 [cited by applicant]
US 20200202538A1 · Hsu et al. · 2020 [cited by applicant]
US 20200409489A1 · Munemoto · 2020 [cited by examiner]
US 20210012574A1 · Fu · 2021 [cited by examiner]
US 20210029290A1 · Okuike · 2021 [cited by applicant]
US 20210090331A1 · Ravasz et al. · 2021 [cited by applicant]
US 20210124417A1 · Ma · 2021 [cited by applicant]
US 20210165486A1 · Erivantcev et al. · 2021 [cited by applicant]
US 20210235203A1 · Lunner et al. · 2021 [cited by applicant]
US 20220028406A1 · Burmistrov et al. · 2022 [cited by applicant]
US 20220253808A1 · Ferguson et al. · 2022 [cited by applicant]
US 20220319041A1 · Jiang et al. · 2022 [cited by applicant]
US 20230065296A1 · Khaleghimeybodi et al. · 2023 [cited by applicant]
US 20240029329A1 · Steptoe et al. · 2024 [cited by applicant]
US 20240193799A1 · Kantor et al. · 2024 [cited by applicant]
US 20240273840A1 · Smith et al. · 2024 [cited by applicant]
JP 5083992B1 · 2012 [cited by applicant]
WO 2014028251A1 · 2014 [cited by applicant]
WO 2016180702A1 · 2016 [cited by applicant]
WO 2017035498A1 · 2017 [cited by applicant]
Villanueva A., et al., “A Novel Gaze Estimation System with One Calibration Point,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Aug. 2008, vol. 38, No. 04, pp. 1123-1138. [cited by applicant]
Wikipedia., “Normalization,” Jan. 2, 2021, Retrieved from the Internet: https://en.wikipedia.org/w/index.php?title=Normalization_(statistics) oldid=997823157, 3 pages. [cited by applicant]
Wu E., et al., “Back-Hand-Pose 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network,” Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, Oct. 20, 2020, pp. … [cited by applicant]
Xu W., et al., “Mo2Cap2: Real-Time Mobile 3D Motion Capture with a Cap-Mounted Fisheye Camera,” IEEE Transactions on Visualization and Computer Graphics, Feb. 15, 2019, vol. 25, No. 5, 9 Pages. [cited by applicant]
Yonemoto H., et al., “Egocentric Articulated Pose Tracking for Action Recognition,” International Conference on Machine Vision Applications (MVA), 2015, pp. 98-101. [cited by applicant]
Yuan Y., et al., “3D Ego-Pose Estimation via Imitation Learning,” Proceedings of European Conference on Computer Vision (ECCV), 2018, pp. 1-16. [cited by applicant]
Yuan Y., et al., “Ego-Pose Estimation and Forecasting as Real-Time PD Control,” International Conference on Computer Vision (ICCV), 2019, pp. 10082-10092. [cited by applicant]
Zhou B., et al., “Scene Parsing Through ADE20K Dataset,” In Conference on Computer Vision and Pattern Recognition, Jul. 2017, pp. 5122-5130. [cited by applicant]
Zhou X., et al., “Deep Kinematic Pose Regression,” European Conference on Computer Vision, Nov. 24, 2016, pp. 186-201. [cited by applicant]
Akhter I., et al., “Pose-Conditioned Joint Angle Limits for 3D Human Pose Reconstruction,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 7-12, 2015, pp. 1446-1455. [cited by applicant]
Baluja S., et al., “Non-Intrusive Gaze Tracking Using Artificial Neural Networks,” Jan. 1994, pp. 1-14. [cited by applicant]
“Blender: Free and Open 3D Creation Software,” Retrieved on Oct. 15, 2021, 9 Pages, Retrieved from the Internet: URL: https://www.blender.org. [cited by applicant]
Bobick A.F., et al., “The Recognition of Human Movement Using Temporal Templates,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Mar. 1, 2001, vol. 23, No. 3, pp. 257-267. [cited by applicant]
Bradski G.R., et al., “Motion Segmentation and Pose Recognition with Motion History Gradients,” Machine Vision and Applications, Jul. 31, 2002, vol. 13, No. 3, pp. 174-184. [cited by applicant]
Campana A. et al., “An Artificial Neural Network That Uses Eye-Tracking Performance to Identify Patients with Schizophrenia,” Schizophrenia Bulletin, vol. 25, No. 4, Jan. 1999, pp. 789-799. [cited by applicant]
Cao Z., et al., “OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields,” arXiv preprint, arXiv:1812.08008V2, May 30, 2019, 14 pages. [cited by applicant]
Cha Y.W., et al., “Towards Fully Mobile 3D Face, Body, and Environment Capture Using Only Head-Worn Cameras,” IEEE Transactions on Visualization and Computer Graphics, 2018, vol. 24, No. 11, 12 Pages. [cited by applicant]
CMU: “Motion Caption Dataset: CMU Graphics Lab Motion Capture Database,” Retrieved on Oct. 15, 2021, 1 Page, Retrieved from the Internet: URL: http://mocap.cs.cmu.edu. [cited by applicant]
Final Office Action mailed Nov. 1, 2023 for U.S. Appl. No. 17/461,769, filed Aug. 30, 2021, 29 pages. [cited by applicant]
“HandPosing: A Tool for Quickly Snapping Hands to Objects in VR Using Hand-Tracking,” HandPosing: Class List [online], Retrieved on Feb. 23, 2021, 2 pages, Retrieved from the Internet: URL: https://mephestokhaan.github.… [cited by applicant]
He K., et al., “Mask R-CNN,” In Proceedings of the IEEE International Conference on Computer Vision, Oct. 2017, pp. 2961-2969. [cited by applicant]
Hwang D.H., et al., “MonoEye: Multimodal Human Motion Capture System Using a Single Ultra-Wide Fisheye Camera,” Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, Oct. 2020, pp. 98-1… [cited by applicant]
Hwang D-H., et al., “Toward Human Motion Capturing With an Ultra-Wide Fisheye Camera on the Chest,” IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Mar. 23-27, 2019, pp. 1524-1526. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/041777, mailed Mar. 14, 2024, 14 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2018/062029, mailed Jul. 2, 2019, 11 Pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/022282, mailed Jul. 25, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/041777, mailed Feb. 13, 2023, 18 pages. [cited by applicant]
Invitation to Pay Additional Fees for International Application No. PCT/US2022/041777, mailed Dec. 21, 2022, 12 pages. [cited by applicant]
Jiang H., et al., “Egocentric Pose Estimation from Human Vision Span,” IEEE/CVF International Conference on Computer Vision (ICCV), Oct. 10, 2021, pp. 10986-10994. [cited by applicant]
Jiang H., et al., “Seeing Invisible Poses: Estimating 3D Body Pose From Egocentric Video,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 3501-3509. [cited by applicant]
Kanazawa A., et al., “End-to-end Recovery of Human Shape and Pose,” Computer Vision and Pattern Recognition (CVPR), Jun. 2018, pp. 7122-7131. [cited by applicant]
Lopez A., et al., “Development of an EOG-Based System to Control a Serious Game,” Measurement, vol. 127, Jun. 15, 2018, 8 pages. [cited by applicant]
Marcard T., et al., “Sparse Inertial Poser: Automatic 3D Human Pose Estimation From Sparse IMUs,” Computer Graphics Forum, Wiley Online Library, 2017, vol. 36, No. 2, pp. 349-360. [cited by applicant]
Martinez J., et al., “A Simple yet Effective Baseline for 3D Human Pose Estimation,” Proceedings of the IEEE International Conference on Computer Vision (ICCV), Oct. 2017, pp. 2640-2649. [cited by applicant]
Mefisto L., “Grabbables—MephestoKhaan / HandPosing Wiki,” GitHub [online], Dec. 29, 2020 [Retrieved on Feb. 23, 2021], 3 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing/wiki/Grabbabl… [cited by applicant]
Mefisto L., “Hand Puppeting—MephestoKhaan/HandPosing Wiki,” GitHub [online], Nov. 23, 2020 [Retrieved on Feb. 23, 2021], 3 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing/wiki/Hand-P… [cited by applicant]
Mefisto L., “Home—MephestoKhaan / HandPosing Wiki,” GitHub [online], Dec. 29, 2020 [Retrieved on Feb. 23, 2021], 3 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing/wiki. [cited by applicant]
Mefisto L., “Snapping Behaviours—MephestoKhaan/HandPosing Wiki,” GitHub [online], Dec. 29, 2020 [Retrieved on Feb. 23, 2021], 7 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing/wiki/S… [cited by applicant]
Mefisto L., “Pose Recording—MephestoKhaan/HandPosing Wiki,” GitHub [online], Dec. 29, 2020 [Retrieved on Feb. 23, 2021], 10 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing/wiki/Pose-… [cited by applicant]
Mefisto L., “Puppeting Oculus Avatars—MephestoKhaan/HandPosing Wiki,” GitHub [online], Dec. 29, 2020 [Retrieved on Feb. 23, 2021], 2 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing/w… [cited by applicant]
“MephestoKhaan/HandPosing: Pose authoring using handtrackingon Quest,” MIT License, GitHub [online], Retrieved on Feb. 24, 2021, 4 pages, Retrieved from the Internet: URL: https://github.com/MephestoKhaan/HandPosing. [cited by applicant]
Moreno-Noguer F., “3D Human Pose Estimation from a Single Image via Distance Matrix Regression,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2823-2832. [cited by applicant]
Ng E., et al., “You2Me: Inferring Body Pose in Egocentric Video via First and Second Person Interactions,” Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 9890-9900. [cited by applicant]
Non-Final Office Action mailed Jun. 6, 2023 for U.S. Appl. No. 17/461,769, filed Aug. 30, 2021, 27 pages. [cited by applicant]
Non-Final Office Action mailed Aug. 13, 2021 for U.S. Appl. No. 15/802,333, filed Nov. 2, 2017, 41 pages. [cited by applicant]
Non-Final Office Action mailed Oct. 2, 2023 for U.S. Appl. No. 17/554,522, filed Dec. 17, 2021, 59 pages. [cited by applicant]
Pavlakos G., et al., “Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Pose,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 7025-7034. [cited by applicant]
Rhodin; et al., “EgoCap: Egocentric Marker-Less Motion Capture with Two Fisheye Cameras.” ACM Transactions on Graphics (TOG), Dec. 5, 2016, vol. 35, No. 6, 11 pages. [cited by applicant]
Rhodin; et al., “General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues,” Proceedings of the 14th European Conference on Computer Vision 2016, Oct. 11, 2016, 19 pages. [cited by applicant]
Rogez G., et al., “First-Person Pose Recognition Using Egocentric Workspaces,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 4325-4333. [cited by applicant]
Rokoko: “Smartsuit Pro: Quality Motion Capture in One Simple Suit,” Retrieved on Oct. 15, 2021, 7 Pages, Retrieved from the Internet: URL: https://www.rokoko.com/products/smartsuit-pro. [cited by applicant]
Schneider N. et al., “An Open-Source Low-Cost Eye-Tracking System for Portable Real-Time and Offline Tracking,” May 26-27, 2011, 4 pages. [cited by applicant]
Shiratori T., et al., “Motion Capture from Body-Mounted Cameras,” ACM Transactions on Graphics (TOG), Jul. 2011, vol. 30, No. 4, Article 31, pp. 31:1-31:10. [cited by applicant]
Sumikura S., et al., “OpenVSLAM : A Versatile Visual SLAM Framework,” Open Source Software Competition, Oct. 2019, pp. 2292-2295. [cited by applicant]
Tekin B., et al., “Structured Prediction of 3D Human Pose With Deep Neural Networks,” British Machine Vision Conference (BMVC), 2016, 11 pages. [cited by applicant]
Tome D., et al., “SelfPose: 3D Egocentric Pose Estimation From a Headset Mounted Camera,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 13 pages. [cited by applicant]
Tome D., et al., “xR-EgoPose: Egocentric 3D Human Pose From an HMD Camera,” International Conference on Computer Vision (ICCV), 2019, pp. 7728-7738. [cited by applicant]
Tu H., et al., “VoxelPose: Towards Multi-Camera 3D Human Pose Estimation in Wild Environment,” European Conference on Computer Vision (ECCV), Nov. 3, 2020, 17 Pages. [cited by applicant]
U.S. Appl. No. 62/239,111, 2016, 32 Pages. [cited by applicant]