IP Library › Granted Patent US 12,406,531
Granted Patent B2
US 12,406,531 · App. 17/737,473 · Granted Sep 2, 2025

Virtual reality user health monitoring

Inventors: Joseph Soryal (Glendale, NY); Shawn Rajguru (Summit, NJ)
Assignee: AT&T Intellectual Property I, L.P.
G06V40/23A61B5/112A61B5/162A61B5/4561A61B5/4803A61B5/7264A61B5/7282A61B5/744G08B21/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,531
App. No.
17/737,473
Granted
Sep 2, 2025
Kind
B2
Abstract

A processing system including at least one processor may obtain a data feed of a region of a virtual environment associated with a virtual representation of a user within the virtual environment and extract behavioral data of the virtual representation of the user from the data feed. The processing system may further detect at least one health anomaly related to a physical condition of the user from the behavioral data via at least one first detection model for detecting the at least one health anomaly and generate an alert in response to the detecting of the at least one health anomaly that is related to the physical condition of the user.

Claims (48)

1. A method comprising:

obtaining, by a processing system including at least one processor, a visual data feed of a region of a virtual environment associated with a virtual representation of a user within the virtual environment, wherein the virtual representation of the user comprises an avatar;

extracting, by the processing system, behavioral data of the virtual representation of the user from the visual data feed;

detecting, by the processing system, at least one health anomaly related to a physical condition of the user from the behavioral data via at least one first detection model for detecting the at least one health anomaly, wherein the at least one first detection model is trained from a training data set comprising at least a portion of the behavioral data that is extracted; and

generating, by the processing system, an alert in response to the detecting of the at least one health anomaly that is related to the physical condition of the user.

2. The method of claim 1 , wherein the processing system is a processing system of an endpoint device of the user that is used to access the virtual environment.

3. The method of claim 1 , wherein the processing system comprises a processing system of a server hosting the virtual environment, wherein the method is performed via at least one first process that is distinct from at least one second process that is for hosting the virtual environment.

4. The method of claim 3 , wherein the at least one second process provides the visual data feed of the region of the virtual environment.

5. The method of claim 1 , wherein the processing system is a processing system of a first server, and wherein the virtual environment is hosted via at least a second server, wherein the at least the second server provides the visual data feed of the region of the virtual environment.

6. The method of claim 1 , wherein the behavioral data comprises at least one of:

gait data;

posture data;

facial expression data;

speech data;

mobility data;

reaction data; or

accuracy data.

7. The method of claim 1 , wherein the extracting the behavioral data comprises detecting an acute health event via at least one second detection model.

8. The method of claim 7 , wherein the detecting the at least one health anomaly related to the physical condition of the user comprises determining that the acute health event is associated with the physical condition of the user.

9. The method of claim 8 , wherein the determining that the acute health event is associated with the physical condition of the user comprises determining that the acute health event is not a virtual event related to the virtual representation of the user within the virtual environment.

10. The method of claim 1 , wherein the detecting the at least one health anomaly related to the physical condition of the user comprises:

applying at least a portion of the behavioral data to the at least one first detection model;

obtaining an indication of the at least one health anomaly as an output of the at least one first detection model; and

determining that the at least one health anomaly is related to the physical condition of the user in response to the obtaining of the indication of the at least one health anomaly as the output of the at least one first detection model.

11. The method of claim 1 , wherein the detecting the at least one health anomaly related to the physical condition of the user comprises:

verifying that the at least one health anomaly is related to the physical condition of the user via biometric data of the user.

12. The method of claim 11 , wherein the biometric data of the user comprises an additional input to the at least one first detection model.

13. The method of claim 1 , wherein the alert is provided to at least one of:

an endpoint device of the user that is used to access the virtual environment;

a medical entity designated by the user or that is assigned to a location associated with the user; or

a caregiver designated by the user.

14. The method of claim 1 , wherein the avatar comprises an anthropomorphized animal or an object.

15. The method of claim 1 , wherein the processing system is for detecting health anomalies from different instances of behavioral data associated with at least one virtual representation of the user extracted from different visual data feeds of a plurality of different virtual environments.

16. A method comprising:

obtaining, by a processing system including at least one processor, a visual data feed of a region of a virtual environment associated with a virtual representation of a user within the virtual environment, wherein the virtual representation of the user comprises an avatar;

extracting, by the processing system, behavioral data of the virtual representation of the user from the visual data feed;

detecting, by the processing system, at least one health anomaly related to a physical condition of the user from the behavioral data via at least one first detection model for detecting the at least one health anomaly, wherein the at least one first detection model comprises at least one machine learning model; and

generating, by the processing system, an alert in response to the detecting of the at least one health anomaly that is related to the physical condition of the user.

17. An apparatus comprising:

a processing system including at least one processor; and

a computer-readable medium storing instructions which, when executed by the processing system, cause the processing system to perform operations, the operations comprising:

obtaining a visual data feed of a region of a virtual environment associated with a virtual representation of a user within the virtual environment, wherein the virtual representation of the user comprises an avatar;

extracting behavioral data of the virtual representation of the user from the visual data feed;

detecting at least one health anomaly related to a physical condition of the user from the behavioral data via at least one first detection model for detecting the at least one health anomaly, wherein the at least one first detection model comprises at least one machine learning model; and

generating an alert in response to the detecting of the at least one health anomaly that is related to the physical condition of the user.

18. The apparatus of claim 17 , wherein the processing system is a processing system of an endpoint device of the user that is used to access the virtual environment.

19. The apparatus of claim 17 , wherein the processing system comprises a processing system of a server hosting the virtual environment, wherein the operations are performed via at least one first process that is distinct from at least one second process that is for hosting the virtual environment.

20. The apparatus of claim 19 , wherein the at least one second process provides the visual data feed of the region of the virtual environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: SORYAL, JOSEPH; RAJGURU, SHAWN
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 059877/0455 →
Continuity (1)
Related Publication 20230360442A1 · Nov 9, 2023
References Cited (9)
US 20100042364A1 · Nakamura et al. · 2010 [cited by applicant]
US 20120229634A1 · Laett · 2012 [cited by examiner]
US 20180193589A1 · McLaughlin · 2018 [cited by examiner]
US 20190095775A1 · Lembersky · 2019 [cited by examiner]
US 20230086248A1 · Puyol · 2023 [cited by examiner]
CN 106901692A · 2017 [cited by examiner]
Chang, Z., et al., “Accurate detection of cerebellar smooth pursuit eye movement abnormalities via mobile phone video and machine learning”, Scientific Reports, Oct. 29, 2020, downloaded from https://www.nature.com/arti… [cited by applicant]
Oliveira, J., et al., “Computer-aided autism diagnosis based on visual attention models using eye tracking”, Scientific Reports, May 12, 2021, downloaded from https://www.nature.com/articles/s41598-021-89023-8, 11 pages. [cited by applicant]
Nam, SH, et al., “Biological-Signal-Based User-Interface System for Virtual-Reality Applications for Healthcare”, Hindawi, Journal of Sensors, vol. 2018, Article ID 9054758, 11 pages. [cited by applicant]