IP Library Granted Patent US 10,853,647
Granted Patent B2
US 10,853,647 · App. 16/033,307 · Granted Dec 1, 2020

Environmental safety notifications in virtual, augmented, and mixed reality (xR) applications

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,853,647
App. No.
16/033,307
Granted
Dec 1, 2020
Kind
B2
Abstract

Systems and methods for providing environmental safety notifications in virtual, augmented, and mixed reality (xR) applications are described. In some embodiments, an Information Handling System (IHS) may include a host processor and a memory coupled to the host processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to: receive an image from a Simultaneous Localization and Mapping (SLAM) camera configured to detect a location of a Head-Mounted Device (HMD) worn by a user during an xR application; identify a safety event based upon the image; and produce an xR object for display by the HMD, wherein the xR object indicates the safety event.

Claims (33)

1. An Information Handling System (IHS), comprising:

a host processor; and

a memory coupled to the host processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to:

receive an image from a Simultaneous Localization and Mapping (SLAM) camera configured to detect a location of a Head-Mounted Device (HMD) worn by a user during a virtual, augmented, or mixed reality (xR) application;

identify a safety event in a danger region based upon the image;

produce an xR object for display by the HMD, wherein the xR object: (i) overlays the danger region, and (ii) indicates the safety event; and

reduce a visual emphasis of the xR object in response to detection of a hand moving with respect to the danger region.

2. The IHS of claim 1 , wherein the SLAM camera comprises a visual spectrum camera, an infrared (IR) camera, or a near-IR (NIR) camera.

3. The IHS of claim 1 , wherein the SLAM camera comprises an inside-out camera or an outside-in camera.

4. The IHS of claim 1 , wherein the safety event comprises a thermal hazard, an electrical hazard, or a chemical hazard.

5. The IHS of claim 1 , wherein to identify the safety event, the program instructions, upon execution, further cause the IHS to extract a feature from a selected area of the image, and to identify the safety event at the danger region in response to the feature indicating an anomaly.

6. The IHS of claim 1 , wherein to produce the xR object, the program instructions, upon execution, further cause the IHS to determine that a hazard notification associated with the safety event is enabled.

7. The IHS of claim 1 , wherein the safety event comprises a disk out of space, and wherein the xR object indicates that backups are subject to failure.

8. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to decrease the visual emphasis of the xR object in response to the location of the HMD moving farther away from the danger region.

9. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to decrease the visual emphasis of the xR object in response to the location of the HMD moving closer to the danger region.

10. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to increase the visual emphasis of the xR object in response to the location of the HMD moving farther away from the danger region.

11. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to increase the visual emphasis of the xR object in response to the location of the HMD moving closer to the danger region.

12. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to remove the xR object from the display in response to a request by the user.

13. The IHS of claim 5 , wherein the program instructions, upon execution, further cause the IHS to choose the danger region based upon head orientation, eye tracking, or gaze tracking information of the user.

14. The IHS of claim 13 , wherein the program instructions, upon execution, further cause the IHS to decrease the visual emphasis of the xR object in response to the head orientation, eye tracking, or gaze tracking information indicating that the user is looking away from the danger region.

15. The IHS of claim 13 , wherein the program instructions, upon execution, further cause the IHS to decrease the visual emphasis of the xR object in response to the head orientation, eye tracking, or gaze tracking information indicating that the user is looking toward the danger region.

16. The IHS of claim 13 , wherein the program instructions, upon execution, further cause the IHS to increase the visual emphasis of the xR object in response to the head orientation, eye tracking, or gaze tracking information indicating that the user is looking away from the danger region.

17. The IHS of claim 13 , wherein the program instructions, upon execution, further cause the IHS to increase the visual emphasis of the xR object in response to the head orientation, eye tracking, or gaze tracking information indicating that the user is looking toward the danger region.

18. A method, comprising:

receiving an image from a Simultaneous Localization and Mapping (SLAM) camera configured to detect a location of a Head-Mounted Device (HMD) worn by a user during a virtual, augmented, or mixed reality (xR) application;

identifying a safety event in a danger region based upon the image;

producing an xR object on a display of the HMD, wherein the xR object: (i) overlays the danger region, and (ii) indicates the safety event; and

reducing a visual emphasis of the xR object in response to detection of a hand moving toward the danger region.

19. A hardware memory device having program instructions stored thereon that, upon execution by a hardware processor, cause the hardware processor to:

receive an image from a Simultaneous Localization and Mapping (SLAM) camera configured to detect a location of a Head-Mounted Device (HMD) worn by a user during a virtual, augmented, or mixed reality (xR) application;

identify a safety event in a danger region based upon the image;

render an xR object on a display of the HMD, wherein the xR object: (i) overlays the danger region, and (ii) indicates the safety event; and

reducing a visual emphasis of the xR object in response to detection of a hand moving away from the danger region.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (047648/0422) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060160/0862 →
RELEASE OF SECURITY INTEREST AT REEL 047648 FRAME 0346 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0510 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 047648/0346 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 047648/0422 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2018
From: SMITH, HANA SCHUSTER; IYER, VIVEK VISWANATHAN
To: DELL PRODUCTS, L.P.
Reel/Frame 046329/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2018
From: SMITH, HANA SCHUSTER; IYER, VIVEK VISWANATHAN
To: DELL PRODUCTS, L.P.
Reel/Frame 046328/0430 →