IP Library Granted Patent US 11,093,209
Granted Patent B2
US 11,093,209 · App. 16/790,023 · Granted Aug 17, 2021

Collaboration between head-mounted devices (HMDs) in co-located virtual, augmented, and mixed reality (xR) applications

Inventors: Anantha K. Boyapalle (Cedar Park, TX); Vivek Viswanathan Iyer (Austin, TX); Philip M. Seibert (Austin, TX); Karthikeyan Krishnakumar (Austin, TX)
Assignee: Dell Products, L.P.
G06F3/147G06T19/006G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,093,209
App. No.
16/790,023
Granted
Aug 17, 2021
Kind
B2
Abstract

In a collaborative virtual, augmented, and mixed reality (xR) session, different users wearing head-mounted devices HMDs may leave the xR session and new HMD-wearing users may join. The HMD worn by the joining user may be calibrated based on the physical characteristics, such as ambient noise and interference, of physical environment in which the xR session is conducted. An HMD may generate a profile of the noise and interference in the environment that adversely affects the ability for the communicating directly via supported transmission mechanisms. The profile may be provided directly to the joining HMD, allowing the joining HMD to quickly calibrate the transmission mechanisms included in the received profile to the particular sources of noise and interference in the physical environment.

Claims (41)

1. A first Head-Mounted Device (HMD) configured for participating in a co-located virtual, augmented, or mixed reality (xR) session in a physical environment, the first HMD comprising:

a processor;

a plurality of sensors, each sensor supporting one or more transmission mechanisms for participating in the xR session; and

a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the first HMD to:

select a preferred transmission mechanism for participating in the xR session based on a first profile of the physical environment;

determine, via the plurality of sensors, a signal integrity within the physical environment for each transmission mechanism;

generate a second profile of the physical environment based on the determined signal integrity for each transmission mechanism; and

modify the preferred transmission mechanism for participating in the xR session based on the second profile.

2. The first HMD of claim 1 , wherein the first profile of the physical environment is received from a second HMD participating in the xR session.

3. The first HMD of claim 1 , wherein the signal integrity for each transmission mechanism comprises a signal-to-noise ratio within the physical environment for each respective transmission mechanism.

4. The first HMD of claim 3 , wherein the program instructions, upon execution, further cause the first HMD to:

normalize the signal-to-noise ratios for the respective transmission mechanisms based on thresholds for use of the respective transmission mechanisms within the physical environment.

5. The first HMD of claim 4 , wherein the second profile for the physical environment specifies a ranking of the normalized signal-to-noise ratios for the transmission mechanisms available for participating in the xR session within the physical environment.

6. The first HMD of claim 1 , wherein the program instructions, upon execution, further cause the first HMD to:

replace the first profile with the second profile, wherein the second profile is used for participating in the xR session.

7. The first HMD of claim 6 , wherein the program instructions, upon execution, further cause the first HMD to:

recalibrate one or more of the plurality of sensors based on the signal integrities included in the second profile.

8. The first HMD of claim 2 , wherein the first profile received from a second HMD corresponds to a first location within the physical environment and wherein the second profile generated by the first HMD corresponds to a second location with the physical environment.

9. The method for participating in a co-located virtual, augmented, or mixed reality (xR) session in a physical environment using a first Head-Mounted Device (HMD), the method comprising:

selecting a preferred transmission mechanism for participating in the xR session based on a first profile of the physical environment;

determining, via a plurality of sensors of the first HMD, a signal integrity within the physical environment for each transmission;

generating a second profile of the physical environment based on the determined signal integrity for each transmission mechanism; and

modifying the preferred transmission mechanism for participating in the xR session based on the second profile.

10. The method of claim 9 , wherein the first profile of the physical environment is received from a second HMD participating in the xR session.

11. The method of claim 9 , wherein the signal integrity for each transmission mechanism comprises a signal-to-noise ratio within the physical environment for each respective transmission mechanism.

12. The method of claim 11 , further comprising:

normalizing the signal-to-noise ratios for the respective transmission mechanisms based on thresholds for use of the respective transmission mechanisms within the physical environment.

13. The method of claim 12 , wherein the second profile for the physical environment specifies a ranking of the normalized signal-to-noise ratios for the transmission mechanisms available for participating in the xR session within the physical environment.

14. The method of claim 9 , further comprising:

replacing the first profile with the second profile, wherein the second profile is used for participating in the xR session.

15. The method of claim 14 , further comprising:

recalibrating one or more of the plurality of sensors of the first HMD based on the signal integrities included in the second profile.

16. The method of claim 10 , wherein the first profile received from a second HMD corresponds to a first location within the physical environment and wherein the second profile generated by the first HMD corresponds to a second location with the physical environment.

17. A computer-readable storage device having instructions stored thereon for supporting participation in a co-located virtual, augmented, or mixed reality (xR) session in a physical environment by a first Head-Mounted Device (HMD), wherein execution of the instructions by one or more processors causes the one or more processors to:

select a preferred transmission mechanism for participating in the xR session based on a first profile of the physical environment;

determine, via a plurality of sensors of the first HMD, a signal integrity within the physical environment for each transmission mechanism;

generate a second profile of the physical environment based on the determined signal integrity for each transmission mechanism; and

modify the preferred transmission mechanism for participating in the xR session based on the second profile.

18. The computer-readable storage device of claim 17 , wherein the first profile of the physical environment is received from a second HMD participating in the xR session.

19. The computer-readable storage device of claim 18 , wherein the first profile received from a second HMD corresponds to a first location within the physical environment and wherein the second profile generated by the first HMD corresponds to a second location with the physical environment.

20. The computer-readable storage device of claim 17 , wherein the signal integrity for each transmission mechanism comprises a signal-to-noise ratio within the physical environment for each respective transmission mechanism.

Assignments (13)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0917) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0509 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052852/0022) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0582 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0081) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0441 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0081 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0917 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052852/0022 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2020
From: BOYAPALLE, ANANTHA K.; IYER, VIVEK VISWANATHAN; SEIBERT, PHILIP M.; KRISHNAKUMAR, KARTHIKEYAN
To: DELL PRODUCTS, L.P.
Reel/Frame 051813/0082 →