IP Library Granted Patent US 10,735,665
Granted Patent B2
US 10,735,665 · App. 16/175,516 · Granted Aug 4, 2020

Method and system for head mounted display infrared emitter brightness optimization based on image saturation

Inventors: Vivek Viswanathan Iyer (Austin, TX); Yagiz C. Yildiz (Austin, TX)
Assignee: Dell Products, LP
H04N5/2354G06T7/80G06T2207/10048G06T2207/20072
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,735,665
App. No.
16/175,516
Granted
Aug 4, 2020
Kind
B2
Abstract

An information handling system operating a wearable headset IR emitter saturation correction system may comprise an infrared emitter emitting IR light, a camera capturing a calibration image and a first session image of the IR light reflected from a landmark, and a SLAM engine generating a first session SLAM frame. A processor may execute code instructions to compare the measured calibration pixel brightness value for each pixel associated with the landmark in a calibration image with a measured first session pixel brightness value for each pixel associated with the landmark in the first session image to determine whether the first session SLAM frame is over or under saturated, and determine an adjusted brightness if the first session SLAM frame is over or under saturated. The infrared emitter may emit light according to the adjusted brightness.

Claims (54)

1. An information handling system operating a wearable headset infrared (IR) emitter saturation correction system comprising:

an infrared emitter mounted on a wearable headset emitting IR light at a first brightness;

a camera capturing a calibration image of the IR light reflected from a first landmark;

a memory storing calibration histogram analysis of the calibration image associating each of a plurality of landmarks identified in the calibration image with brightness values for a subset of pixels within the calibration image, and with one or more of a plurality of IR emitters including the infrared emitter;

the camera capturing a session image of the IR light reflected from the first landmark;

a SLAM engine generating a first session SLAM frame based on the first session image;

a processor executing binary divide and conquer code instructions of the IR emitter saturation correction system to:

associate each of the plurality of landmarks identified in the session image with brightness values for a subset of pixels within the session image, and with one or more of the plurality of IR emitters including the infrared emitter;

determine whether the first session SLAM frame is over or under saturated based on a comparison, for each of the plurality of landmarks, of brightness values for the associated subset of pixels within the calibration image to brightness values for the associated subset of pixels within the session image;

determine an adjusted brightness for the infrared emitter based on the first brightness and a brightness range within which the infrared emitter is capable of emitting light if the first session SLAM frame is over or under saturated; and

the infrared emitter emitting light according to the adjusted brightness.

2. The information handling system of claim 1 , further comprising:

the infrared emitter emitting light at the first brightness if the SLAM engine generates a consecutive number of over or under saturated SLAM frames meeting a non-convergence threshold value.

3. The information handling system of claim 1 , further comprising:

the processor executing the binary divide and conquer code instructions at a regular interval in which the SLAM engine generates a consecutive number of SLAM frames meeting a brightness test threshold value.

4. The information handling system of claim 1 , wherein the first session SLAM frame is over saturated and the adjusted brightness is an adjustable convergence coefficient multiplied by a difference between the first brightness and a minimum of the range of brightness values at which the infrared emitter is capable of emitting light, subtracted from the first brightness.

5. The information handling system of claim 3 , wherein the convergence coefficient is determined based on a number of headsets emitting IR light reflecting off one or more of the plurality of landmarks.

6. The information handling system of claim 3 , wherein the convergence coefficient increases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks increases.

7. The information handling system of claim 3 , wherein the convergence coefficient decreases as a number of instances in which the infrared emitter is adjusted to emit light at the first brightness during a user session increases.

8. A method of adaptively adjusting brightness of an infrared (IR) emitter comprising:

emitting IR light at a first brightness via an infrared emitter mounted on a wearable headset;

capturing a calibration image of the IR light reflected from a first landmark via a camera;

storing, via a memory, calibration histogram analysis of the calibration image associating each of a plurality of landmarks identified in the calibration image with brightness values for a subset of pixels within the calibration image, and with one or more of a plurality of IR emitters including the infrared emitter;

capturing a session image of the IR light reflected from the first landmark via the camera;

generating a first session SLAM frame based on the first session image, via a SLAM engine;

associating each of the plurality of landmarks identified in the session image with brightness values for a subset of pixels within the session image, and with one or more of the plurality of IR emitters including the infrared emitter, via a processor;

determining, via the processor, whether the first session SLAM frame is over or under saturated based on a comparison, for each of the plurality of landmarks, of brightness values for the associated subset of pixels within the calibration image to brightness values for the associated subset of pixels within the session image;

determining an adjusted brightness for the infrared emitter, via the processor, based on the first brightness and a brightness range within which the infrared emitter is capable of emitting light if the first session SLAM frame is over or under saturated; and

emitting light via the infrared emitter according to the adjusted brightness.

9. The method of claim 8 , further comprising:

emitting light via the infrared emitter at the first brightness if the SLAM engine generates a consecutive number of over or under saturated SLAM frames meeting a non-convergence threshold value.

10. The method of claim 8 , wherein the adjusted brightness is an adjustable convergence coefficient multiplied by a difference between a maximum of the range of brightness values at which the infrared emitter is capable of emitting light and the first brightness, added to the first brightness.

11. The method of claim 10 , wherein the convergence coefficient is determined based on a number of headsets emitting IR light reflecting off one or more of the plurality of landmarks.

12. The method of claim 10 , wherein the convergence coefficient decreases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks decreases.

13. The method of claim 10 , wherein the convergence coefficient decreases as a number of instances in which the infrared emitter is adjusted to emit light at the first brightness during a user session increases.

14. The method of claim 10 , wherein the first session SLAM frame is under saturated.

15. An information handling system operating a wearable headset infrared (IR) emitter saturation correction system comprising:

an infrared emitter mounted on a wearable headset emitting IR light at a first brightness;

a camera capturing a calibration image of the IR light reflected from a first landmark;

a memory storing calibration histogram analysis of the calibration image associating each of a plurality of landmarks identified in the calibration image with brightness values for a subset of pixels within the calibration image, and with one or more of a plurality of IR emitters including the infrared emitter;

the camera capturing a session image of the IR light reflected from the first landmark;

a SLAM engine generating a first session SLAM frame based on the first session image;

a processor executing binary divide and conquer code instructions of the IR emitter saturation correction system to:

associate each of the plurality of landmarks identified in the session image with brightness values for a subset of pixels within the session image, and with one or more of the plurality of IR emitters including the infrared emitter;

determine whether the first session SLAM frame is over or under saturated based on a comparison, for each of the plurality of landmarks, of brightness values for the associated subset of pixels within the calibration image to brightness values for the associated subset of pixels within the session image;

determine an adjusted brightness, if the first session SLAM frame is over or under saturated, equivalent to an adjustable convergence coefficient multiplied by a difference between the first brightness and a minimum or maximum of the range of brightness values at which the infrared emitter is capable of emitting light, subtracted from the first brightness; and

the infrared emitter emitting light according to the adjusted brightness.

16. The information handling system of claim 15 , further comprising:

the infrared emitter emitting light at the first brightness if the SLAM engine generates a consecutive number of over or under saturated SLAM frames meeting a non-convergence threshold value.

17. The information handling system of claim 15 , further comprising:

the processor executing the binary divide and conquer code instructions at a regular interval in which the SLAM engine generates a consecutive number of SLAM frames meeting a brightness test threshold value.

18. The information handling system of claim 15 , wherein the convergence coefficient increases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks increases.

19. The information handling system of claim 15 , wherein the convergence coefficient decreases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks decreases.

20. The information handling system of claim 15 , wherein the convergence coefficient decreases as a number of instances in which the infrared emitter is adjusted to emit light at the first brightness during a user session increases.

Assignments (6)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2018
From: IYER, VIVEK VISWANATHAN; YILDIZ, YAGIZ C.
To: DELL PRODUCTS, LP
Reel/Frame 047360/0996 →
Continuity (1)
Related Publication 20200137289A1 · Apr 30, 2020
Cited By (1)
US 12,301,748