IP Library Granted Patent US 10,401,958
Granted Patent B2
US 10,401,958 · App. 15/868,947 · Granted Sep 3, 2019

Immersive environment correction display and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,401,958
App. No.
15/868,947
Granted
Sep 3, 2019
Kind
B2
Abstract

An information handling system (IHS) controls a display for an immersive experience based upon a gazing view of one or more users. A processor communicates with the display and a gaze detector to detect a relative location of the user(s) to the display. A graphic processing unit (GPU) allocates a field of view on the display based upon the relative location, centers display content in the field of view on the display, and accesses color point control data in response to the allocated field of view. The GPU manages color and brightness of display components of the display according to the accessed color point control data to compensate for variations of color and brightness in a viewing angle of the field of view.

Claims (57)

1. An information handling system (IHS) comprising:

a display comprising one or more gaze detection sensors;

a gaze detector that synthesizes information from the one or more gaze detection sensors to detect a relative location of one or more users;

a processor that communicates with the display and the gaze detector to detect a relative location of the one or more users to the display and which executes an immersive environment controller that enables an immersive experience for the one or more users viewing the display; and

a graphic processing unit (GPU) that communicates with the processor and the display to:

allocate a field of view on the display based upon the relative locations;

subjectively center display content in the field of view on the display on a portion of the display that presents a most perpendicular surface as an offset field of view to present an immersive environment;

access color point control data in response to the allocated field of view; and

manage color and brightness of display components of the display according to the accessed color point control data to compensate for variations of color and brightness in a viewing angle of the field of view to maintain the immersive environment.

2. The IHS of claim 1 , wherein:

the gaze detector comprises a three-dimensional camera to produce a three-dimensional camera image; and

the processor detecting the relative location of the user comprises the processor detecting the user within the three-dimensional camera image.

3. The IHS of claim 1 , wherein the processor detects the relative location of the user by:

detecting more than one candidate user within a viewing area of the display;

querying the more than one candidate user to indicate which one candidate is to be deemed as defining the field of view; and

receiving confirmation from one user among the more than one candidate user as having the field of view.

4. The IHS of claim 1 , wherein the processor detects the relative location of the user by:

detecting relative locations of more than one candidate user within a viewing area of the display; and

determining a compromise location between the relative locations by three dimensionally averaging the relative locations of the more than one candidate user.

5. The IHS of claim 1 , wherein the processor detects the relative location of the user by receiving a communication signal from a portable communication device that is being worn or carried by the user.

6. The IHS of claim 1 , further comprising one or more microphones that detect an angular direction to an audio source, wherein the processor is electronically connected to the one or more microphones and detects the relative location of the user by receiving the angular direction based on a verbal utterance from the user that is detected by the one or more microphones.

7. The IHS of claim 1 , further comprising a measuring device that:

maps color shift and brightness of pixel display components of the display as a function of viewing angle; and

generates more than one three-dimensional (3D) look up table (LUT) of compensation values for color management of the pixel display components, wherein each 3D LUT corresponds to a selected viewing angle and one of the 3D LUT comprises the accessed color point control data that is associated with the selected viewing angle of the allocated field of view.

8. The IHS of claim 1 , wherein:

the display comprises an array of more than one display panel each comprising a gaze detection sensor; and

the gaze detector synthesizes information from the gaze detection sensors to detect the relative location of the user.

9. The IHS of claim 1 , wherein the display comprises a curved display panel and the GPU manages color and brightness of display components, while taking a curvative and direct viewing of the curved display panel into consideration to make a correction.

10. The IHS of claim 1 , wherein:

the GPU executes a color management component based on color point control data contained in 3D lookup tables which provide a map of display color/brightness characteristics as a function of viewing angle; and

the GPU centering the field of view comprises the color management component executing on the GPU to enable the GPU to calculate a number of pixels that comprise a subjective horizontal dimension width of a pixel, the subjective horizontal width being a function of an angle to the user and a distance from the user.

11. The IHS of claim 1 , wherein:

the immersive environment controller directs the color management component of the GPU to compensate for a color shift and change in brightness and to subjectively center graphical information on a portion of the display that presents the most perpendicular surface as an offset field of view; and

the immersive environment controller provides exceptions to centering for immersiveness, the exceptions comprising static 3D images, movies, moving within a gaming world environment, and manipulating objects within a gaming world environment.

12. A computer-implemented method of controlling a display for an immersive experience based upon a gazing view of a user, the method comprising:

detecting, via a processor communicating with a gaze detector, a relative location of one or more users to a display based on input from one or more gaze detector sensors, the processor executing an immersive environment controller that enables an immersive experience for the one or more users viewing the display;

allocating, via a graphic processing unit, a field of view on the display based upon the relative location;

subjectively centering display content in the field of view on the display on a portion of the display that presents a most perpendicular surface as an offset field of view to present an immersive environment;

accessing color point control data in response to the allocated field of view; and

managing, via the graphic processing unit, color and brightness of display components of the display according to the accessed color point control data to compensate for variations of color and brightness in a viewing angle of the field of view to maintain the immersive environment.

13. The method of claim 12 , wherein the processor detecting the relative location of the user comprises detecting the user within a three-dimensional camera image.

14. The method of claim 12 , wherein detecting the relative location of the user comprises:

detecting more than one candidate user within a viewing area of the display;

querying the more than one candidate user to indicate which one candidate is to be deemed as defining the field of view; and

receiving confirmation from a user among the more than one candidate user as to having the field of view.

15. The method of claim 12 , wherein detecting the relative location of the user comprises:

detecting relative locations of more than one candidate user within a viewing area of the display; and

determining a compromise location between the relative locations by three dimensionally averaging the relative locations of the more than one candidate user.

16. The method of claim 12 , wherein detecting the relative location of the user comprises receiving a communication signal from a portable communication device that is being worn or carried by the user.

17. The method of claim 12 , wherein detecting the relative location of the user comprises:

detecting, via one or more microphones, an angular direction to an audio source; and

detecting, via the processor that is electronically connected to the one or more microphones, the relative location of the user by receiving the angular direction based on an utterance from the user that is detected by the one or more microphones.

18. The method of claim 12 , further comprising:

mapping, via a measuring equipment, color shift and brightness of pixel display components of the display as a function of viewing angle; and

generating more than one three-dimensional (3D) look up table (LUT) of compensation values for color management of the pixel display components, each 3D LUT corresponding to a selected viewing angle and one of the 3D LUT comprises the accessed color point control data that is associated with the selected viewing angle of the allocated field of view.

19. The method of claim 12 , wherein the display comprises an array of more than one display panel.

20. The method of claim 12 , wherein the display comprises a curved display panel.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045482/0131) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 061749/0924 →
RELEASE OF SECURITY INTEREST AT REEL 045482 FRAME 0395 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0314 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 045482/0131 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 045482/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2018
From: PEANA, STEPHAN; AURONGZEB, DEEDER
To: DELL PRODUCTS, L.P.
Reel/Frame 044603/0790 →