IP Library Granted Patent US 10,540,819
Granted Patent B2
US 10,540,819 · App. 15/853,233 · Granted Jan 21, 2020

Augmented reality workspace system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,540,819
App. No.
15/853,233
Granted
Jan 21, 2020
Kind
B2
Abstract

An augmented reality workspace system includes a physical display device, a user tracking subsystem, and an augmented reality display subsystem, all coupled to a computing system. The computing system uses the augmented reality display subsystem to display an augmented reality element that appears located in a three-dimensional volume immediately adjacent the physical display device as viewed through the augmented reality display subsystem, and uses the physical display device to display a two-dimensional element in a manner that is coordinated with the augmented reality element displayed using the augmented reality display subsystem. When the computing system receives user tracking information from the user tracking subsystem that indicates a user interaction with the augmented reality element, it provides for a coordinated modification of the display of each of the augmented reality element and the two-dimensional element by the augmented reality display subsystem and the physical display device, respectively.

Claims (59)

1. A physical display device integrated augmented reality workspace system, comprising:

a physical display device;

an augmented reality display subsystem; and

a computing system that includes a processor that is coupled to the physical display device and the augmented reality display subsystem, wherein the computing system is configured to:

receive, from the augmented reality display subsystem, a plurality of images;

recognize, in the plurality of images received from the augmented reality display subsystem, the physical display device;

define, in real-time adjacent the physical display device as viewed through the augmented reality display subsystem and using physical display device information associated with the physical display device, a three-dimensional volume that remains stationary relative to the physical display device as a view of the physical display device through the augmented reality display subsystem moves; and

provide, for display on the augmented reality display subsystem, at least one object within the three-dimensional volume, wherein the at least one object remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves.

2. The physical display device integrated augmented reality workspace system of claim 1 , further comprising:

a user tracking subsystem that is coupled to the computing system, wherein the computing system is configured to:

receive, from the user tracking subsystem, user tracking information;

define, using the user tracking information, the three-dimensional volume that remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves; and

provide, using the user tracking information, the at least one object within the three-dimensional volume such that the at least one object within the three-dimensional volume remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves.

3. The physical display device integrated augmented reality workspace system of claim 1 , wherein the computing system is configured to:

receive, from the physical display device, the physical display device information describing characteristics of the physical display device.

4. The physical display device integrated augmented reality workspace system of claim 1 , wherein the physical display device information includes at least one of a location of the physical display device, an orientation of the physical display device, and a size of the physical display device.

5. The physical display device integrated augmented reality workspace system of claim 1 , wherein the computing system is configured to define the three-dimensional volume adjacent the physical display device as viewed through the augmented reality display subsystem by:

identifying display screen boundaries of a display screen on the physical display device; and

defining the three-dimensional volume such that a plurality of three-dimensional volume boundaries of the three-dimensional volume coincide with the display screen boundaries.

6. The physical display device integrated augmented reality workspace system of claim 1 , wherein the computing system is configured to:

provide, for display on the augmented reality display subsystem, at least one object outside of the three-dimensional volume.

7. An Information Handling System (IHS), comprising:

a processing system that includes a processor; and

a memory system that includes system memory and that is coupled to the processing system and that includes instructions that, when executed by the processing system, cause the processing system to provide an augmented reality display engine that is configured to:

receive, from an augmented reality display subsystem, a plurality of images;

recognize, in the plurality of images received from the augmented reality display subsystem, a physical display device;

define, in real-time adjacent the physical display device as viewed through the augmented reality display subsystem and using physical display device information associated with the physical display device, a three-dimensional volume that remains stationary relative to the physical display device as a view of the physical display device through the augmented reality display subsystem moves; and

provide, for display on the augmented reality display subsystem, at least one object within the three-dimensional volume, wherein the at least one object remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves.

8. The IHS of claim 7 , wherein the augmented reality display engine is configured to:

receive, from a user tracking subsystem, user tracking information;

define, using the user tracking information, the three-dimensional volume that remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves; and

provide, using the user tracking information, the at least one object within the three-dimensional volume such that the at least one object within the three-dimensional volume remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves.

9. The IHS of claim 8 , wherein the user tracking information includes information about at least one of a location of a user's head, an orientation of the user's head, and movement of the user's head.

10. The IHS of claim 7 , wherein the augmented reality display engine is configured to:

receive, from the physical display device, the physical display device information describing characteristics of the physical display device.

11. The IHS of claim 10 , wherein the physical display device information includes at least one of a location of the physical display device, an orientation of the physical display device, and a size of the physical display device.

12. The IHS of claim 7 , wherein the augmented reality display engine is configured to define the three-dimensional volume adjacent the physical display device as viewed through the augmented reality display subsystem by:

identifying display screen boundaries of a display screen on the physical display device; and

defining the three-dimensional volume such that a plurality of three-dimensional volume boundaries of the three-dimensional volume coincide with the display screen boundaries.

13. The IHS of claim 7 , wherein the augmented reality display engine is configured to:

provide, for display on the augmented reality display subsystem, at least one object outside of the three-dimensional volume.

14. A method for providing an augmented reality workspace that is integrated with a physical display device, comprising:

receiving, by a computing system from an augmented reality display subsystem, a plurality of images;

recognizing, by the computing system in the plurality of images received from the augmented reality display subsystem, the physical display device;

defining, by the computing system in real-time adjacent the physical display device as viewed through the augmented reality display subsystem and using physical display device information associated with the physical display device, a three-dimensional volume that remains stationary relative to the physical display device as a view of the physical display device through the augmented reality display subsystem moves; and

providing, by the computing system for display on the augmented reality display subsystem, at least one object within the three-dimensional volume, wherein the at least one object remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves.

15. The method of claim 14 , further comprising:

receiving, by the computing system from a user tracking subsystem, user tracking information; and

defining, by the computing system using the user tracking information, the three-dimensional volume that remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves; and

providing, by the computing system and using the user tracking information, the at least one object within the three-dimensional volume such that the at least one object within the three-dimensional volume remains stationary relative to the physical display device as the view of the physical display device through the augmented reality display subsystem moves.

16. The method of claim 15 , wherein the user tracking information includes information about at least one of a location of a user's head, an orientation of the user's head, and movement of the user's head.

17. The method of claim 14 , further comprising:

receiving, by the computing system from the physical display device, the physical display device information describing characteristics of the physical display device.

18. The method of claim 14 , wherein the physical display device information includes at least one of a location of the physical display device, an orientation of the physical display device, and a size of the physical display device.

19. The method of claim 14 , wherein the defining the three-dimensional volume adjacent the physical display device as viewed through the augmented reality display subsystem includes:

identifying display screen boundaries of a display screen on the physical display device; and

defining the three-dimensional volume such that a plurality of three-dimensional volume boundaries of the three-dimensional volume coincide with the display screen boundaries.

20. The method of claim 14 , further comprising:

providing, by the computing system for display on the augmented reality display subsystem, at least one object outside of the three-dimensional volume.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045482/0131) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 061749/0924 →
RELEASE OF SECURITY INTEREST AT REEL 045482 FRAME 0395 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0314 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 045482/0131 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 045482/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2017
From: AURONGZEB, DEEDER M.; KNOPPERT, MICHIEL SEBASTIAAN EMANUËL PETRUS
To: DELL PRODUCTS L.P.
Reel/Frame 044473/0859 →