IP Library Granted Patent US 11,675,424
Granted Patent B2
US 11,675,424 · App. 17/424,075 · Granted Jun 13, 2023

Mixed reality presentation

Inventors: Ian N. Robinson (Palo Alto, CA); Rafael A. Ballagas (Palo Alto, CA)
Assignee: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
G06F3/012G06F3/041G06T7/20G06T19/006G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,675,424
App. No.
17/424,075
Granted
Jun 13, 2023
Kind
B2
Abstract

A mixed reality presentation system may include a headwear to present virtual images to a person wearing the headwear and a main unit. The main unit may include sensors to sense a surrounding physical environment and position and orientation of the headwear, a virtual image generator and a transmitter. The virtual image generator is to generate the virtual images based on the sensed surrounding physical environment and the sensed headwear position and orientation. The transmitter is to transmit the generated virtual images to the headwear for presentation.

Claims (35)

1. A mixed reality presentation system comprising:

a headwear to present virtual images to a person wearing the headwear;

a main unit comprising:

sensors to sense a surrounding physical environment and position and orientation of the headwear;

a virtual image generator to generate the virtual images based on the sensed surrounding physical environment and the sensed position and orientation of the headwear; and

a transmitter to transmit the generated virtual images to the headwear for presentation;

wherein the main unit is a stationary desktop accessory in a single box housing, and

wherein the headwear includes an inertial motion sensor and a display controller to modify the virtual images received from the main unit based on signals from the inertial motion sensor.

2. The system of claim 1 , wherein the display controller is configured to modify the virtual images by performing a two-dimension shift of the virtual images.

3. The system of claim 1 , wherein the sensors of the main unit has a field of view and wherein the headwear further comprises a sensor to sense the physical environment outside the field of view and transmit signals to the main unit for use by the main unit to track physical objects outside the field of view.

4. The system of claim 1 , wherein the sensors of the main unit are supported by a display having a vertical face.

5. The system of claim 1 , wherein the virtual image generator is to virtually attach the generated virtual images to objects of the sensed surrounding physical environment such that the generated virtual images attached to the object are positionally relocated based upon sensed movement of the object.

6. The system of claim 1 , wherein the sensors of the main unit comprise:

optical tracking sensors to locate and track movement of the headwear; and

image and depth cameras to sense the surrounding physical environment.

7. The system of claim 6 , wherein the sensors of the main unit further comprise a user interaction sensor to detect user touches in the surrounding physical environment.

8. The system of claim 1 , wherein the main unit is part of a stationary desktop mounted display and sensor system.

9. A mixed reality presentation method comprising:

building a spatial map of a surrounding physical environment with a stationary main unit;

tracking position and orientation of a headwear with the stationary main unit;

generating virtual images based upon the spatial map and the tracked position and orientation of the headwear with the stationary main unit;

transmitting the virtual images from the stationary main unit to the headwear for presentation by the headwear, wherein the stationary main unit is a stationary desktop accessory in a single box housing;

sensing, with an inertial motion sensor of the headwear, movement of the headwear; and

modifying, with a display controller of the headwear, the virtual images received from the stationary main unit based upon signals from the inertial motion sensor.

10. The method of claim 9 , wherein the stationary main unit is a desktop accessory and wherein the surrounding physical environment comprises a desktop.

11. The method of claim 9 , wherein the virtual images generated by the stationary main unit and transmitted to the headwear omit any image data from the headwear.

12. A mixed reality presentation system comprising a non-transitory computer-readable medium containing instructions to direct a processor to:

build a spatial map of a surrounding physical environment with a stationary main unit;

track position and orientation of a headwear with the stationary main unit;

generate virtual images based upon the spatial map and the tracked position and orientation of the headwear with the stationary main unit;

transmit the virtual images from the stationary main unit to the headwear for presentation by the headwear;

sense movement of the headwear with an inertial motion sensor included in the headwear; and

modifying, with a display controller of the headwear, the virtual images received from the stationary main unit based upon signals from the inertial motion sensor,

wherein the stationary main unit is a stationary desktop accessory in a single box housing.

13. The mixed reality presentation system of claim 12 , wherein the stationary desktop accessory includes the non-transitory computer-readable medium.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2021
From: ROBINSON, IAN N.; BALLAGAS, RAFAEL A.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 057905/0203 →
Continuity (1)
Related Publication 20220100267A1 · Mar 31, 2022