IP Library › Granted Patent US 11,244,512
Granted Patent B2
US 11,244,512 · App. 16/749,501 · Granted Feb 8, 2022

Hybrid rendering for a wearable display attached to a tethered computer

Inventors: Deepak Shashidhar Vembar (Portland, OR); Paul Diefenbaugh (Portland, OR); Vallabhajosyula S. Somayazulu (Portland, OR); Atsuo Kuwahara (Portland, OR); Kofi Whitney (Hillsboro, OR); Richmond Hicks (Beaverton, OR)
Assignee: INTEL CORPORATION
G06T19/006G02B27/017G06F3/011G06F3/14G06T7/20G06T7/215G06T7/70G02B2027/0132G02B2027/0134G02B2027/0178G09G2350/00G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,244,512
App. No.
16/749,501
Granted
Feb 8, 2022
Kind
B2
Abstract

Hybrid rendering is described for a wearable display that is attached to a tethered computer. In one example a process include determining a position and orientation of a wearable computing device, determining a rate of motion of the wearable computing device, comparing the rate of motion to a threshold, if the rate of motion is above the threshold, then rendering a view of a scene at the wearable computing device using the position and orientation information, and displaying the rendered view of the scene.

Claims (65)

1. A method comprising:

determining a rate of motion of a wearable computing device based on one or more of position information or orientation information for the wearable computing device;

in response to the rate of motion satisfying a rate of motion threshold, causing a first frame to be displayed at the wearable computing device, the first frame having a first resolution; and

in response to the rate of motion not satisfying the rate of motion threshold,

causing a first portion of a second frame to be displayed at the wearable computing device, the second frame having a second resolution different than the first resolution;

selecting a second portion of the second frame for presentation based on one or more of the position information or the orientation information, the second portion different than the first portion; and

causing the second portion of the second frame to be displayed at the wearable computing device instead of the first portion.

2. The method of claim 1 , wherein the position information includes a first position of the wearable computing device and a second position of the wearable computing device and the orientation information includes a first orientation of the wearable computing device and a second orientation of the wearable computing device, and wherein the determining of the rate of motion is based on one or more of (a) the first position and the second position or (b) the first orientation and second orientation.

3. The method of claim 1 , wherein the first resolution is greater than the first second resolution.

4. The method of claim 1 , wherein the first frame is to be rendered at least in part at a computer system separate from the wearable computing device.

5. The method of claim 1 , further including rendering the first frame at the wearable computing device using a scene model.

6. The method of claim 1 , wherein the determining the rate of motion is based on one or more of a scene model or a scene texture.

7. The method of claim 1 , wherein the wearable computing device is a head-mounted display system and further including generating the position information and the orientation information using an inertial measurement unit of the head-mounted display system.

8. The method of claim 1 , further including:

determining a rate of change of a gaze of a user of the wearable computing device;

comparing the rate of change of the gaze to a rate of gaze change threshold; and

if the rate of change of the gaze satisfies the rate of gaze change threshold, causing the first frame to be displayed at the wearable computing device.

9. The method of claim 1 , further including:

causing a third frame to be displayed at the wearable computing device, the third frame to be rendered based on position information and orientation information associated with a predicted gaze direction of a user of the wearable computing device.

10. An article of manufacture comprising instructions, which, when executed, cause at least one processor to at least:

determine a rate of motion of a wearable computing device based on one or more of position information or orientation information for the wearable computing device;

in response to the rate of motion satisfying a rate of motion threshold, cause a display of the wearable computing device to present a first view of a scene, the first view having a first resolution; and

in response to the rate of motion not satisfying the rate of motion threshold,

cause the display of the wearable computing device to present a first portion of a second view of the scene;

identify a second portion of the second view of the scene for presentation based on the position information or the orientation information, the first portion different than the second portion; and

cause the display of the wearable computing device to switch from presenting the first portion of the second view to presenting the second portion of the second view of the scene, the second view having a second resolution lower than the first resolution.

11. The article of manufacture of claim 10 , wherein the instructions, when executed, cause the at least one processor to access the first view from a remote rendering source.

12. The article of manufacture of claim 11 , wherein the position information includes a first position of the wearable computing device and a second position of the wearable computing device and the orientation information includes a first orientation of the wearable computing device and a second orientation of the wearable computing device, and wherein the instructions, when executed, cause the at least one processor to:

determine the rate of motion based on one or more of (a) the first position and the second position or (b) the first orientation and second orientation; and

compare the rate of motion to the rate of motion threshold.

13. The article of manufacture of claim 10 , wherein the instructions, when executed, cause the at least one processor to

cause the display to present a third view of the scene, the third view of the scene to be based on position information and orientation information associated with a predicted gaze direction of a user of the wearable computing device.

14. The article of manufacture of claim 10 , wherein the instructions, when executed, cause the at least one processor to determine the rate of motion based on one or more of a scene model or a scene texture.

15. A wearable computing device comprising:

an inertial measurement unit to determine position information and orientation information of the wearable computing device;

a communications interface;

a screen; and

a processor to:

determine a rate of motion of the wearable computing device based on one or more of the position information or the orientation information;

in response to the rate of motion satisfying a rate of motion threshold, cause the screen to display a first view of a scene at a first resolution; and

in response to the rate of motion not satisfying the rate of motion threshold,

cause the display of the wearable computing device to present a first portion of a second view of the scene at a second resolution, the second resolution different than the first resolution;

select a second portion of the second view of the scene to present based on one or more of the position information or the orientation information, the second portion different than the first portion; and

cause the screen to display the second portion of the second view of the scene at the second resolution instead of the first portion of the second view.

16. The wearable computing device of claim 15 , wherein the second resolution is lower than the first resolution.

17. The wearable computing device of claim 15 , wherein the wearable computing device is a head-mounted display.

18. The wearable computing device of claim 15 , wherein the processor is to cause the screen to display a third view of the scene at the second resolution, the third view to be based on position information and orientation information associated with a predicted gaze direction of a user of the wearable computing device.

19. The wearable computing device of claim 15 , wherein the processor is to determine the rate of motion based on one or more of a scene model or a scene texture.

20. An apparatus comprising:

at least one memory;

instructions in the apparatus; and

processor circuitry to execute the instructions to:

determine a rate of motion of a wearable computing device based on one or more of position information or orientation information for the wearable computing device;

in response to the rate of motion satisfying a rate of motion threshold, cause a display of the wearable computing device to present a first view of a scene, the first view having a first resolution; and

in response to the rate of motion not satisfying the rate of motion threshold,

cause the display of the wearable computing device to present a first portion of a second view of the scene, the second view having a second resolution different than the first resolution;

identify a second portion of the second view of the scene for presentation based on the position information or the orientation information, the first portion different than the second portion; and

cause the display of the wearable computing device to switch from presenting the first portion of the second view to presenting the second portion of the second view of the scene.

21. The apparatus of claim 20 , wherein the second resolution is lower than the first resolution.

22. The apparatus of claim 20 , wherein the processor circuitry is to access the first view from a remote rendering source.

23. The apparatus of claim 20 , wherein the position information includes a first position of the wearable computing device and a second position of the wearable computing device and the orientation information includes a first orientation of the wearable computing device and a second orientation of the wearable computing device, and the processor circuitry is to:

determine the rate of motion based on one or more of (a) the first position and the second position or (b) the first orientation and second orientation; and

compare the rate of motion to the rate of motion threshold.

24. The apparatus of claim 20 , wherein the processor circuitry is to cause the display to present a third view of the scene, the third view of the scene to be based on position information and orientation information associated with a predicted gaze direction of a user of the wearable computing device.

25. The apparatus of claim 20 , wherein the processor circuitry is to determine the rate of motion based on one or more of a scene model or a scene texture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2021
From: VEMBAR, DEEPAK SHASHIDHAR; DIEFENBAUGH, PAUL; SOMAYAZULU, VALLABHAJOSYULA S.; KUWAHARA, ATSUO; WHITNEY, KOFI; HICKS, RICHMOND
To: INTEL CORPORATION
Reel/Frame 055562/0346 →
Continuity (3)
Continuation 15937649 · Mar 27, 2018
Continuation 15262369 · Sep 12, 2016
Related Publication 20200160609A1 · May 21, 2020
Cited By (1)
US 12,525,170