IP Library › Granted Patent US 10,573,079
Granted Patent B2
US 10,573,079 · App. 15/937,649 · Granted Feb 25, 2020

Hybrid rendering for a wearable display attached to a tethered computer

Inventors: Deepak Shashidhar Vembar (Portland, OR); Paul Diefenbaugh (Portland, OR); Vallabhajosyula S. Somayazulu (Portland, OR); Atsuo Kuwahara (Portland, OR); Kofi Whitney (Hillsboro, OR); Richmond Hicks (Beaverton, OR)
Assignee: INTEL CORPORATION
G06T19/006G06T7/20G06T7/215G06T7/70G02B2027/0132G02B2027/0134G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,573,079
App. No.
15/937,649
Granted
Feb 25, 2020
Kind
B2
Abstract

Hybrid rendering is described for a wearable display that is attached to a tethered computer. In one example, a process includes determining a position and orientation of a wearable computing device, determining a rate of motion of the wearable computing device, comparing the rate of motion to a threshold, if the rate of motion is above the threshold, then rendering a view of a scene at the wearable computing device using the position and orientation information, and displaying the rendered view of the scene.

Claims (47)

1. A method for rendering a view of a scene, the method comprising:

in response to a rate of motion of a wearable computing device meeting a predetermined criterion, rendering a view of a scene at the wearable computing device using one or both of position and orientation information;

in response to the rate of motion of the wearable computing device not meeting the predetermined criterion, sending one or both the position and orientation information to a computer system, and receiving a rendered view of a scene from the computer system based on the sent position and/or orientation information; and

causing display of the rendered view of the scene.

2. The method of claim 1 , wherein the predetermined criterion comprises the rate of motion being greater than a threshold.

3. The method of claim 2 , wherein the position and orientation information includes (1) first position of the wearable computing device and/or first orientation of the wearable computing device and (2) second position of the wearable computing device and/or second orientation of the wearable computing device, the method further comprising:

determining the first position and/or first orientation;

determining the second position and/or second orientation;

determining the rate of motion based on the first and second positions and/or the first and second orientations; and

comparing the rate of motion to the threshold.

4. The method of claim 1 , wherein rendering the view of a scene at the wearable computing device comprises rendering a frame with less detail than a frame received from the computer system.

5. The method of claim 4 , wherein rendering the frame with less detail comprises rendering the frame with less resolution than a frame received from the computer system.

6. The method of claim 1 , wherein rendering the view of a scene at the wearable computing device comprises rendering the view using a scene model received from the computer system.

7. The method of claim 1 , further comprising receiving scene models and textures from the computer system before determining the rate of motion of the wearable computing device.

8. The method of claim 1 , wherein the wearable computing device is a head-mounted display system and wherein the position and orientation information is obtained from determining the position and orientation at the head-mounted display system using an inertial measurement unit of the head-mounted display system.

9. The method of claim 8 , wherein the rate of motion of the wearable computing device is determined based on a rate of change of a gaze of a user wearing the head-mounted display system, and the predetermined criterion is a rate of gaze change threshold, the method further comprising:

determining the rate of change of the gaze of the user of the head-mounted display system; and

comparing the rate of change of the gaze to the rate of gaze change threshold;

wherein if the rate of change of the gaze is above the rate of gaze change threshold, then the rendering of the view of the scene at the wearable computing device is carried out using the position and orientation information.

10. The method of claim 1 , further comprising increasing a frame rate of the rendered view of the scene if the rate of motion meets the predetermined criterion.

11. An article of manufacture having one or more non-transitory computer readable storage media storing instructions which when executed by a system causes the system to perform a process for rendering a view of a scene, the process comprising:

in response to a rate of motion of a wearable computing device meeting a predetermined criterion, rendering a view of a scene at the wearable computing device using one or both of position and orientation information;

in response to the rate of motion of the wearable computing device not meeting the predetermined criterion, sending one or both the position and orientation information to a computer system, and receiving a rendered view of a scene from the computer system based on the sent position and/or orientation information; and

causing display of the rendered view of the scene.

12. The article of manufacture of claim 11 , wherein the predetermined criterion comprises the rate of motion being greater than a threshold.

13. The article of manufacture of claim 12 , wherein the position and orientation information includes (1) first position of the wearable computing device and/or first orientation of the wearable computing device and (2) second position of the wearable computing device and/or second orientation of the wearable computing device, and wherein the operations further comprise

determining the first position and/or first orientation;

determining the second position and/or second orientation;

determining the rate of motion based on the first and second positions and/or the first and second orientations; and

comparing the rate of motion to the threshold.

14. A wearable computing device comprising:

an inertial measurement unit configured to determine position and orientation information of the wearable computing device;

a communications interface;

a processor coupled to the inertial measurement unit and configured to

in response to a rate of motion of the wearable computing device meeting a predetermined criterion, render a view of a scene at the wearable computing device using one or both the position and orientation information,

in response to the rate of motion of the wearable computing device not meeting the predetermined criterion, send one or both the position and orientation information via the communications interface to a computer system, and receiving a rendered view of the scene from the computer system based on the sent position and/or orientation information, and

cause a display to show the rendered view of the scene.

15. The apparatus of claim 14 , wherein the predetermined criterion comprises the rate of motion being greater than a threshold.

16. The apparatus of claim 14 , wherein the processor is operable to render the view of a scene at the wearable computing device by rendering a frame with less detail than a frame received from the computer system.

17. The apparatus of claim 14 , wherein the processor is operable to render the view of a scene at the wearable computing device using a scene model received from the computer system and the position and orientation information.

18. A head-mounted display comprising:

an inertial measurement unit configured to determine one or both position and orientation information of the head-mounted display;

an eye tracker configured to determine a rate of change of a gaze of a user of the head-mounted display;

a processor coupled to the inertial measurement unit and the eye tracker and configured to determine a rate of motion of the head-mounted display, and to render a view of a scene using one or both of the position and orientation information based on one or both of (1) the rate of motion of the head-mounted display and (2) the rate of change of the gaze of the user, meeting predetermined criterion; and

a display configured to show the rendered view of the scene.

19. The head-mounted display of claim 18 , wherein the processor is configured to increase a frame rate of the rendered view of the scene if the rate of motion is above a threshold.

20. The head-mounted display of claim 18 , wherein the processor is configured to render the view by rendering frames at a lower resolution than rendered frames received from a computer system communicatively coupled to the head-mounted display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2021
From: VEMBAR, DEEPAK SHASHIDHAR; DIEFENBAUGH, PAUL; SOMAYAZULU, VALLABHAJOSYULA S.; KUWAHARA, ATSUO; WHITNEY, KOFI; HICKS, RICHMOND
To: INTEL CORPORATION
Reel/Frame 055562/0346 →
Continuity (2)
Continuation 15262369 · Sep 12, 2016
Related Publication 20180218543A1 · Aug 2, 2018
Cited By (1)
US 12,525,170