IP Library › Granted Patent US 10,572,764
Granted Patent B1
US 10,572,764 · App. 15/997,884 · Granted Feb 25, 2020

Adaptive stereo rendering to reduce motion sickness

Inventors: Behnam Bastani (San Jose, CA); Damien Saint-Macary (San Bruno, CA)
Assignee: GOOGLE LLC
G06K9/4671G02B27/017G02B27/2228G06F3/013G06T15/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,572,764
App. No.
15/997,884
Granted
Feb 25, 2020
Kind
B1
Abstract

Techniques of displaying video in an HMD include performing an adaptive rendering operation to produce a transition between stereo and non-stereo rendering of objects in a virtual environment during eye saccade. Because viewers generally have low visual perception performance during eye saccade, the viewer will not notice this transition as much and will not experience as much motion sickness.

Claims (50)

1. A method, comprising:

receiving, by controlling circuitry of a processor configured to display video content to a viewer over a plurality of pixels of a display, eye saccade indication data indicating that the viewer is undergoing an eye saccade; and

in response to receiving the eye saccade indication data, performing, by the controlling circuitry, an adaptive rendering operation during the eye saccade to produce a transition between a stereo rendering and a non-stereo rendering of an object for a first portion of the plurality of pixels and a maintenance of the stereo rendering of the object for a second portion of the plurality of pixels.

2. The method of claim 1 , wherein the display is a head-mounted display (HMD), and

wherein the first portion of pixels is associated with a field of view (FOV) of a first eye of the viewer and the second portion of pixels is associated with a FOV of a second eye of the viewer.

3. The method of claim 2 , wherein the first eye is a non-dominant eye and the second eye is a dominant eye.

4. The method of claim 1 , wherein the adaptive rendering operation is a first adaptive rendering operation, and

wherein the method further comprises:

after performing the first adaptive rendering operation, performing a second adaptive rendering operation to produce a transition between the non-stereo rendering of the object and the stereo rendering of the object for the first portion of the plurality of pixels.

5. The method of claim 1 , wherein performing the adaptive rendering operation during the eye saccade includes:

producing a transition to a non-stereo rendering of a first set of the first portion of the plurality of pixels during a first time and a transition to a non-stereo rendering of a second set of the first portion of the plurality of pixels during a second time after the first time.

6. The method of claim 5 , wherein the second set of the first portion of the plurality of pixels includes the first set of the first portion of the plurality of pixels.

7. The method of claim 1 , wherein the video content displayed to the viewer over the first portion of the plurality of pixels of the display includes first salient content and second salient content, and

wherein performing the adaptive rendering operation during the eye saccade includes:

identifying first pixels associated with the first salient content and second pixels associated with the second salient content; and

producing a transition to a non-stereo rendering of the first pixels during a first time and a transition to a non-stereo rendering of the second pixels during a second time after the first time.

8. The method as in claim 1 , wherein the adaptive rendering operation performed during the eye saccade is configured to reduce accommodation conflict in the viewer.

9. A computer program product comprising a non-transitory storage medium, the computer program product including code that, when executed by processing circuitry of a user device configured to display video content to a viewer over a plurality of pixels of a display, causes the processing circuitry to perform a method, the method comprising:

receiving eye saccade indication data indicating that the viewer is undergoing an eye saccade; and

in response to receiving the eye saccade indication data, performing an adaptive rendering operation during the eye saccade to produce a transition between a stereo rendering and a non-stereo rendering of an object for a first portion of the plurality of pixels and a maintenance of the stereo rendering of the object for a second portion of the plurality of pixels.

10. The computer program product of claim 9 , wherein the display is a head-mounted display (HMD), and

wherein the first portion of pixels is associated with a field of view (FOV) of a first eye of the viewer and the second portion of pixels is associated with a FOV of a second eye of the viewer.

11. The computer program product of claim 10 , wherein the first eye is a non-dominant eye and the second eye is a dominant eye.

12. The computer program product of claim 9 , wherein the adaptive rendering operation is a first adaptive rendering operation, and

wherein the method further comprises:

after performing the first adaptive rendering operation, performing a second adaptive rendering operation to produce a transition between the non-stereo rendering of the object and the stereo rendering of the object for the first portion of the plurality of pixels.

13. The computer program product of claim 9 , wherein performing the adaptive rendering operation during the eye saccade includes:

producing a transition to a non-stereo rendering of a first set of the first portion of the plurality of pixels during a first time and a transition to a non-stereo rendering of a second set of the first portion of the plurality of pixels during a second time after the first time.

14. The computer program product of claim 13 , wherein the second set of the first portion of the plurality of pixels includes the first set of the first portion of the plurality of pixels.

15. The computer program product of claim 9 , wherein the video content displayed to the viewer over the first portion of the plurality of pixels of the display includes first salient content and second salient content, and

wherein performing the adaptive rendering operation during the eye saccade includes:

identifying first pixels associated with the first salient content and second pixels associated with the second salient content; and

producing a transition to a non-stereo rendering of the first pixels during a first time and a transition to a non-stereo rendering of the second pixels during a second time after the first time.

16. An electronic apparatus configured to display video content to a viewer over a plurality of pixels of a display, the electronic apparatus comprising:

memory; and

controlling circuitry coupled to the memory, the controlling circuitry being configured to:

receive eye saccade indication data indicating that the viewer is undergoing an eye saccade; and

in response to a receipt of the eye saccade indication data, perform an adaptive rendering operation during the eye saccade to produce a transition between a stereo rendering and a non-stereo rendering of an object for a first portion of the plurality of pixels and a maintenance of the stereo rendering of the object for a second portion of the plurality of pixels.

17. The electronic apparatus product of claim 16 , wherein the display is a head-mounted display (HMD), and

wherein the first portion of pixels is associated with a field of view (FOV) of a first eye of the viewer and the second portion of pixels is associated with a FOV of a second eye of the viewer.

18. The electronic apparatus of claim 17 , wherein the first eye is a non-dominant eye and the second eye is a dominant eye.

19. The electronic apparatus of claim 16 , wherein the adaptive rendering operation is a first adaptive rendering operation, and

wherein the controlling circuitry is further configured to:

after performing the first adaptive rendering operation, perform a second adaptive rendering operation to produce a transition between the non-stereo rendering of the object and the stereo rendering of the object for the first portion of the plurality of pixels.

20. The electronic apparatus of claim 16 , wherein the controlling circuitry configured to perform the adaptive rendering operation during the eye saccade is further configured to:

produce a transition to a non-stereo rendering of a first set of the first portion of the plurality of pixels during a first time and a transition to a non-stereo rendering of a second set of the first portion of the plurality of pixels during a second time after the first time.

21. The electronic apparatus of claim 16 , wherein the video content displayed to the viewer over the first portion of the plurality of pixels of the display includes first salient content and second salient content, and

wherein the controlling circuitry configured to perform the adaptive rendering operation during the eye saccade is further configured to:

identify first pixels associated with the first salient content and second pixels associated with the second salient content; and

produce a transition to a non-stereo rendering of the first pixels during a first time and a transition to a non-stereo rendering of the second pixels during a second time after the first time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2018
From: BASTANI, BEHNAM; SAINT-MACARY, DAMIEN
To: GOOGLE LLC
Reel/Frame 046717/0516 →
Continuity (1)
Provisional Application 62515111 · Jun 5, 2017
Cited By (4)
US 12,341,941 US 12,425,743 US 12,470,850 US 12,730,509