IP Library Granted Patent US 9,766,698
Granted Patent B2
US 9,766,698 · App. 13/101,297 · Granted Sep 19, 2017

Methods and apparatuses for defining the active channel in a stereoscopic view by using eye tracking

Inventors: Jussi Huhtala (Oulu, FI); Katja Kytökorpi (Oulu, FI); Mikko Paldanius (Oulu, FI); Sarjanoja Ari-Heikki (Oulu, FI); Minna Karukka (Oulu, FI)
Assignee: Nokia Technologies Oy
G06F3/013H04N13/0484G02B27/0172G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,766,698
App. No.
13/101,297
Granted
Sep 19, 2017
Kind
B2
Abstract

Methods and apparatuses are provided for facilitating interaction with a three-dimensional user interface. A method may include receiving an indication of an eye movement input to an imaging sensor. The method may further include determining, by a processor, a relation of the eye movement to at least one of a displayed element of a three-dimensional user interface. The method may additionally include causing, based at least in part on the determined relation, a selection of at least one of a displayed element of the three-dimensional user image. The method may also include causing a modification of a displayed element of the at least one selected displayed element of the three-dimensional image. Corresponding apparatuses are also provided.

Claims (45)

1. A method comprising:

receiving an indication of an eye movement to an imaging sensor;

determining that the eye movement comprises at least one of an opening or closing of at least one eye;

determining, by a processor, a relation of the eye movement to at least one of a displayed element of a three-dimensional image;

causing, based at least in part on the determined relation, a selection of at least one of a displayed element of the three-dimensional image; and

in response to the receiving the indication of the eye movement, causing a modification of at least one attribute of the at least one selected displayed element of the three-dimensional image based on the determination of whether the at least one eye movement comprises opening or closing, wherein the at least one attribute is identified based on which of a left, right, or both eyes to which the eye movement is attributed.

2. The method of claim 1 , wherein the displayed element comprises at least one of a right image and a left image of an autostereoscopic three-dimensional image.

3. The method of claim 1 , wherein causing the modification of the at least one selected displayed element comprises:

in an instance in which a left eye is closed, causing modification of the right image;

in an instance in which a right eye is closed, causing modification of the left image; and

in an instance in which the left eye and the right eye are open, causing modification of the right image and the left image.

4. The method of claim 1 further comprising a three-dimensional user interface, the three-dimensional user interface comprising an autostereoscopic three-dimensional image.

5. The method of claim 1 , wherein causing the modification of the at least one selected displayed element comprises:

in an instance in which the imaging sensor detects a left eye is closed, causing modification of the displayed element such that the right image is displayed and the left image is not displayed; and

in an instance in which the imaging sensor detects a right eye is closed, causing modification of the displayed element such that the left image is displayed and the right image is not displayed.

6. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

receive an indication of an eye movement to an imaging sensor;

determine that the eye movement comprises at least one of an opening or closing of at least one eye;

determine a relation of the eye movement to at least one of a displayed element of a three-dimensional image;

cause, based at least in part on the determined relation, a selection of at least one of a displayed element of the three-dimensional image; and

in response to the receiving the indication of the eye movement, cause a modification of at least one attribute of the at least one selected displayed element of the three-dimensional image based on the determination of whether the at least one eye movement comprises opening or closing, wherein the at least one attribute is identified based on which of a left, right, or both eyes to which the eye movement is attributed to.

7. The apparatus of claim 6 , wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to display a stereoscopic image comprising a left image and a right image.

8. The apparatus of claim 6 , wherein causing the modification of the at least one selected displayed element comprises:

in an instance in which a left eye is closed, cause modification of the right image;

in an instance in which a right eye is closed, cause modification of the left image; and

in an instance in which the left eye and the right eye are open, cause modification of the right image and the left image.

9. The apparatus of claim 6 further comprising a three-dimensional user interface, the three-dimensional user interface comprising an autostereoscopic three-dimensional image.

10. The apparatus of claim 6 , wherein causing the modification of the at least one selected displayed element comprises:

in an instance in which the imaging sensor detects a left eye is closed, causing modification of the displayed element such that the right image is displayed and the left image is not displayed; and

in an instance in which the imaging sensor detects a right eye is closed, causing modification of the displayed element such that the left image is displayed and the right image is not displayed.

11. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions comprising program instructions configured to cause an apparatus to perform a method comprising:

receiving an indication of an eye movement to an imaging sensor;

determining that the eye movement comprises at least one of an opening or closing of at least one eye;

determining a relation of the eye movement to at least one of a displayed element of a three-dimensional image;

causing, based at least in part on the determined relation, a selection of at least one of a displayed element of the three-dimensional image; and

in response to the receiving the indication of the eye movement, causing a modification of at least one attribute of the at least one selected displayed element of the three-image based on the determination of whether the at least one eye movement comprises opening or closing, wherein the at least one attribute is identified based on which of a left, right, or both eyes to which the eye movement is attributed.

12. The computer program product of claim 11 , wherein the displayed element comprises at least one of a left image and a right image of an autostereoscopic three-dimensional image.

13. The computer program product of claim 11 , wherein causing the modification of the at least one selected displayed element comprises:

in an instance in which a left eye is closed, causing modification of the right image;

in an instance in which a right eye is closed, causing modification of the left image; and

in an instance in which the left eye and the right eye are open, causing modification of the right image and the left image.

14. The computer program product of claim 11 further comprising a three-dimensional user interface, the three-dimensional user interface comprising an autostereoscopic three-dimensional image.

15. The computer program product of claim 11 , wherein causing the modification of the at least one selected displayed element comprises:

in an instance in which the imaging sensor detects a left eye is closed, causing modification of the displayed element such that the right image is displayed and the left image is not displayed; and

in an instance in which the imaging sensor detects a right eye is closed, causing modification of the displayed element such that the left image is displayed and the right image is not displayed.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035424/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2011
From: HUHTALA, JUSSI; KYTOKORPI, KATJA; PALDANIUS, MIKKO; ARI-HEIKKI, SARJANOJA; KARUKKA, MINNA
To: NOKIA CORPORATION
Reel/Frame 026229/0677 →
Continuity (1)
Related Publication 20120280899A1 · Nov 8, 2012