IP Library Granted Patent US 10,444,832
Granted Patent B2
US 10,444,832 · App. 15/795,962 · Granted Oct 15, 2019

Method and system for operating a display apparatus

Inventor: Eberhard Schmidt (Kleinmachnow, DE)
Assignee: Apple Inc.
G06F3/012G06F3/013G06F3/041G06F17/212G06F17/246G06T7/0002G09G5/391G06T2207/30168G09G2340/045G09G2340/0407G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,444,832
App. No.
15/795,962
Granted
Oct 15, 2019
Kind
B2
Abstract

The invention relates to a method for operating a display apparatus ( 12 ), comprising the following steps: capture of image data from at least one part of the head of a user ( 14 ) (step 110 ), ascertainment of at least one parameter, which the user ( 14 ) can alter by moving at least one part of the head, from the image data captured in step a) (step 120 ), control of a visual representation on a display apparatus ( 12 ) on the basis of the ascertained at least one parameter (step 130 ), wherein the capture in step a) is taken as a basis for ascertaining at least one quality parameter (step 140 ) and the at least one quality parameter is taken as a basis for varying at least one resolution of at least one part of the visual representation (step 150 ). Moreover, the invention relates to a corresponding computer program product and to a corresponding system for operating a display apparatus.

Claims (30)

1. A method comprising:

obtaining image data of an eye of a user;

determining an eye tracking parameter based on the image data;

determining an accuracy parameter indicative of the accuracy of the eye tracking parameter; and

moving a movable element of a visual representation of a software application based on the eye tracking parameter and the accuracy parameter, wherein a movement speed of the movable element is based on the accuracy parameter.

2. The method of claim 1 , wherein the eye tracking parameter includes a gaze point of the user.

3. The method of claim 1 , wherein accuracy parameter is indicative of a measure of deviation between the determined eye tracking parameter and an actual value of the eye tracking parameter.

4. The method of claim 1 , wherein determining the accuracy parameter includes determining a noise value of the image data.

5. The method of claim 1 , wherein determining the accuracy parameter includes determining a difference between a first value of the eye tracking parameter obtained for a first time and a second value of the eye tracking parameter obtained for a second time.

6. The method of claim 1 , wherein determining the accuracy parameter includes determining whether the image data includes a second eye of the user.

7. The method of claim 1 , wherein moving the movable element of the visual representation of the software application includes moving display of a selection device based on the eye tracking parameter, wherein the movement speed of the selection device is based on the accuracy parameter.

8. The method of claim 1 , wherein moving the movable element of the visual representation of the software application includes scrolling a representation, wherein the movement speed of scrolling the representation is based on the accuracy parameter.

9. The method of claim 1 , wherein moving the movable element of the visual representation of the software application includes moving a magnifier area based on the eye tracking parameter, wherein a movement speed of the magnifier area is based on the accuracy parameter.

10. A non-transitory computer-readable medium having instructions which, when executed by a computer, cause the computer to perform operations comprising:

obtaining image data of an eye of a user;

determining an eye tracking parameter based on the image data;

determining an accuracy parameter indicative of the accuracy of the eye tracking parameter; and

moving a movable element of a visual representation of a software application based on the eye tracking parameter and the accuracy parameter, wherein a movement speed of the movable element is based on the accuracy parameter.

11. The non-transitory computer-readable medium of claim 10 , wherein determining the accuracy parameter includes determining whether the image data includes a second eye of the user.

12. The non-transitory computer-readable medium of claim 10 , wherein moving the movable element of the visual representation of the software application includes moving display of a selection device object based on the eye tracking parameter, wherein the movement speed of the selection device is based on the accuracy parameter.

13. The non-transitory computer-readable medium of claim 10 , wherein moving the movable element of the visual representation of the software application includes scrolling a representation, wherein a movement speed of scrolling the representation is based on the accuracy parameter.

14. The non-transitory computer-readable medium of claim 10 , wherein moving the movable element of the visual representation of the software application includes moving a magnifier area based on the eye tracking parameter, wherein the movement speed of the magnifier area is based on the accuracy parameter.

15. An apparatus comprising:

a camera to obtain image data of an eye of a user;

an eye tracker to determine an eye tracking parameter based on the image data and determine an accuracy parameter indicative of the accuracy of the eye tracking parameter; and

a display to present a visual representation of a software application including a movable element that is moved based on the eye tracking parameter and the accuracy parameter, wherein a movement speed of the movable element is based on the accuracy parameter.

16. The apparatus of claim 15 , wherein the eye tracker is to determine the accuracy parameter by determining whether the image data includes a second eye of the user.

17. The apparatus of claim 15 , wherein the visual representation of the software application is controlled by moving display of selection object based on the eye tracking parameter, wherein a speed of the movement is based on the accuracy parameter.

18. The apparatus of claim 15 , wherein the movable element is moved by moving a selection device, wherein the movement speed of the selection device is based on the accuracy parameter.

19. The apparatus of claim 15 , wherein the movable element is moved by scrolling a representation, wherein the movement speed of scrolling the representation is based on the accuracy parameter.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2019
From: SCHMIDT, EBERHARD
To: SENSOMOTORIC INSTRUMENTS GESELLSCHAFT FÜR INNOVATIVE SENSORIK MBH
Reel/Frame 049408/0080 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2019
From: SENSOMOTORIC INSTRUMENTS GESELLSCHAFT FUR INNOVATIVE SENSORIK MBH
To: APPLE INC.
Reel/Frame 049408/0423 →
Priority Claims (1)
EP 14162073 · Mar 27, 2014 · regional
Continuity (2)
Continuation 15129010
Related Publication 20180307307A1 · Oct 25, 2018