Granted Patent B2

US 10,013,053 · App. 13/646,299 · Granted Jul 3, 2018

Inventors: Markus Cederlund (Sollentuna, SE); Robert Gavelin (Åkerberga, SE); Anders Vennström (Stockholm, SE); Anders Kaplan (Uppsala, SE); Anders Olsson (Stockholm, SE); Mårten Skogö (Danderyd, SE)

Assignee: Tobii AB

G06F3/013B60K37/06G02B27/01G02B27/017G06F1/1613G06F3/014G06F3/017G06F3/04883G02B2027/014G02B2027/0187G06F2203/0381

Abstract

Claims (87)

1. A control module for executing object selection commands during user interaction with an information presentation area displaying an object, wherein the control module is configured to:

acquire user gaze data signals from a gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receive, from an input device that includes a physical touch sensitive area, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generate a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receive, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determine, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resize, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including the object and overlapping with the gaze point area;

receive, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determine, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

select, based on the select command, the object in the updated gaze point area.

2. A method for executing object selection commands during user interaction with an information presentation area associated with a computer device, said method comprising:

acquiring gaze data signals from a gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receiving, from an input device that includes a physical touch sensitive area, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generating a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receiving, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determining, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resizing, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including an object and overlapping with the gaze point area;

receiving, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determining, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

selecting, based on the select command, the object in the updated gaze point area.

3. A system for user interaction with an information presentation area, said system comprising:

an input device comprising a physical touch sensitive area, said user input device being adapted to detect user gestures in a form of user finger touch on, movement on and release from the physical touch sensitive area;

a gaze tracking module adapted to detect gaze data of a user of said information presentation area;

a control module configured to:

acquire user gaze data signals from the gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receive, from the input device, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generate a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receive, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determine, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resize, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including the object and overlapping with the gaze point area;

receive, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determine, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

select, based on the select command, the object in the updated gaze point area.

4. A computer device associated with an information presentation area, said computer device comprising:

an input device comprising a physical touch sensitive area, said user input device being adapted to detect user gestures in a form of user finger touch on, movement on and release from the physical touch sensitive area;

a gaze tracking module adapted to detect gaze data of a user of said information presentation area;

a control module configured to:

acquire user gaze data signals from the gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receive, from the input device, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generate a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receive, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determine, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resize, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including the object and overlapping with the gaze point area;

receive, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determine, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

select, based on the select command, the object in the updated gaze point area.

5. A handheld portable device including an information presentation area and comprising an input device comprising a physical touch sensitive area, said user input device being adapted to detect user gestures in a form of user finger touch on, movement on and release from the physical touch sensitive area, and a gaze tracking module adapted to detect gaze data of a user of said information presentation area, said handheld portable device further comprising a control module configured to:

acquire user gaze data signals from the gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receive, from the input device, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generate a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receive, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determine, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resize, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including the object and overlapping with the gaze point area;

receive, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determine, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

select, based on the select command, the object in the updated gaze point area.

6. A system for user interaction with an information presentation area, said system comprising:

an input device adapted to detect user gestures, said input device comprising at least one physical touch sensitive area arranged on a steering device of a vehicle or adapted to be integrated in a steering device of a vehicle, said touchpad being adapted to detect user gestures in a form of user finger touch on, movement on and release from the physical touch sensitive area;

a gaze tracking module adapted to detect gaze data of a user of said information presentation area;

a control module configured to:

acquire user gaze data signals from the gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receive, from the input device, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generate a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receive, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determine, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resize, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including the object and overlapping with the gaze point area;

receive, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determine, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

select, based on the select command, the object in the updated gaze point area.

7. A wireless transmit/receive unit, WTRU, associated with an information presentation area and comprising an input device comprising a touch sensitive area and being adapted to detect user gestures in a form of user finger touch on, movement on and release from the touch sensitive area, and a gaze tracking module adapted to detect gaze data of a viewer of said information presentation area, said WTRU further comprising a control module configured to:

acquire user gaze data signals from the gaze tracking module, the user gaze signals indicating a gaze point on the information presentation area;

receive, from the input device, first user gesture data corresponding to a press of a finger on the physical touch sensitive area;

generate a gaze point area on the information presentation area based on the user gaze data signals and on the first user gesture data, the gaze point area being a local area that includes the gaze point;

receive, from the input device, second user gesture data corresponding to a movement of the finger on the physical touch sensitive area, the press of the finger followed next by the movement of the finger;

determine, based on the gaze point area, that the second user gesture data is associated with a fine tuning command to update the gaze point area;

resize, based on the fine tuning command, the gaze point area according to the second user gesture data to generate an updated gaze point area, the updated gaze point area including the object and overlapping with the gaze point area;

receive, from the input device, third user gesture data indicating a release of the finger from the physical touch sensitive area, the movement of the finger followed next by the release of the finger;

determine, based on the object being included in the updated gaze point area, that the third user gesture data is associated with a select command to select the object; and

select, based on the select command, the object in the updated gaze point area.

8. The control module of claim 1 further configured to:

receive, from the input device, fourth user gesture data indicating a first finger press on the physical touch sensitive area;

present, at the gaze point, an icon illustrating a location of the gaze point on the information presentation area;

receive, from the input device, fifth user gesture data indicating a finger movement on the physical touch sensitive area, the first finger press followed next by the finger movement;

determine, based on the icon, that the fifth gesture data is associated with a relocation command to relocate the gaze point to a new location on the information presentation area;

relocate, based on the relocation command, the gaze point from the location to the new location;

receive, based on the relocating, sixth user gesture data indicating a second finger press concurrent with the first finger press, the finger movement followed next by the second finger press; and

manipulate the object based on the sixth user gesture data and the new location of the gaze point.

Assignments (2)

Continuity (2)

Cited By (75)

US 12,197,043 US 12,204,097 US 12,205,230 US 12,210,164 US 12,211,145 US 12,212,948 US 12,216,821 US 12,222,513 US 12,232,688 US 12,236,543 US 12,238,496 US 12,242,068 US 12,243,531 US 12,245,097 US 12,249,024 US 12,254,582 US 12,266,064 US 12,267,654 US 12,271,560 US 12,277,586 US 12,283,013 US 12,294,852 US 12,306,413 US 12,308,011 US 12,309,577 US 12,315,094 US 12,317,062 US 12,317,064 US 12,320,982 US 12,326,565 US 12,327,573 US 12,333,066 US 12,333,069 US 12,337,189 US 12,342,158 US 12,347,415 US 12,347,448 US 12,353,841 US 12,386,186 US 12,389,187 US 12,393,030 US 12,396,641 US 12,405,466 US 12,405,470 US 12,417,766 US 12,430,860 US 12,436,392 US 12,436,395 US 12,443,294 US 12,449,662 US 12,455,619 US 12,455,630 US 12,478,254 US 12,493,358 US 12,495,094 US 12,504,809 US 12,536,756 US 12,554,129 US 12,579,966 US 12,615,407 US 12,650,602 US 12,677,087 US 12,687,668 US 12,687,721 US 12,687,725 US 12,688,845 US 12,689,666 US 12,696,045 US 12,699,447 US 12,702,615 US 12,704,726 US 12,710,659 US 12,710,662 US 12,717,147 US 12,724,449