IP Library › Granted Patent US 11,435,822
Granted Patent B2
US 11,435,822 · App. 17/052,458 · Granted Sep 6, 2022

Estimation method, estimation program, and estimation device

Inventors: Jumpei Yamashita (Tokyo, JP); Hidetaka Koya (Tokyo, JP); Hajime Nakajima (Tokyo, JP)
Assignee: Nippon Telegraph and Telephone Corporation
G06F3/013A61B5/163A61B5/297G06F3/012A61B5/1114
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,435,822
App. No.
17/052,458
Granted
Sep 6, 2022
Kind
B2
Abstract

An estimation method includes first acquiring information of an eyeball motion of a user on the basis of a measurement value of an eye potential of the user, second acquiring positional information of an interaction target on a screen that corresponds to an interaction performed on a device through an operation of the user, third acquiring information regarding a relative motion of sight of the user on the basis at least of the information of the eyeball motion of the user, and estimating a sight position of the user on the screen on the basis of the information regarding the relative motion of the sight of the user and the positional information of the interaction target on the screen, by processing circuitry.

Claims (35)

1. An estimation method comprising:

acquiring information of an eyeball motion of a user based on a measurement value of an eye potential of the user;

acquiring positional information of an interaction target on a screen that corresponds to an interaction performed on a device through an operation of the user;

acquiring information regarding a relative motion of sight of the user based on at least of the information of the eyeball motion of the user; and

estimating a sight position of the user on the screen based on the information regarding the relative motion of the sight of the user and the positional information of the interaction target on the screen, by processing circuitry, comprising:

determining whether or not a first distance between a previously estimated sight position of the user on the screen and a position of an interaction target on the screen corresponding to a new interaction is equal to or less than a predetermined threshold value; and

in accordance with determining that the first distance is equal to or less than the predetermined threshold value, estimating the sight position of the user on the screen based on positional information of the interaction target on the screen that corresponds to the new interaction and information regarding the relative motion of the sight of the user that corresponds to the positional information; and

in accordance with determining that the first distance is greater than the predetermined threshold value, estimating the sight position of the user on the screen based on positional information of the interaction target on the screen on which the first distance is determined to be equal to or less than the predetermined threshold value in determining immediately before the new interaction and information regarding the relative motion of the sight of the user that corresponds to the positional information.

2. The estimation method according to claim 1 , wherein the determining is executed at a timing based on characteristic information regarding a stop of the eyeball motion of the user.

3. The estimation method according to claim 1 ,

wherein the acquiring information regarding the relative motion of sight of the user includes:

saving, in a data set, the information of the eyeball motion of the user and the positional information of the interaction target on the screen, and

acquiring an amount of sight movement on the screen that corresponds to an eyeball motion amount of the user based on the information of the eyeball motion of the user and the positional information of the interaction target on the screen that are present in the data set.

4. The estimation method according to claim 3 , wherein the saving includes storing positional information of the interaction target on the screen in the new interaction, the first distance of which has been determined to be equal to or less than the predetermined threshold value in the determining, and information of an eyeball motion that corresponds to the new interaction in the data set at this timing.

5. The estimation method according to claim 3 , further including:

acquiring head movement information of the user based on a measurement value regarding movement of a head of the user,

wherein the acquiring heading movement information includes acquiring the amount of sight movement on the screen using the head movement information of the user along with the information of the eyeball motion of the user and the positional information of the interaction target on the screen.

6. A non-transitory computer-readable recording medium storing therein an estimation program that causes a computer to execute a process comprising:

acquiring information of an eyeball motion of a user based on a measurement value of an eye potential of the user;

acquiring positional information of an interaction target on a screen that corresponds to an interaction performed on a device through an operation of the user;

acquiring information regarding a relative motion of sight of the user based on at least of the information of the eyeball motion of the user; and

estimating a sight position of the user on the screen based on the information regarding the relative motion of the sight of the user and the positional information of the interaction target on the screen, comprising:

determining whether or not a first distance between a previously estimated sight position of the user on the screen and a position of an interaction target on the screen corresponding to a new interaction is equal to or less than a predetermined threshold value; and

in accordance with determining that the first distance is equal to or less than the predetermined threshold value, estimating the sight position of the user on the screen based on positional information of the interaction target on the screen that corresponds to the new interaction and information regarding the relative motion of the sight of the user that corresponds to the positional information; and

in accordance with determining that the first distance is greater than the predetermined threshold value, estimating the sight position of the user on the screen based on positional information of the interaction target on the screen on which the first distance is determined to be equal to or less than the predetermined threshold value in determining immediately before the new interaction and information regarding the relative motion of the sight of the user that corresponds to the positional information.

7. An estimation apparatus comprising:

a memory; and

processing circuitry coupled to the memory and configured to:

acquire information of an eyeball motion of a user based on a measurement value of an eye potential of the user;

acquire positional information of an interaction target on a screen that corresponds to an interaction performed on a device through an operation of the user;

acquire information regarding a relative motion of sight of the user based on at least of the information of the eyeball motion of the user; and

estimate a sight position of the user on the screen based on the information regarding the relative motion of the sight of the user and the positional information of the interaction target on the screen, comprising:

determining whether or not a first distance between a previously estimated sight position of the user on the screen and a position of an interaction target on the screen corresponding to a new interaction is equal to or less than a predetermined threshold value; and

in accordance with determining that the first distance is equal to or less than the predetermined threshold value, estimating the sight position of the user on the screen based on positional information of the interaction target on the screen that corresponds to the new interaction and information regarding the relative motion of the sight of the user that corresponds to the positional information; and

in accordance with determining that the first distance is greater than the predetermined threshold value, estimating the sight position of the user on the screen based on positional information of the interaction target on the screen on which the first distance is determined to be equal to or less than the predetermined threshold value in determining immediately before the new interaction and information regarding the relative motion of the sight of the user that corresponds to the positional information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2020
From: YAMASHITA, JUMPEI; KOYA, HIDETAKA; NAKAJIMA, HAJIME
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 054600/0490 →
Priority Claims (1)
JP JP2018-090711 · May 9, 2018 · national
Continuity (1)
Related Publication 20210048882A1 · Feb 18, 2021
Cited By (1)
US 12,608,081