IP Library Granted Patent US 9,232,186
Granted Patent B2
US 9,232,186 · App. 14/262,942 · Granted Jan 5, 2016

Video terminal device and method of detecting direction of gaze

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,232,186
App. No.
14/262,942
Granted
Jan 5, 2016
Kind
B2
Abstract

A video terminal device includes a capture module, a detection module, a transmitting module, and a displaying module. The capture module takes images of the eyes of a user when the user is gazing at a display device to obtain three points of focus of the eyes, and confirms a circle bounding the three points of focus. The detection module detects whether an area of the applied circle is less than a first threshold. The transmitting module outputs coordinates of the center of the applied circle as an eyes direction when the area of the circle is less than the first threshold, enabling the participants in a conference to see the eyes direction of the presenter and the presenter to see the eyes directions of each of his audience.

Claims (42)

1. A video terminal device comprising a processor and a storage system, the storage system storing one or more software programs in the form of computerized codes operable to be executed by the processor, the one or more software programs comprising:

a capture module, configured for continuously taking images of eyes of a user when the user gazes at a display device to obtain three visual focal positions of the user, and confirming a circle according to the three visual focal position of the user;

a detection module, configured for detecting whether an area of the circle is less than a first threshold; and

a transmitting module, outputting a coordinate of a centre of the circle as an eye direction coordinate when the area of the circle is less than the first threshold;

wherein the first threshold area is a preset constant according to a speaker's preference.

2. The video terminal device of claim 1 , wherein the capture module is further configured to continuously obtain again three new visual focal positions of the user to confirm a new circle when the area of the circle is not less than the first threshold.

3. The video terminal device of claim 2 , further comprising:

a displaying module, configured for storing the eye direction coordinate output by the transmitting module in the storage system, and showing the eye direction coordinate in the display device.

4. The video terminal device of claim 3 , wherein the detection module is further configured to detect whether the storage system has ever stored a previous eye direction coordinate, and the displaying module shows the eye direction coordinate output by the transmitting module as a newest eye direction coordinate in the display device when the storage system has not stored the previous eye direction coordinate.

5. The video terminal device of claim 4 , wherein the detection module is further configured to detect whether a distance between the eye direction coordinate output by the transmitting module and the previous eye direction coordinate stored in the storage system is less than a second threshold when the storage system has stored the previous eye direction coordinate.

6. The video terminal device of claim 5 , wherein the displaying module configured to update the previous eye direction coordinate to the eye direction coordinate output by the transmitting module when the distance between the eye direction coordinate output by the transmitting module and the previous eye direction coordinate stored in the storage system is not less than the second threshold.

7. The video terminal device of claim 5 , wherein the displaying module is configured to not update the previous eye direction coordinate when the distance between the eye direction coordinate eye direction output by the transmitting module and the previous eye direction coordinate stored in the storage system is less than the second threshold.

8. The video terminal device of claim 3 , wherein the detection module is further configured to detect whether a distance between the eye direction coordinate output by the transmitting module and a eye direction coordinate of another user is less than a third threshold.

9. The video terminal device of claim 8 , wherein the displaying module is further configured to show an area which listener are earnest listening when the distance between the eye direction coordinate output by the transmitting module and the eye direction coordinate of another user is less than the third threshold.

10. The video terminal device of claim 8 , wherein the displaying module is further configured to show an area which listener are not earnest listening when the distance between the eye direction coordinate output by the transmitting module and the eye direction coordinate of another user is not less than the third threshold.

11. An eye direction detecting method of a video terminal device, the method comprising:

continuously taking images of eyes of a user when the user gazes at a display device to obtain three visual focal positions of the user, and confirming a circle according to the three visual focal positions of the user;

detecting whether area of the circle is less than a first threshold; and

outputting a coordinate of a centre of the circle as an eye direction coordinate when the area of the circle is less than the first threshold;

wherein the first threshold area is a preset constant according to a speaker's preference.

12. The eye direction detecting method of a video terminal device of claim 11 , further comprising:

continuously obtaining again three new visual focal positions of the user to confirm a new circle when the area of the circle is not less than the first threshold.

13. The eye direction detecting method of a video terminal device of claim 12 , further comprising:

detecting whether a previous eye direction coordinate has been stored ever;

showing the eye direction coordinate as a newest eye direction coordinate in the display device when the previous eye direction coordinate has not been stored;

detecting whether a distance between the eye direction coordinate and the previous eye direction coordinate is less than a second threshold when the previous eye direction coordinate has been stored;

updating the previous eye direction coordinate to the eye direction coordinate and showing the eye direction coordinate as the newest eye direction coordinate in the display device when the distance between the eye direction coordinate and the previous eye direction coordinate is not less than the second threshold; and

showing the previous eye direction coordinate in the display device when the distance between the eye direction coordinate and the previous eye direction coordinate is less than the second threshold.

14. The eye direction detecting method of a video terminal device of claim 12 , further comprising

detecting whether the distance between the eye direction coordinate and a eye direction coordinate of another user is less than a third threshold;

showing an area which at least one listener is earnestly listening when the distance between the eye direction coordinate and the eye direction coordinate of another user is less than the third threshold; and

showing an area in which at least one listener is not earnestly listening when the distance between the eye direction coordinate and the eye direction coordinate of another user is not less than the third threshold.

15. A video terminal device comprising a processor and a storage system, the storage system storing one or more software programs in the form of computerized codes operable to be executed by the processor, the one or more software programs comprising:

a capture module, configured for continuously taking images of eyes of a user when the user gazes at a display device to obtain three visual focal positions of the user, and confirming a circle according to the three visual focal position of the user;

a detection module, configured for detecting whether an area of the circle is less than a first threshold; and

a transmitting module, outputting a coordinate of a centre of the circle as an eye direction coordinate when the area of the circle is less than the first threshold;

wherein the first threshold area is a preset constant according to a speaker's preference, and

the detection module is further configured to detect whether a distance between the eye direction coordinate output by the transmitting module and a eye direction coordinate of another user is less than a second threshold.

16. The video terminal device of claim 15 , further comprising:

a displaying module, configured for storing the eye direction coordinate output by the transmitting module in the storage system, and showing the eye direction coordinate in the display device.

17. The video terminal device of claim 16 , wherein the displaying module is further configured to show an area which listener are earnest listening when the distance between the eye direction coordinate output by the transmitting module and the eye direction coordinate of another user is less than the second threshold.

18. The video terminal device of claim 16 , wherein the displaying module is further configured to show an area which listener are not earnest listening when the distance between the eye direction coordinate output by the transmitting module and the eye direction coordinate of another user is not less than the second threshold.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2018
From: HON HAI PRECISION INDUSTRY CO., LTD.
To: CLOUD NETWORK TECHNOLOGY SINGAPORE PTE. LTD.
Reel/Frame 045171/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2014
From: KUO, CHUNG-HSUAN
To: HON HAI PRECISION INDUSTRY CO., LTD.
Reel/Frame 032766/0483 →