IP Library › Granted Patent US 10,075,491
Granted Patent B2
US 10,075,491 · App. 15/257,978 · Granted Sep 11, 2018

Directing communications using gaze interaction

Inventor: Boris Smus (San Francisco, CA)
Assignee: Google LLC
H04L65/403G06F3/012G06F3/013G06K9/00335G06K9/00617H04L65/601G06F3/04817
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,075,491
App. No.
15/257,978
Granted
Sep 11, 2018
Kind
B2
Abstract

In some implementations, audio data or video data associated with a first participant of a communication session is obtained. The communication session may include communication between a first device of the first participant with a second device of a second participant of the communication session. It is determined that biometric information associated with the first participant indicates that the first participant is looking toward the first device. In response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, the audio data or the video data associated with the first participant is transmitted to the second device of the second participant of the communication session.

Claims (47)

1. A method performed by one or more electronic devices, the method comprising:

obtaining audio data or video data associated with a first participant of a communication session, wherein the communication session includes communication between a first device of the first participant with a second device of a second participant of the communication session;

muting audio of the first participant such that the audio of the first participant is not transmitted to the second device of the second participant;

after muting the audio of the first participant, determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device; and

in response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, unmuting the audio of the first participant such that the audio of the first participant is transmitted to the second device of the second participant.

2. The method of claim 1 , wherein the biometric information comprises eye tracking data for the first participant.

3. The method of claim 1 , wherein the biometric information comprises head position data for the first participant.

4. The method of claim 1 , wherein the communication session includes communication with a third device of a third participant of the communication session; and

wherein determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining a direction of gaze of the first participant during the communication session;

wherein the method comprises selecting, from among the participants of the communication session, the second participant based on the direction of the gaze of the first participant; and

wherein the method further comprises transmitting the audio data or the video data associated with the first participant to the second device of the second participant of the communication session based at least on selecting the second participant from among the participants of the communication session.

5. The method of claim 4 , further comprising:

providing, for display at the device of the first participant, an indicator that indicates the selected participant.

6. The method of claim 4 , wherein:

the second participant has an assigned direction relative to the first participant; and

determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining that the first participant is looking toward the assigned direction corresponding to the second participant.

7. A system comprising:

one or more electronic devices; and

one or more non-transitory machine-readable media coupled to the one or more electronic devices, the one or more non-transitory machine-readable media having instructions stored thereon, which, when executed by the one or more electronic devices, cause the one or more electronic devices to perform operations comprising:

obtaining audio data or video data associated with a first participant of a communication session, wherein the communication session includes communication between a first device of the first participant with a second device of a second participant of the communication session;

muting audio of the first participant such that the audio of the first participant is not transmitted to the second device of the second participant,

after muting the audio of the first participant, determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device; and

in response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, unmuting the audio of the first participant such that the audio of the first participant is transmitted to the second device of the second participant.

8. The system of claim 7 , wherein the biometric information comprises eye tracking data for the first participant.

9. The system of claim 7 , wherein the biometric information comprises head position data for the first participant.

10. The system of claim 7 , wherein the communication session includes communication with a third device of a third participant of the communication session;

wherein determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining a direction of gaze of the first participant during the communication session;

wherein the operations comprise selecting, from among the participants of the communication session, the second participant based on the direction of the gaze of the first participant; and

wherein the operations further comprise transmitting the audio data or the video data associated with the first participant to the second device of the second participant of the communication session based at least on selecting the second participant from among the participants of the communication session.

11. The system of claim 10 , wherein the operations further comprise:

providing, for display at the device of the first participant, an indicator that indicates the selected participant.

12. The system of claim 10 , wherein:

the second participant has an assigned direction relative to the first participant; and

determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining that the first participant is looking toward the assigned direction corresponding to the second participant.

13. One or more non-transitory machine-readable storage devices storing instructions that, when executed by one or more processors of one or more electronic devices, cause the one or more electronic devices to perform operations comprising:

obtaining audio data or video data associated with a first participant of a communication session, wherein the communication session includes communication between a first device of the first participant with a second device of a second participant of the communication session;

muting audio of the first participant such that the audio of the first participant is not transmitted to the second device of the second participant;

after muting the audio of the first participant, determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device; and

in response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, unmuting the audio of the first participant such that the audio of the first participant is transmitted to the second device of the second participant.

14. The one or more non-transitory machine-readable storage devices of claim 13 , wherein the biometric information comprises eye tracking data for the first participant.

15. The one or more non-transitory machine-readable storage devices of claim 13 , wherein the biometric information comprises head position data for the first participant.

16. The one or more non-transitory machine-readable storage devices of claim 13 , wherein the communication session includes communication with a third device of a third participant of the communication session;

wherein determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining a direction of gaze of the first participant during the communication session;

wherein the operations comprise selecting, from among the participants of the communication session, the second participant based on the direction of the gaze of the first participant; and

wherein the operations further comprise transmitting the audio data or the video data associated with the first participant to the second device of the second participant of the communication session based at least on selecting the second participant from among the participants of the communication session.

17. The one or more non-transitory machine-readable storage devices of claim 16 , wherein the operations further comprise:

providing, for display at the device of the first participant, an indicator that indicates the selected participant.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2016
From: SMUS, BORIS
To: GOOGLE INC.
Reel/Frame 039662/0794 →
Continuity (2)
Continuation 14965289 · Dec 10, 2015
Related Publication 20170171261A1 · Jun 15, 2017
Cited By (4)
US 12,192,605 US 12,279,065 US 12,424,222 US 12,548,558