System and method for assessing speaker spatial orientation

1. A system for assessing spatial orientation of speakers, the system comprising:

at least one processing unit configured to:

obtain audio data captured by one or more audio sensors;

obtain one or more images captured by one or more image sensors;

analyze the audio data to determine that two speakers are engaged in conversation, the two speakers comprises a first speaker and a second speaker;

obtain directional information associated with a relative direction of the first speaker with respect to the second speaker;

analyze the one or more images to identify a spatial orientation of at least one of a torso, a face and an eye of at least one of the two speakers;

use the obtained directional information and the identified spatial orientation to calculate a difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers to assess the spatial orientation according to the directional information, therefore obtaining spatial orientation assessment; and

provide information based on the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers.

2. The system of claim 1 , wherein the at least one processing unit is further configured to:

compare the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers with a selected threshold to obtain the spatial orientation assessment; and

provide information based on a result of the comparison of the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers with a selected threshold.

3. The system of claim 2 , wherein the at least one processing unit is further configured to select the threshold based on a type of interaction the two speakers are engaged in.

4. The system of claim 2 , wherein the at least one processing unit is further configured to select the threshold based on a type of relationship between the two speakers.

5. The system of claim 2 , wherein the at least one processing unit is further configured to:

analyze the audio data to measure a length of the conversation; and

use the measured length to select the threshold.

6. The system of claim 2 , wherein the at least one processing unit is further configured to:

analyze the audio data to identify a topic of the conversation; and

use the identified topic to select the threshold.

7. The system of claim 2 , wherein the at least one processing unit is further configured to:

analyze the one or more images to produce distance information associated with the distance between the first speaker and the second speaker; and

use the distance information to select the threshold.

8. The system of claim 1 , wherein the at least one processing unit is further configured to:

analyze the one or more images to produce distance information associated with the distance between the first speaker and the second speaker; and

assess the spatial orientation according to the directional information and the distance information to obtain the spatial orientation assessment.

9. The system of claim 1 , wherein the at least one processing unit is further configured to:

use the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers to determine whether the first speaker is spatially oriented towards the second speaker; and

use the determination of whether the first speaker is spatially oriented towards the second speaker to produce the spatial orientation assessment.

10. The system of claim 1 , wherein the at least one processing unit is further configured to:

analyze the one or more images to identify a spatial orientation of the face of at least one of the two speakers;

calculate a difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the face of the at least one of the two speakers; and

provide information based on the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the face of the at least one of the two speakers.

11. The system of claim 1 , wherein the one or more audio sensors are included in a wearable apparatus, and wherein the at least one processing unit is further configured to:

use the spatial orientation assessment to determine whether the spatial orientation of the wearer is socially acceptable; and

provide feedback to a wearer of the wearable apparatus when the spatial orientation of the wearer is not socially acceptable.

12. A method for assessing spatial orientation of speakers, the method comprising:

obtaining audio data captured by one or more audio sensors;

obtaining one or more images captured by one or more image sensors;

analyzing the audio data to determine that two speakers are engaged in conversation, the two speakers comprises a first speaker and a second speaker;

obtaining directional information associated with the relative direction of the first speaker with respect to the second speaker;

analyzing the one or more images to identify a spatial orientation of at least one of a torso, a face and an eye of at least one of the two speakers;

using the obtained directional information and the identified spatial orientation to calculate a difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers to assess the spatial orientation according to the directional information, therefore obtaining spatial orientation assessment; and

providing Information based on the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers.

13. The method of claim 12 , further comprising:

comparing the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers with a selected threshold to obtain the spatial orientation assessment; and

providing information based on a result of the comparison of the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers with a selected threshold.

14. The method of claim 13 , further comprising:

analyzing the audio data to measure a length of the conversation; and

using the measured length to select the threshold.

15. The method of claim 13 , further comprising:

analyzing the audio data to identify a topic of the conversation; and

using the identified topic to select the threshold.

16. The method of claim 13 , further comprising:

analyzing the one or more images to produce distance information associated with the distance between the first speaker and the second speaker; and

using the distance information to select the threshold.

17. The method of claim 12 , further comprising:

analyzing the one or more images to produce distance information associated with the distance between the first speaker and the second speaker; and

assessing the spatial orientation according to the directional information and the distance information to obtain the spatial orientation assessment.

18. The method of claim 12 , further comprising:

analyzing the one or more images to identify a spatial orientation of the eye of at least one of the two speakers;

calculating a difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the eye of the at least one of the two speakers; and

providing information based on the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the eye of the at least one of the two speakers.

19. The method of claim 12 , wherein the one or more audio sensors are included in a wearable apparatus, and further comprising:

using the spatial orientation assessment to determine whether the gaze of the speaker is socially acceptable; and

provide feedback to a wearer of the wearable apparatus when the gaze of the speaker is not socially acceptable.

20. A non-transitory computer readable medium storing data and computer implementable instructions for carrying out a method for assessing spatial orientation of speakers, the method comprising:

obtaining audio data captured by one or more audio sensors;

obtaining one or more images captured by one or more image sensors;

analyzing the audio data to determine that two speakers are engaged in conversation, the two speakers comprises a first speaker and a second speaker;

obtaining directional information associated with the relative direction of the first speaker with respect to the second speaker;

analyzing the one or more images to identify a spatial orientation of at least one of a torso, a face and an eye of at least one of the two speakers;

using the obtained directional information and the identified spatial orientation to calculate a difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers to assess the spatial orientation according to the directional information, therefore obtaining spatial orientation assessment; and

providing information based on the calculated difference between the relative direction of the first speaker with respect to the second speaker and the identified spatial orientation of the at least one of a torso, a face and an eye of the at least one of the two speakers.