Private real-time communication between meeting attendees during a meeting using one or more augmented reality headsets
Private real-time communications are provided between meeting attendees during a meeting using one or more augmented reality headsets. An augmented reality headset worn by a sending meeting attendee continuously monitors a current direction of the sending meeting attendee's gaze during the meeting, and detects that the sending meeting attendee has selected a receiving meeting attendee when the current direction of the sending attendee's gaze intersects with a location of the receiving meeting attendee. The augmented reality headset worn by the sending meeting attendee also receives a messaging command issued by the sending meeting attendee, also based on monitoring the sending meeting attendee's gaze during the meeting. In response to the messaging command, the augmented reality headset worn by the sending meeting attendee automatically transmits the private message to a device associated with the receiving meeting attendee, such as an augmented reality headset worn by the receiving meeting attendee.
1. A method of providing private real-time communications between meeting attendees during a meeting, the method comprising:
in an augmented reality headset worn by a sending meeting attendee
calculating a three dimensional location of each one of other meeting attendees,
generating an invisible boundary box surrounding each one of the three dimensional locations of each one of the other meeting attendees,
continuously monitoring a current direction of the sending meeting attendee's gaze during the meeting,
automatically detecting, responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, selection of at least one receiving meeting attendee from a plurality of meeting attendees other than the sending meeting attendee, wherein detecting selection of the receiving meeting attendee includes detecting that the current direction of the sending attendee's gaze intersects with a location of the receiving meeting attendee, wherein detecting that the current direction of the sending meeting attendee's gaze intersects with the location of the receiving meeting attendee includes detecting that the current direction of the sending meeting attendee's gaze intersects with an invisible boundary box that surrounds the three dimensional location of the receiving meeting attendee,
after detecting selection of the receiving meeting attendee, and also responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, receiving a messaging command issued by the sending meeting attendee, and
automatically transmitting a private message from the augmented reality headset worn by the sending meeting attendee to a device associated with the receiving meeting attendee in response to receiving the messaging command.
2. The method claim 1 , further comprising:
capturing a plurality of facial images via the augmented reality headset worn by the sending meeting attendee;
performing a set of facial recognition operations to associate an attendee identity with each one of the facial images captured via the augmented reality headset worn by the sending meeting attendee; and
in a current view of the meeting provided to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, displaying each one of the attendee identities in close visual proximity to the associated facial image.
3. The method of claim 1 , wherein receiving the messaging command issued by the sending meeting attendee to the augmented reality headset worn by the sending meeting attendee includes detecting, as the messaging command, and also responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, that the direction of the meeting attendee's gaze has continuously intersected with the location of the receiving meeting attendee for at least a predefined amount of time; and
wherein automatically transmitting the private message from the augmented reality headset worn by the sending meeting attendee to the device associated with the receiving meeting attendee includes transmitting a default private message in response to detecting that the direction of the sending meeting attendee's gaze has continuously intersected with the location of the receiving meeting attendee for at least the predefined amount of time.
4. The method of claim 2 , wherein receiving the messaging command issued by the sending meeting attendee to the augmented reality headset worn by the sending meeting attendee includes i) displaying, to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, within the current view of the meeting provided to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, a list of predefined messages, and ii) detecting, responsive to monitoring the current direction of the sending meeting attendee's gaze during the meeting, selection by the sending meeting attendee of a predefined message from within the list of predefined messages, by detecting that the current direction of the sending meeting attendee's gaze has intersected with the predefined message displayed within the list of the predefined messages; and
wherein automatically transmitting the private message from the augmented reality headset worn by the sending meeting attendee to the device associated with the receiving meeting attendee includes transmitting the predefined message selected by the sending meeting attendee from within the list of predefined messages to the device associated with the receiving meeting attendee.
5. The method of claim 4 , wherein the device associated with the receiving meeting attendee comprises an augmented reality headset worn by the receiving meeting attendee, the method further comprising:
in the augmented reality headset worn by the receiving attendee
responsive to receipt of the private message, detecting whether the sending meeting attendee is within a current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, and
in response to detecting that the sending meeting attendee is within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, displaying the private message in close visual proximity to the sending meeting attendee within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee.
6. The method of claim 4 , wherein the device associated with the receiving meeting attendee comprises an augmented reality headset worn by the receiving meeting attendee, the method further comprising:
in the augmented reality headset worn by the receiving meeting attendee
responsive to receipt of the private message, detecting whether the sending meeting attendee is within a current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, and
in response to detecting that the sending meeting attendee is not within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, displaying the private message in a pop-up message display object within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, wherein the pop-up message includes both the private message and an identifier of the sending meeting attendee.
7. The method of claim 2 , wherein performing the set of facial recognition operations includes retrieving a network address of the device associated with the receiving meeting attendee; and
wherein automatically transmitting the private message from the augmented reality headset worn by the sending meeting attendee to the device associated with the receiving meeting attendee includes transmitting the private message to the network address of the device associated with the receiving meeting attendee.
8. The method of claim 1 , further comprising:
displaying, by the augmented reality headset worn by the sending meeting attendee, within a current view of the meeting provided to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, a display object associated with a group of meeting attendees;
wherein detecting selection of at least one receiving meeting attendee comprises detecting selection of the display object associated with the group of meeting attendees, wherein detecting selection of the display object associated with the group of meeting attendees includes detecting that the current direction of the sending attendee's gaze intersects with the display object associated with the group of meeting attendees; and
transmitting the private message from the augmented reality headset worn by the sending meeting attendee to each device associated with a respective one of the meeting attendees in the group of meeting attendees.
9. The method of claim 1 , further comprising:
storing the invisible boundary boxes surrounding the three dimensional locations of the other meeting attendees as part of a polygonal mesh generated by the augmented reality headset to represent a real world of the meeting.
10. The method of claim 9 , wherein the polygonal mesh generated by the augmented reality headset also represents at least one user interface display object that is overlaid on top of the real world.
11. A system for providing private real-time communication between meeting attendees during a meeting, comprising:
an augmented reality headset worn by a sending meeting attendee and including at least one processor and memory, wherein the augmented reality headset worn by the sending meeting attendee is configured to
calculate a three dimensional location of each one of the other meeting attendees,
generate an invisible boundary box surrounding each one of the three dimensional locations of each one of the other meeting attendees,
continuously monitor a current direction of the sending meeting attendee's gaze during the meeting,
automatically detect, responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, selection of at least one receiving meeting attendee from a plurality of meeting attendees other than the sending meeting attendee, wherein detecting selection of the receiving meeting attendee includes detecting that the current direction of the sending attendee's gaze intersects with a location of the receiving meeting attendee, wherein the augmented reality headset detects that the current direction of the sending meeting attendee's gaze intersects with the location of the receiving meeting attendee at least in part by detecting that the current direction of the sending meeting attendee's gaze intersects with an invisible boundary box that surrounds the three dimensional location of the receiving meeting attendee,
after selection of the receiving meeting attendee has been detected, and also responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, receive a messaging command issued by the sending meeting attendee, and
automatically transmit a private message from the augmented reality headset to a device associated with the receiving meeting attendee in response to receiving the messaging command.
12. The system of claim 11 , wherein the augmented reality headset worn by the sending meeting attendee is further configured to:
capture a plurality of facial images via the augmented reality headset worn by the sending meeting attendee;
perform a set of facial recognition operations to associate an attendee identity with each one of the facial images captured via the augmented reality headset worn by the sending meeting attendee; and
in a current view of the meeting provided to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, display each one of the attendee identities in close visual proximity to the associated facial image.
13. The system of claim 11 , wherein the augmented reality headset worn by the sending meeting attendee receives the messaging command issued by the sending meeting attendee at least in part by detecting, as the messaging command, and also responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, that the direction of the meeting attendee's gaze has continuously intersected with the location of the receiving meeting attendee for at least a predefined amount of time; and
wherein the augmented reality headset worn by the sending meeting attendee is further configured to automatically transmit the private message to the device associated with the receiving meeting attendee at least in part by transmitting a default private message in response to detecting that the direction of the sending meeting attendee's gaze has continuously intersected with the location of the receiving meeting attendee for at least the predefined amount of time.
14. The system of claim 12 , wherein the augmented reality headset worn by the sending meeting attendee receives the messaging command issued by the sending meeting attendee at least in part by i) displaying, to the sending meeting attendee, within the current view of the meeting provided to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, a list of predefined messages, and ii) detecting, responsive to monitoring the current direction of the sending meeting attendee's gaze during the meeting, selection by the sending meeting attendee of a predefined message from within the list of predefined messages, by detecting that the current direction of the sending meeting attendee's gaze has intersected with the predefined message displayed within the list of the predefined messages; and
wherein the augmented reality headset worn by the sending meeting attendee is further configured to automatically transmit the private message to the device associated with the receiving meeting attendee at least in part by transmitting the predefined message selected by the sending meeting attendee from within the list of predefined messages to the device associated with the receiving meeting attendee.
15. The system of claim 14 , further comprising:
an augmented reality headset worn by the receiving meeting attendee and having at least one processor and memory, wherein the device associated with the receiving meeting attendee comprises the augmented reality headset worn by the receiving meeting attendee, and wherein the augmented reality device worn by the receiving meeting attendee is configured to
responsive to receipt of the private message, detect whether the sending meeting attendee is within a current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, and
in response to detecting that the sending meeting attendee is within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, display the private message in close visual proximity to the sending meeting attendee within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee.
16. The system of claim 14 , further comprising:
an augmented reality headset worn by the receiving meeting attendee and having at least one processor and memory, wherein the device associated with the receiving meeting attendee comprises the augmented reality headset worn by the receiving meeting attendee, and wherein the augmented reality device worn by the receiving meeting attendee is configured to
responsive to receipt of the private message, detect whether the sending meeting attendee is within a current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, and
in response to detecting that the sending meeting attendee is not within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, display the private message in a pop-up message display object within the current view of the meeting provided to the receiving meeting attendee by the augmented reality headset worn by the receiving meeting attendee, wherein the pop-up message includes both the private message and an identifier of the sending meeting attendee.
17. The system of claim 12 , wherein the augmented reality headset worn by the sending meeting attendee is further configured to perform the set of facial recognition operations at least in part by retrieving a network address of the device associated with the receiving meeting attendee; and
wherein the augmented reality headset worn by the sending meeting attendee is further configured to automatically transmit the private message to the device associated with the receiving meeting attendee at least in part by transmitting the private message to the network address of the device associated with the receiving meeting attendee.
18. The system of claim 11 , further comprising:
wherein the augmented reality headset worn by the sending meeting attendee is further configured to display, within a current view of the meeting provided to the sending meeting attendee by the augmented reality headset worn by the sending meeting attendee, a display object associated with a group of meeting attendees;
wherein the augmented reality headset worn by the sending meeting attendee is further configured to detect selection of at least one receiving meeting attendee at least in part by detecting selection of the display object associated with the group of meeting attendees, wherein detecting selection of the display object associated with the group of meeting attendees includes detecting that the current direction of the sending attendee's gaze intersects with the display object associated with the group of meeting attendees; and
wherein the augmented reality headset worn by the sending meeting attendee is further configured to transmit the private message to each device associated with a respective one of the meeting attendees in the group of meeting attendees.
19. A computer program product having a non-transitory computer readable medium storing a set of instructions that when executed by a processor perform the steps of:
in an augmented reality headset worn by a sending meeting attendee
calculating a three dimensional location of each one of other meeting attendees,
generating an invisible boundary box surrounding each one of the three dimensional locations of each one of the other meeting attendees,
continuously monitoring a current direction of the sending meeting attendee's gaze during the meeting,
automatically detecting, responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, selection of at least one receiving meeting attendee from a plurality of meeting attendees other than the sending meeting attendee, wherein detecting selection of the receiving meeting attendee includes detecting that the current direction of the sending attendee's gaze intersects with a location of the receiving meeting attendee, wherein detecting that the current direction of the sending meeting attendee's gaze intersects with the location of the receiving meeting attendee includes detecting that the current direction of the sending meeting attendee's gaze intersects with an invisible boundary box that surrounds the three dimensional location of the receiving meeting attendee,
after detecting selection of the receiving meeting attendee, and also responsive to monitoring of the current direction of the sending meeting attendee's gaze during the meeting, receiving a messaging command issued by the sending meeting attendee, and
automatically transmitting a private message from the augmented reality headset worn by the sending meeting attendee to a device associated with the receiving meeting attendee in response to receiving the messaging command.