Generative artificial intelligence email client with sender centric capabilities in an immersive environment

1 . A non-transitory, computer-readable storage medium storing instructions that, when executed by at least one data processor of a mixed reality system, cause the mixed reality system to:

cause display of multiple virtual elements of respective email messages in a mixed reality interface,

wherein each email message identifies a particular sender and is associated with data indicative of a particular relationship between the particular sender and a receiver of the email message;

determine, based on input of content of a first new inbound email message from a first sender into a generative artificial intelligence (AI) model, that a relationship between the first sender and the receiver is of a first type,

wherein the generative AI model is trained based on data specific to one or more senders and the data indicative of respective relationships between the one or more senders and the receiver;

in response to detection of a motion-based gesture relative to the mixed reality interface:

generate, by the generative AI model, a first custom response to the first new inbound email message,

wherein the first custom response is responsive to content of the first new inbound email message, and a relationship between the first sender and the receiver being of the first type;

cause display, in the mixed reality interface, of a first new virtual element for the first new inbound email message and the first generated custom response in the mixed reality interface;

determine, based on input of content of a second new inbound email message from a second sender into the generative AI model, that a relationship between the second sender and the receiver is of a second type different from the first type,

wherein a second custom response to the second inbound email message is generated responsive to the second new inbound email message and the relationship between the second sender and the receiver being of the second type; and

cause display, in the mixed reality interface, of a second new virtual element for the second new inbound email message and the second generated custom response in the mixed reality interface.

2 . The non-transitory, computer-readable storage medium of claim 1 , wherein the mixed reality system is further caused to:

cause display of the multiple virtual elements in the mixed reality interface to a user wearing a head-mounted display (HMD) device;

identify the user as the receiver of the first new inbound email message;

determine that the first sender is a first-time sender to the receiver;

define the first type of relationship between the first-time sender and the receiver as an unknown relationship,

wherein the first generated custom response is based on information provided by the first-time sender and the content of the first new inbound email message from the first-time sender; and

cause display of the first generated custom response at the HMD device.

3 . The non-transitory, computer-readable storage medium of claim 1 , wherein the mixed reality system is further caused to:

cause display of the multiple virtual elements in the mixed reality interface to a user wearing a head-mounted display (HMD) device;

identify the user as the receiver of the first new inbound email message;

determine that the first sender is a known sender to the receiver;

determine the first type of relationship between the known sender and the receiver as a known relationship,

wherein the first custom response is generated based on previous email messages between the first sender and the receiver; and

cause display of the first generated custom response at the HMD device.

4 . The non-transitory, computer-readable storage medium of claim 1 , wherein the mixed reality system is further caused to:

in response to detection of a motion-based gesture to select a virtual element of a particular email message through the mixed reality interface:

generate, by the generative AI model, a summary of the particular email message; and

cause display of the summary of the particular email message to a user wearing a head-mounted display (HMD) device.

5 . The non-transitory, computer-readable storage medium of claim 4 , wherein the mixed reality system is further caused to:

generate a summary of a chain of email messages as an output of the generative AI model; and

cause display of the summary of the chain of email messages to a user wearing a head-mounted display (HMD) device.

6 . The non-transitory, computer-readable storage medium of claim 1 , wherein the mixed reality system is further caused to:

generate, by the generative AI model, a common mixed reality display for all email messages received from a specific sender,

wherein the common mixed reality display is customizable by the receiver and independent of content of a particular email message of all the email messages received from the specific sender.

7 . The non-transitory, computer-readable storage medium of claim 1 , wherein the mixed reality system is further caused to:

create a sender profile for a specific sender, the sender profile being customizable by the specific sender or the receiver,

wherein the sender profile includes data specific to the specific sender and data used to determine a relationship between the specific sender and the receiver, and

wherein the sender profile is input to the generative AI model to generate custom responses to email messages from the specific sender.

8 . The non-transitory, computer-readable storage medium of claim 1 , wherein the mixed reality system is further caused to:

cause display of a generated custom response as an editable custom response in the mixed reality interface,

wherein the editable custom response includes a combination of editable elements,

in response to detection of a motion-based gesture to select an editable element of the editable custom response;

animate, through the mixed reality interface, a change to the editable custom response; and

cause display, on the mixed reality interface, of an edited version of the editable custom response.

9 . The non-transitory, computer-readable storage medium of claim 8 , wherein the mixed reality system is further caused to:

store data associated with edits made to the editable custom response; and

retrain the generative AI model with the data associated with the edits made by to the editable custom response.

10 . A mixed reality system comprising:

a head-mounted display (HMD) device;

a data processor; and

a memory storing instructions that, when executed by the data processor, cause the mixed reality system to:

cause the HMD device to render a mixed reality interface including multiple virtual elements of respective email messages, each email message containing data that identifies a particular sender of the email message and being associated with data used to determine a particular relationship between the particular sender and a receiver of the email message;

in response to detection of a motion-based gesture of a user wearing the HMD device, generate, by a generative artificial intelligence (AI) model, a first custom response to a first new inbound email message,

wherein the first custom response is responsive to content of the first new inbound email message and a first type of relationship between the first sender and the receiver, and

wherein a second custom response is generated responsive to content of a second new email message and a second type of relationship between a second sender and the receiver, the second type of relationship being different from the first type of relationship; and

cause display of the first generated custom response and of the second generated custom response to the user of the HMD device.

11 . The mixed reality system of claim 10 further caused to:

identify the user wearing the HMD device as the receiver of the first new inbound email message;

identify the first sender as a first-time sender to the receiver; and

define the first type of relationship between the first-time sender and the receiver as an unknown relationship,

wherein the first generated custom response is based on information provided by the first-time sender and the content of the email message from the first-time sender.

12 . The mixed reality system of claim 10 further caused to:

identify the user wearing the HMD device as the receiver of the first new inbound email message;

identify the first sender as a known sender to the receiver;

determine the first type of relationship between the known sender and the receiver as a known relationship; and

generate the first custom response based on content of previous email messages communicated between the known sender and the receiver.

13 . The mixed reality system of claim 10 further caused to:

generate a summary of a particular email message from the multiple email messages; and

cause display of the summary of the particular email message at the HMD device.

14 . The mixed reality system of claim 10 further caused to:

generate a summary of a chain of email messages as an output of the generative AI model; and

cause a mixed reality display of the summary of the chain of email messages at the HMD device.

15 . The mixed reality system of claim 10 further caused to:

customize all email messages from a specific sender in a common format designated for the specific sender,

wherein the customization is independent of content of the email message.

16 . The mixed reality system of claim 10 further caused to:

create a sender profile for a specific sender, the sender profile being customizable by the specific sender or the receiver,

wherein the sender profile includes data specific to the specific sender and data used to determine a relationship between the specific sender and the receiver, and

wherein the data included in the sender profile is used as input to the generative AI model to generate custom responses to the specific sender.

17 . A method comprising:

causing display of multiple virtual elements of respective email messages in a mixed reality interface,

wherein each email message identifies a particular sender and is associated with data indicative of a relationship between the particular sender and a receiver of the email message;

inputting content of an inbound email message into a generative artificial intelligence (AI) model that is trained based on one or more senders and respective relationships between senders and the receiver;

detecting a motion-based gesture relative to the mixed reality interface;

in response to detection of the motion-based gesture, generating, by the generative AI model, a first custom response to the first inbound email message,

wherein the first custom response is specific to content of the first inbound email message and a first type of relationship between the first sender and the receiver,

wherein a second custom response is generated responsive to content of a second inbound email message and a second type of relationship between a second sender and the receiver, the second type of relationship being different from the first type of relationship; and

causing display of the first and second generated custom responses in the mixed reality interface.

18 . The method of claim 17 further comprising:

causing display of the first generated custom response on the display of a head mounted display (HMD) device upon access of the first inbound email message,

wherein the first generated custom response is presented with editable components that allow for editing the first generated custom response.

19 . The method of claim 17 , wherein generating the custom response to the first inbound email message further comprises:

querying previously received email messages for content related to the first inbound email message; and

including the related content in the first custom response to the first inbound email message.

20 . The method of claim 17 , wherein the method is performed by a virtual reality system, the method further comprising:

communicatively coupling to a head-mounted display (HMD) device that displays the mixed reality interface; and

detecting motion-based gestures relative to the mixed reality interface.

21 . A mixed reality system comprising:

a head-mounted display (HMD) device;

a data processor; and

a memory storing instructions that, when executed by the data processor, cause the mixed reality system to:

cause the HMD device to render a mixed reality interface including multiple virtual elements of respective messages, each message containing data that identifies a specific sender of the message and being associated with data used to determine a specific relationship between the specific sender and a receiver of the message,

wherein the mixed reality interface is superimposed on the user's surrounding real-world environment;

in response to detection of a user action of a user wearing the HMD device, generate, by a generative artificial intelligence (AI) model, a first custom response to a first new inbound message,

wherein the first custom response is responsive to content of the first new inbound message and a relationship between the first sender and the receiver being of a first type, and

wherein a second custom response is responsive to content of a second new inbound message and a relationship between a second sender and the receiver being of a second type different from the first type; and

cause display of the first and second generated custom responses.

22 . The mixed reality system of claim 21 , wherein the user's surrounding real-world environment is captured by an externally facing camera configured on the HMD device.

23 . The mixed reality system of claim 21 , wherein the user action includes an eye movement of the user, wherein the HMD device is further configured to:

detect the eye movement of the user with a camera configured with the HMD device to capture movement of the user's pupils.

24 . The mixed reality system of claim 21 , wherein the user action includes a voice command by the user, wherein the HMD device is further configured to:

detect the user's voice command with a microphone configured with the HMD device to capture audio within a threshold proximity.

25 . The mixed reality system of claim 21 , wherein the user action includes a motion-based gesture of the user, wherein the HMD device is further configured to:

detect the motion-based gesture of the user with at least one of a camera and a sensor configured with the HMD device.