Conversational user interfaces with multimodal inputs and mind map like interactions

1 . A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:

displaying, on a display in communication with the data processing hardware, a user interface for a chat session between a user and a chatbot, the user interface comprising a plurality of entries sequentially input by the user and a plurality of corresponding responses from the chatbot, wherein the plurality of entries and the plurality of corresponding response are displayed together in the user interface;

receiving, in the user interface, a user input indication indicating selection of a selected entry of the plurality of entries, the selected entry being other than a last entry of the plurality of entries sequentially input by the user;

in response to the user input indication indicating selection of the selected entry, displaying, in the user interface, an additional text entry box to allow the user to input an additional entry related to the selected entry, the additional text entry box and the selected entry displayed together in the user interface;

receiving, as input by the user into the additional text entry box displayed in the user interface together with the selected entry, the additional entry related to the selected entry; and

based on the additional entry related to the selected entry and input by the user into the additional text entry box displayed in the user interface, causing the chatbot to update the response of the plurality of corresponding responses displayed in the user interface that corresponds to the selected entry without updating a last response of the plurality of corresponding responses, the last response of the plurality of corresponding responses displayed in the user interface corresponding to the last entry of the plurality of entries sequentially input by the user,

wherein the selected entry, the additional text entry box including the additional entry related to the selected entry, the updated response corresponding to the selected entry, the last entry, and the last response corresponding to the last entry are displayed together in the user interface.

2 . The computer-implemented method of claim 1 , wherein the response that corresponds to the selected entry updated by the chatbot is other than the last response of the plurality of corresponding responses.

3 . The computer-implemented method of claim 1 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry results in a non-linear chat session.

4 . The computer-implemented method of claim 1 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry results in an unstructured chat session.

5 . The computer-implemented method of claim 1 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry results in a mind map comprising an unstructured collection of interconnected ideas.

6 . The computer-implemented method of claim 1 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry associates the additional entry with the selected entry in a hierarchical association of ideas.

7 . The computer-implemented method of claim 1 , wherein:

the selected entry of the plurality of entries was input by the user using a first input modality; and

the additional entry input by the user for the additional entry is input by the user using a second input modality different than the first input modality.

8 . The computer-implemented method of claim 7 , wherein:

the first input modality comprises one of text or speech; and

the second input modality comprises the other one of text or speech.

9 . The computer-implemented method of claim 1 , wherein the operations further comprise displaying, on the display, a collapsed representation of the selected entry and the additional entry.

10 . The computer-implemented method of claim 1 , wherein the operations further comprise:

receiving, in the user interface, from a second user associated with the chat session, another user input indication indicating selection of another selected entry of the plurality of entries, the another selected entry being other than the last entry of the plurality of entries sequentially input by the user;

receiving, in the user interface, a second additional entry input by the second user for another additional entry to be associated with the another selected entry;

associating the another additional entry with the another selected entry in the chat session; and

based on the another additional entry associated with the another selected entry, causing the chatbot to update one or more of the plurality of corresponding responses from the chatbot without updating the last response of the plurality of corresponding responses.

11 . A system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

displaying, on a display in communication with the data processing hardware, a user interface for a chat session between a user and a chatbot, the user interface comprising a plurality of entries sequentially input by the user and a plurality of corresponding responses from the chatbot, wherein the plurality of entries and the plurality of corresponding response are displayed together in the user interface;

receiving, in the user interface, a user input indication indicating selection of a selected entry of the plurality of entries, the selected entry being other than a last entry of the plurality of entries sequentially input by the user;

in response to the user input indication indicating selection of the selected entry, displaying, in the user interface, an additional text entry box to allow the user to input an additional entry related to the selected entry, the additional text entry box and the selected entry displayed together in the user interface;

receiving, as input by the user into the additional text entry box displayed in the user interface together with the selected entry, the additional entry related to the selected entry; and

based on the additional entry related to the selected entry and input by the user into the additional text entry box displayed in the user interface, causing the chatbot to update the response of the plurality of corresponding responses displayed in the user interface that corresponds to the selected entry without updating a last response of the plurality of corresponding responses, the last response of the plurality of corresponding responses displayed in the user interface corresponding to the last entry of the plurality of entries sequentially input by the user,

wherein the selected entry, the additional text entry box including the additional entry related to the selected entry, the updated response corresponding to the selected entry, the last entry, and the last response corresponding to the last entry are displayed together in the user interface.

12 . The system of claim 11 , wherein the response that corresponds to the selected entry updated by the chatbot is other than the last response of the plurality of corresponding responses.

13 . The system of claim 11 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry results in a non-linear chat session.

14 . The system of claim 11 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry results in an unstructured chat session.

15 . The system of claim 11 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry results in a mind map comprising an unstructured collection of interconnected ideas.

16 . The system of claim 11 , wherein receiving the additional entry input by the user for the additional entry associated with the selected entry associates the additional entry with the selected entry in a hierarchical association of ideas.

17 . The system of claim 11 , wherein:

the selected entry of the plurality of entries was input by the user using a first input modality; and

the additional entry input by the user for the additional entry is input by the user using a second input modality different than the first input modality.

18 . The system of claim 17 , wherein:

the first input modality comprises one of text or speech; and

the second input modality comprises the other one of text or speech.

19 . The system of claim 11 , wherein the operations further comprise displaying, on the display, a collapsed representation of the selected entry and the additional entry.

20 . The system of claim 11 , wherein the operations further comprise:

receiving, in the user interface, from a second user associated with the chat session, another user input indication indicating selection of another selected entry of the plurality of entries, the another selected entry being other than the last entry of the plurality of entries sequentially input by the user;

receiving, in the user interface, a second additional entry input by the second user for another additional entry to be associated with the another selected entry;

associating the another additional entry with the another selected entry in the chat session; and

based on the another additional entry associated with the another selected entry, causing the chatbot to update one or more of the plurality of corresponding responses from the chatbot without updating the last response of the plurality of corresponding responses.