Granted Patent B1

US 12,450,802 · App. 18/465,565 · Granted Oct 21, 2025

Inventors: Vijay Jayaram Rao (Sunnyvale, CA); David Patrick Vronay (Danville, CA)

Assignee: Zoom Communications, Inc.

G06T11/60G06F40/169G06F40/186G06F40/30

Abstract

Claims (49)

1. A method, comprising:

adding user-generated graphical elements to a whiteboard;

generating a textual document that describes graphical elements of the whiteboard, including the user-generated graphical elements;

transmitting, to a language processing model, a content request comprising the textual document and a semantic description associated with the whiteboard;

receiving, from the language processing model, an updated textual document that includes graphical elements generated by the language processing model; and

rendering the updated textual document on the whiteboard.

2. The method of claim 1 , wherein transmitting the content request to the language processing model comprises:

retrieving the semantic description from a whiteboard template associated with the whiteboard for inclusion in the content request.

3. The method of claim 1 , wherein the content request further comprises graphical structural information specifying an arrangement of graphical elements in a whiteboard template associated with the whiteboard.

4. The method of claim 1 , further comprising:

presenting one or more queries associated with the whiteboard; and

formulating the content request in response to a selection of one of the one or more queries.

5. The method of claim 1 , further comprising:

receiving an open-ended query from a user of the whiteboard; and

formulating the content request based on the open-ended query.

6. The method of claim 1 , wherein the semantic description associated with the whiteboard comprises linguistic information describing an intended use of visual content within a whiteboard template associated with the whiteboard.

7. The method of claim 1 , wherein rendering the updated textual document in association with the whiteboard comprises:

highlighting, on the whiteboard, at least one of the graphical elements generated by the language processing model.

8. The method of claim 1 ,

wherein the updated textual document comprises an annotation to one of the user-generated graphical elements, and

wherein rendering the updated textual document in association with the whiteboard comprises:

highlighting the one of the user-generated graphical elements to indicate the annotation.

9. The method of claim 1 , wherein the user-generated graphical elements comprises at least one of a shape or text and properties defining an appearance of the shape or text.

10. A system, comprising:

one or more memories; and

one or more processors, the one or more processors configured to execute instructions stored in the one or more memories to:

add user-generated graphical elements to a whiteboard;

generate a textual document that describes graphical elements of the whiteboard, including the user-generated graphical elements;

transmit to a language processing model a content request comprising the textual document and a semantic description associated with the whiteboard;

receive, from the language processing model, an updated textual document that includes graphical elements generated by the language processing model; and

render the updated textual document on the whiteboard.

11. The system of claim 10 , wherein the semantic description is associated with a whiteboard template from which the whiteboard is instantiated.

12. The system of claim 10 , wherein the semantic description associated with the whiteboard comprises linguistic information describing an intended use of the whiteboard.

13. The system of claim 10 , wherein the language processing model is cloud-based.

14. The system of claim 10 , wherein the language processing model is integrated into a whiteboard software.

15. The system of claim 10 , wherein the language processing model is further configured to analyze the graphical elements and the semantic description to generate suggested content modifications, and wherein the suggested content modifications are included in the updated textual document.

16. A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:

adding user-generated graphical elements to a whiteboard;

generating a textual document that describes graphical elements of the whiteboard, including the user-generated graphical elements;

transmitting to a language processing model a content request comprising the textual document and a semantic description associated with the whiteboard;

receiving, from the language processing model, an updated textual document that includes graphical elements generated by the language processing model; and

rendering the updated textual document on the whiteboard.

17. The non-transitory computer readable medium of claim 16 , wherein the operations further comprise:

formulating the content request based on an open-ended query received from a user of the whiteboard.

18. The non-transitory computer readable medium of claim 16 , wherein the operations further comprise:

formulating the content request in response to a selection of a user prompt selected from a set of user prompts.

19. The non-transitory computer readable medium of claim 16 , wherein the content request comprises instructions to the language processing model to highlight graphical elements added by the language processing model in the update textual document.

20. The non-transitory computer readable medium of claim 16 , wherein the instructions further comprise:

receiving a command to accept one of graphical elements generated by the language processing model.

Assignments (2)

References Cited (35)