Augmenting shared digital content with dynamically generated digital content to improve meetings with multiple displays
The present disclosure relates to systems, methods, and computer-readable media for utilizing a presentation enhancement system to provide enhancements for hybrid meetings (e.g., meetings where shared content is provided to multiple displays). For example, the presentation enhancement system generates dynamic digital content in response to detecting physical interactions of a presenting user with shared digital content on a display device. Further, the presentation enhancement system augments the shared digital content provided to a remote display device with the dynamic digital content. In addition to providing augmented shared digital content to remote display devices, the presentation enhancement system can perform several additional actions on the shared digital content based on the detected physical interactions.
1 . A computer-implemented method comprising:
providing a first piece of digital content for display on a first display device within a first physical area;
detecting, by a capture device, a user interaction that creates non-digital content on a physical surface in a second physical area, wherein the second physical area is distinct from the first physical area, wherein the non-digital content includes handwritten text, shapes, or lines;
generating a second piece of digital content of the non-digital content detected from the user interaction with the physical surface in the second physical area; and
providing the second piece of digital content for display on the first display device within the first physical area.
2 . The computer-implemented method of claim 1 , wherein generating the second piece of digital content comprises generating a digital version of non-digital content captured from the physical surface in the second physical area.
3 . The computer-implemented method of claim 2 , further comprising updating the second piece of digital content in real-time based on detecting additional user interactions modifying the non-digital content on the physical surface in the second physical area.
4 . The computer-implemented method of claim 1 , wherein the user interaction is a non-digital physical interaction that occurs separately from components of the first display device.
5 . The computer-implemented method of claim 1 , wherein the first physical area is located adjacent to the second physical area.
6 . The computer-implemented method of claim 1 , wherein the capture device detects the user interaction with the physical surface in the second physical area by tracking a presenting user moving from the first physical area to the second physical area.
7 . The computer-implemented method of claim 1 , wherein:
the physical surface is a writing board; and
the writing board is a whiteboard, a chalkboard, or paper.
8 . The computer-implemented method of claim 7 , wherein detecting the user interaction includes:
detecting a user picking up a writing object; and
detecting the user writing on the writing board with the writing object.
9 . The computer-implemented method of claim 1 , further comprising sharing the first piece and the second piece of digital content with a second display device at a remote location as part of a hybrid video meeting.
10 . The computer-implemented method of claim 9 , wherein a viewing user at the remote location is unable to view the physical surface in the second physical area.
11 . The computer-implemented method of claim 1 , further comprising using a projector device as the first display device to project images of the first piece of digital content and the second piece of digital content on a projection surface in the first physical area.
12 . The computer-implemented method of claim 11 , wherein the capture device is associated with the first display device and the first physical area.
13 . The computer-implemented method of claim 1 , wherein providing the second piece of digital content for display on the first display device includes replacing the first piece of digital content.
14 . The computer-implemented method of claim 1 , wherein providing the second piece of digital content for display on the first display device includes displaying the first piece of digital content and the second piece of digital content together.
15 . A system comprising:
a processor; and
a computer memory comprising instructions that, when executed by the processor, cause the system to carry out operations comprising:
providing a first piece of digital content for display on a first display device within a first physical area;
detecting, by a capture device, a user interaction that creates non-digital content on a physical surface in a second physical area, wherein the second physical area is distinct from the first physical area, wherein the non-digital content includes handwritten text, shapes, or lines;
generating a second piece of digital content of the non-digital content detected from the user interaction with the physical surface in the second physical area; and
providing the second piece of digital content for display on the first display device within the first physical area.
16 . The system of claim 15 , further comprising instructions that, when executed by the processor, cause the system to carry out operations comprising generating a digital version of non-digital content captured from the physical surface in the second physical area.
17 . The system of claim 15 wherein detecting the user interaction includes detecting a user writing on the physical surface in the second physical area with a writing object to generate the non-digital content.
18 . The system of claim 15 , further comprising instructions that, when executed by the processor, cause the system to carry out operations comprising sharing the first piece and the second piece of digital content with a second display device at a remote location as part of a hybrid video meeting.
19 . A computer-implemented method comprising:
providing a first piece of digital content to a projector, wherein the projector projects the first piece of digital content as a projected image on a wall or projection screen in a first physical area;
detecting, by a camera of a capture device that captures an image of at least a portion of a user, a user interaction that creates non-digital content on a physical surface in a second physical area, wherein the second physical area is distinct from the first physical area, wherein the non-digital content includes handwritten text, shapes, or lines;
generating a second piece of digital content based on the non-digital content detected on the physical surface in the second physical area; and
providing the second piece of digital content to the projector for display as the projected image on the wall or projection screen in the first physical area.
20 . The computer-implemented method of claim 19 , wherein generating the second piece of digital content comprises generating a digital version of non-digital content captured from the physical surface in the second physical area.