IP Library Granted Patent US 12,407,538
Granted Patent B2
US 12,407,538 · App. 18/471,918 · Granted Sep 2, 2025

Independently configurable annotation layers

Inventor: Shane Paul Springer (Oregon City, OR)
Assignee: Zoom Communications, Inc.
H04L12/1822H04L65/4015H04L65/403H04N7/147H04N7/152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,538
App. No.
18/471,918
Granted
Sep 2, 2025
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing multi-point video presentations with live annotations within a communication platform. First, the system receives video feeds depicting imagery of a number of users. The system then determines a boundary about each user in the video feeds, with the boundaries each having an interior portion and an exterior portion. The system provides a media background for the exterior portions, then generates a composite video for each of the feeds. The system then determines that one or more client devices have annotation permissions, and receives one or more annotation inputs corresponding to at least one of the composite videos. Finally, the system updates at least one of the composite videos to additionally depict the annotation inputs within a third layer.

Claims (42)

1. A method, comprising:

receiving a video feed within a video session on a communication platform;

determining a boundary associated with a first user in the video feed, wherein the boundary has an interior portion and an exterior portion, wherein the interior portion includes the first user;

generating a composite video comprising the interior portion as a first layer, a media background as a second layer, and annotation inputs as a third layer;

independently adjusting a video quality of each of the first layer, the second layer, and the third layer based on a detected network bandwidth of each client device of one or more client devices; and

causing the composite video to be displayed at the one or more client devices, wherein each client device is configured to adjust which layers of the composite video are displayed at that client device.

2. The method of claim 1 , further comprising:

causing the media background to be displayed at the one or more client devices in front of the exterior portion and behind the first user.

3. The method of claim 1 , wherein a host of the video session is enabled to override independent layer adjustments of each client device.

4. The method of claim 1 , further comprising:

causing the annotation inputs to be displayed at the one or more client devices in front of the media background but not in front of the interior portion.

5. The method of claim 1 , wherein a host of the video session is enabled to remove annotation inputs corresponding to one user device from the composite video.

6. The method of claim 1 , wherein the media background comprises a first media background received from a first user device and a second media background received from a second user device.

7. The method of claim 6 , wherein a host of the video session is enabled to provide annotations over both the first media background and the second media background, and wherein the host is enabled to independently adjust annotation privileges over the first media background and annotation privileges over the second media background.

8. The method of claim 6 , wherein the interior portion comprises a second user, wherein the first media background overlays the exterior portion about the first user, and wherein the second media background overlays the exterior portion about the second user.

9. The method of claim 1 , wherein each client device is configured to independently adjust a transparency of the annotation inputs being displayed.

10. The method of claim 1 , further comprising:

receiving a request to remove the first user from the composite video; and

removing the first user from the composite video.

11. The method of claim 10 , wherein the request is received by a host of the video session.

12. The method of claim 10 , wherein the request is received from the first user.

13. The method of claim 10 , wherein the request is received from a non-presenting participant.

14. The method of claim 1 , further comprising:

generating a dynamic recording comprising the composite video, wherein each layer of the composite video is independently configurable during playback of the dynamic recording.

15. An apparatus, comprising:

a memory; and

a processor configured to execute instructions stored in the memory to:

receive a video feed within a video session on a communication platform;

determine a boundary associated with a first user in the video feed, wherein the boundary has an interior portion and an exterior portion, wherein the interior portion includes the first user;

generate a composite video comprising the interior portion as a first layer, a media background as a second layer, and annotation inputs as a third layer;

independently adjust a video quality of each of the first layer, the second layer, and the third layer based on a detected network bandwidth of each client device of one or more client devices; and

causing the composite video to be displayed at the one or more client devices, wherein each client device is configured to adjust which layers of the composite video are displayed at that client device.

16. The apparatus of claim 15 , wherein the instructions are further executable to generate a dynamic recording comprising the composite video, wherein each layer of the composite video is configurable during playback of the dynamic recording.

17. The apparatus of claim 15 , wherein a host is enabled to independently adjust annotation privileges over a first media background and annotation privileges over a second media background.

18. A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:

receiving a video feed within a video session on a communication platform;

determining a boundary associated with a first user in the video feed, wherein the boundary has an interior portion and an exterior portion, wherein the interior portion includes the first user;

generating a composite video comprising the interior portion as a first layer, a media background as a second layer, and annotation inputs as a third layer;

independently adjusting a video quality of each of the first layer, the second layer, and the third layer based on a detected network bandwidth of each client device of one or more client devices; and

causing the composite video to be displayed at the one or more client devices, wherein each client device is configured to adjust which layers of the composite video are displayed at that client device.

19. The non-transitory computer readable medium of claim 18 , wherein a host of the video session is enabled to remove annotation inputs corresponding to each user device from the composite video.

20. The non-transitory computer readable medium of claim 18 , wherein the media background comprises a first media background received from a first user device and a second media background received from a second user device.

Assignments (3)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: SPRINGER, SHANE
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 065508/0678 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2023
From: SPRINGER, SHANE PAUL
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 064987/0587 →
Continuity (3)
Continuation 17562264 · Dec 27, 2021
Continuation 17163444 · Jan 30, 2021
Related Publication 20240015042A1 · Jan 11, 2024
References Cited (33)
US 8380866B2 · Savitzky et al. · 2013 [cited by applicant]
US 8639032B1 · Voorhees · 2014 [cited by examiner]
US 10880496B1 · Voss et al. · 2020 [cited by applicant]
US 10986311B1 · Noland · 2021 [cited by examiner]
US 11134217B1 · Goel · 2021 [cited by applicant]
US 11265181B1 · Springer · 2022 [cited by applicant]
US 11743417B2 · Springer · 2023 [cited by examiner]
US 11799677B2 · Springer · 2023 [cited by examiner]
US 20080077953A1 · Fernandez · 2008 [cited by examiner]
US 20080091778A1 · Ivashin et al. · 2008 [cited by applicant]
US 20100037151A1 · Ackerman et al. · 2010 [cited by applicant]
US 20120092435A1 · Wohlert · 2012 [cited by applicant]
US 20130339847A1 · Bartek et al. · 2013 [cited by applicant]
US 20140178050A1 · St. Clair · 2014 [cited by examiner]
US 20160072862A1 · Bader-Natal et al. · 2016 [cited by applicant]
US 20160072863A1 · Wu et al. · 2016 [cited by applicant]
US 20160291814A1 · Pigat et al. · 2016 [cited by applicant]
US 20160353057A1 · Chung et al. · 2016 [cited by applicant]
US 20170039867A1 · Fieldman · 2017 [cited by applicant]
US 20170118271A1 · Reyes · 2017 [cited by examiner]
US 20180011627A1 · Siracusano, Jr. · 2018 [cited by applicant]
US 20180376104A1 · Li · 2018 [cited by applicant]
US 20190147402A1 · Sitrick et al. · 2019 [cited by applicant]
US 20190260966A1 · Leatherman, III · 2019 [cited by applicant]
US 20200273359A1 · Stetson · 2020 [cited by applicant]
US 20220109810A1 · Kancharlawar · 2022 [cited by examiner]
US 20220239847A1 · Swierk · 2022 [cited by examiner]
JP 3846666B2 · 2006 [cited by examiner]
“Annotate Your shared Files As You Discuss Them”, Kaltura Knowledge Center (Year: 2020). [cited by applicant]
Bonnie, “Draw annotation on Twillio video Chat” , Stack Overflow (Year: 2016). [cited by applicant]
“Zoom Screensharing: how to share content”, Securevideo.com (Year: 2016). [cited by applicant]
International Search Report in PCT International Application No. PCT/US2021/064240, mailed Apr. 11, 2022. [cited by applicant]
Lienhard et al., “Multi-Layer Recording as a New Concept of Combining Lecture Recording and Students' Handwritten notes”, ACM (Year: 2002). [cited by applicant]