IP Library › Granted Patent US 12,081,899
Granted Patent B2
US 12,081,899 · App. 17/233,330 · Granted Sep 3, 2024

Immersive scenes

Inventors: Lin Han (Los Altos, CA); Nitasha Walia (Sunnyvale, CA)
Assignee: Zoom Video Communications, Inc.
H04N5/272H04N5/2621H04N5/2628H04N7/157
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,081,899
App. No.
17/233,330
Granted
Sep 3, 2024
Kind
B2
Abstract

One example system for displaying immersive scenes includes a processor and at least one memory device. The memory device includes instructions that are executable by the processor to cause the processor to receive a plurality of video streams associated with a video conference, each of the plurality of video streams having a removable background, receive a dynamic immersive background, receive an instruction, the instruction comprising a plurality of locations within the dynamic immersive background, and display an immersive scene including at least a subset of the plurality of video streams, wherein each video stream is displayed at one of the plurality of locations within the dynamic immersive background.

Claims (43)

1. A method comprising:

receiving at a client a plurality of video streams associated with a video conference, each of the plurality of video streams having a removable background;

receiving at the client a dynamic immersive background;

receiving at the client an instruction in the form of a data structure separate and distinct from the plurality of video streams, the instruction comprising a plurality of locations within the dynamic immersive background;

displaying a first portion of an immersive scene including at least a first subset of the plurality of video streams, wherein each video stream is displayed at one of the plurality of locations within the dynamic immersive background based at least in part on the instruction;

receiving a panning input to view a second portion of the immersive scene, the second portion including a second subset of the plurality of video streams, wherein the panning input causes the display to pan across the immersive scene between the first portion and the second portion;

displaying the second portion of the immersive scene; and

receiving an input at the client modifying the display of the immersive scene and modifying the instruction based at least in part on the input.

2. The method of claim 1 , wherein the dynamic immersive background is received from a participant of the video conference.

3. The method of claim 1 , further comprising creating the dynamic immersive background.

4. The method of claim 1 , further comprising moving at least one of the video streams from a first one of the plurality of locations to a second one of the plurality of locations.

5. The method of claim 1 , wherein each video stream is displayed at a first size and further comprising displaying the video stream at a second size.

6. The method of claim 1 , wherein the dynamic immersive background comprises a scene representing one of a classroom, a courtroom, or a digital office space.

7. The method of claim 1 , further comprising zooming the immersive scene.

8. The method of claim 1 , wherein the input comprises a command to move a first video stream of the plurality of video streams from a first location in the dynamic immersive background to a second location in the dynamic immersive background.

9. The method of claim 8 , wherein the data structure comprises an extensible Markup Language (“XML”) file.

10. A system comprising:

a processor; and

at least one memory device including instructions that are executable by the processor to cause the processor to:

receive, at a client, a plurality of video streams associated with a video conference, each of the plurality of video streams having a removable background;

receive, at the client, a dynamic immersive background;

receive, at the client, an instruction in the form of a data structure separate and distinct from the plurality of video streams, the instruction in the form of a data structure comprising a plurality of locations within the dynamic immersive background;

display, at the client, a first portion of an immersive scene including at least a first subset of the plurality of video streams, wherein each video stream is displayed at one of the plurality of locations within the dynamic immersive background based at least in part on the instruction;

receive a panning input to view a second portion of the immersive scene, the second portion including a second subset of the plurality of video streams, wherein the panning input causes the display to pan across the immersive scene between the first portion and the second portion;

display the second portion of the immersive scene; and

receive an input at the client modifying the display of the immersive scene and modifying the instruction based at least in part on the input.

11. The system of claim 10 , wherein the dynamic immersive background is received from a participant of the video conference.

12. The system of claim 10 , further comprising including instructions that are executable by the processor to cause the processor to create the dynamic immersive background.

13. The system of claim 10 , further comprising including instructions that are executable by the processor to cause the processor to move at least one of the video streams from a first one of the plurality of locations to a second one of the plurality of locations.

14. The system of claim 10 , wherein each video stream is displayed at a first size and further comprising displaying the video stream at a second size.

15. The system of claim 10 , wherein the dynamic immersive background comprises a scene representing one of a classroom, a courtroom, or a digital office space.

16. The system of claim 10 , further comprising including instructions that are executable by the processor to cause the processor to zoom the immersive scene.

17. A non-transitory computer-readable medium comprising code that is executable by a processor for causing the processor to:

receive at a client a first plurality of video streams associated with a video conference, each of the plurality of video streams having a removable background;

receive at the client a dynamic immersive background;

receive at the client an instruction in the form of a data structure separate and distinct from the plurality of video streams, the instruction comprising a plurality of locations within the dynamic immersive background;

display a first portion of an immersive scene including at least a first subset of the plurality of video streams, wherein each video stream is displayed at one of the plurality of locations within the dynamic immersive background based at least in part on the instruction;

receive a panning input to view a second portion of the immersive scene, the second portion including a second subset of the plurality of video streams, wherein the panning input causes the display to pan across the immersive scene between the first portion and the second portion;

display the second portion of the immersive scene; and

receive an input at the client modifying the display of the immersive scene and modifying the instruction based at least in part on the input.

18. The non-transitory computer-readable medium of claim 17 , wherein the dynamic immersive background is received from a participant of the video conference.

19. The non-transitory computer-readable medium of claim 17 , further comprising including instructions that are executable by the processor to cause the processor to create the dynamic immersive background.

20. The non-transitory computer-readable medium of claim 17 , further comprising including instructions that are executable by the processor to cause the processor to move at least one of the video streams from a first one of the plurality of locations to a second one of the plurality of locations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2021
From: HAN, LIN; WALIA, NITASHA
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 056338/0714 →
Continuity (1)
Related Publication 20220353437A1 · Nov 3, 2022
Cited By (1)
US 12,342,098