IP Library Patent Application 18815175
Patent Application
App. No. 18/815,175

AUGMENTED REALITY FOR RENDERING VIRTUAL REPRESENTATIONS OF OBJECTS IN VIDEO CONFERENCING PLATFORMS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/815,175
Abstract

A system for implementing augmented reality in connection with a conferencing platform obtains, via an imaging device, interaction space image information indicative of an interaction space. The system generates, based on the interaction space image information, virtual interaction space information corresponding to a virtual interaction space comprising a virtual three-dimensional (3D) structure representing the interaction space. The system obtains virtual object information for displaying a virtual object within the virtual interaction space. The system provides, for output, rendering information configured to cause a computing device to present, via a display device, the virtual object within the virtual interaction space.

Claims (56)

1 . A method, comprising:

obtaining, via an imaging device, interaction space image information indicative of an interaction space;

generating, based on the interaction space image information, virtual interaction space information corresponding to a virtual interaction space associated with a video conference, the virtual interaction space comprising a virtual three-dimensional (3D) structure representing the interaction space;

obtaining, via an artificial intelligence content generation (AICG) system, virtual object information for displaying a virtual object within the virtual interaction space, wherein the virtual object information comprises new content generated by the AICG system based on input data associated with user interactions and environmental contexts; and

providing, for output and based on the virtual interaction space information and the virtual object information, rendering information configured to cause a computing device to present, via a display device, the virtual object within the virtual interaction space.

2 . The method of claim 1 , wherein obtaining the virtual object information comprises:

obtaining the virtual object information via at least one of the imaging device or an additional imaging device, the virtual object comprising a virtual representation of a physical object.

3 . The method of claim 1 , wherein obtaining the virtual object information comprises:

obtaining the virtual object information via a content service.

4 . The method of claim 1 , further comprising:

obtaining, from a plurality of users, a plurality of concurrent user inputs indicative of user interaction with a virtual object; and

prioritizing the plurality of concurrent user inputs based on at least one of predefined criteria or a user.

5 . The method of claim 1 , further comprising:

obtaining a gesture indication indicative of detection, in user image information associated with the video conference, of a hand gesture made by a participant; and

providing, for output and based on the gesture indication, additional rendering information configured to cause the computing device to present, via the display device, a modification of the virtual object.

6 . The method of claim 1 , further comprising:

obtaining an indication of a request, from a participant, to display a 3D virtual participant depiction within the virtual interaction space; and

providing, for output and based on the indication, additional rendering information configured to cause the computing device to present, via the display device, the 3D virtual participant depiction within the virtual interaction space, wherein the 3D virtual participant depiction comprises a 3D representation of the participant.

7 . The method of claim 1 , further comprising:

obtaining an indication of a request, from a participant, to display a 3D virtual participant depiction within the virtual interaction space; and

providing, for output and based on the indication, additional rendering information configured to cause the computing device to present, via the display device, the 3D virtual participant depiction within the virtual interaction space, wherein the 3D virtual participant depiction comprises a 3D representation of the participant, wherein providing the additional rendering information comprises providing the additional rendering information configured to cause the computing device to present the 3D virtual participant depiction in a virtual location within the virtual interaction space based on a location of the participant.

8 . The method of claim 1 , further comprising:

obtaining an indication of a request, from a participant, to display a 3D virtual participant depiction within the virtual interaction space; and

providing, for output and based on the indication, additional rendering information configured to cause the computing device to present, via the display device, the 3D virtual participant depiction within the virtual interaction space, wherein the 3D virtual participant depiction comprises a 3D representation of the participant, wherein providing the additional rendering information comprises providing the additional rendering information configured to cause the computing device to present the 3D virtual participant depiction in a virtual pose based on a pose of the participant.

9 . The method of claim 1 , further comprising:

obtaining an indication of a request, from a participant, to display a 3D virtual participant depiction within the virtual interaction space; and

providing, for output and based on the indication, additional rendering information configured to cause the computing device to present, via the display device, the 3D virtual participant depiction within the interaction space, wherein the 3D virtual participant depiction comprises a 3D representation of the participant, wherein providing the additional rendering information comprises providing the additional rendering information configured to cause the computing device to present the 3D virtual participant depiction as having a virtual facial expression based on a facial expression of the participant.

10 . The method of claim 1 , further comprising:

obtaining an indication of a request, from a participant, to display a 3D virtual participant depiction within the virtual interaction space; and

providing, for output and based on the indication, additional rendering information configured to cause the computing device to present, via the display device, the 3D virtual participant depiction within the virtual interaction space, wherein the 3D virtual participant depiction comprises a 3D representation of the participant, wherein providing the additional rendering information comprises providing the additional rendering information configured to cause the computing device to present a virtual action performed by the 3D virtual participant depiction based on an action performed by the participant.

11 . A non-transitory computer-readable medium storing instructions operable to cause one or more processors to perform operations comprising:

obtaining, via an imaging device, interaction space image information indicative of an interaction space;

generating, based on the interaction space image information, virtual interaction space information corresponding to a virtual interaction space associated with a video conference, the virtual interaction space comprising a virtual three-dimensional (3D) structure representing the interaction space;

obtaining, via an artificial intelligence content generation (AICG) system, virtual object information for displaying a virtual object within the virtual interaction space, wherein the virtual object information comprises new content generated by the AICG system based on input data associated with user interactions and environmental contexts; and

providing, for output, and based on the virtual interaction space information and the virtual object information, rendering information configured to cause a computing device to present, via a display device, the virtual object within the virtual interaction space.

12 . The non-transitory computer-readable medium of claim 11 , wherein the virtual object comprises a virtual representation of a white board.

13 . The non-transitory computer-readable medium of claim 11 , wherein the virtual object comprises a virtual representation of a white board, and wherein the virtual representation of the white board is configured to be manipulated by a participant via an input device of the computing device.

14 . The non-transitory computer-readable medium of claim 11 , wherein the virtual object comprises a virtual representation of a physical object.

15 . The non-transitory computer-readable medium of claim 11 , wherein the virtual object information comprises content provided by a content service.

16 . The non-transitory computer-readable medium of claim 11 , the operations further comprising:

obtaining, from a plurality of users, a plurality of concurrent user inputs indicative of user interaction with a virtual object; and

prioritizing the plurality of concurrent user inputs based on at least one of predefined criteria or a user role.

17 . The non-transitory computer-readable medium of claim 11 , the operations further comprising:

obtaining a gesture indication indicative of detection, in user image information associated with the video conference, of a hand gesture made by a participant; and

providing, for output and based on the gesture indication, additional rendering information configured to cause the computing device to present, via the display device, a modification of a virtual position of the virtual object.

18 . A system, comprising:

one or more memories; and

one or more processors configured to execute instructions stored in the one or more memories to:

obtain, via an imaging device, interaction space image information indicative of an interaction space;

generate, based on the interaction space image information, virtual interaction space information corresponding to a virtual interaction space associated with a video conference, the virtual interaction space comprising a virtual three-dimensional (3D) structure representing the interaction space;

obtain, via an artificial intelligence content generation (AICG) system, virtual object information for displaying a virtual object within the virtual interaction space, wherein the virtual object information comprises new content generated by the AICG system based on input data associated with user interactions and environmental contexts; and

provide, for output, rendering information configured to cause a computing device to present, via a display device and based on the virtual 3D structure, the virtual object within the virtual interaction space.

19 . The system of claim 18 , wherein the one or more processors are further configured to execute the instructions stored in the one or more memories to:

obtain an indication of a request, from a participant, to display a 3D virtual participant depiction within the virtual interaction space; and

provide, for output and based on the indication, additional rendering information configured to cause the computing device to present, via the display device, the 3D virtual participant depiction within the virtual interaction space, wherein the 3D virtual participant depiction comprises a 3D representation of the participant.

20 . The system of claim 18 , wherein the one or more processors are further configured to execute the instructions stored in the one or more memories to provide, for output, additional rendering information configured to cause the computing device to present an additional virtual object within the virtual interaction space, wherein the additional virtual object is configured to interact with the virtual object.

Assignments (2)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2024
From: FENG, JUNTAO; LIN, WENCHONG; LING, BO; LV, CHONG; ZHU, XINGGUO
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 068398/0770 →