Granted Patent B2

US 12,627,770 · App. 18/033,855 · Granted May 12, 2026

Inventors: Ali El Essaili (Aachen, DE); Natalya Tyudina (Aachen, DE); Joerg Christian Ewert (Aachen, DE); Ola Melander (Wuerselen, DE)

Assignee: Telefonaktiebolaget LM Ericsson (publ)

H04N7/157G06V40/10G06V2201/12

Abstract

Claims (39)

1 . A method for providing a three-dimensional, 3D, representation of a transmitting participant in a virtual meeting, the method being performed in a representation provider, the method comprising:

obtaining a live camera stream representing parts of the transmitting participant of the virtual meeting;

based on a characteristic of the transmitting participant in the obtained live camera stream, selecting a non-realtime 3D model from a plurality of non-realtime 3D models that are general models that can be used for several different transmitting participants;

identifying at least one body feature in the non-realtime 3D model;

identifying at least one body feature in the live camera stream; and

generating a combined 3D representation of the transmitting participant based on both the non-realtime 3D model and the live camera stream, wherein generating the combined 3D representation further comprises, when the live camera stream is temporarily unavailable, combining the non-realtime 3D model with the most recently received live camera stream, and generating an appearance of the transmitting participant representing unavailability.

2 . The method according to claim 1 , further comprising:

generating the non-realtime 3D model based on camera data.

3 . The method according to claim 1 , wherein generating the combined 3D representation comprises, for body features forming part of both the non-realtime 3D model and the live camera stream, assigning higher weights to data included in the live camera stream than data included in the non-realtime 3D model.

4 . The method according to claim 1 , further comprising:

transmitting the combined 3D representation to a user device of the transmitting participant.

5 . The method according to claim 4 , further comprising:

receiving a performance indication from the user device of the transmitting participant.

6 . The method according to claim 1 , wherein the representation provider forms part of a user device of a receiving participant.

7 . The method according to claim 6 , wherein the user device of the receiving participant is an extended reality, XR, device.

8 . The method according to claim 1 , wherein the representation provider forms part of a server.

9 . The method according to claim 8 , further comprising:

transmitting the combined 3D representation to a user device of a receiving participant.

10 . A representation provider for providing a three-dimensional, 3D, representation of a transmitting participant in a virtual meeting, the representation provider comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the representation provider to:

obtain a live camera stream representing parts of the transmitting participant of the virtual meeting;

based on a characteristic of the transmitting participant in the obtained live camera stream, select a non-realtime 3D model from a plurality of non-realtime 3D models that are general models that can be used for several different transmitting participants;

identify at least one body feature in the non-realtime 3D model;

identify at least one body feature in the live camera stream; and

generate a combined 3D representation of the transmitting participant based on both the non-realtime 3D model and the live camera stream, wherein generating the combined 3D representation further comprises, when the live camera stream is temporarily unavailable, combining the non-realtime 3D model with the most recently received live camera stream, and generating an appearance of the transmitting participant representing unavailability.

11 . The representation provider according to claim 10 , further comprising instructions that, when executed by the processor, cause the representation provider to:

generate the non-realtime 3D model based on camera data.

12 . The representation provider according to claim 10 , wherein generating the combined 3D representation comprises, for body features forming part of both the non-realtime 3D model and the live camera stream, assigning higher weights to data included in the live camera stream than data included in the non-realtime 3D model.

13 . The representation provider according to claim 10 , further comprising instructions that, when executed by the processor, cause the representation provider to:

transmit the combined 3D representation to a user device of the transmitting participant.

14 . The representation provider according to claim 13 , further comprising instructions that, when executed by the processor, cause the representation provider to:

receive a performance indication from the user device of the transmitting participant.

15 . A computer program product for providing a 3D, three-dimensional, representation of a transmitting participant in a virtual meeting, the computer program product comprising a non-transitory computer readable medium storing instructions which, when executed by a processor of a representation provider causes the representation provider to:

obtain a live camera stream representing parts of the transmitting participant of the virtual meeting;

based on a characteristic of the transmitting participant in the obtained live camera stream, select a non-realtime 3D model from a plurality of non-realtime 3D models that are general models that can be used for several different transmitting participants;

identify at least one body feature in the non-realtime 3D model;

identify at least one body feature in the live camera stream; and

generate a combined 3D representation of the transmitting participant based on both the non-realtime 3D model and the live camera stream, wherein generating the combined 3D representation further comprises, when the live camera stream is temporarily unavailable, combining the non-realtime 3D model with the most recently received live camera stream, and generating an appearance of the transmitting participant representing unavailability.

Assignments (1)

Continuity (2)

References Cited (24)