IP Library Granted Patent US 10,924,710
Granted Patent B1
US 10,924,710 · App. 16/827,722 · Granted Feb 16, 2021

Method for managing avatars in virtual meeting, head-mounted display, and non-transitory computer readable storage medium

Inventor: Kuan-Wei Li (Taoyuan, TW)
Assignee: HTC Corporation
H04N7/157G06F3/167G06T13/40H04N13/20H04N13/344
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,924,710
App. No.
16/827,722
Granted
Feb 16, 2021
Kind
B1
Abstract

The disclosure provides a method for managing a virtual meeting, a head-mounted display, and a non-transitory computer readable storage medium. The method includes: detecting whether an external participant exists in an image capturing range of a front camera of the head-mounted display while the head-mounted display is participating the virtual meeting; in response to determining that the external participant existing in the image capturing range of the front camera of the head-mounted display, adding a specific avatar representing the external participant into the virtual meeting; identifying an appearance characteristic of the external participant; mapping the appearance characteristic of the external participant to an appearance of the specific avatar.

Claims (50)

1. A method for managing avatars in a virtual meeting, adapted for a head-mounted display, comprising:

detecting whether an external participant exists in an image capturing range of a front camera of the head-mounted display while the head-mounted display is participating the virtual meeting, comprising:

retrieving a voice characteristic of a wearer of the head-mounted display;

in response to determining that a human voice being detected does not match the voice characteristic of the wearer of the head-mounted display, controlling the front camera to capture a face in the image capturing range;

in response to determining that the face has been detected in the image capturing range, determining that the external participant existing in the image capturing range of the front camera of the head-mounted display;

in response to determining that the external participant existing in the image capturing range of the front camera of the head-mounted display, adding a specific avatar representing the external participant into the virtual meeting;

identifying an appearance characteristic of the external participant;

mapping the appearance characteristic of the external participant to an appearance of the specific avatar.

2. The method according to claim 1 , further comprising:

providing a notification for the wearer of the head-mounted display to determine whether to add the specific avatar of the external participant into the virtual meeting;

adding the specific avatar representing the external participant into the virtual meeting in response to determining that the wearer of the head-mounted display has confirmed to add the specific avatar of the external participant into the virtual meeting.

3. The method according to claim 1 , wherein the step of adding the specific avatar representing the external participant into the virtual meeting comprising:

in response to determining that the external participant has a previously used avatar, adding the previously used avatar into the virtual meeting, otherwise creating a new avatar for representing the external participant and adding the new avatar into the virtual meeting.

4. The method according to claim 1 , wherein the appearance characteristic of the external participant comprises at least one of a posture, a gesture, and a facial expression of the external participant.

5. The method according to claim 4 , wherein the step of mapping the appearance characteristic of the external participant to the appearance of the specific avatar comprising:

modifying at least one of a posture, a gesture, and a facial expression of the specific avatar based on the appearance characteristic of the external participant.

6. The method according to claim 1 , further comprising:

detecting a specific voice content provided by the external participant;

controlling the specific avatar to output the specific voice content.

7. The method according to claim 6 , further comprising:

in response to a voice content has been detected, identifying whether a mouth of the external participant is moving;

in response to determining that the mouth of the external participant is moving when the voice content is being detected, determining that the voice content is the specific voice content provided by the external participant.

8. The method according to claim 7 , wherein the external participant locates at a specific location relative to the head-mounted display, and the method further comprising:

in response to a voice content has been detected, identifying a specific direction where the voice content comes from;

in response to determining that the specific direction corresponds to the specific location, determining that the voice content is the specific voice content provided by the external participant.

9. The method according to claim 1 , wherein the head-mounted display is disposed with a speaker for outputting voice outward, and the method further comprising controlling the speaker to output an audio content associated with the virtual meeting.

10. The method according to claim 1 , wherein the head-mounted display is paired with an electronic device, and the method further comprising:

providing an audio content associated with the virtual meeting to the electronic device for the electronic device to output the audio content.

11. The method according to claim 10 , wherein the electronic device comprises at least one of wireless headphones, an external speaker, a smart device, a wired headphone.

12. The method according to claim 1 , wherein the specific avatar in the virtual meeting is displayed as in a standing posture by default, and the method further comprising:

in response to determining that the external participant changes to a sitting posture, maintaining the specific avatar in the virtual meeting as in the standing posture.

13. The method according to claim 1 , wherein the specific avatar in the virtual meeting is displayed as in a standing posture by default, and the method further comprising:

in response to determining that the external participant changes to a sitting posture, creating a seat for the specific avatar in the virtual meeting to sit.

14. The method according to claim 1 , wherein the specific avatar in the virtual meeting is displayed as in a sitting posture by default, and the method further comprising:

ignoring any posture change of a lower body of the external participant.

15. A head-mounted display, comprising:

a front camera;

a processor, coupled to the front camera, and configured to:

detect whether an external participant exists in an image capturing range of the front camera of the head-mounted display while the head-mounted display is participating a virtual meeting;

in response to determining that the external participant existing in the image capturing range of the front camera of the head-mounted display, add a specific avatar representing the external participant into the virtual meeting;

identify an appearance characteristic of the external participant;

map the appearance characteristic of the external participant to an appearance of the specific avatar;

provide a notification for the wearer of the head-mounted display to determine whether to add the specific avatar of the external participant into the virtual meeting;

add the specific avatar representing the external participant into the virtual meeting in response to determining that the wearer of the head-mounted display has confirmed to add the specific avatar of the external participant into the virtual meeting.

16. A non-transitory computer readable storage medium, recording an executable computer program to be loaded by a head-mounted display to execute steps of:

detecting whether an external participant exists in an image capturing range of a front camera of the head-mounted display while the head-mounted display is participating the virtual meeting;

in response to determining that the external participant existing in the image capturing range of the front camera of the head-mounted display, adding a specific avatar representing the external participant into the virtual meeting;

identifying an appearance characteristic of the external participant;

mapping the appearance characteristic of the external participant to an appearance of the specific avatar;

in response to determining that the external participant has a previously used avatar, adding the previously used avatar into the virtual meeting, otherwise creating a new avatar for representing the external participant and adding the new avatar into the virtual meeting.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2020
From: LI, KUAN-WEI
To: HTC CORPORATION
Reel/Frame 052200/0487 →
Cited By (6)
US 12,360,557 US 12,360,558 US 12,380,238 US 12,474,816 US 12,619,774 US 12,669,848