IP Library › Granted Patent US 12,189,866
Granted Patent B1
US 12,189,866 · App. 18/415,748 · Granted Jan 7, 2025

Using wearable devices to capture actions of participants in a meeting

Inventors: Jin Fang (Saratoga, CA); Qijun Liu (San Jose, CA); Kaidong Pei (San Jose, CA); Zhenxi Wang (San Jose, CA)
Assignee: Zoom Video Communications, Inc.
G06F3/017G06F3/011H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,866
App. No.
18/415,748
Filed
Jan 18, 2024
Granted
Jan 7, 2025
Kind
B1
Art Unit
2628
USPC
345/156
Abstract

The present disclosure relates to systems and methods for capture actions of users participating within a virtual conference and conveying those actions to participants of the virtual conference. A user device connects to a virtual conference device, the virtual conference device participating in a virtual conference hosted by a virtual conference provider. The user device receives sensor data relating to a user associated with the user device from at least one sensor during the virtual conference. The user device determines a physical action of the user associated with the user device based on the sensor data. The user device transmits a representation of the physical action to the virtual conference device for conveyance within the virtual conference.

Claims (45)

1. A method comprising:

connecting, by a user device, to a virtual conference device, the virtual conference device participating in a virtual conference hosted by a virtual conference provider;

receiving, by the user device, sensor data relating to a user associated with the user device from at least one sensor during the virtual conference;

determining, by the user device, a physical action of the user associated with the user device based on the sensor data; and

transmitting, by the user device, a representation of the physical action to the virtual conference device for conveyance within the virtual conference.

2. The method of claim 1 , wherein the representation of the physical action comprises a pictogram, a logogram, an ideogram, an emoji or combination thereof presented within the virtual conference and representing the physical action performed by a wearer.

3. The method of claim 1 , wherein the physical action comprises at least one of thumbs up, clapping, clapping, waving, beckoning, head nodding, head shaking, or a combination thereof.

4. The method of claim 1 , wherein the at least one sensor comprises a motion sensor, an environmental sensor, a biosensor, an imaging sensor, or a combination thereof.

5. The method of claim 1 , further comprising connecting, by the user device, to at least one wearable device associated with the user, wherein the at least one wearable device comprises the at least one sensor, and wherein the at least one wearable device is at least one of a smart watch, smart jewelry, smart glasses, smart clothing, or a combination thereof.

6. The method of claim 1 , wherein identifying the physical action of the user associated with the at least one sensor based on the sensor data comprises comparing the sensor data to one or more predefined movement patterns.

7. The method of claim 1 , further comprising:

transmitting, by the user device, a request to connect with the virtual conference device; and

receiving, by the user device, connection information from the virtual conference device.

8. A system comprising:

a communications interface;

a non-transitory computer-readable medium; and

one or more processors communicatively coupled to the communications interface and the non-transitory computer-readable medium, the one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to:

connect to a virtual conference device, the virtual conference device participating in a virtual conference hosted by a virtual conference provider;

receive sensor data relating to a user from at least one sensor during the virtual conference;

determine a physical action of the user based on the sensor data; and

transmit a representation of the physical action to the virtual conference device for conveyance within the virtual conference.

9. The system of claim 8 , wherein the representation of the physical action comprises a pictogram, a logogram, an ideogram, an emoji or combination thereof presented within the virtual conference and representing the physical action performed by a wearer.

10. The system of claim 8 , wherein the physical action comprises at least one of thumbs up, clapping, clapping, waving, beckoning, head nodding, head shaking, or a combination thereof.

11. The system of claim 8 , wherein the at least one sensor comprises a motion sensor, an environmental sensor, a biosensor, an imaging sensor, or a combination thereof.

12. The system of claim 8 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

connect to at least one wearable device associated with the user, wherein the at least one wearable device comprises the at least one sensor, and wherein the at least one wearable device is at least one of a smart watch, smart jewelry, smart glasses, smart clothing, or a combination thereof.

13. The system of claim 8 , wherein identifying the physical action of the user associated with the at least one sensor comprises comparing the sensor data to one or more predefined movement patterns.

14. The system of claim 8 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

transmit a request to connect with the virtual conference device; and

receive connection information from the virtual conference device.

15. A non-transitory computer-readable medium comprising processor-executable instructions configured to cause one or more processors to:

connect to a virtual conference device, the virtual conference device participating in a virtual conference hosted by a virtual conference provider;

receive sensor data relating to a user from at least one sensor during the virtual conference;

determine a physical action of the user based on the sensor data; and

transmit a representation of the physical action to the virtual conference device for conveyance within the virtual conference.

16. The non-transitory computer-readable medium of claim 15 ,

wherein the representation of the physical action comprises a pictogram, a logogram, an ideogram, an emoji or combination thereof presented within the virtual conference and representing a physical action performed by a wearer; and

wherein the physical action comprises at least one of thumbs up, clapping, clapping, waving, beckoning, head nodding, head shaking, or a combination thereof.

17. The non-transitory computer-readable medium of claim 15 , wherein the at least one sensor comprises a motion sensor, an environmental sensor, a biosensor, an imaging sensor, or a combination thereof.

18. The non-transitory computer-readable medium of claim 15 , further comprising processor-executable instructions configured to cause one or more processors to:

connect to at least one wearable device associated with the user, wherein the at least one wearable device comprises the at least one sensor, and wherein the at least one wearable device is at least one of a smart watch, smart jewelry, smart glasses, smart clothing, or a combination thereof.

19. The non-transitory computer-readable medium of claim 15 , wherein physical action of the user associated with the at least one sensor based on the sensor data comprises comparing the sensor data to one or more predefined movement patterns.

20. The non-transitory computer-readable medium of claim 15 , further comprising processor-executable instructions configured to cause one or more processors to:

transmit a request to connect with the virtual conference device; and

receive connection information from the virtual conference device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2024
From: FANG, JIN; LIU, QIJUN; PEI, KAIDONG; WANG, ZHENIX
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 066160/0424 →
Continuity (1)
Continuation 18101688 · Jan 26, 2023
References Cited (10)
US 11621979B1 · Slotznick · 2023 [cited by examiner]
US 11785063B2 · Janakiraman · 2023 [cited by examiner]
US 11872468B2 · Wu · 2024 [cited by examiner]
US 11910132B2 · Thiel · 2024 [cited by examiner]
US 11991224B2 · Gandlin · 2024 [cited by examiner]
US 20240089407A1 · Fisher-Stawinski · 2024 [cited by examiner]
US 20240147177A1 · Jia · 2024 [cited by examiner]
US 20240163123A1 · Legatski · 2024 [cited by examiner]
US 20240163390A1 · Hutto · 2024 [cited by examiner]
US 20240220100A1 · Harris · 2024 [cited by examiner]