IP Library › Granted Patent US 12,302,037
Granted Patent B2
US 12,302,037 · App. 17/823,785 · Granted May 13, 2025

Virtual participant interaction for hybrid event

Inventors: Andrew Cheng-min Lin (Long Island City, NY); Walton Lin (Chatham, NJ)
Assignee: Snap Inc.
H04N7/157H04N23/698
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,302,037
App. No.
17/823,785
Granted
May 13, 2025
Kind
B2
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for virtual participant interaction for a hybrid event. The program and method provide an interface for designing a hybrid event between in-person and virtual participants, the interface for setting first properties of a physical space device present in a physical space, and setting second properties of a virtual room for the virtual participants; receive an indication of first user input setting the first and second properties; and in association with conferencing, configure the physical space device based on the first properties, display the virtual room based on the second properties, the virtual room including a live video feed of the physical space, receive, from a virtual participant device, an indication of second user input for interacting with the physical space device, and provide for interaction the based on the second user input.

Claims (72)

1. A method, comprising:

providing an interface for designing a hybrid event for conferencing between in-person participants and virtual participants, the interface for setting first properties of a physical space device present in a physical space of the in-person participants, the interface further for setting second properties of a virtual room displayable on respective client devices of the virtual participants;

receiving, via the interface, an indication of first user input setting the first properties and the second properties; and

in association with conferencing for the hybrid event,

configuring the physical space device based on the first properties as set by the first user input,

providing for display of the virtual room based on the second properties as set by the first user input, the virtual room including a live video feed of the physical space,

receiving, from at least one client device of the respective client devices, an indication of second user input for interacting with the physical space device, and

providing for interaction with the physical space device based on the second user input,

wherein the live video feed is accessible to the respective client devices via a link specified by the first properties,

wherein the physical space device comprises a 360-degree camera for capturing the live video feed of the physical space, and

wherein the second user input provides for changing a perspective view of the 360-degree camera for the at least one client device, such that live video feed displayed for the virtual room is updated based on the changing of the perspective view.

2. The method of claim 1 , further comprising:

receiving, from at least one client device of the respective client devices, an indication of third user input for interacting with the physical space device, and

providing for interaction with the physical space device based on the third user input.

3. The method of claim 2 , wherein the physical space device comprises a display device, and

wherein the third user input corresponds to user-submitted text for presenting on the display device and on the respective client devices of the virtual participants.

4. The method of claim 2 , wherein the physical space device comprises a display device, and

wherein the third user input corresponds to a user-submitted reaction for presenting on the display device and on the respective client devices of the virtual participants.

5. The method of claim 2 , wherein the physical space device comprises a speaker, and

wherein the third user input corresponds to at least one of user-submitted audio or a user-submitted reaction with an audio component for outputting via the speaker and via the respective client devices of the virtual participants.

6. The method of claim 2 , wherein the first user input is provided by a designer of the hybrid event, and

wherein the third user input is provided by a virtual participant, of the virtual participants, associated with the at least one client device.

7. The method of claim 1 , further comprising:

providing, on a display device in the physical space, for rotating display of live video feeds captured by the respective client devices.

8. A system comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the processor to perform operations comprising:

providing an interface for designing a hybrid event for conferencing between in-person participants and virtual participants, the interface for setting first properties of a physical space device present in a physical space of the in-person participants, the interface further for setting second properties of a virtual room displayable on respective client devices of the virtual participants;

receiving, via the interface, an indication of first user input setting the first properties and the second properties; and

in association with conferencing for the hybrid event,

configuring the physical space device based on the first properties as set by the first user input,

providing for display of the virtual room based on the second properties as set by the first user input, the virtual room including a live video feed of the physical space,

receiving, from at least one client device of the respective client devices, an indication of second user input for interacting with the physical space device, and

providing for interaction with the physical space device based on the second user input,

wherein the live video feed is accessible to the respective client devices via a link specified by the first properties,

wherein the physical space device comprises a 360-degree camera for capturing the live video feed of the physical space, and

wherein the second user input provides for changing a perspective view of the 360-degree camera for the at least one client device, such that live video feed displayed for the virtual room is updated based on the changing of the perspective view.

9. The system of claim 8 , the operations further comprising:

receiving, from at least one client device of the respective client devices, an indication of third user input for interacting with the physical space device, and

providing for interaction with the physical space device based on the third user input.

10. The system of claim 2 , wherein the physical space device comprises a display device, and

wherein the third user input corresponds to user-submitted text for presenting on the display device and on the respective client devices of the virtual participants.

11. The system of claim 9 , wherein the physical space device comprises a display device, and

wherein the third user input corresponds to a user-submitted reaction for presenting on the display device and on the respective client devices of the virtual participants.

12. The system of claim 9 , wherein the physical space device comprises a speaker, and

wherein the third user input corresponds to at least one of user-submitted audio or a user-submitted reaction with an audio component for outputting via the speaker and via the respective client devices of the virtual participants.

13. The 9 , wherein the first user input is provided by a designer of the hybrid event, and

wherein the third user input is provided by a virtual participant, of the virtual participants, associated with the at least one client device.

14. The system of claim 8 , the operations further comprising:

providing, on a display device in the physical space, for rotating display of live video feeds captured by the respective client devices.

15. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

providing an interface for designing a hybrid event for conferencing between in-person participants and virtual participants, the interface for setting first properties of a physical space device present in a physical space of the in-person participants, the interface further for setting second properties of a virtual room displayable on respective client devices of the virtual participants;

receiving, via the interface, an indication of first user input setting the first properties and the second properties; and

in association with conferencing for the hybrid event,

configuring the physical space device based on the first properties as set by the first user input,

providing for display of the virtual room based on the second properties as set by the first user input, the virtual room including a live video feed of the physical space,

receiving, from at least one client device of the respective client devices, an indication of second user input for interacting with the physical space device, and

providing for interaction with the physical space device based on the second user input,

wherein the live video feed is accessible to the respective client devices via a link specified by the first properties,

wherein the physical space device comprises a 360-degree camera for capturing the live video feed of the physical space, and

wherein the second user input provides for changing a perspective view of the 360-degree camera for the at least one client device, such that live video feed displayed for the virtual room is updated based on the changing of the perspective view.

16. The computer-readable medium of claim 15 , the operations further comprising:

receiving, from at least one client device of the respective client devices, an indication of third user input for interacting with the physical space device, and

providing for interaction with the physical space device based on the third user input.

17. The computer-readable medium of claim 16 , wherein the physical space device comprises a display device, and

wherein the third user input corresponds to user-submitted text for presenting on the display device and on the respective client devices of the virtual participants.

18. The computer-readable medium of claim 16 , wherein the physical space device comprises a display device, and

wherein the third user input corresponds to a user-submitted reaction for presenting on the display device and on the respective client devices of the virtual participants.

19. The computer-readable medium of claim 16 , wherein the physical space device comprises a speaker, and

wherein the third user input corresponds to at least one of user-submitted audio or a user-submitted reaction with an audio component for outputting via the speaker and via the respective client devices of the virtual participants.

20. The computer-readable medium of claim 16 , wherein the first user input is provided by a designer of the hybrid event, and

wherein the third user input is provided by a virtual participant, of the virtual participants, associated with the at least one client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: LIN, ANDREW CHENG-MIN; LIN, WALTON
To: SNAP INC.
Reel/Frame 060956/0640 →
Continuity (1)
Related Publication 20240073371A1 · Feb 29, 2024
References Cited (96)
US 6002853A · De · 1999 [cited by applicant]
US 6079982A · Meader · 2000 [cited by applicant]
US 6119147A · Toomey et al. · 2000 [cited by applicant]
US 6179619B1 · Tanaka · 2001 [cited by applicant]
US 6219045B1 · Leahy et al. · 2001 [cited by applicant]
US 6362817B1 · Powers et al. · 2002 [cited by applicant]
US 6396522B1 · Vu · 2002 [cited by applicant]
US 6414679B1 · Miodonski et al. · 2002 [cited by applicant]
US 6570563B1 · Honda · 2003 [cited by applicant]
US 6573903B2 · Gantt · 2003 [cited by applicant]
US 6784901B1 · Harvey et al. · 2004 [cited by applicant]
US 6961055B2 · Doak et al. · 2005 [cited by applicant]
US 7119819B1 · Robertson et al. · 2006 [cited by applicant]
US 7414629B2 · Santodomingo et al. · 2008 [cited by applicant]
US 7542040B2 · Templeman · 2009 [cited by applicant]
US 7663625B2 · Chartier et al. · 2010 [cited by applicant]
US 7746343B1 · Charaniya et al. · 2010 [cited by applicant]
US 7788323B2 · Greenstein et al. · 2010 [cited by applicant]
US 7804507B2 · Yang et al. · 2010 [cited by applicant]
US 7814429B2 · Buffet et al. · 2010 [cited by applicant]
US 7817150B2 · Reichard et al. · 2010 [cited by applicant]
US 7844724B2 · Van et al. · 2010 [cited by applicant]
US 9244533B2 · Friend et al. · 2016 [cited by applicant]
US 9696795B2 · Marcolina et al. · 2017 [cited by applicant]
US 9996797B1 · Holz et al. · 2018 [cited by applicant]
US 10516853B1 · Gibson et al. · 2019 [cited by applicant]
US 11362848B1 · Lin et al. · 2022 [cited by applicant]
US 11381411B1 · Gale et al. · 2022 [cited by applicant]
US 20010018667A1 · Kim · 2001 [cited by applicant]
US 20020113820A1 · Robinson et al. · 2002 [cited by applicant]
US 20040113887A1 · Pair et al. · 2004 [cited by applicant]
US 20040193441A1 · Altieri · 2004 [cited by applicant]
US 20050093719A1 · Okamoto et al. · 2005 [cited by applicant]
US 20050128212A1 · Edecker et al. · 2005 [cited by applicant]
US 20080030429A1 · Hailpern et al. · 2008 [cited by applicant]
US 20080125218A1 · Collins · 2008 [cited by applicant]
US 20080246693A1 · Hailpern et al. · 2008 [cited by applicant]
US 20090076791A1 · Rhoades et al. · 2009 [cited by applicant]
US 20090091583A1 · Mccoy · 2009 [cited by applicant]
US 20090287728A1 · Martine et al. · 2009 [cited by applicant]
US 20090300528A1 · Stambaugh · 2009 [cited by applicant]
US 20100070378A1 · Trotman et al. · 2010 [cited by applicant]
US 20100115428A1 · Shuping et al. · 2010 [cited by applicant]
US 20100205541A1 · Rapaport et al. · 2010 [cited by applicant]
US 20100214284A1 · Rieffel et al. · 2010 [cited by applicant]
US 20100274567A1 · Carlson et al. · 2010 [cited by applicant]
US 20100274627A1 · Carlson · 2010 [cited by applicant]
US 20110010636A1 · Hamilton, II et al. · 2011 [cited by applicant]
US 20110041083A1 · Gabai et al. · 2011 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20130042296A1 · Hastings et al. · 2013 [cited by applicant]
US 20130174213A1 · Liu et al. · 2013 [cited by applicant]
US 20140082526A1 · Park et al. · 2014 [cited by applicant]
US 20140282105A1 · Nordstrom · 2014 [cited by applicant]
US 20170185261A1 · Perez et al. · 2017 [cited by applicant]
US 20170243403A1 · Daniels et al. · 2017 [cited by applicant]
US 20180096505A1 · Valdivia · 2018 [cited by examiner]
US 20180129278A1 · Luchinskiy · 2018 [cited by applicant]
US 20180131907A1 · Schmirler et al. · 2018 [cited by applicant]
US 20180357472A1 · Dreessen · 2018 [cited by applicant]
US 20190087015A1 · Lam et al. · 2019 [cited by applicant]
US 20200110928A1 · Al Jazaery et al. · 2020 [cited by applicant]
US 20200117267A1 · Gibson et al. · 2020 [cited by applicant]
US 20200117270A1 · Gibson et al. · 2020 [cited by applicant]
US 20210008413A1 · Asikainen et al. · 2021 [cited by applicant]
US 20210041951A1 · Gibson et al. · 2021 [cited by applicant]
US 20210165557A1 · Agarawala · 2021 [cited by examiner]
US 20220070232A1 · Young · 2022 [cited by applicant]
US 20220321369A1 · Lin et al. · 2022 [cited by applicant]
US 20220321371A1 · Lin et al. · 2022 [cited by applicant]
US 20220321372A1 · Cho et al. · 2022 [cited by applicant]
US 20220321373A1 · Lin et al. · 2022 [cited by applicant]
US 20220321374A1 · Lin et al. · 2022 [cited by applicant]
US 20220321375A1 · Lin et al. · 2022 [cited by applicant]
US 20220321376A1 · Lin et al. · 2022 [cited by applicant]
US 20220321613A1 · Lin et al. · 2022 [cited by applicant]
US 20220321617A1 · Gale et al. · 2022 [cited by applicant]
US 20220321832A1 · Lin et al. · 2022 [cited by applicant]
US 20220321833A1 · Lin et al. · 2022 [cited by applicant]
US 20220385490A1 · Lin et al. · 2022 [cited by applicant]
US 20220407735A1 · Gale et al. · 2022 [cited by applicant]
US 20230032922A1 · Lin et al. · 2023 [cited by applicant]
US 20230094963A1 · Lin et al. · 2023 [cited by applicant]
US 20230095314A1 · Lin et al. · 2023 [cited by applicant]
US 20230096597A1 · Lin et al. · 2023 [cited by applicant]
US 20230101377A1 · Lin et al. · 2023 [cited by applicant]
US 20230101879A1 · Lin et al. · 2023 [cited by applicant]
US 20240073372A1 · Lin et al. · 2024 [cited by applicant]
WO 2022212386 · 2022 [cited by applicant]
WO 2022212391 · 2022 [cited by applicant]
“U.S. Appl. No. 17/899,921, Non Final Office Action mailed Sep. 13, 2023”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,921, Response filed Nov. 30, 2023 to Non Final Office Action mailed Sep. 13, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,921, Final Office Action mailed Dec. 18, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,921, Response filed Feb. 28, 2024 to Final Office Action mailed Dec. 18, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,921, Notice of Allowance mailed Apr. 4, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,921, Corrected Notice of Allowability mailed Apr. 23, 2024”, 4 pgs. [cited by applicant]