IP Library Granted Patent US 12,262,145
Granted Patent B2
US 12,262,145 · App. 18/216,081 · Granted Mar 25, 2025

Integration of remote audio into a performance venue

Inventor: William J. Raduchel (Palo Alto, CA)
Assignee: eIngot LLC
H04N7/152H04L65/4053H04R27/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,145
App. No.
18/216,081
Granted
Mar 25, 2025
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for validating and publishing workflows from remote environments. In some implementations, a link that includes at least one of audio data and video data is established between a wireless device of a remote participant and a computational mixer. A profile for the remote participant is referenced. A venue signal related to the at least one audio data and video data is generated based on the profile for the remote participant and using the computational mixer. The venue signal is transmitted.

Claims (70)

1. A computer-implemented method, the method comprising:

establishing a link that includes at least a first device of a first remote participant, a second device of a second remote participant, and a venue system comprising sensors and located within an venue;

transmitting, using the link, multimedia data that includes at least one of audio data and video data;

referencing a first profile for the first remote participant and a second profile of the second remote participant;

receiving, from the first device of the first remote participant, first data representing a first multimedia data;

accessing venue data a) for the venue system and b) that represents venue multimedia data for the venue;

generating a composite signal that comprises at least a portion of the first data and the venue data, based on the first profile, the second profile, the first data, and the venue data for the venue system, wherein the venue data is different than the first data; and

transmitting, to the second device of the second remote participant, the composite signal.

2. The method of claim 1 , wherein referencing the second profile for the second remote participant includes referencing a social media configured to enable access to other profiles for other users.

3. The method of claim 1 , wherein referencing the second profile for the second remote participant comprises referencing a designated seat location within a venue hosting an event that the second remote participant is virtually attending; and

wherein generating the composite signal comprises generating the composite signal using a seat location within the venue, the seat location retrieved from the second profile for each remote participant.

4. The method of claim 1 , wherein referencing the second profile for the second remote participant includes referencing a logical transformation that describes a modification to at least the audio data or the video data.

5. The method of claim 4 , wherein generating the composite signal comprises:

referencing a transformation that modifies at least a portion of at least one of the audio data and the video data that corresponds to other remote participants based on one or more of the following:

a distance from a location corresponding to the second remote participant to a location corresponding to a third remote participant of the other remote participants;

an identity of a remote participant of the other remote participants;

a remote participant of the other remote participants being identified as a friend of the remote participant;

a remote participant of the other remote participants being identified as a family member of the remote participant; or

a remote participant of the other remote participants being identified as a celebrity.

6. The method of claim 1 , wherein establishing the link comprises:

verifying, using a virtual ticket for the second remote participant, that the second remote participant has registered to receive the composite signal.

7. The method of claim 1 , wherein generating the composite signal comprises:

determining audio volume levels for the composite signal using a seat location within the venue and retrieved from the second profile for each remote participant.

8. The method of claim 1 , wherein generating the composite signal comprises:

receiving audio data and video data from one or more devices associated with seat locations within a predetermined distance from seat locations within the venue and retrieved from the first profile or the second profile; and

mixing at least one of the audio data and the video data from the one or more devices associated with seat locations within a predetermined distance from the seat locations of the first remote participant.

9. The method of claim 1 , wherein generating, the composite signal comprises:

mixing the at least one of audio data and video data for the second remote participant with one or more of the following:

audio data captured using one or more microphones in a venue corresponding to an event that the second remote participant is virtually attending;

video data captured using one or more cameras in a venue corresponding to an event that the second remote participant is virtually attending;

audio data corresponding to one or more performers of the event in the venue;

video data corresponding to one or more performers of the event in the venue;

audio data corresponding to one or more hosts of the event in the venue;

video data corresponding to one or more hosts of the event in the venue;

audio data corresponding to one or more other remote participants virtually attending the event in the venue; or

video data corresponding to one or more other remote participants virtually attending the event in the venue.

10. The method of claim 1 , wherein generating the composite signal comprises:

accessing at least one of audio and video settings specified in the second profile for the second remote participant; and

generating the composite signal based on at least one of the audio and the video settings.

11. The method of claim 1 , wherein generating the composite signal comprises;

generating data representing a virtual reality environment that includes other remote participant data or an augmented reality environment to that includes other remote participant data within a predetermined distance from a seat location of second participant retrieved from the second profile.

12. The method of claim 1 , wherein generating the composite signal comprises:

generating data representing one or more virtual models corresponding to at least one of the first remote participant, the second remote participant, or one or more other remote participants; and

presenting for display a composite image of the one or more virtual models with video data captured from a camera in a venue hosting an event that the second remote participant is virtually attending.

13. The method of claim 1 , wherein the composite signal comprises:

data representing a visual representation of the first remote participant.

14. The method of claim 1 , wherein the first profile or the second profile comprises at least one of:

data representing a team preference;

data representing an audio preference;

data representing a seat location; or

data representing seating visibility.

15. The method of claim 1 , wherein the composite signal comprises audio data or visual data of one or more types selected using the second profile, wherein the types are a general venue signal, a home team venue signal, or an away team venue signal.

16. One or more non-transitory computer-readable media storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

establishing a link that includes at least a first device of a first remote participant, a second device of a second remote participant, and a venue system comprising sensors and located within an venue;

transmitting, using the link, multimedia data that includes at least one of audio data and video data;

referencing a first profile for the first remote participant and a second profile of the second remote participant;

receiving, from the first device of the first remote participant, first data representing a first multimedia data;

accessing venue data a) for the venue system and b) that represents venue multimedia data for the venue;

generating a composite signal that comprises at least a portion of the first data and the venue data, based on the first profile, the second profile, the first data, and the venue data for the venue system, wherein the venue data is different than the first data; and

transmitting, to the second device of the second remote participant, the composite signal.

17. A system comprising:

one or more computers; and

one or more computer-readable media storing instructions that, when executed, cause the one or more computers to perform operations comprising:

establishing a link that includes at least a first device of a first remote participant, a second device of a second remote participant, and a venue system comprising sensors and located within an venue;

transmitting, using the link, multimedia data that includes at least one of audio data and video data;

referencing a first profile for the first remote participant and a second profile of the second remote participant;

receiving, from the first device of the first remote participant, first data representing a first multimedia data;

accessing venue data a) for the venue system and b) that represents venue multimedia data for the venue;

generating a composite signal that comprises at least a portion of the first data and the venue data, based on the first profile, the second profile, the first data, and the venue data for the venue system, wherein the venue data is different than the first data; and

transmitting, to the second device of the second remote participant, the composite signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2023
From: RADUCHEL, WILLIAM J.
To: EINGOT LLC
Reel/Frame 064717/0276 →
Continuity (3)
Continuation 17087735 · Nov 3, 2020
Provisional Application 63005917 · Apr 6, 2020
Related Publication 20240187553A1 · Jun 6, 2024
References Cited (81)
US 7587214B2 · Inselberg · 2009 [cited by applicant]
US 8208000B1 · Swanson · 2012 [cited by examiner]
US 8214254B1 · Mowry · 2012 [cited by applicant]
US 8266313B2 · Pettinato · 2012 [cited by examiner]
US 8289362B2 · Baird · 2012 [cited by examiner]
US 8554840B1 · Milgramm · 2013 [cited by examiner]
US 8675067B2 · Chou · 2014 [cited by examiner]
US 8701153B2 · Abrams · 2014 [cited by examiner]
US 8725064B2 · Anderson, Jr. · 2014 [cited by examiner]
US 8997167B1 · Bliss · 2015 [cited by examiner]
US 9031855B2 · Ohmura et al. · 2015 [cited by applicant]
US 9066144B2 · Yerli · 2015 [cited by applicant]
US 9137495B2 · Narasimhan · 2015 [cited by examiner]
US 9544538B2 · Cahill et al. · 2017 [cited by applicant]
US 9861878B2 · Penna et al. · 2018 [cited by applicant]
US 10009568B1 · Ellis et al. · 2018 [cited by applicant]
US 10089785B2 · Demirli · 2018 [cited by examiner]
US 10699482B2 · Demirli et al. · 2020 [cited by applicant]
US 10887628B1 · Flachsbart · 2021 [cited by examiner]
US 10937239B2 · Huston et al. · 2021 [cited by applicant]
US 11115765B2 · Metzar et al. · 2021 [cited by applicant]
US 11356488B2 · Mackell · 2022 [cited by examiner]
US 11700353B2 · Raduchel · 2023 [cited by examiner]
US 20020199198A1 · Stonedahl · 2002 [cited by examiner]
US 20040002049A1 · Beavers et al. · 2004 [cited by applicant]
US 20040003040A1 · Beavers et al. · 2004 [cited by applicant]
US 20060015904A1 · Marcus · 2006 [cited by examiner]
US 20060126861A1 · Saliterman · 2006 [cited by examiner]
US 20070022447A1 · Arseneau et al. · 2007 [cited by applicant]
US 20070064125A1 · Didow · 2007 [cited by examiner]
US 20070240190A1 · Arseneau et al. · 2007 [cited by applicant]
US 20090070420A1 · Quackenbush · 2009 [cited by examiner]
US 20100182436A1 · Boman · 2010 [cited by examiner]
US 20100290638A1 · Heineman · 2010 [cited by applicant]
US 20110126255A1 · Perlman et al. · 2011 [cited by applicant]
US 20110225039A1 · Goldman et al. · 2011 [cited by applicant]
US 20110225516A1 · Goldman et al. · 2011 [cited by applicant]
US 20110225517A1 · Goldman et al. · 2011 [cited by applicant]
US 20120050456A1 · Arnao · 2012 [cited by examiner]
US 20120060101A1 · Vonog · 2012 [cited by examiner]
US 20120192087A1 · Lemmey · 2012 [cited by applicant]
US 20120262537A1 · Baker · 2012 [cited by examiner]
US 20120287230A1 · Zhao · 2012 [cited by examiner]
US 20120306992A1 · Watson · 2012 [cited by examiner]
US 20130070047A1 · DiGiovanni · 2013 [cited by examiner]
US 20130188007A1 · Duong · 2013 [cited by examiner]
US 20130216063A1 · Sherman et al. · 2013 [cited by applicant]
US 20130297302A1 · Pan · 2013 [cited by examiner]
US 20130321566A1 · Simonnet · 2013 [cited by examiner]
US 20140006518A1 · Sinkov · 2014 [cited by applicant]
US 20140033078A1 · Goldman et al. · 2014 [cited by applicant]
US 20140098180A1 · Periyannan et al. · 2014 [cited by applicant]
US 20140137162A1 · McNamee · 2014 [cited by examiner]
US 20150063553A1 · Gleim · 2015 [cited by examiner]
US 20150063572A1 · Gleim · 2015 [cited by examiner]
US 20150116449A1 · Oetting · 2015 [cited by examiner]
US 20150237295A1 · Stonedahl · 2015 [cited by examiner]
US 20160027209A1 · Demirli · 2016 [cited by examiner]
US 20160085501A1 · Denton · 2016 [cited by examiner]
US 20160173912A1 · Jabara · 2016 [cited by examiner]
US 20170111680A1 · Schneider · 2017 [cited by examiner]
US 20170201779A1 · Publicover · 2017 [cited by examiner]
US 20170353811A1 · McGibney · 2017 [cited by examiner]
US 20170365102A1 · Huston · 2017 [cited by examiner]
US 20180316948A1 · Todd · 2018 [cited by examiner]
US 20180374145A1 · Koon et al. · 2018 [cited by applicant]
US 20190104235A1 · Sarkar · 2019 [cited by applicant]
US 20190208278A1 · Pinto et al. · 2019 [cited by applicant]
US 20190215540A1 · Nicol · 2019 [cited by examiner]
US 20200073623A1 · Denton · 2020 [cited by examiner]
US 20200081682A1 · Vestal · 2020 [cited by examiner]
US 20200169763A1 · Burkhart · 2020 [cited by examiner]
US 20200213629A1 · Eden · 2020 [cited by examiner]
US 20200329273A1 · Eden · 2020 [cited by examiner]
US 20200333997A1 · Metzar et al. · 2020 [cited by applicant]
US 20200336848A1 · Metzar · 2020 [cited by examiner]
US 20210314525A1 · Raduchel · 2021 [cited by examiner]
US 20210400142A1 · Jorasch · 2021 [cited by examiner]
US 20240187553A1 · Raduchel · 2024 [cited by examiner]
International Search Report and Written Opinion in International Appln. No. PCT/US2021/025916, dated Jul. 16, 2021, 17 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/US2021/025916, mailed on Oct. 20, 2022, 16 pages. [cited by applicant]