IP Library Granted Patent US 12,308,985
Granted Patent B1
US 12,308,985 · App. 18/938,996 · Granted May 20, 2025

Multi-party collaboration methods and systems

Inventor: Dong Seo (Middle Village, NY)
H04L12/1813H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,308,985
App. No.
18/938,996
Granted
May 20, 2025
Kind
B1
Abstract

A method for multi-party collaboration involves utilizing a processor, network interface, input device, and output device to facilitate collaborative music creation. The method includes playing a backing track through the output device, recording a local performance via the input device, and transmitting the local performance to a remote device over a network. The remote device, equipped with its own processor, network interface, input device, and output device, receives the local performance, plays the backing track, and records a remote performance. The remote performance is then transmitted back to the original processor. The method enables real-time playback of the remote performance alongside the backing track, fostering seamless multi-party collaboration in music production.

Claims (65)

1. A method for multi-party collaboration, comprising:

providing a processor, a network interface in electronic communication with the processor and configured to transmit and receive data over a network, an input device in electronic communication with the processor, and an output device in electronic communication with the processor; and

using the processor:

playing a backing track via the output device;

recording a local performance via the input device;

transmitting the local performance to a remote device via the network using the network interface, the remote device including a remote processor, a remote network interface in electronic communication with the remote processor and configured to transmit and receive data over the network, a remote input device in electronic communication with the remote processor, and a remote output device in electronic communication with the remote processor, wherein the remote device is configured to, using the remote processor:

receive the local performance via the network using the remote network interface;

play the backing track via the remote output device;

play the local performance simultaneously with the backing track via the remote output device;

record a remote performance via the remote input device; and

transmit the remote performance to the processor via the network using the remote network interface;

receiving the remote performance via the network using the network interface; and

playing the remote performance simultaneously with the backing track via the output device.

2. The method of claim 1 , wherein the recording the remote performance is simultaneous with the recording the local performance.

3. The method of claim 2 , wherein the playing the local performance is simultaneous with the playing the remote performance.

4. The method of claim 1 , further comprising, using the processor, playing an interlude via the output device.

5. The method of claim 1 , wherein the recording the remote performance begins before the playing the local performance is completed.

6. The method of claim 4 , further comprising, using the processor:

using the network interface, determining a streaming latency between the processor and the remote processor; and

setting a duration of the interlude based on the streaming latency and a performance continuity rule.

7. The method of claim 6 , wherein the performance continuity rule includes a tempo of the backing track and the duration is equal to a maximum of the streaming latency and a multiple of the tempo.

8. The method of claim 1 , wherein the backing track comprises an introduction segment, and wherein the playing the backing track via the output device comprises playing the introduction segment via the output device prior to the recording the local performance.

9. The method of claim 8 , wherein the playing the backing track comprises playing the introduction segment prior to the playing the local performance.

10. The method of claim 1 , further comprising, prior to playing the backing track, using the processor, selecting the backing track.

11. The method of claim 1 , wherein the backing track includes a local performance segment and a remote performance segment, and wherein the playing the backing track via the output device comprises playing the local performance segment of the backing track simultaneously with the recording the local performance and the playing the backing track via the remote output device comprises playing the remote performance segment of the backing track simultaneously with the recording the remote performance.

12. The method of claim 1 , further comprising, using the processor, triggering an indicator, wherein the indicator includes one or more of:

a display element on a screen of a computing device;

a vibrator;

a light indicator; or

a sound emitted from the output device, wherein the output device is an audio output device.

13. A system for multi-party collaboration, comprising:

a processor;

a network interface in electronic communication with the processor and configured to transmit and receive data over a network;

an input device in electronic communication with the processor; and

an output device in electronic communication with the processor;

wherein the processor is configured to:

play a backing track via the output device;

record a local performance via the input device;

transmit the local performance to a remote device via the network using the network interface, the remote device including a remote processor, a remote network interface in electronic communication with the remote processor and configured to transmit and receive data over the network, a remote input device in electronic communication with the remote processor, and a remote output device in electronic communication with the remote processor, wherein the remote device is configured to, using the remote processor:

receive the local performance via the network using the remote network interface;

play the backing track via the remote output device;

play the local performance simultaneously with the backing track via the remote output device;

record a remote performance via the remote input device; and

transmit the remote performance to the processor via the network using the remote network interface;

receive the remote performance via the network using the network interface; and

play the remote performance simultaneously with the backing track via the output device.

14. The system of claim 13 , wherein the recording the remote performance is simultaneous with the recording the local performance and the playing the local performance is simultaneous with the playing the remote performance.

15. The system of claim 13 , further comprising, using the processor, playing an interlude via the output device.

16. The system of claim 15 , further comprising, using the processor:

using the network interface, determining a streaming latency between the processor and the remote processor; and

setting a duration of the interlude based on the streaming latency and a performance continuity rule including a tempo of the backing track, wherein the duration is equal to a maximum of the streaming latency and a multiple of the tempo.

17. The system of claim 13 , wherein the local performance comprises either or both of an audio or a visual recording.

18. The system of claim 13 , wherein the input device comprises one or more of an instrument, a microphone, or a camera.

19. The system of claim 13 , wherein the output device comprises an audio output device, and the remote output device comprises a remote audio output device.

20. A tangible, non-transitory, computer-readable medium for multi-party collaboration, the tangible, non-transitory, computer-readable medium having instructions thereupon which when executed by a processor in electronic communication with a network interface configured to transmit and receive data over a network, an input device, and an output device cause the processor to:

play a backing track via the output device;

record a local performance via the input device;

transmit the local performance to a remote device via the network using the network interface, the remote device including a remote processor, a remote network interface in electronic communication with the remote processor and configured to transmit and receive data over the network, a remote input device in electronic communication with the remote processor, and a remote output device in electronic communication with the remote processor, wherein the remote device is configured to, using the remote processor:

receive the local performance via the network using the remote network interface;

play the backing track via the remote output device;

play the local performance simultaneously with the backing track via the remote output device;

record a remote performance via the remote input device; and

transmit the remote performance to the processor via the network using the remote network interface;

receive the remote performance via the network using the network interface; and

play the remote performance simultaneously with the backing track via the output device.

References Cited (30)
US 6353174B1 · Schmidt et al. · 2002 [cited by applicant]
US 6482087B1 · Egozy · 2002 [cited by examiner]
US 6653545B2 · Redmann et al. · 2003 [cited by applicant]
US 6740803B2 · Brinkman et al. · 2004 [cited by applicant]
US 6898637B2 · Curtin et al. · 2005 [cited by applicant]
US 7405355B2 · Both et al. · 2008 [cited by applicant]
US 7518051B2 · Redmann · 2009 [cited by applicant]
US 7657224B2 · Goldberg et al. · 2010 [cited by applicant]
US 7945621B2 · Yuan et al. · 2011 [cited by applicant]
US RE42565E · Paepcke · 2011 [cited by applicant]
US 8653349B1 · White et al. · 2014 [cited by applicant]
US 8918484B2 · Moncavage et al. · 2014 [cited by applicant]
US 9274745B2 · Clements et al. · 2016 [cited by applicant]
US 9661043B2 · Walker et al. · 2017 [cited by applicant]
US 9697871B2 · Hwang et al. · 2017 [cited by applicant]
US 9857934B2 · Humphrey et al. · 2018 [cited by applicant]
US 10008190B1 · Elson · 2018 [cited by applicant]
US 10080252B2 · Sonnleitner · 2018 [cited by examiner]
US 10825480B2 · Marco et al. · 2020 [cited by applicant]
US 11196808B2 · Weinberger et al. · 2021 [cited by applicant]
US 11341947B2 · Yan et al. · 2022 [cited by applicant]
US 11546393B2 · Goldstein et al. · 2023 [cited by applicant]
US 11563504B2 · Galuten · 2023 [cited by examiner]
US 11616589B2 · Galuten · 2023 [cited by applicant]
US 11818186B2 · Marchuk et al. · 2023 [cited by applicant]
US 20220141943A1 · Choi · 2022 [cited by applicant]
US 20220215819A1 · Palmer · 2022 [cited by applicant]
US 20230031866A1 · Hudson · 2023 [cited by applicant]
WO 2013133898 · 2013 [cited by applicant]
Rottondi et al., An Overview on Networked Music Performance Technologies, Dec. 5, 2016. [cited by applicant]