IP Library Granted Patent US 11,658,927
Granted Patent B2
US 11,658,927 · App. 17/977,948 · Granted May 23, 2023

Telecommunication and multimedia management method and apparatus

Inventors: Thomas E. Katis (Jackson, WY); James T. Panttaja (San Francisco, CA); Mary G. Panttaja (San Francisco, CA); Matthew J. Ranney (Oakland, CA)
Assignee: Voxer IP LLC
E04H3/126
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,658,927
App. No.
17/977,948
Granted
May 23, 2023
Kind
B2
Abstract

A telecommunication and multimedia management apparatus and method that supports voice and other media communications and that enables users to: (i) participate in multiple conversation modes, including live phone calls, conference calls, instant voice messaging or tactical communications; (ii) review the messages of conversations in either a live mode or a time-shifted mode and to seamlessly transition back and forth between the two modes; (iii) participate in multiple conversations either concurrently or simultaneously; (iv) archive the messages of conversations for later review or processing; and (v) persistently store media either created or received on the communication devices of users. The latter feature enables users to generate or review media when either disconnected from the network or network conditions are poor and to optimize the delivery of media over the network based on network conditions and the intention of the users participating in conversations.

Claims (55)

1. A method for operating a multi-media conversation service, the method comprising:

enabling a conversation initiator to initiate a multi-media conversation, conducted over a network, by creating and disseminating to one or more participants a video message that may be selectively rendered in a real-time mode by:

(a) enabling the conversation initiator to define the one or more participants;

(b) ascertaining, by a server infrastructure located on the network, one or more receiving devices associated with the one or more participants respectively;

(c) delivering, via the server infrastructure, to one or more of the receiving devices at least portions of video media of the video message for rendering in the real-time mode as the video media of the video message is streamed over the network by a sending device, wherein the rendering of the at least portions of the video media of the video messages in the real-time mode occurs:

(i) without having to first establish an end-to-end connection over the network between the sending device and any of the one or more receiving devices respectively; and

(ii) after (a) and (b), but while streaming of the video media of the video message is occurring;

(d) enabling the one or more participants, or the conversation initiator, to add one or more other messages associated with the video message, the one or more other messages containing one or more types of media;

(e) threading together the one or more other messages associating the video message to construct the multi-media conversation; and

(f) enabling the conversation initiator, and any of the one or more participants, to selectively engage in the multi-media conversation by one of:

(iii) rendering the video media of the video message in the real-time mode or a time-shifted mode;

(iv) rendering the one or more other messages that are threaded together;

(v) add a new message that is added to the one or more other messages that are threaded together, or

(vi) any combination of (iii) through (vi).

2. The method of claim 1 , wherein the addition of at least one of the other messages overlaps with the streaming of the video media of the video message by the sending device.

3. The method of claim 1 , further comprising simultaneously rendering:

the video media of the video message in the real time mode;

the one or more other messages that are threaded together; and

any new messages that are added to the one or more other messages that are threaded together while the video media of the video message is being streamed by the sending device.

4. The method of claim 1 , wherein at least one of the other messages is added to the one or more other messages that are threaded together after the streaming of the video media of the video message by the sending device is complete.

5. The method of claim 1 , further comprising:

storing the video media of the video message in a storage location accessible by the server infrastructure; and

providing the video media of the video message from the storage location to any of the one or more receiving devices for rendering in the time-shifted mode.

6. The method of claim 1 , further comprising enabling the one or more participants to selectively added the one or more other messages of the multi-media conversation either during or after the rendering of the video media of the video message in the time shifted mode.

7. The method of claim 1 , wherein the one or more other messages are threaded together in a time-order in which the one or more other messages were added to the multi-media conversation.

8. The method of claim 1 , wherein the media contained in the other messages include one or more of the following: voice; video; photo; text; location data; sensor data; image; or other data.

9. The method of claim 1 , wherein defining the one or more participants comprises selecting by the conversation initiator one or more contacts.

10. The method of claim 1 , wherein the video media of the video message is disseminated only to the one or more participants and not disseminated to other users of the multi-media conversation service.

11. The method of claim 1 , wherein defining the one or more participants further comprises selecting a group of users.

12. The method of claim 1 , wherein defining the one or more participants of the conversation further comprises selecting a channel with the one or more participants associated therewith.

13. The method of claim 1 , further comprising:

enabling the conversation initiator to initiate multiple multi-media conversations by creating and disseminating multiple video messages, each of which may be selectively rendered in the real-time mode and has associated therewith an associated thread of one or more other messages; and

enabling the conversation initiator to selectively switch participation among the multiple multi-media conversations.

14. The method of claim 1 , further comprising tagging the multi-media conversation using one or more tags.

15. The method of claim 1 , further comprising configuring the multi-media conversation to be searchable using one or more tags.

16. The method of claim 1 , further comprising transcoding the video media of the video message from one encoding format to a second encoding format suitable for rendering on a select receiving device.

17. The method of claim 1 , further comprising degrading a quality of the video media of the video message to enhance an ability of a select receiving device to render the video media of the video message in the real-time mode when network conditions along a delivery route to the select receiving device are poor.

18. The method of claim 17 , wherein the quality of the video media is degraded to a degree commensurate with an ascertained bandwidth as measured by packet loss along the delivery route over the network to the select receiving device.

19. The method of claim 1 , further comprising providing two or more rendering options for rendering the video media of the video message, the two or more rendering options including: play; play fast; play slow; jump back; jump forward; jump to start; jump to head; rewind; pause; and play again.

20. The method of claim 1 , further comprising assigning one or more attributes to the video message and the one or more other messages that are threaded together, the one or more attributes including (g) a name for the video message; (h) a name for the conversation initiator, (i) a name or names of the participant(s) that added the other messages, (j) a date and time stamp when the video message or the other messages were added, or (k) any combination of (g) through (j).

21. The method of claim 1 , wherein the streaming or delivery of the video media of the video message further comprises:

segmenting the video media of the video message into a sequence of segments, each of the segments including a payload;

adaptively adjusting a number of bits representing the video media of the video message contained in the payloads of the segments, the number of bits adaptively adjusted based on an ascertained bandwidth over a network connection; and

transmitting the sequence of segments, with the adaptively adjusted number of bits contained in the payloads, over the network connection.

22. The method of claim 1 , further comprising:

optionally transcoding the video media of the video message as needed for the one or more receiving devices respectively; and

selectively streaming the video media of the video message using a real-time streaming protocol, either as originally encoded or as transcoded, to the one or more receiving devices respectively.

23. The method of claim 1 , further comprising adaptively adjusting a number of bits contained in video media payloads used to deliver the video message to the one or more receiving devices, the adaptive adjustment based on bandwidth conditions over network connection(s) between the server infrastructure and the one or more receiving devices respectively.

24. The method of claim 1 , further comprising segmenting the video message into a plurality of indexed media payloads, the plurality of indexed media payloads time-stamped, sequentially numbered, and associated by a message identifier.

25. The method of claim 1 , wherein the video media of the video message and the one or more other messages associated with the video message are stored in multiple locations which are accessible by one or more servers included in the server infrastructure.

26. The method of claim 1 , further comprising enabling the conversation initiator to initiate multiple conversations with new video messages at fixed time intervals respectively.

27. The method of claim 1 , further enabling the one or more participants to interact with and participate in the multi-media conversation through a user interface on the one or more receiving devices respectively.

28. The method of claim 1 , further comprising assigning one or more attributes to the multi-media conversation, the one or more attributes selected from a conversation name, identifiers for the one or more participants, an identifier for the conversation initiator, a begin time, or an end time.

29. The method of claim 1 , further comprising notifying the one or more participants of the video message by the conversation initiator.

30. The method of claim 1 , further comprising requiring the conversation initiator and the one or more participants to log into and be authenticated by the multi-media conversation service before initiating, interacting, or participating in the multi-media conversation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2023
From: KATIS, THOMAS E.; PANTTAJA, JAMES T.; PANTTAJA, MARY G.; RANNEY, MATTHEW J.
To: VOXER IP LLC
Reel/Frame 062454/0814 →
Continuity (17)
Continuation 17889108 · Aug 16, 2022
Continuation 17473199 · Sep 13, 2021
Continuation 17062060 · Oct 2, 2020
Continuation 16669865 · Oct 31, 2019
Continuation 16161474 · Oct 16, 2018
Continuation 15937361 · Mar 27, 2018
Continuation 15923287 · Mar 16, 2018
Continuation 15584224 · May 2, 2017
Continuation 15231240 · Aug 8, 2016
Continuation 14799528 · Jul 14, 2015
Continuation 14198043 · Mar 5, 2014
Continuation 13555034 · Jul 20, 2012
Continuation 12037256 · Feb 26, 2008
Continuation 12028400 · Feb 8, 2008
Provisional Application 60937552 · Jun 28, 2007
Provisional Application 60999619 · Oct 19, 2007
Related Publication 20230047999A1 · Feb 16, 2023