Granted Patent B2

US 10,362,173 · App. 15/611,489 · Granted Jul 23, 2019

Abstract

Claims (68)

1. A system comprising:

one or more computer-readable storage media having instructions stored thereon; and

one or more processors communicatively coupled to the one or more computer-readable storage media and configured to, in response to execution of the instructions, cause the system to perform operations comprising:

receiving, from a first user device of a first user, a video mail file of a video mail message designated as being for a second user, the video mail file including an audio track that includes audio data of audio of the video mail message and a video track that includes video data of video of the video mail message;

storing the video mail file in a database;

receiving, from a second user device of the second user, a request to view the video mail message; and

in response to receiving the request to view the video mail message:

generating, from the audio track of the video mail file stored in the database, an audio stream of the audio data, the audio stream having a streaming characteristic that resembles a streaming characteristic of the audio data being sequentially obtained from audio being captured by a microphone in real-time;

generating, from the video track of the video mail file stored in the database, a video stream of the video data, the video stream having a streaming characteristic that resembles a streaming characteristic of the video data being sequentially obtained from images being captured by a video camera in real-time;

providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client of the system;

communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of the second user device using WebRTC protocols such that the second user device is able to present the video mail message based on the audio stream and the video stream;

receiving the audio stream back from the second user device;

generating a plurality of text transcriptions of the audio of the video mail message based on the audio stream received back from the second user device; and

providing the plurality of text transcriptions to the second user device while the second user device is presenting the video mail message for presentation of the text transcriptions in real-time with the presentation of the video mail message by the second user device.

2. The system of claim 1 , wherein the operations further comprise establishing a WebRTC connection between the system WebRTC client and the user-device WebRTC client in response to receiving the request to view the video mail message.

3. The system of claim 1 , wherein the operations further comprise:

receiving, from the first user device, a communication session request intended for the second user device;

communicating the communication session request to the second user device in response to the communication session request being intended for the second user device;

determining a declination of the communication session request at the second user device;

communicating a declination notification to the first user device in response to determining the declination of the communication session request; and

receiving the video mail file from the first user device based on the declination notification.

4. The system of claim 3 , wherein the first user device is configured to prompt the first user to record the video mail message in response to receiving the declination notification.

5. The system of claim 3 , wherein the operations further comprise determining the declination of the communication session request in response to the second user device not responding to the communication session request.

6. The system of claim 1 , wherein the video mail file includes recorded audio and video of the first user.

7. The system of claim 1 , wherein the first user device is configured to present text transcriptions received from the system.

8. A method comprising:

receiving, from a first user device of a first user, a video mail file of a video mail message designated as being for a second user, the video mail file including an audio track that includes audio data of audio of the video mail message and a video track that includes video data of video of the video mail message;

storing the video mail file in a database;

receiving, from a second user device of the second user, a request to view the video mail message; and

in response to receiving the request to view the video mail message:

generating, from the audio track of the video mail file stored in the database, an audio stream of the audio data, the audio stream having a streaming characteristic that resembles a streaming characteristic of the audio data being sequentially obtained from audio being captured in real-time;

generating, from the video track of the video mail file stored in the database, a video stream of the video data, the video stream having a streaming characteristic that resembles a streaming characteristic of the video data being sequentially obtained from video being captured in real-time;

providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client; and

communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of the second user device using WebRTC protocols such that the second user device is able to present the video mail message based on the audio stream and the video stream.

9. The method of claim 8 , further comprising:

generating a plurality of text transcriptions of the audio of the video mail message based on the audio stream; and

providing the plurality of text transcriptions to the second user device while the second user device is presenting the video mail message.

10. The method of claim 8 , further comprising establishing a WebRTC connection between the system WebRTC client and the user-device WebRTC client in response to receiving the request to view the video mail message.

11. The method of claim 8 , further comprising:

receiving, from the first user device, a communication session request intended for the second user device;

communicating the communication session request to the second user device in response to the communication session request being intended for the second user device;

determining a declination of the communication session request at the second user device;

communicating a declination notification to the first user device in response to determining the declination of the communication session request; and

receiving the video mail file from the first user device based on the declination notification.

12. The method of claim 11 , wherein the first user device is configured to prompt the first user to record the video mail message in response to receiving the declination notification.

13. The method of claim 11 , further comprising determining the declination of the communication session request in response to the second user device not responding to the communication session request.

14. The method of claim 8 , wherein the video mail file includes recorded audio and video of the first user.

15. At least one non-transitory computer-readable media configured to store one or more instructions that in response to being executed by at least one computing system cause performance of operations comprising:

receiving, from a first user device of a first user, a video mail file of a video mail message designated as being for a second user, the video mail file including an audio track that includes audio data of audio of the video mail message and a video track that includes video data of video of the video mail message;

storing the video mail file in a database;

receiving, from a second user device of the second user, a request to view the video mail message; and

in response to receiving the request to view the video mail message:

generating, from the audio track of the video mail file stored in the database, an audio stream of the audio data, the audio stream having a streaming characteristic that resembles a streaming characteristic of the audio data being sequentially obtained from audio being captured in real-time;

generating, from the video track of the video mail file stored in the database, a video stream of the video data, the video stream having a streaming characteristic that resembles a streaming characteristic of the video data being sequentially obtained from video being captured in real-time;

providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client; and

communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of the second user device using WebRTC protocols such that the second user device is able to present the video mail message based on the audio stream and the video stream.

16. The at least one non-transitory computer-readable media of claim 15 , wherein the operations further comprise:

generating a plurality of text transcriptions of the audio of the video mail message based on the audio stream; and

providing the plurality of text transcriptions to the second user device while the second user device is presenting the video mail message.

17. The at least one non-transitory computer-readable media of claim 15 , wherein the operations further comprise establishing a WebRTC connection between the system WebRTC client and the user-device WebRTC client in response to receiving the request to view the video mail message.

18. The at least one non-transitory computer-readable media of claim 15 , wherein the operations further comprise:

receiving, from the first user device, a communication session request intended for the second user device;

communicating the communication session request to the second user device in response to the communication session request being intended for the second user device;

determining a declination of the communication session request at the second user device;

communicating a declination notification to the first user device in response to determining the declination of the communication session request; and

receiving the video mail file from the first user device based on the declination notification.

19. The at least one non-transitory computer-readable media of claim 18 , wherein the first user device is configured to prompt the first user to record the video mail message in response to receiving the declination notification.

20. The at least one non-transitory computer-readable media of claim 15 , wherein the video mail file includes recorded audio and video of the first user.

Assignments (12)