IP Library › Granted Patent US 11,256,414
Granted Patent B2
US 11,256,414 · App. 16/947,709 · Granted Feb 22, 2022

Hybridization of voice notes and calling

Inventors: Jonathan Brody (Marina Del Rey, CA); Matthew Hanover (Los Angeles, CA); Chamal Samaranayake (Venice, CA); William Wu (Marina del Rey, CA)
Assignee: Snap Inc.
G06F3/04883G06F3/017G06F3/0484G06F3/04842G06F3/04845H04M1/72403H04M1/72433H04M1/72436H04M2250/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,256,414
App. No.
16/947,709
Filed
Aug 13, 2020
Granted
Feb 22, 2022
Kind
B2
Examiner
LU, HUA
Art Unit
2171
USPC
715/863
Abstract

A system and method for receiving a user interaction with a user interface of a client device, determining a current communication mode and a desired communication mode, where the desired communication mode is determined based on the user interaction received by the sensor module. The system further sets the desired communication mode as the current communication mode, and causes presentation of a user interface of the client device based on the desired communication mode being set as the current communication mode.

Claims (82)

1. A method comprising:

receiving, by a first client device, a first interaction to transition from a text-based communication mode to a voice-based communication mode with a second client device;

prior to the first client device completing the transition to the voice-based communication mode, receiving speech input by a microphone of the first client device;

in response to receiving the speech input prior to the first client device completing the transition to the voice-based communication mode, causing the first client device to transition to a voice transcription mode;

generating an audio file comprising the speech input and a text-based communication segment comprising a transcription of the speech input in response to the first client device transitioning to the voice transcription mode and prior to completing the transition to the voice-based communication mode; and

transmitting the audio file and the text-based communication segment to the second client device, the first and second client device completing the transition to the voice-based communication mode after the second client device presents the audio file and the text-based communication segment to a user of the second client device.

2. The method of claim 1 , further comprising:

during a synchronous communication session, receiving input by the first client device to terminate the synchronous communication session while a first portion of speech input associated with the synchronous communication session is being received by the second client device;

in response to receiving the input by the first client device, causing the second client device to return to an asynchronous communication mode;

causing the second client device to generate a voice note comprising a remaining portion of the speech input received after the synchronous communication session has been terminated; and

receiving, by the first client device, the voice note comprising the remaining portion of the speech input from the second client device.

3. The method of claim 1 , further comprising:

receiving communications data from the second client device;

in response to receiving communications data, determining a communication type for the communications data;

based on the communication type, identifying a communication mode from a set of communication modes which receives input associated with the communication type for the received communications data; and

causing presentation of a default communication mode, the default communication mode being the identified communication mode.

4. The method of claim 1 , further comprising:

receiving sensor data indicative of a position change in the first client device; and

based on the position change in the first client device, determining a desired communication mode.

5. The method of claim 4 , wherein the receiving the sensor data further comprises:

identifying a value within the sensor data, the value associated with a communication mode of a set of communication modes, the value indicating a distance traveled by the first client device;

comparing the value indicating the distance traveled by the first client device with a predetermined distance threshold; and

selecting a desired communication mode as the communication mode associated with the value based on the value exceeding the predetermined distance threshold.

6. The method of claim 4 , further comprising:

receiving communications data from the second client device, the communications data including a mode indication representing a suggested communication mode for responding to the communications data;

determining a compatible communication mode based on the desired communication mode and the suggested communication mode; and

causing the first client device to set the compatible communication mode as a current communication mode.

7. The method of claim 1 , further comprising:

determining that the second client device is unavailable to communicate in a synchronous communication mode; and

maintaining an asynchronous communication session at first client device regardless of receiving user interaction that is associated with the synchronous communication mode.

8. The method of claim 1 , further comprising displaying on the first client device an indication that a user of the second client device is creating a voice note.

9. A system, comprising:

one or more processors configured to perform operations comprising:

receiving, by a first client device, a first interaction to transition from a text-based communication mode to a voice-based communication mode with a second client device;

prior to the first client device completing the transition to the voice-based communication mode, receiving speech input by a microphone of the first client device;

in response to receiving the speech input prior to the first client device completing the transition to the voice-based communication mode, causing the first client device to transition to a voice transcription mode;

generating an audio file comprising the speech input and a text-based communication segment comprising a transcription of the speech input in response to the first client device transitioning to the voice transcription mode and prior to completing the transition to the voice-based communication mode; and

transmitting the audio file and the text-based communication segment to the second client device, the first and second client device completing the transition to the voice-based communication mode after the second client device presents the audio file and the text-based communication segment to a user of the second client device.

10. The system of claim 9 , further comprising operations for:

during a synchronous communication session, receiving input by the first client device to terminate the synchronous communication session while a first portion of speech input associated with the synchronous communication session is being received by the second client device;

in response to receiving the input by the first client device, causing the second client device to return to an asynchronous communication mode;

causing the second client device to generate a voice note comprising a remaining portion of the speech input received after the synchronous communication session has been terminated; and

receiving, by the first client device, the voice note comprising the remaining portion of the speech input from the second client device.

11. The system of claim 9 , further comprising operations for:

receiving communications data from the second client device;

in response to receiving communications data, determining a communication type for the communications data;

based on the communication type, identifying a communication mode from a set of communication modes which receives input associated with the communication type for the received communications data; and

causing presentation of a default communication mode, the default communication mode being the identified communication mode.

12. The system of claim 9 , further comprising operations for:

receiving sensor data indicative of a position change in the first client device; and

based on the position change in the first client device, determining a desired communication mode.

13. The system of claim 12 , wherein the receiving the sensor data further comprises:

identifying a value within the sensor data, the value associated with a communication mode of a set of communication modes, the value indicating a distance traveled by the first client device;

comparing the value indicating the distance traveled by the first client device with a predetermined distance threshold; and

selecting a desired communication mode as the communication mode associated with the value based on the value exceeding the predetermined distance threshold.

14. The system of claim 12 , further comprising operations for:

receiving communications data from the second client device, the communications data including a mode indication representing a suggested communication mode for responding to the communications data;

determining a compatible communication mode based on the desired communication mode and the suggested communication mode; and

causing the first client device to set the compatible communication mode as a current communication mode.

15. The system of claim 9 , further comprising operations for:

determining that the second client device is unavailable to communicate in a synchronous communication mode; and

maintaining an asynchronous communication session at first client device regardless of receiving user interaction that is associated with the synchronous communication mode.

16. The system of claim 9 , further comprising operations for displaying on the first client device an indication that a user of the second client device is creating a voice note.

17. A non-transitory machine-readable storage medium storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:

receiving, by a first client device, a first interaction to transition from a text-based communication mode to a voice-based communication mode with a second client device;

prior to the first client device completing the transition to the voice-based communication mode, receiving speech input by a microphone of the first client device;

in response to receiving the speech input prior to the first client device completing the transition to the voice-based communication mode, causing the first client device to transition to a voice transcription mode;

generating an audio file comprising the speech input and a text-based communication segment comprising a transcription of the speech input in response to the first client device transitioning to the voice transcription mode and prior to completing the transition to the voice-based communication mode; and

transmitting the audio file and the text-based communication segment to the second client device, the first and second client device completing the transition to the voice-based communication mode after the second client device presents the audio file and the text-based communication segment to a user of the second client device.

18. The non-transitory machine-readable storage medium of claim 17 , further comprising operations for:

during a synchronous communication session, receiving input by the first client device to terminate the synchronous communication session while a first portion of speech input associated with the synchronous communication session is being received by the second client device;

in response to receiving the input by the first client device, causing the second client device to return to an asynchronous communication mode;

causing the second client device to generate a voice note comprising a remaining portion of the speech input received after the synchronous communication session has been terminated; and

receiving, by the first client device, the voice note comprising the remaining portion of the speech input from the second client device.

19. The non-transitory machine-readable storage medium of claim 18 , further comprising operations for:

receiving communications data from the second client device;

in response to receiving communications data, determining a communication type for the communications data;

based on the communication type, identifying a communication mode from a set of communication modes which receives input associated with the communication type for the received communications data; and

causing presentation of a default communication mode, the default communication mode being the identified communication mode.

20. The non-transitory machine-readable storage medium of claim 17 , further comprising operations for:

receiving sensor data indicative of a position change in the first client device; and

based on the position change in the first client device, determining a desired communication mode.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: BRODY, JONATHAN; HANOVER, MATTHEW; SAMARANAYAKE, CHAMAL; WU, WILLIAM
To: SNAPCHAT, INC.
Reel/Frame 058149/0200 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: SNAPCHAT, INC.
To: SNAP INC.
Reel/Frame 058149/0264 →
Continuity (4)
Continuation 14949785 · Nov 23, 2015
Provisional Application 62119963 · Feb 24, 2015
Provisional Application 62085209 · Nov 26, 2014
Related Publication 20200371682A1 · Nov 26, 2020
Cited By (3)
US 12,216,519 US 12,608,126 US 12,645,280