Granted Patent B2

US 12,608,126 · App. 18/626,951 · Granted Apr 21, 2026

Inventors: Jonathan Brody (Marina Del Rey, CA); Matthew Hanover (Los Angeles, CA); Chamal Samaranayake (Venice, CA); William Wu (Marina del Rey, CA)

Assignee: SNAP INC.

G06F3/04883G06F3/017G06F3/0484G06F3/04842G06F3/04845H04M1/72403H04M1/72433H04M1/72436H04M2250/22

Abstract

Claims (83)

1 . A method comprising:

establishing an asynchronous communication mode between a first device and a second device;

selecting an individual communication mode comprising a voice transcription mode;

prior to establishing a two-way, full duplex, communication mode, between a first device and a second device, receiving speech input from a first user of the first device during the voice transcription mode;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, transcribing a first portion of the speech input while the speech input is received from the first user to generate a first transcription portion;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, causing, via the asynchronous communication mode, the first transcription portion to be presented to a second user on the second device as a voice note while the speech input continues to be received from the first user;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, transcribing a second portion of the speech input while the speech input is received from the first user to generate a second transcription portion; and

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, causing the second device to update the voice note by presenting the second transcription portion as an additional portion of the first transcription portion while the speech input continues to be received from the first user.

2 . The method of claim 1 , further comprising:

presenting a text input region on a graphical user interface of the first device;

detecting a partial swipe gesture across a first portion of the text input region;

in response to detecting the partial swipe gesture across the first portion of the text input region, transitioning the individual communication mode from a text-based communication mode to an audio message mode; and

in response to detecting a full swipe gesture across the first portion of the text input region and a second portion of the text input region, transitioning the individual communication mode to a synchronous mode of communication.

3 . The method of claim 1 , further comprising:

receiving, by the first device, a first interaction to transition from a text-based communication mode to a voice-based communication mode with a second device;

receiving speech input by a microphone of the first device;

in response to receiving the speech input prior to the first device completing the transition to the voice-based communication mode, causing the first device to transition to the voice transcription mode; and

generating an audio file comprising the speech input and a text-based communication segment comprising a transcription of the speech input in response to the first device transitioning to the voice transcription mode and prior to completing the transition to the voice-based communication mode.

4 . The method of claim 3 , further comprising:

transmitting the audio file and the text-based communication segment to the second device, the first and second devices completing the transition to the voice-based communication mode after the second device presents the audio file and the text-based communication segment to a user of the second device.

5 . The method of claim 1 , further comprising:

during a synchronous communication session, receiving input by the first device to terminate the synchronous communication session while a third portion of speech input associated with the synchronous communication session is being received by the second device;

in response to receiving the input by the first device, causing the second device to return to the asynchronous communication mode;

causing the second device to generate the voice note comprising a remaining portion of the speech input received after the synchronous communication session has been terminated; and

receiving, by the first device, the voice note comprising the remaining portion of the speech input from the second device.

6 . The method of claim 1 , further comprising:

receiving sensor data indicative of a position change in the first device; and

based on the position change in the first device, determining a desired the individual communication mode.

7 . The method of claim 6 , wherein the receiving the sensor data further comprises:

identifying a value within the sensor data, the value associated with the individual communication mode of a set of communication modes, the value indicating a distance traveled by the first device;

comparing the value indicating the distance traveled by the first device with a predetermined distance threshold; and

selecting a desired communication mode as the individual communication mode associated with the value based on the value transgressing the predetermined distance threshold.

8 . The method of claim 1 , further comprising presenting on the first device a waveform to indicate a change in the individual communication mode from a text-based communication mode to the voice transcription mode, the waveform being presented in a communication interface.

9 . The method of claim 1 , further comprising:

accessing information comprising a plurality of values representing movement of a first device from a gyroscope and an accelerometer of the first device;

identifying an individual value of the plurality of values as a primary value based on an amount of change associated with each of the plurality of values;

detecting a change to a physical spatial position or an orientation of the first device based on the identified individual value; and

comparing the change to a predetermined threshold.

10 . The method of claim 9 , wherein the individual communication mode transitions in response to determining that the change transgresses the predetermined threshold.

11 . A system, comprising:

one or more processors configured to perform operations comprising:

establishing an asynchronous communication mode between a first device and a second device;

selecting an individual communication mode comprising a voice transcription mode;

prior to establishing a two-way, full duplex, communication mode, between a first device and a second device, receiving speech input from a first user of the first device during the voice transcription mode;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, transcribing a first portion of the speech input while the speech input is received from the first user to generate a first transcription portion;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, causing, via the asynchronous communication mode, the first transcription portion to be presented to a second user on the second device as a voice note while the speech input continues to be received from the first user;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, transcribing a second portion of the speech input while the speech input is received from the first user to generate a second transcription portion; and

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, causing the second device to update the voice note by presenting the second transcription portion as an additional portion of the first transcription portion while the speech input continues to be received from the first user.

12 . The system of claim 11 , further comprising operations for:

detecting a swipe gesture on the first device in which a finger contacts a display screen and slides to a point on the display screen;

in response to determining that the finger remains in contact with the display screen at the point on the display screen, initiating recording of the voice note including presenting a waveform; and

in response to determining that the finger has been released from the point on the display screen after initiating recording of the voice note, ending recording of the voice note and initiating transmission of the voice note to the second device.

13 . The system of claim 11 , further comprising operations for:

determining a first difference corresponding to a first of a plurality of values, the first difference representing a difference between a starting and ending quantity of orientation of the first device;

determining a second difference corresponding to an individual value, the second difference representing a difference between a starting and ending quantity of a physical spatial position of the first device;

determining that the second difference is greater than the first difference; and

selecting the individual value as a primary value for comparing to a predetermined threshold in response to determining that the second difference is greater than the first difference.

14 . The system of claim 11 , further comprising operations for:

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, presenting on a display of the second device an indication that the speech input is currently being received from the first user of the first device, indicating that the first user is currently talking.

15 . The system of claim 11 , further comprising operations for:

receiving sensor data indicative of a position change in the first device; and

based on the position change in the first device, determining the individual communication mode.

16 . The system of claim 15 , wherein the receiving the sensor data further comprises:

identifying a value within the sensor data, the value associated with the individual communication mode of a set of communication modes, the value indicating a distance traveled by the first device;

comparing the value indicating the distance traveled by the first device with a predetermined distance threshold; and

selecting a desired communication mode as the individual communication mode associated with the value based on the value transgressing the predetermined distance threshold.

17 . The system of claim 11 , further comprising operations for displaying on the second device an indication that the first device is creating the voice note.

18 . A non-transitory machine-readable storage medium storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:

establishing an asynchronous communication mode between a first device and a second device;

selecting an individual communication mode comprising a voice transcription mode;

prior to establishing a two-way, full duplex, communication mode, between a first device and a second device, receiving speech input from a first user of the first device during the voice transcription mode;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, transcribing a first portion of the speech input while the speech input is received from the first user to generate a first transcription portion;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, causing, via the asynchronous communication mode, the first transcription portion to be presented to a second user on the second device as a voice note while the speech input continues to be received from the first user;

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, transcribing a second portion of the speech input while the speech input is received from the first user to generate a second transcription portion; and

prior to establishing the two-way, full duplex, communication mode, between the first device and the second device, causing the second device to update the voice note by presenting the second transcription portion as an additional portion of the first transcription portion while the speech input continues to be received from the first user.

19 . The non-transitory machine-readable storage medium of claim 18 , further comprising operations for:

receiving, by the first device, a first interaction to transition from a text-based communication mode to a voice-based communication mode with a second device;

receiving speech input by a microphone of the first device;

in response to receiving the speech input prior to the first device completing the transition to the voice-based communication mode, causing the first device to transition to the voice transcription mode; and

generating an audio file comprising the speech input and a text-based communication segment comprising a transcription of the speech input in response to the first device transitioning to the voice transcription mode and prior to completing the transition to the voice-based communication mode.

20 . The non-transitory machine-readable storage medium of claim 18 , further comprising operations for:

receiving sensor data indicative of a position change in the first device; and

based on the position change in the first device, determining the individual communication mode.

Assignments (2)

Continuity (6)

References Cited (234)