IP Library Granted Patent US 12682895
Granted Patent B1
US 12682895 · App. 18/136,905 · Granted Jul 14, 2026

Presenting a text representation of audible signal data based on language context

Inventors: Ioana Negoita (San Jose, CA); Brian W. Temple (Santa Clara, CA)
Assignee: Apple Inc.
G10L15/183G06F40/166G10L13/02G10L15/005G10L15/22G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12682895
App. No.
18/136,905
Granted
Jul 14, 2026
Kind
B1
Abstract

Various implementations disclosed herein include devices, systems, and methods for presenting text representations of audible signal data based on language context. In some implementations, a first device includes a display, one or more processors, and a memory. The first device receives a first text representation of an audio signal corresponding to a spoken phrase detected at a second device. The first device determines a second text representation based on the first text representation, first language context information associated with the first device, and second language context information associated with the second device. The second text representation is presented via an output device.

Claims (76)

1 . A method comprising:

at a first device comprising an output device, one or more processors, and a memory:

transmitting device status data to a second device, wherein the device status data indicates a resource availability of the first device;

receiving from the second device a first text representation of audible signal data corresponding to a spoken phrase detected at the second device in response to the resource availability of the first device being less than a resource availability threshold;

determining a second text representation based on the first text representation, first language context information associated with the first device, and second language context information associated with the second device; and

presenting the second text representation via the output device.

2 . The method of claim 1 , wherein determining the second text representation comprises:

determining whether the first language context information and the second language context information satisfy a similarity threshold; and

on a condition that the first language context information and the second language context information do not satisfy the similarity threshold, generating the second text representation by modifying the first text representation based on a difference between the first language context information and the second language context information.

3 . The method of claim 1 , wherein the first language context information indicates a first language associated with the first device and the second language context information indicates a second language associated with the second device; and

wherein determining the second text representation comprises translating the first text representation from the second language to the first language.

4 . The method of claim 1 , wherein the first language context information indicates a first locale associated with the first device and the second language context information indicates a second locale associated with the second device; and

wherein determining the second text representation comprises modifying the first text representation based on linguistic differences between the first locale and the second locale.

5 . The method of claim 1 , wherein the first language context information indicates a first vocabulary associated with the first device and the second language context information indicates a second vocabulary associated with the second device; and

wherein determining the second text representation comprises replacing a phrase in the first text representation with a replacement phrase from the first vocabulary.

6 . The method of claim 1 , wherein the first language context information indicates a first verbosity associated with the first device and the second language context information indicates a second verbosity associated with the second device; and

wherein determining the second text representation comprises modifying the first text representation to match the first verbosity associated with the first device.

7 . The method of claim 1 , wherein determining the second text representation comprises:

determining whether the first language context information and the second language context information satisfy a similarity threshold; and

on a condition that the first language context information and the second language context information satisfy the similarity threshold, using the first text representation as the second text representation.

8 . The method of claim 1 , wherein presenting the second text representation comprises:

determining whether or not the second text representation includes a complete phrase or a complete sentence; and

outputting the second text representation in response to determining that the second text representation includes a complete phrase or a complete sentence.

9 . A first device comprising:

one or more processors;

a non-transitory memory;

an output device;

an input device; and

one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:

transmit device status data to a second device, wherein the device status data indicates a resource availability of the first device;

receive from the second device a first text representation of audible signal data corresponding to a spoken phrase detected at the second device in response to the resource availability of the first device being less than a resource availability threshold;

determine a second text representation based on the first text representation, first language context information associated with the first device, and second language context information associated with the second device; and

present the second text representation via the output device.

10 . A non-transitory memory storing one or more programs, which, when executed by one or more processors of a first device including an input device and an output device, cause the first device to:

transmit device status data to a second device, wherein the device status data indicates a resource availability of the first device;

receive from the second device a first text representation of audible signal data corresponding to a spoken phrase detected at the second device in response to the resource availability of the first device being less than a resource availability threshold;

determine a second text representation based on the first text representation, first language context information associated with the first device, and second language context information associated with the second device; and

present the second text representation via the output device.

11 . The method of claim 1 , further comprising:

constructing one or more of audio and video of a user uttering the spoken phrase based on the first text representation.

12 . The non-transitory memory of claim 10 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to determine the first language context information based on a profile associated with the first device.

13 . The non-transitory memory of claim 10 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to receive the second language context information from the second device.

14 . The non-transitory memory of claim 10 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to determine the second language context information based on a profile associated with the second device.

15 . The non-transitory memory of claim 10 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to determine the second language context information based on the first text representation.

16 . The non-transitory memory of claim 10 , wherein the output device includes one or more speakers, and wherein presenting the second text representation comprises:

generating an audio representation of the second text representation; and

presenting the audio representation via the one or more speakers.

17 . The non-transitory memory of claim 10 , wherein receiving the first text representation of audible signal data comprises:

receiving an audio input at the first device; and

generating the first text representation based on the audio input.

18 . The non-transitory memory of claim 17 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to:

receive, from the second device, device status data that indicates a resource availability of the second device; and

generate the first text representation based on the audio input in response to the resource availability of the second device being below a resource availability threshold associated with generating the first text representation.

19 . The non-transitory memory of claim 10 , wherein the output device comprises one or more speakers, and wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to:

obtain the audible signal data that is associated with the first text representation;

determine that the audible signal data is distorted beyond a distortion threshold;

generate new audible signal data based on the first text representation; and

output the new audible signal data via the one or more speakers.

20 . The first device of claim 9 , wherein receiving the first text representation of audible signal data comprises:

receiving an audio input at the first device; and

generating the first text representation based on the audio input.

21 . The first device of claim 20 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to:

receive, from the second device, device status data that indicates a resource availability of the second device; and

generate the first text representation based on the audio input in response to the resource availability of the second device being below a resource availability threshold associated with generating the first text representation.

22 . The first device of claim 9 , wherein the output device comprises one or more speakers, and wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to:

obtain the audible signal data that is associated with the first text representation;

determine that the audible signal data is distorted beyond a distortion threshold;

generate new audible signal data based on the first text representation; and

output the new audible signal data via the one or more speakers.

23 . The first device of claim 9 , wherein the output device comprises one or more displays, and wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to:

obtain image data that is associated with the first text representation;

determine that the image data is distorted beyond a distortion threshold;

generate new image data based on the first text representation; and

display the new image data on the one or more displays.

24 . The first device of claim 9 , wherein the one or more programs, which, when executed by the one or more processors of the first device, further cause the first device to:

construct one or more of audio and video of a user uttering the spoken phrase based on the first text representation.