IP Library › Granted Patent US 12,744,843
Granted Patent B2
US 12,744,843 · App. 19/020,992 · Granted Sep 22, 2026

Interfaces and devices for dynamically-available media playback

Inventors: Taylor G. Carrigan (San Francisco, CA); Pedro Mari (Santa Cruz, CA)
Assignee: Apple Inc.
H04M1/72415G06F3/0482H04M1/72412H04M1/72454H04M1/72463
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,744,843
App. No.
19/020,992
Granted
Sep 22, 2026
Kind
B2
Abstract

The present disclosure generally relates to managing dynamically-available media playback and adapting visual outputs based on device capabilities and a state of the device. In some embodiments, a computer system manages whether an external electronic device is configurable to be available for a first media playback function. In some embodiments, a computer system selective causes an external electronic device to respond to a request to perform a media playback operation. In some embodiments, an electronic device adapts visual outputs based on device capabilities and a state of the device.

Claims (111)

1 . An electronic device that includes a set of one or more visual components, comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

while the electronic device is operating in a first state, detecting a change from the first state to an updated state; and

in response to detecting the change from the first state to the updated state:

in accordance with a determination that the updated state is a second state, different from the first state:

in accordance with the set of one or more visual output devices having a first set of visual output capabilities, providing, via the set of one or more visual output devices, a first type of visual output; and

in accordance with the set of one or more visual output devices having a second set of visual output capabilities, different from the first set of visual output capabilities, providing, via the set of one or more visual output devices, a second type of visual output, different from the first type of visual output; and

in accordance with a determination that the updated state is a third state, different from the first state and the second state:

in accordance with the set of one or more visual output devices having a third set of visual output capabilities, providing, via the set of one or more visual output devices, a third type of visual output; and

in accordance with the set of one or more visual output devices having a fourth set of visual output capabilities, different from the third set of visual output capabilities, providing, via the set of one or more visual output devices, a fourth type of visual output, different from the third type of visual output.

2 . The electronic device of claim 1 , wherein:

the one or more visual output devices have the first set of visual output capabilities when the one or more visual output devices are capable of providing a first type of visual output; and

the one or more visual output devices have the second set of visual output capabilities when the one or more visual output devices are capable of providing a second type of visual output, different than the first type of visual output.

3 . The electronic device of claim 1 , wherein:

the first set of visual output capabilities include the one or more visual output devices being capable of providing visual output that is responsive to audio input that is detected by one or more microphones that are in communication with the electronic device; and

the second set of visual output capabilities do not include the one or more visual output devices being capable of providing visual output that is responsive to audio input that is detected by one or more microphones that are in communication with the electronic device.

4 . The electronic device of claim 1 , wherein:

the second state includes the electronic device being in a first digital assistant activity state; and

the third state includes the electronic device being in a second digital assistant activity state, different from the first digital assistant activity state.

5 . The electronic device of claim 4 , wherein the first digital assistant activity state is selected from the group consisting of: an idle digital assistant state, a listening digital assistant state, a request-processing digital assistant state, a responding digital assistant state.

6 . The electronic device of claim 1 , wherein:

the second state includes the electronic device being in a first audio playback state; and

the third state includes the electronic device being in a second audio playback state, different from the first audio playback state.

7 . The electronic device of claim 6 , wherein the first audio playback state is selected from the group consisting of: a state in which the electronic device is outputting an audio alarm notification, a state in which the electronic device is outputting an audio timer notification, a state in which the electronic device is outputting audio from an inter-device communication, and a state in which the electronic device is outputting audio media.

8 . The electronic device of claim 1 , wherein:

the first type of visual output is a predetermined output;

the second type of visual output is a dynamic visual output based on one or more dynamic variables.

9 . The electronic device of claim 1 , wherein:

the first type of visual output includes one or more visual characteristics that vary based on audio input that is detected by one or more microphones that are in communication with the electronic device; and

the second type of visual output does not vary based on audio input that is detected by one or more microphones that are in communication with the electronic device.

10 . The electronic device of claim 1 , wherein:

the updated state includes the electronic device outputting a first audio output;

the first type of visual output includes one or more visual characteristics that vary based on the first audio output; and

the second type of visual output does not vary based on the first audio output.

11 . The electronic device of claim 1 , wherein:

the first type of visual output includes a first output color pattern; and

the second type of visual output includes a second output color pattern, different from the first output color pattern.

12 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device that includes a set of one or more visual output devices, the one or more programs including instructions for:

while the electronic device is operating in a first state, detecting a change from the first state to an updated state; and

in response to detecting the change from the first state to the updated state:

in accordance with a determination that the updated state is a second state, different from the first state:

in accordance with the set of one or more visual output devices having a first set of visual output capabilities, providing, via the set of one or more visual output devices, a first type of visual output; and

in accordance with the set of one or more visual output devices having a second set of visual output capabilities, different from the first set of visual output capabilities, providing, via the set of one or more visual output devices, a second type of visual output, different from the first type of visual output; and

in accordance with a determination that the updated state is a third state, different from the first state and the second state:

in accordance with the set of one or more visual output devices having a third set of visual output capabilities, providing, via the set of one or more visual output devices, a third type of visual output; and

in accordance with the set of one or more visual output devices having a fourth set of visual output capabilities, different from the third set of visual output capabilities, providing, via the set of one or more visual output devices, a fourth type of visual output, different from the third type of visual output.

13 . A method, comprising:

at an electronic device that includes a set of one or more visual output devices:

while the electronic device is operating in a first state, detecting a change from the first state to an updated state; and

in response to detecting the change from the first state to the updated state:

in accordance with a determination that the updated state is a second state, different from the first state:

in accordance with the set of one or more visual output devices having a first set of visual output capabilities, providing, via the set of one or more visual output devices, a first type of visual output; and

in accordance with the set of one or more visual output devices having a second set of visual output capabilities, different from the first set of visual output capabilities, providing, via the set of one or more visual output devices, a second type of visual output, different from the first type of visual output; and

in accordance with a determination that the updated state is a third state, different from the first state and the second state:

in accordance with the set of one or more visual output devices having a third set of visual output capabilities, providing, via the set of one or more visual output devices, a third type of visual output; and

in accordance with the set of one or more visual output devices having a fourth set of visual output capabilities, different from the third set of visual output capabilities, providing, via the set of one or more visual output devices, a fourth type of visual output, different from the third type of visual output.

14 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the one or more visual output devices have the first set of visual output capabilities when the one or more visual output devices are capable of providing a first type of visual output; and

the one or more visual output devices have the second set of visual output capabilities when the one or more visual output devices are capable of providing a second type of visual output, different than the first type of visual output.

15 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the first set of visual output capabilities include the one or more visual output devices being capable of providing visual output that is responsive to audio input that is detected by one or more microphones that are in communication with the electronic device; and

the second set of visual output capabilities do not include the one or more visual output devices being capable of providing visual output that is responsive to audio input that is detected by one or more microphones that are in communication with the electronic device.

16 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the second state includes the electronic device being in a first digital assistant activity state; and

the third state includes the electronic device being in a second digital assistant activity state, different from the first digital assistant activity state.

17 . The non-transitory computer-readable storage medium of claim 16 , wherein the first digital assistant activity state is selected from the group consisting of: an idle digital assistant state, a listening digital assistant state, a request-processing digital assistant state, a responding digital assistant state.

18 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the second state includes the electronic device being in a first audio playback state; and

the third state includes the electronic device being in a second audio playback state, different from the first audio playback state.

19 . The non-transitory computer-readable storage medium of claim 18 , wherein the first audio playback state is selected from the group consisting of: a state in which the electronic device is outputting an audio alarm notification, a state in which the electronic device is outputting an audio timer notification, a state in which the electronic device is outputting audio from an inter-device communication, and a state in which the electronic device is outputting audio media.

20 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the first type of visual output is a predetermined output;

the second type of visual output is a dynamic visual output based on one or more dynamic variables.

21 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the first type of visual output includes one or more visual characteristics that vary based on audio input that is detected by one or more microphones that are in communication with the electronic device; and

the second type of visual output does not vary based on audio input that is detected by one or more microphones that are in communication with the electronic device.

22 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the updated state includes the electronic device outputting a first audio output;

the first type of visual output includes one or more visual characteristics that vary based on the first audio output; and

the second type of visual output does not vary based on the first audio output.

23 . The non-transitory computer-readable storage medium of claim 12 , wherein:

the first type of visual output includes a first output color pattern; and

the second type of visual output includes a second output color pattern, different from the first output color pattern.

24 . The method of claim 13 , wherein:

the one or more visual output devices have the first set of visual output capabilities when the one or more visual output devices are capable of providing a first type of visual output; and

the one or more visual output devices have the second set of visual output capabilities when the one or more visual output devices are capable of providing a second type of visual output, different than the first type of visual output.

25 . The method of claim 13 , wherein:

the first set of visual output capabilities include the one or more visual output devices being capable of providing visual output that is responsive to audio input that is detected by one or more microphones that are in communication with the electronic device; and

the second set of visual output capabilities do not include the one or more visual output devices being capable of providing visual output that is responsive to audio input that is detected by one or more microphones that are in communication with the electronic device.

26 . The method of claim 13 , wherein:

the second state includes the electronic device being in a first digital assistant activity state; and

the third state includes the electronic device being in a second digital assistant activity state, different from the first digital assistant activity state.

27 . The method of claim 26 , wherein the first digital assistant activity state is selected from the group consisting of: an idle digital assistant state, a listening digital assistant state, a request-processing digital assistant state, a responding digital assistant state.

28 . The method of claim 13 , wherein:

the second state includes the electronic device being in a first audio playback state; and

the third state includes the electronic device being in a second audio playback state, different from the first audio playback state.

29 . The method of claim 28 , wherein the first audio playback state is selected from the group consisting of: a state in which the electronic device is outputting an audio alarm notification, a state in which the electronic device is outputting an audio timer notification, a state in which the electronic device is outputting audio from an inter-device communication, and a state in which the electronic device is outputting audio media.

30 . The method of claim 13 , wherein:

the first type of visual output is a predetermined output;

the second type of visual output is a dynamic visual output based on one or more dynamic variables.

31 . The method of claim 13 , wherein:

the first type of visual output includes one or more visual characteristics that vary based on audio input that is detected by one or more microphones that are in communication with the electronic device; and

the second type of visual output does not vary based on audio input that is detected by one or more microphones that are in communication with the electronic device.

32 . The method of claim 13 , wherein:

the updated state includes the electronic device outputting a first audio output;

the first type of visual output includes one or more visual characteristics that vary based on the first audio output; and

the second type of visual output does not vary based on the first audio output.

33 . The method of claim 13 , wherein:

the first type of visual output includes a first output color pattern; and

the second type of visual output includes a second output color pattern, different from the first output color pattern.

Continuity (5)
Continuation 18657600 · May 7, 2024
Continuation 17579253 · Jan 19, 2022
Provisional Application 63197423 · Jun 6, 2021
Provisional Application 63175312 · Apr 15, 2021
Related Publication 20250159071A1 · May 15, 2025
References Cited (85)
US 10216351B2 · Yang · 2019 [cited by applicant]
US 10254911B2 · Yang · 2019 [cited by applicant]
US 10956116B2 · Coburn, IV · 2021 [cited by examiner]
US 11079894B2 · Yang · 2021 [cited by applicant]
US 11281711B2 · Sanders · 2022 [cited by examiner]
US 11386887B1 · Teng · 2022 [cited by examiner]
US 11393473B1 · Fenster · 2022 [cited by examiner]
US 11416210B2 · Elliot · 2022 [cited by examiner]
US 11467802B2 · Newendorp · 2022 [cited by examiner]
US 11477609B2 · Behzadi · 2022 [cited by examiner]
US 11481186B2 · Pratt · 2022 [cited by examiner]
US 11482224B2 · Smith · 2022 [cited by examiner]
US 11758035B2 · Nadathur et al. · 2023 [cited by applicant]
US 11838582B1 · Sharifi · 2023 [cited by examiner]
US 12003659B2 · Carrigan · 2024 [cited by examiner]
US 12244754B2 · Carrigan · 2025 [cited by examiner]
US 12405717B2 · Carrigan · 2025 [cited by examiner]
US 20070061495A1 · Cummins et al. · 2007 [cited by applicant]
US 20140159879A1 · Rezvani et al. · 2014 [cited by applicant]
US 20140173510A1 · Kanno · 2014 [cited by applicant]
US 20150032812A1 · Dudley · 2015 [cited by examiner]
US 20150355878A1 · Corbin · 2015 [cited by examiner]
US 20150381706A1 · Wohlert · 2015 [cited by examiner]
US 20160260414A1 · Yang · 2016 [cited by applicant]
US 20160278143A1 · Akhtar · 2016 [cited by applicant]
US 20170005806A1 · Brand et al. · 2017 [cited by applicant]
US 20170010857A1 · Bates · 2017 [cited by examiner]
US 20170231015A1 · Jang et al. · 2017 [cited by applicant]
US 20180088896A1 · Olson · 2018 [cited by examiner]
US 20180147913A1 · Bergin · 2018 [cited by applicant]
US 20180260453A1 · Lim · 2018 [cited by applicant]
US 20180335903A1 · Coffman · 2018 [cited by examiner]
US 20190119978A1 · Hall et al. · 2019 [cited by applicant]
US 20190342446A1 · Coverstone · 2019 [cited by applicant]
US 20190372862A1 · Carrigan et al. · 2019 [cited by applicant]
US 20200127988A1 · Bradley et al. · 2020 [cited by applicant]
US 20200382332A1 · Carrigan et al. · 2020 [cited by applicant]
US 20200382908A1 · Behzadi · 2020 [cited by examiner]
US 20200387339A1 · House · 2020 [cited by examiner]
US 20220129144A1 · Carrigan · 2022 [cited by examiner]
US 20220229671A1 · Nadathur et al. · 2022 [cited by applicant]
US 20220345565A1 · Carrigan · 2022 [cited by examiner]
US 20220368740A1 · Ketterman · 2022 [cited by examiner]
US 20230076970A1 · Coburn, IV · 2023 [cited by examiner]
US 20230098814A1 · Carrigan · 2023 [cited by examiner]
US 20230275781A1 · Roe · 2023 [cited by examiner]
US 20230308707A1 · Alvarez · 2023 [cited by examiner]
US 20230308721A1 · Peterson · 2023 [cited by examiner]
US 20230409191A1 · Carrigan · 2023 [cited by examiner]
US 20230421687A1 · Nadathur et al. · 2023 [cited by applicant]
US 20240045577A1 · Kumar · 2024 [cited by examiner]
US 20240291916A1 · Carrigan · 2024 [cited by examiner]
US 20250159071A1 · Carrigan · 2025 [cited by examiner]
CN 117178252A · 2023 [cited by examiner]
WO WO2014110898A1 · 2014 [cited by examiner]
WO 2018067528A1 · 2018 [cited by applicant]
WO WO2022221062A1 · 2022 [cited by examiner]
Final Office Action received for U.S. Appl. No. 18/244,900, mailed on Apr. 23, 2025, 27 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/244,900, mailed on Feb. 28, 2025, 4 pages. [cited by applicant]
Office Action received for European Patent Application No. 22724157.7, mailed on Mar. 12, 2025, 6 pages. [cited by applicant]
Intention to Grant received for European Patent Application No. 22724157.7, mailed on Nov. 10, 2025, 9 pages. [cited by applicant]
Office Action received for European Patent Application No. 22704817.0, mailed on Feb. 10, 2025, 6 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/657,600, mailed on Feb. 3, 2025, 5 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 18/244,900, mailed on Jan. 24, 2025, 48 pages. [cited by applicant]
Action received for U.S. Appl. No. 17/477,098, mailed on Aug. 11, 2022, 3 pages. [cited by applicant]
Interview Summary received for U.S. Appl. No. 17/477,098, mailed on Apr. 15, 2022, 5 pages. [cited by applicant]
Interview Summary received for U.S. Appl. No. 17/477,098, mailed on Jan. 27, 2023, 5 pages. [cited by applicant]
Interview Summary received for U.S. Appl. No. 17/477,098, mailed on Jul. 25, 2022, 5 pages. [cited by applicant]
Interview Summary received for U.S. Appl. No. 17/477,098, mailed on May 19, 2023, 8 pages. [cited by applicant]
Interview Summary received for U.S. Appl. No. 18/244,900, mailed on Oct. 4, 2024, 3 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/477,098, mailed on Mar. 8, 2023, 58 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/477,098, mailed on May 27, 2022, 31 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/012817, mailed on Jul. 27, 2023, 19 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/022570, mailed on Oct. 26, 2023, 16 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/012817, mailed on Apr. 8, 2022, 22 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/022570, mailed on Sep. 13, 2022, 22 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2022/022570, mailed on Jun. 29, 2022, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/477,098, mailed on Jan 24, 2022, 17 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/477,098, mailed on Nov. 9, 2022, 39 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/244,900, mailed on Aug. 27, 2024, 30 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/477,098, mailed on Jun. 16, 2023, 8 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/579,253, mailed on Apr. 12, 2024, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/579,253, mailed on Feb. 21, 2024, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/657,600, mailed on Nov. 15, 2024, 11 pages. [cited by applicant]
Sengled, “Pairing your Pulse system to a Google Home assistant”, Retrieved from the Internet: https://web.archive.org/web/20201123161527/https://support.sengled.com/hc/en-us/articles/360003716593-Pairing-your-Pulse-syst… [cited by applicant]