IP Library › Granted Patent US 12,425,695
Granted Patent B2
US 12,425,695 · App. 17/504,174 · Granted Sep 23, 2025

Methods and user interfaces for auditory features

Inventors: Mitchell R. Lerner (San Francisco, CA); Elizabeth C. Cranfill (San Francisco, CA); Charles C. Hoyt (Pacifica, CA); Jeffrey D. Tanner (Walnut Creek, CA); Ian M. Fisch (Santa Cruz, CA); Jakub Mazur (Daly City, CA)
Assignee: Apple Inc.
H04N21/4852G06F3/165H04N21/4394
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,425,695
App. No.
17/504,174
Granted
Sep 23, 2025
Kind
B2
Abstract

The present disclosure generally relates to providing auditory features. An example method includes, at a computer system in communication with one or more input devices: while playing an audio media item of a first type, receiving, via the one or more input devices, a request to play an audio media item of a second type; in accordance with a determination that a set of concurrent audio criteria is satisfied, concurrently playing: the audio media item of the first type; and the audio media item of the second type; and in accordance with a determination that the set of concurrent audio criteria is not satisfied: ceasing to play the audio media item of the first type; and playing the audio media item of the second type.

Claims (150)

1. A computer system configured to communicate with a display generation component and one or more input devices, comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display generation component, a first user interface concurrently including:

a background sounds user-interactive graphical user interface object that, when selected, enables a concurrent playback feature;

a background sounds volume feature for adjusting a volume level of an audio media item of a first type; and

a concurrent volume feature for adjusting a volume level of the audio media item of the first type when the audio media item of the first type is concurrently played with an audio media item of a second type;

while playing the audio media item of the first type at a first volume level that is set via the background sounds volume feature, receiving, via the one or more input devices, a request to play the audio media item of the second type;

in response to receiving the request to play the audio media item of the second type:

in accordance with a determination that a set of concurrent audio criteria is satisfied, wherein the set of concurrent audio criteria includes a requirement that the concurrent playback feature is enabled on the computer system, via the background sounds user-interactive graphical user interface object, at the time the request to play the audio media item of the second type is received, concurrently playing:

the audio media item of the first type at a second volume level that is different from the first volume level, wherein the second volume level is set via the concurrent volume feature; and

the audio media item of the second type; and

in accordance with a determination that the concurrent playback feature is disabled on the computer system at the time the request to play the audio media item of the second type is received:

ceasing to play the audio media item of the first type; and

playing the audio media item of the second type.

2. The computer system of claim 1 , wherein the audio media item of the first type includes audio selected from the group consisting of environmental sounds, irregular noise, and a combination thereof.

3. The computer system of claim 1 , wherein the audio media item of the first type includes audio selected from the group consisting of randomly selected segments of audio, randomly arranged segments of audio, and a combination thereof.

4. The computer system of claim 1 , wherein the concurrent playback feature is manually configurable.

5. The computer system of claim 1 , wherein concurrently playing the audio media item of the first type and the audio media item of the second type comprises:

adjusting a magnitude of a volume level of the audio media item of the first type from the first volume level to an adjusted volume based on a magnitude of the concurrent volume feature.

6. The computer system of claim 1 , wherein the set of concurrent audio criteria includes a criterion that is satisfied when a determination is made that a magnitude of a second concurrent volume feature exceeds a threshold magnitude.

7. The computer system of claim 1 , further comprising adjusting, based on contextual information, a magnitude of at least one of:

the background sounds volume feature for adjusting the volume level of the audio media item of the first type; and

the concurrent volume feature for adjusting the volume level of the audio media item of the first type when the audio media item of the first type is concurrently played with the audio media item of the second type.

8. The computer system of claim 1 , wherein playing the audio media item of the first type includes:

in accordance with a determination that the computer system is in a first context state, playing the audio media item of the first type with first audio content; and

in accordance with a determination that the computer system is in a second context state, different from the first context state, playing the audio media item of the first type with second audio content, different than the first audio content.

9. The computer system of claim 1 , wherein displaying the first user interface includes concurrently displaying:

the background sounds user-interactive graphical user interface object; and

a first audio content user-interactive graphical user interface object that, when selected, causes display of a second user interface that includes:

a second audio content user-interactive graphical user interface object that, when selected, causes third audio content to be included in the audio media item of the first type during playback; and

a third audio content user-interactive graphical user interface object that, when selected, causes fourth audio content, different from the third audio content, to be included in the audio media item of the first type during playback.

10. The computer system of claim 9 , the one or more programs including instructions for:

detecting, via the one or more input devices, a first input corresponding to the background sounds user-interactive graphical user interface object;

in response to detecting the first input, enabling playback of the audio media item of the first type when a determination is made that the set of playback criteria are met; and

while the computer system is enabled to playback the audio media item of the first type when a determination is made that the set of playback criteria are met:

in accordance with a determination that the set of playback criteria are met, playing the audio media item of a first type.

11. The computer system of claim 9 , the one or more programs including instructions for:

while displaying the second user interface:

detecting, via the one or more input devices, a second input; and

in response to detecting the second input:

in accordance with a determination that the second input corresponds to the second audio content user-interactive graphical user interface object, configuring the computer system to include the third audio content in the audio media item of the first type during playback; and

in accordance with a determination that the second input corresponds to the third audio content user-interactive graphical user interface object, configuring the computer system to include the fourth audio content in the audio media item of the first type during playback.

12. The computer system of claim 1 , wherein:

the first user interface includes a background sounds status indicator, a volume user-interactive graphical user interface object, and a background sounds enable user-interactive graphical user interface object;

the one or more programs further include instructions for:

detecting, via the one or more input devices, a third input;

in accordance with a determination that the third input corresponds to a swipe gesture at a location corresponding to the volume user-interactive graphical user interface object, adjusting a volume level of the audio media item of the first type from a second initial volume to a second adjusted volume based on a direction and magnitude of the swipe gesture; and

in accordance with a determination that the third input corresponds to a selection of the background sounds enable user-interactive graphical user interface object:

selectively activating a background sounds feature; and

modifying a visual characteristic of the background sounds status indicator.

13. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and one or more input devices, the one or more programs including instructions for:

displaying, via the display generation component, a first user interface concurrently including:

a background sounds user-interactive graphical user interface object that, when selected, enables a concurrent playback feature;

a background sounds volume feature for adjusting a volume level of the audio media item of the first type; and

a concurrent volume feature for adjusting a volume level of a media item of a first type when the audio media item of the first type is concurrently played with an audio media item of a second type;

while playing the audio media item of the first type at a first volume level that is set via the background sounds volume feature, receiving, via the one or more input devices, a request to play the audio media item of the second type;

in response to receiving the request to play the audio media item of the second type:

in accordance with a determination that a set of concurrent audio criteria is satisfied, wherein the set of concurrent audio criteria includes a requirement that the concurrent playback feature is enabled on the computer system, via the background sounds user-interactive graphical user interface object, at the time the request to play the audio media item of the second type is received, concurrently playing:

the audio media item of the first type at a second volume level that is different from the first volume level, wherein the second volume level is set via the concurrent volume feature; and

the audio media item of the second type; and

in accordance with a determination that the concurrent playback feature is disabled on the computer system at the time the request to play the audio media item of the second type is received:

ceasing to play the audio media item of the first type; and

playing the audio media item of the second type.

14. A method, comprising:

at a computer system in communication with a display generation component and one or more input devices:

displaying, via the display generation component, a first user interface concurrently including:

a background sounds user-interactive graphical user interface object that, when selected, enables a concurrent playback feature;

a background sounds volume feature for adjusting a volume level of an audio media item of a first type; and

a concurrent volume feature for adjusting a volume level of the audio media item of the first type when the audio media item of the first type is concurrently played with an audio media item of a second type;

while playing the audio media item of the first type at a first volume level that is set via the background sounds volume feature, receiving, via the one or more input devices, a request to play the audio media item of the second type;

in response to receiving the request to play the audio media item of the second type:

in accordance with a determination that a set of concurrent audio criteria is satisfied, wherein the set of concurrent audio criteria includes a requirement that the concurrent playback feature is enabled on the computer system, via the background sounds user-interactive graphical user interface object, at the time the request to play the audio media item of the second type is received, concurrently playing:

the audio media item of the first type at a second volume level that is different from the first volume level, wherein the second volume level is set via the concurrent volume feature; and

the audio media item of the second type; and

in accordance with a determination that the concurrent playback feature is disabled on the computer system at the time the request to play the audio media item of the second type is received:

ceasing to play the audio media item of the first type; and

playing the audio media item of the second type.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the audio media item of the first type includes audio selected from the group consisting of environmental sounds, irregular noise, and a combination thereof.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the audio media item of the first type includes audio selected from the group consisting of randomly selected segments of audio, randomly arranged segments of audio, and a combination thereof.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the concurrent playback feature is manually configurable.

18. The non-transitory computer-readable storage medium of claim 13 , wherein concurrently playing the audio media item of the first type and the audio media item of the second type comprises:

adjusting a magnitude of a volume level of the audio media item of the first type from the first volume level to an adjusted volume based on a magnitude of the concurrent volume feature.

19. The non-transitory computer-readable storage medium of claim 13 , wherein the set of concurrent audio criteria includes a criterion that is satisfied when a determination is made that a magnitude of a second concurrent volume feature exceeds a threshold magnitude.

20. The non-transitory computer-readable storage medium of claim 13 , further comprising adjusting, based on contextual information, a magnitude of at least one of:

the background sounds volume feature for adjusting the volume level of the audio media item of the first type; and

the concurrent volume feature for adjusting the volume level of the audio media item of the first type when the audio media item of the first type is concurrently played with the audio media item of the second type.

21. The non-transitory computer-readable storage medium of claim 13 , wherein playing the audio media item of the first type includes:

in accordance with a determination that the computer system is in a first context state, playing the audio media item of the first type with first audio content; and

in accordance with a determination that the computer system is in a second context state, different from the first context state, playing the audio media item of the first type with second audio content, different than the first audio content.

22. The non-transitory computer-readable storage medium of claim 13 , wherein displaying the first user interface includes concurrently displaying:

the background sounds user-interactive graphical user interface object that, when selected, enables playback of the audio media item of the first type when a determination is made that a set of playback criteria are met; and

a first audio content user-interactive graphical user interface object that, when selected, causes display of a second user interface that includes:

a second audio content user-interactive graphical user interface object that, when selected, causes third audio content to be included in the audio media item of the first type during playback; and

a third audio content user-interactive graphical user interface object that, when selected, causes fourth audio content, different from the third audio content, to be included in the audio media item of the first type during playback.

23. The non-transitory computer-readable storage medium of claim 22 , the one or more programs including instructions for:

detecting, via the one or more input devices, a first input corresponding to the background sounds user-interactive graphical user interface object;

in response to detecting the first input, enabling playback of the audio media item of the first type when a determination is made that the set of playback criteria are met; and

while the computer system is enabled to playback the audio media item of the first type when a determination is made that the set of playback criteria are met:

in accordance with a determination that the set of playback criteria are met, playing the audio media item of a first type.

24. The non-transitory computer-readable storage medium of claim 22 , the one or more programs including instructions for:

while displaying the second user interface:

detecting, via the one or more input devices, a second input; and

in response to detecting the second input:

in accordance with a determination that the second input corresponds to the second audio content user-interactive graphical user interface object, configuring the computer system to include the third audio content in the audio media item of the first type during playback; and

in accordance with a determination that the second input corresponds to the third audio content user-interactive graphical user interface object, configuring the computer system to include the fourth audio content in the audio media item of the first type during playback.

25. The non-transitory computer-readable storage medium of claim 13 , wherein:

the first user interface includes a background sounds status indicator, a volume user-interactive graphical user interface object, and a background sounds enable user-interactive graphical user interface object;

the one or more programs further include instructions for:

detecting, via the one or more input devices, a third input;

in accordance with a determination that the third input corresponds to a swipe gesture at a location corresponding to the volume user-interactive graphical user interface object, adjusting a volume level of the audio media item of the first type from a second initial volume to a second adjusted volume based on a direction and magnitude of the swipe gesture; and

in accordance with a determination that the third input corresponds to a selection of the background sounds enable user-interactive graphical user interface object:

selectively activating a background sounds feature; and

modifying a visual characteristic of the background sounds status indicator.

26. The method of claim 14 , wherein the audio media item of the first type includes audio selected from the group consisting of environmental sounds, irregular noise, and a combination thereof.

27. The method of claim 14 , wherein the audio media item of the first type includes audio selected from the group consisting of randomly selected segments of audio, randomly arranged segments of audio, and a combination thereof.

28. The method of claim 14 , wherein the concurrent playback feature is manually configurable.

29. The method of claim 14 , wherein concurrently playing the audio media item of the first type and the audio media item of the second type comprises:

adjusting a magnitude of a volume level of the audio media item of the first type from the first volume level to an adjusted volume based on a magnitude of a concurrent volume feature.

30. The method of claim 14 , wherein the set of concurrent audio criteria includes a criterion that is satisfied when a determination is made that a magnitude of a second concurrent volume feature exceeds a threshold magnitude.

31. The method of claim 14 , further comprising adjusting, based on contextual information, a magnitude of at least one of:

the background sounds volume feature for adjusting the volume level of the audio media item of the first type; and

the concurrent volume feature for adjusting the volume level of the audio media item of the first type when the audio media item of the first type is concurrently played with the audio media item of the second type.

32. The method of claim 14 , wherein playing the audio media item of the first type includes:

in accordance with a determination that the computer system is in a first context state, playing the audio media item of the first type with first audio content; and

in accordance with a determination that the computer system is in a second context state, different from the first context state, playing the audio media item of the first type with second audio content, different than the first audio content.

33. The method of claim 14 , wherein displaying the first user interface includes concurrently displaying:

the background sounds user-interactive graphical user interface object; and

a first audio content user-interactive graphical user interface object that, when selected, causes display of a second user interface that includes:

a second audio content user-interactive graphical user interface object that, when selected, causes third audio content to be included in the audio media item of the first type during playback; and

a third audio content user-interactive graphical user interface object that, when selected, causes fourth audio content, different from the third audio content, to be included in the audio media item of the first type during playback.

34. The method of claim 33 , further comprising:

detecting, via the one or more input devices, a first input corresponding to the background sounds user-interactive graphical user interface object;

in response to detecting the first input, enabling playback of the audio media item of the first type when a determination is made that the set of playback criteria are met; and

while the computer system is enabled to playback the audio media item of the first type when a determination is made that the set of playback criteria are met:

in accordance with a determination that the set of playback criteria are met, playing the audio media item of a first type.

35. The method of claim 33 , further comprising:

while displaying the second user interface:

detecting, via the one or more input devices, a second input; and

in response to detecting the second input:

in accordance with a determination that the second input corresponds to the second audio content user-interactive graphical user interface object, configuring the computer system to include the third audio content in the audio media item of the first type during playback; and

in accordance with a determination that the second input corresponds to the third audio content user-interactive graphical user interface object, configuring the computer system to include the fourth audio content in the audio media item of the first type during playback.

36. The method of claim 14 , wherein:

the first user interface includes a background sounds status indicator, a volume user-interactive graphical user interface object, and a background sounds enable user-interactive graphical user interface object;

the method further includes:

detecting, via the one or more input devices, a third input;

in accordance with a determination that the third input corresponds to a swipe gesture at a location corresponding to the volume user-interactive graphical user interface object, adjusting a volume level of the audio media item of the first type from a second initial volume to a second adjusted volume based on a direction and magnitude of the swipe gesture; and

in accordance with a determination that the third input corresponds to a selection of the background sounds enable user-interactive graphical user interface object:

selectively activating a background sounds feature; and

modifying a visual characteristic of the background sounds status indicator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: LERNER, MITCHELL R.; CRANFILL, ELIZABETH C.; HOYT, CHARLES C.; TANNER, JEFFREY D.; FISCH, IAN M.; MAZUR, JAKUB
To: APPLE INC.
Reel/Frame 061858/0344 →
Continuity (3)
Provisional Application 63197452 · Jun 6, 2021
Provisional Application 63190765 · May 19, 2021
Related Publication 20220377431A1 · Nov 24, 2022
References Cited (212)
US 5692058A · Eggers · 1997 [cited by examiner]
US 5856824A · Shieh · 1999 [cited by applicant]
US 6140987A · Stein et al. · 2000 [cited by applicant]
US 6232957B1 · Hinckley · 2001 [cited by applicant]
US 6850150B1 · Ronkainen · 2005 [cited by applicant]
US 6888536B2 · Westerman et al. · 2005 [cited by applicant]
US 7318198B2 · Sakayori et al. · 2008 [cited by applicant]
US 7730223B1 · Bavor et al. · 2010 [cited by applicant]
US 7907125B2 · Weiss et al. · 2011 [cited by applicant]
US 8234395B2 · Millington · 2012 [cited by applicant]
US 8326444B1 · Classen · 2012 [cited by examiner]
US 9582178B2 · Grant et al. · 2017 [cited by applicant]
US 9680982B2 · Fiedler · 2017 [cited by applicant]
US 10055094B2 · Li et al. · 2018 [cited by applicant]
US 10142122B1 · Hill et al. · 2018 [cited by applicant]
US 10237141B2 · Sasaki et al. · 2019 [cited by applicant]
US 10284980B1 · Woo et al. · 2019 [cited by applicant]
US 10303422B1 · Woo et al. · 2019 [cited by applicant]
US 10310725B2 · Smith et al. · 2019 [cited by applicant]
US 10436977B2 · Bergman et al. · 2019 [cited by applicant]
US 10454781B2 · Sasaki et al. · 2019 [cited by applicant]
US 10511456B2 · Smith et al. · 2019 [cited by applicant]
US 10779085B1 · Carrigan · 2020 [cited by applicant]
US 20020152255A1 · Smith et al. · 2002 [cited by applicant]
US 20040141009A1 · Hinckley et al. · 2004 [cited by applicant]
US 20040143430A1 · Said et al. · 2004 [cited by applicant]
US 20040218451A1 · Said et al. · 2004 [cited by applicant]
US 20060026536A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060097991A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060161870A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060161871A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060189278A1 · Scott et al. · 2006 [cited by applicant]
US 20070189544A1 · Rosenberg · 2007 [cited by examiner]
US 20090007026A1 · Scott et al. · 2009 [cited by applicant]
US 20090085878A1 · Heubel et al. · 2009 [cited by applicant]
US 20090153289A1 · Hope et al. · 2009 [cited by applicant]
US 20090166098A1 · Sunder et al. · 2009 [cited by applicant]
US 20090231271A1 · Heubel et al. · 2009 [cited by applicant]
US 20090306798A1 · Moeller · 2009 [cited by examiner]
US 20100106981A1 · Sim · 2010 [cited by examiner]
US 20100318917A1 · Holladay et al. · 2010 [cited by applicant]
US 20110071656A1 · Mckiel, Jr. · 2011 [cited by applicant]
US 20120066632A1 · Sundermeyer et al. · 2012 [cited by applicant]
US 20120269361A1 · Bhow et al. · 2012 [cited by applicant]
US 20130022218A1 · Miyazawa et al. · 2013 [cited by applicant]
US 20130113822A1 · Putrevu et al. · 2013 [cited by applicant]
US 20130141378A1 · Yumiki et al. · 2013 [cited by applicant]
US 20130283161A1 · Reimann et al. · 2013 [cited by applicant]
US 20140236325A1 · Sasaki et al. · 2014 [cited by applicant]
US 20140288686A1 · Sant · 2014 [cited by examiner]
US 20140363024A1 · Apodaca · 2014 [cited by applicant]
US 20140380234A1 · Shim et al. · 2014 [cited by applicant]
US 20150081072A1 · Kallai et al. · 2015 [cited by applicant]
US 20150212705A1 · Sasaki et al. · 2015 [cited by applicant]
US 20150256957A1 · Kim et al. · 2015 [cited by applicant]
US 20150280669A1 · Vilermo · 2015 [cited by examiner]
US 20150319046A1 · Plummer et al. · 2015 [cited by applicant]
US 20160004499A1 · Kim et al. · 2016 [cited by applicant]
US 20160043962A1 · Kim et al. · 2016 [cited by applicant]
US 20160070244A1 · Cipollo et al. · 2016 [cited by applicant]
US 20160073197A1 · Hammer et al. · 2016 [cited by applicant]
US 20160073482A1 · Fok et al. · 2016 [cited by applicant]
US 20160092072A1 · So et al. · 2016 [cited by applicant]
US 20160119734A1 · Sladeczek · 2016 [cited by examiner]
US 20160139752A1 · Shim et al. · 2016 [cited by applicant]
US 20160173318A1 · Ha et al. · 2016 [cited by applicant]
US 20160253145A1 · Lee et al. · 2016 [cited by applicant]
US 20160320849A1 · Koo · 2016 [cited by applicant]
US 20160366481A1 · Lim et al. · 2016 [cited by applicant]
US 20170017531A1 · Choi et al. · 2017 [cited by applicant]
US 20170046025A1 · Dascola et al. · 2017 [cited by applicant]
US 20170206779A1 · Lee et al. · 2017 [cited by applicant]
US 20170251314A1 · Pye et al. · 2017 [cited by applicant]
US 20170285788A1 · Park et al. · 2017 [cited by applicant]
US 20170357390A1 · Alonso Ruiz · 2017 [cited by examiner]
US 20170357425A1 · Smith et al. · 2017 [cited by applicant]
US 20170357434A1 · Coffman et al. · 2017 [cited by applicant]
US 20170358320A1 · Cameron · 2017 [cited by examiner]
US 20170359189A1 · Smith et al. · 2017 [cited by applicant]
US 20180204432A1 · Phillips · 2018 [cited by applicant]
US 20190005959A1 · Cameron · 2019 [cited by examiner]
US 20190056907A1 · So et al. · 2019 [cited by applicant]
US 20200314496A1 · Wittke · 2020 [cited by applicant]
US 20200382332A1 · Carrigan et al. · 2020 [cited by applicant]
US 20200413197A1 · Carrigan et al. · 2020 [cited by applicant]
US 20220374194A1 · Casarini · 2022 [cited by examiner]
US 20230208921A1 · Dickins · 2023 [cited by examiner]
US 20230394955A1 · Giuliani · 2023 [cited by applicant]
US 20230403509A1 · Carrigan et al. · 2023 [cited by applicant]
US 20240031759A1 · Watanabe · 2024 [cited by examiner]
US 20240406632A1 · Carrigan et al. · 2024 [cited by applicant]
CN 104956276A · 2015 [cited by applicant]
CN 105374192A · 2016 [cited by applicant]
CN 105474580A · 2016 [cited by applicant]
CN 105900376A · 2016 [cited by applicant]
CN 107533368A · 2018 [cited by applicant]
CN 107819928A · 2018 [cited by applicant]
CN 109117078A · 2019 [cited by applicant]
CN 109196825A · 2019 [cited by applicant]
CN 109287140A · 2019 [cited by applicant]
CN 109302531A · 2019 [cited by applicant]
CN 109348052A · 2019 [cited by applicant]
CN 109688441A · 2019 [cited by applicant]
CN 109688442A · 2019 [cited by applicant]
EP 3038427A1 · 2016 [cited by applicant]
EP 3255536A1 · 2017 [cited by applicant]
EP 3445058A1 · 2019 [cited by applicant]
EP 3038427B1 · 2019 [cited by applicant]
JP 200496397A · 2004 [cited by applicant]
JP 2013200879A · 2013 [cited by applicant]
JP 201663531A · 2016 [cited by applicant]
JP 201741008A · 2017 [cited by applicant]
JP 2017212096A · 2017 [cited by applicant]
KR 1020140148289A · 2014 [cited by applicant]
KR 1020170008601A · 2017 [cited by applicant]
KR 1020170100358A · 2017 [cited by applicant]
KR 1020180034637A · 2018 [cited by applicant]
KR 1020190002658A · 2019 [cited by applicant]
KR 1020190014495A · 2019 [cited by applicant]
KR 1020190057414A · 2019 [cited by applicant]
WO 2011027964A1 · 2011 [cited by applicant]
WO 2014128800A1 · 2014 [cited by applicant]
WO 2015008409A1 · 2015 [cited by applicant]
WO 2015114690A1 · 2015 [cited by applicant]
WO 2017027526A1 · 2017 [cited by applicant]
WO 2017058293A1 · 2017 [cited by applicant]
WO 2017147081A1 · 2017 [cited by applicant]
WO 2017218143A1 · 2017 [cited by applicant]
WO 2017218192A1 · 2017 [cited by applicant]
WO 2018144339A2 · 2018 [cited by applicant]
WO 2018213401A1 · 2018 [cited by applicant]
WO 2021231412A1 · 2021 [cited by applicant]
Avid Protools 7 user manual; copyright 2005 (Year: 2005). [cited by examiner]
Yamaha DME designer 3.8 user manual; copyright 2004-2010 (Year: 2010). [cited by examiner]
Sony Oxford user manual; copyright 1997 (Year: 1997). [cited by examiner]
Protools 7 User Manual (Year: 2005). [cited by examiner]
AKAI MPC 5000 manual; available for sale at least 2008-2012 (Year: 2008). [cited by examiner]
Notice of Allowance received for U.S. Appl. No. 17/019,845, mailed on Jun. 5, 2023, 10 pages. [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2021261941, mailed on Mar. 15, 2023, 3 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2022-014389, mailed on Jan. 27, 2023, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Office Action received for European Patent Application No. 20719301.2, mailed on Jan. 24, 2023, 9 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2021261941, mailed on Nov. 3, 2022, 3 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 202110235995.X, mailed on Sep. 30, 2022, 13 pages (7 pages of English Translation and 6 pages of Official Copy). [cited by applicant]
Brewster et al., “Multimodal ‘Eyes-Free’ Interaction Techniques Wearable Devices”, CHI 2003, Interaction techniques for Constrained Displays, Apr. 5-10, 2003, pp. 473-480. [cited by applicant]
Brewster et al., “Tactons: Structured Tactile Messages for Non-Visual Information Display”, 5th Australasian User Interface Conference, 2004, pp. 15-23. [cited by applicant]
Brewster et al., “Using Non-Speech Sounds in Mobile Computing Devices”, First Workshop on Human-Computer Interaction with Mobile Devices, 1998, pp. 1-3. [cited by applicant]
Brown et al., “Multidimensional Tactons for Non-Visual Information Presentation in Mobile Devices”, MobileHCI'06, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, Sep. 12… [cited by applicant]
Final Office Action received for U.S. Appl. No. 12/006,172, mailed on Mar. 2, 2012, 16 pages. [cited by applicant]
Helal et al., “Drishti: An Integrated Navigation System for Visually Impaired and Disabled”, Fifth International Symposium on Wearable Computers (ISWC'01), IEEE, 2001, pp. 149-156. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2020/024390, mailed on Dec. 9, 2021, 20 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2022/030110, mailed on Sep. 28, 2022, 16 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 12/006,172, mailed on Jun. 22, 2011, 23 pages. [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2021201403, mailed on Oct. 22, 2021, 3 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 202011450203.2, mailed on Sep. 30, 2022, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2021-026630, mailed on Jan. 7, 2022, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Notice of Allowance received for Korean Patent Application No. 10-2021-7021047, mailed on Dec. 6, 2021, 3 pages (1 page of English Translation and 2 pages of Official Copy). [cited by applicant]
Office Action received for Chinese Patent Application No. 202011450203.2, mailed on Apr. 20, 2022, 9 pages (5 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Office Action received for Chinese Patent Application No. 202110235995.X, mailed on Mar. 22, 2022, 17 pages (9 pages of English Translation and 8 pages of Official Copy). [cited by applicant]
Office Action received for European Patent Application No. 20719301.2, mailed on Feb. 21, 2022, 9 pages. [cited by applicant]
Office Action received for European Patent Application No. 21160991.2, mailed on Mar. 24, 2022, 11 pages. [cited by applicant]
Pirhonen et al., “Gestural and Audio Metaphors as a Means of Control for Mobile Devices”, CHI 2002, Minneapolis, Minnesota, Apr. 20-25, 2002. [cited by applicant]
Summons to Attend Oral Proceedings received for European Patent Application No. 21160991.2, mailed on Oct. 19, 2022, 10 pages. [cited by applicant]
Williamson et al., “Shoogle: Excitatory Multimodal Interaction on Mobile Devices”, CHI 2007, San Jose, California, Apr. 28-May 3, 2007, pp. 121-124. [cited by applicant]
Xiaoyu et al., “Mobile Browsable Information Access for the Visually Impaired”, AMCIS 2004 Proceedings. Paper 424, Dec. 31, 2004. [cited by applicant]
Zhao et al., “earPod: Eyes-free Menu Selection using Touch Input and Reactive Audio Feedback”, CHI 2007 Proceedings of Alternative Interaction, Apr. 28-May 3, 2007, 10 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/030110 mailed on Nov. 18, 2022, 22 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7001521, mailed on Dec. 26, 2022, 13 pages (6 pages of English Translation and 7 pages of Official Copy). [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/584,743, mailed on May 1, 2020, 5 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/586,002, mailed on Apr. 28, 2020, 5 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 16/584,743, mailed on Dec. 30, 2020, 3 pages. [cited by applicant]
Extended European Search Report received for European Patent Application No. 21160991.2, mailed on Jul. 16, 2021, 14 pages. [cited by applicant]
International Search Report and written Opinion received for PCT Patent Application No. PCT/US2020/024390, mailed on Aug. 17, 2020, 22 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2020/024390, mailed on Oct. 23, 2020, 26 pages. [cited by applicant]
Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2020/024390, mailed on Jun. 26, 2020, 15 pages. [cited by applicant]
Invitation to Pay Search Fees received for European Patent Application No. 20719301.2, mailed on Dec. 17, 2020, 5 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/584,743, mailed on Feb. 6, 2020, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/586,002, mailed on Feb. 20, 2020, 15 pages. [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2020257092, mailed on Aug. 27, 2021, 3 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2020-558885, mailed on Jul. 26, 2021, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Notice of Allowance received for Korean Patent Application No. 10-2020-7031319, mailed on Apr. 6, 2021, 5 pages (2 pages of English Translation and 3 pages of Official Copy). [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/584,743, mailed on Aug. 7, 2020, 8 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/584,743, mailed on Nov. 16, 2020, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/586,002, mailed on Jun. 9, 2020, 5 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2020257092, mailed on Mar. 3, 2021, 7 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2020257092, mailed on Nov. 30, 2020, 6 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2021201403, mailed on Mar. 16, 2021, 3 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 202011450203.2, mailed on Sep. 1, 2021, 12 pages (6 pages of English Translation and 6 pages of Official Copy). [cited by applicant]
Office Action received for European Patent Application No. 20719301.2, mailed on Jan. 28, 2021, 15 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2021-026630, mailed on Aug. 20, 2021, 7 pages (3 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Office Action received for Korean Patent Application No. 10-2020-7031319, mailed on Dec. 8, 2020, 14 pages (6 pages of English Translation and 8 pages of Official Copy). [cited by applicant]
Office Action received for Korean Patent Application No. 10-2021-7021047, mailed on Aug. 13, 2021, 5 pages (2 pages of English Translation and 3 pages of Official Copy). [cited by applicant]
Supplemental Notice of Allowance received for U.S. Appl. No. 16/584,743, mailed on Nov. 25, 2020, 2 pages. [cited by applicant]
Benjamin Jeff, “iOS 10: How to use the new Home app to control HomeKit devices [Video]”, Available online at: https://9to5mac.com/2016/09/23/ios-10-how-to-use-new-home-app-control-homekit-devices-video, Sep. 23, 2016, 3… [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7001521, mailed on Jun. 21, 2023, 10 pages (5 page of English Translation and 5 pages of Official Copy). [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 17/019,845, mailed on Aug. 7, 2023, 4 pages. [cited by applicant]
Office Action received for European Patent Application No. 20719301.2, mailed on Oct. 20, 2023, 11 pages. [cited by applicant]
Notice of Allowance received for Korean Patent Application No. 10-2022-7001521, mailed on Mar. 22, 2024, 7 pages (2 pages of English Translation and 5 pages of Official Copy). [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/030110 mailed on Nov. 30, 2023, 17 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/024335, mailed on Sep. 21, 2023, 15 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2023203357, mailed on Feb. 14, 2024, 3 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2023-022576, mailed on Feb. 26, 2024, 10 pages (5 pages of English Translation and 5 pages of Official Copy). [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7001521, mailed on Dec. 19, 2023, 7 pages (3 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2023203357, mailed on May 16, 2024, 3 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/235,291, mailed on Jul. 18, 2024, 3 pages. [cited by applicant]
Intention to Grant received for European Patent Application No. 20719301.2, mailed on Jul. 2, 2024, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/235,291, mailed on Jul. 3, 2024, 18 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/235,291, mailed on Aug. 7, 2024, 2 pages. [cited by applicant]
Decision to Refuse received for Japanese Patent Application No. 2023-022576, mailed on Jul. 26, 2024, 6 pages (3 pages of English Translation and 3 pages of Official Copy). [cited by applicant]
Decision to Grant received for European Patent Application No. 20719301.2, mailed on Nov. 7, 2024, 3 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2023/024335, mailed on Dec. 12, 2024, 12 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2023-022576, mailed on Dec. 24, 2024, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Extended European Search Report received for European Patent Application No. 24208135.4, mailed on Jan. 21, 2025, 13 pages. [cited by applicant]