IP Library Granted Patent US 10,909,988
Granted Patent B2
US 10,909,988 · App. 16/140,227 · Granted Feb 2, 2021

Systems and methods for displaying a user interface

Inventors: Lae-Hoon Kim (San Diego, CA); Erik Visser (San Diego, CA); Phuong Lam Ton (San Diego, CA); Jeremy Patrick Toman (San Diego, CA); Jeffrey Clinton Shaw (Escondido, CA)
Assignee: Qualcomm Incorporated
G10L17/00G01B21/00G01S3/80G01S3/8006G01S5/18G01S5/186G01S15/876G06F3/0484G06F3/04817G06F3/04883G06F3/167G06F16/433H04R1/08H04R3/00H04R3/005H04S7/40G01S3/8083G01S15/86G06F1/1633G10L2021/02166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,909,988
App. No.
16/140,227
Granted
Feb 2, 2021
Kind
B2
Abstract

An electronic device includes a display, wherein the display is configured to present a user interface, wherein the user interface comprises a coordinate system. The coordinate system corresponds to physical coordinates. The display is configured to present a sector selection feature that allows selection of at least one sector of the coordinate system. The at least one sector corresponds to captured audio from multiple microphones. The sector selection may also include an audio signal indicator. The electronic device includes operation circuitry coupled to the display. The operation circuitry is configured to perform an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

Claims (41)

1. An electronic device, comprising:

a display, wherein the display is configured to:

present a user interface, wherein the user interface comprises a coordinate system, wherein the coordinate system corresponds to physical coordinates based on sensor data;

present a sector selection feature that allows selection of at least one sector of the coordinate system, wherein the at least one sector corresponds to captured audio from multiple microphones, and wherein a sector selection comprises an audio signal indicator; and

operation circuitry coupled to the display, wherein the operation circuitry is configured to perform an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

2. The electronic device of claim 1 , further comprising the multiple microphones, wherein the multiple microphones are configured to capture at least one audio signal, and wherein the display is configured to present a directionality of the at least one audio signal captured by the multiple microphones.

3. The electronic device of claim 2 , wherein the at least one audio signal comprises a voice signal.

4. The electronic device of claim 2 , wherein the display is configured to present an icon corresponding to the at least one audio signal.

5. The electronic device of claim 4 , wherein the display is configured to present at least one of an icon for a target audio signal and an icon for an interference audio signal.

6. The electronic device of claim 1 , wherein the operation circuitry is configured to pass audio signals indicated within the at least one sector.

7. The electronic device of claim 1 , wherein the operation circuitry is configured to attenuate audio signals not indicated within the at least one sector.

8. The electronic device of claim 1 , wherein the display is configured to indicate image data from one or more image sensors.

9. The electronic device of claim 1 , wherein the operation circuitry is configured to pass image data based on the one or more sectors.

10. The electronic device of claim 1 , wherein at least one of the sector selection feature and the sector editing feature operate based on at least one of a group consisting of single-touch input and multi-touch input.

11. The electronic device of claim 1 , wherein the display is configured to present at least one touch point corresponding to the at least one sector, and wherein the electronic device further comprises a touch sensor that is configured to receive a touch input corresponding to the at least one touch point, and wherein the user interface is configured to edit the at least one sector based on the touch input.

12. The electronic device of claim 1 , wherein the operational circuitry is part of one or more processors.

13. The electronic device of claim 1 , wherein the display is configured to present a sector editing feature that allows adjusting a size of the at least one sector based on a received input providing an adjustment to at least one boundary of the at least one sector of the coordinate system.

14. The electronic device of claim 13 , wherein an adjusted size of the at least one sector is expanded relative to the size of the at least one sector of the coordinate system prior to the adjustment.

15. The electronic device of claim 1 , wherein the physical coordinates are earth coordinates.

16. The electronic device of claim 1 , wherein the physical coordinates represent a physical space independent of earth coordinates.

17. The electronic device of claim 1 , wherein the display is configured to maintain a coordinate system orientation independent of electronic device orientation.

18. The electronic device of claim 1 , further comprising audio signature recognition circuitry that is configured to recognize an audio signature, look up the audio signature in a database, obtain identification information corresponding to the audio signature, and is configured to pass the identification information to the display.

19. The electronic device of claim 18 , wherein the identification information is an image of a person corresponding to the audio signature.

20. The electronic device of claim 18 , wherein the display is configured to present the user interface providing at least one of a show target control and a show interferer control.

21. The electronic device of claim 1 , wherein the display is configured to provide the sector selection feature enabling selection of multiple sectors at once.

22. The electronic device of claim 1 , wherein the display is configured to provide a sector editing feature enabling adjusting the sector based on single- or multi-touch input.

23. The electronic device of claim 1 , wherein the display is configured to receive one or more swipe inputs indicating the at least one sector.

24. The electronic device of claim 1 , wherein the display is configured to receive a single swipe.

25. The electronic device of claim 1 , wherein the display is configured to present an editable mode or both a fixed mode and the editable mode.

26. A method for displaying a user interface on an electronic device, comprising:

presenting a user interface, wherein the user interface comprises a coordinate system, wherein the coordinate system corresponds to physical coordinates based on sensor data;

providing a sector selection feature that allows selection of at least one sector of the coordinate system, wherein the at least one sector corresponds to captured audio from multiple microphones, and wherein a sector selection comprises an audio signal indicator; and

performing an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

27. The method of claim 26 , further comprising indicating image data from one or more image sensors.

28. The method of claim 26 , further comprising:

recognizing an audio signature;

looking up the audio signature in a database;

obtaining identification information corresponding to the audio signature; and

displaying the identification information on the user interface.

29. The method of claim 28 , wherein the identification information is an image of a person corresponding to the audio signature.

30. The method of claim 26 , wherein an adjusted size of the at least one sector is expanded relative to the size of the at least one sector of the coordinate system prior to the adjustment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2018
From: KIM, LAE-HOON; VISSER, ERIK; TON, PHUONG LAM; TOMAN, JEREMY PATRICK; SHAW, JEFFREY CLINTON
To: QUALCOMM INCORPORATED
Reel/Frame 046954/0853 →
Continuity (7)
Continuation 13835881 · Mar 15, 2013
Provisional Application 61713447 · Oct 12, 2012
Provisional Application 61714212 · Oct 15, 2012
Provisional Application 61624181 · Apr 13, 2012
Provisional Application 61642954 · May 4, 2012
Provisional Application 61726336 · Nov 14, 2012
Related Publication 20190139552A1 · May 9, 2019