IP Library Granted Patent US 12,712,971
Granted Patent B2
US 12,712,971 · App. 18/638,369 · Granted Aug 18, 2026

Transcribing interactive voice response menu options to generate visualizations during a call

Inventor: Vi Dinh Chau (Seattle, WA)
Assignee: Zoom Communications, Inc.
H04M3/5166G10L15/26H04M1/72469H04M3/493H04M3/567H04M3/568H04M2201/40H04M2201/42H04M2203/256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,712,971
App. No.
18/638,369
Filed
Apr 17, 2024
Granted
Aug 18, 2026
Kind
B2
Examiner
HASHEM, LISA
Art Unit
2692
USPC
379/88.18
Abstract

A method includes connecting a call from a client device to a destination having an interactive voice response service; transcribing audio from the destination during the call to identify menu options of the interactive voice response service; generating visualizations representing the menu options; and outputting the visualizations to a display associated with the client device. A system includes a telephony system, an automatic speech recognition processing tool, and a visualization output generation tool. The telephony system connects a call from a client device to a destination having an interactive voice response service. The automatic speech recognition processing tool transcribes audio from the destination during the call to identify menu options of the interactive voice response service. The visualization output generation tool generates visualizations representing the menu options. The telephony system outputs the visualizations to a display associated with the client device.

Claims (43)

1 . A method, comprising:

determining, during a call associated with an interactive voice response service, a first menu option of a current menu of the interactive voice response service;

outputting, for display at a device during the call, a first visualization generated to represent the first menu option;

determining, during the call and based on the current menu including one or more other menu options, a second menu option of the current menu; and

outputting, for display at the device during the call, a second visualization generated to represent the second menu option.

2 . The method of claim 1 , wherein determining the second menu option of the current menu comprises:

determining the second menu option after the first visualization is output.

3 . The method of claim 1 , wherein determining a menu option of the current menu of the interactive voice response service comprises:

transcribing audio of the call.

4 . The method of claim 3 , wherein the menu options are determined using a telephony system of a software platform and the audio of the call is transcribed using a transcription service of the software platform.

5 . The method of claim 3 , wherein the menu options are determined using a telephony system of a software platform and the audio of the call is transcribed using a transcription service external to the software platform.

6 . The method of claim 1 , comprising:

determining a selection of one of the first visualization or the second visualization at the device; and

indicating the selection to the interactive voice response service.

7 . The method of claim 1 , comprising:

determining whether the device is video-enabled.

8 . The method of claim 1 , comprising:

routing the call through an external telephony system.

9 . The method of claim 1 , comprising:

generating the first visualization during the call; and

generating the second visualization during the call.

10 . A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:

determining, during a call associated with an interactive voice response service, a first menu option of a current menu of the interactive voice response service;

outputting, for display at a device during the call, a first visualization generated to represent the first menu option;

determining, during the call and based on the current menu including one or more other menu options, a second menu option of the current menu; and

outputting, for display at the device during the call, a second visualization generated to represent the second menu option.

11 . The non-transitory computer readable medium of claim 10 , wherein the first visualization is output before the second visualization is output.

12 . The non-transitory computer readable medium of claim 10 , the operations comprising:

performing a real-time transcription process against audio of the call to determine the first menu option and the second menu option.

13 . The non-transitory computer readable medium of claim 10 , wherein the device is a secondary device in communication with a calling device used to initiate the call.

14 . The non-transitory computer readable medium of claim 10 , wherein one or more of the first visualization or the second visualization includes one or more of image content or video content.

15 . A system, comprising:

one or more memories; and

one or more processors configured to execute instructions stored in the one or more memories to:

determine, during a call associated with an interactive voice response service, a first menu option of a current menu of the interactive voice response service;

output, for display at a device during the call, a first visualization generated to represent the first menu option;

determine, during the call and based on the current menu including one or more other menu options, a second menu option of the current menu; and

output, for display at the device during the call, a second visualization generated to represent the second menu option.

16 . The system of claim 15 , wherein the first visualization is output before the second menu option is determined.

17 . The system of claim 15 , wherein the first menu option and the second menu option are separately determined based on a real-time transcription process performed against audio of the call.

18 . The system of claim 15 , wherein the device is one of a calling device used to initiate the call or a secondary device in communication with the calling device.

19 . The system of claim 15 , wherein the call is routed to a destination through an external telephony system.

20 . The system of claim 15 , wherein the menu options are determined and the visualizations are output using one or more services of a unified communications as a service software platform.

Assignments (2)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: CHAU, VI DINH
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 067148/0166 →
Continuity (3)
Continuation 18181080 · Mar 9, 2023
Continuation 17237139 · Apr 22, 2021
Related Publication 20240267463A1 · Aug 8, 2024
References Cited (63)
US 6408272B1 · White · 2002 [cited by examiner]
US 7027990B2 · Sussman · 2006 [cited by applicant]
US 7092738B2 · Creamer et al. · 2006 [cited by applicant]
US 7450954B2 · Randall · 2008 [cited by applicant]
US 8081749B1 · Shaffer et al. · 2011 [cited by applicant]
US 8406388B2 · Or-Bach et al. · 2013 [cited by applicant]
US 8537989B1 · Lavian et al. · 2013 [cited by applicant]
US 8548131B1 · Lavian et al. · 2013 [cited by applicant]
US 8548135B1 · Lavian et al. · 2013 [cited by applicant]
US 8553859B1 · Lavian et al. · 2013 [cited by applicant]
US 8572303B2 · Lavian et al. · 2013 [cited by applicant]
US 8594280B1 · Or-Bach et al. · 2013 [cited by applicant]
US 8625756B1 · Lavian et al. · 2014 [cited by applicant]
US 8666046B2 · Ozeri et al. · 2014 [cited by applicant]
US 8687777B1 · Lavian et al. · 2014 [cited by applicant]
US 8903073B2 · Or-Bach et al. · 2014 [cited by applicant]
US 8976945B2 · Patel · 2015 [cited by applicant]
US 8989369B1 · Asghari et al. · 2015 [cited by applicant]
US 9001819B1 · Or-Bach et al. · 2015 [cited by applicant]
US 9628623B2 · Vymenets et al. · 2017 [cited by applicant]
US 9966072B2 · Ruiz Rodriguez · 2018 [cited by applicant]
US 9978367B2 · Aleksic et al. · 2018 [cited by applicant]
US 10009740B2 · Langevin et al. · 2018 [cited by applicant]
US 10250749B1 · Boone et al. · 2019 [cited by applicant]
US 10579330B2 · Koul et al. · 2020 [cited by applicant]
US 10659501B2 · Klemm et al. · 2020 [cited by applicant]
US 10922890B1 · Pusch et al. · 2021 [cited by applicant]
US 10929561B2 · Long et al. · 2021 [cited by applicant]
US 10979568B1 · Lu et al. · 2021 [cited by applicant]
US 11102342B2 · Dhawan et al. · 2021 [cited by applicant]
US 11457109B2 · Myers et al. · 2022 [cited by applicant]
US 11627223B2 · Chau · 2023 [cited by applicant]
US 11722737B1 · Arazi · 2023 [cited by applicant]
US 20020013709A1 · Ortega · 2002 [cited by examiner]
US 20020090943A1 · Kwon · 2002 [cited by applicant]
US 20030074198A1 · Sussman · 2003 [cited by examiner]
US 20040121814A1 · Creamer · 2004 [cited by examiner]
US 20060018443A1 · Knott · 2006 [cited by examiner]
US 20060293897A1 · White et al. · 2006 [cited by applicant]
US 20070135101A1 · Ramati et al. · 2007 [cited by applicant]
US 20080226042A1 · Singh · 2008 [cited by applicant]
US 20100150322A1 · Yin · 2010 [cited by examiner]
US 20110246172A1 · Liberman et al. · 2011 [cited by applicant]
US 20120008755A1 · Mittal · 2012 [cited by applicant]
US 20130094633A1 · Mauro · 2013 [cited by applicant]
US 20130282381A1 · Mauro · 2013 [cited by examiner]
US 20140126713A1 · Ristock et al. · 2014 [cited by applicant]
US 20140161249A1 · Tolksdorf · 2014 [cited by applicant]
US 20150169336A1 · Harper et al. · 2015 [cited by applicant]
US 20150237196A1 · Song et al. · 2015 [cited by applicant]
US 20170270929A1 · Aleksic et al. · 2017 [cited by applicant]
US 20170374198A1 · de Silva et al. · 2017 [cited by applicant]
US 20180020093A1 · Bentitou et al. · 2018 [cited by applicant]
US 20180146090A1 · Lavian et al. · 2018 [cited by applicant]
US 20190251961A1 · Wang et al. · 2019 [cited by applicant]
US 20200007493A1 · Nair et al. · 2020 [cited by applicant]
US 20210064680A1 · Maheshwari et al. · 2021 [cited by applicant]
US 20210084153A1 · Paiva · 2021 [cited by examiner]
US 20210136210A1 · Paiva · 2021 [cited by applicant]
US 20210281682A1 · Agarwal et al. · 2021 [cited by applicant]
US 20210400138A1 · Andar et al. · 2021 [cited by applicant]
US 20220115020A1 · Bradley et al. · 2022 [cited by applicant]
US 20230005483A1 · Garg et al. · 2023 [cited by applicant]