IP Library Granted Patent US 12,244,752
Granted Patent B1
US 12,244,752 · App. 18/373,382 · Granted Mar 4, 2025

Text assisted telephony on wireless device method and apparatus

Inventors: Christopher R. Engelke (Verona, WI); Kevin R. Colwell (Middleton, WI); Troy Vitek (Waunakee, WI)
Assignee: ULTRATEC, INC.
H04M1/2475H04M1/72412H04M3/42391
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,244,752
App. No.
18/373,382
Granted
Mar 4, 2025
Kind
B1
Abstract

A communication system and method usable to facilitate communication between a hearing user and an assisted user. In particular, the system employs a wireless portable tablet or other portable electronic computing device linked to a captioning enabled phone as a remote interface for that phone, thereby providing an assisted user with more options, more freedom, and improved usability of the system.

Claims (57)

1. A method comprising:

obtaining, at a host device, remote audio originating at a remote device during a communication session involving the remote device;

directing, from the host device during the communication session, the remote audio to a transcription system, the transcription system obtaining the remote audio of the communication session from the host device;

directing, from the host device during the communication session, the remote audio to a communication device, the host device and the communication device being locally linked and both being located within a single residence of a user;

obtaining, at the host device during the communication session, transcript data from the transcription system, the transcript data including a transcription of the remote audio generated by the transcription system; and

presenting, by the host device during at least a portion of the communication session, the transcription.

2. The method of claim 1 , further comprising:

obtaining, at the host device during the communication session, local audio; and

directing, from the host device during the communication session, the local audio to the remote device.

3. The method of claim 2 , wherein the local audio is obtained from the communication device.

4. The method of claim 1 , wherein the communication device is configured to broadcast the remote audio to the user and the host device is not configured to broadcast the remote audio to the user.

5. The method of claim 1 wherein the remote audio is directed to the transcription system from the host device over a first network type and the remote audio is directed to the communication device from the host device over a second network of a second network type that is different than the first network type.

6. The method of claim 5 wherein the first network type is the Internet and wherein the second network type is a wireless network.

7. The method of claim 6 wherein the communication device is a portable wireless computing device including a display screen, the method further including receiving a user input requesting that the transcription be presented via the portable device display screen and, in response to the input request, directing, from the host device during the communication session, the transcription to the communication device and presenting the transcription via the portable device display screen during the communication session.

8. A host device comprising:

a first network link configured to obtain remote audio originating at a remote device during a communication session involving the remote device;

a second network link configured to direct, during the communication session, the remote audio to a transcription system and to obtain transcript data from the transcription system, the transcript data including a transcription of the remote audio generated by the transcription system and the transcription system obtaining the remote audio of the communication session only from the host device;

a third network link configured to direct, during the communication session, the remote audio to a communication device; and

a display configured to present the transcription during at least a portion of the communication session.

9. The host device of claim 8 , wherein the third network link is configured to obtain, during the communication session, local audio, and

the first network link is configured to direct, during the communication session, the local audio to the remote device.

10. The host device of claim 8 , wherein the host device is associated with a user and the communication device is associated with the user.

11. The host device of claim 10 , wherein the host device is not configured to broadcast the remote audio to the user.

12. The device of claim 8 , wherein the first network link is of a first network link type and the second network link is of a second network link type that is different than the first network link type.

13. The host device of claim 8 wherein the first network link is a PSTN, the second network link is the Internet, and the third network link is a wireless communication link.

14. A method comprising:

obtaining, at a host device, remote audio originating at a remote device during a communication session involving the remote device;

directing, from the host device during the communication session, the remote audio to a first local device, the first local device being configured to receive and broadcast the remote audio, the host device and the first local device being locally coupled and both being located within a single residence of a user; and

presenting, by the host device during the communication session, transcript data that includes a transcription of the remote audio.

15. The method of claim 14 , further comprising:

obtaining, at the host device during the communication session, local audio; and

directing, from the host device during the communication session, the local audio to the remote device.

16. The method of claim 14 , wherein the first local device is configured to broadcast the remote audio to the user, the method including broadcasting the remote audio via the first local device.

17. The method of claim 14 , further comprising:

directing, from the host device during the communication session, the remote audio to a transcription system; and

obtaining, at the host device during the communication session, the transcript data from the transcription system, the transcript data generated by the transcription system.

18. The method of claim 17 , wherein the transcription system obtains the remote audio of the communication session only from the host device.

19. The method of claim 14 wherein the host device and the first local device are linked via a wireless communication link.

20. The method of claim 14 wherein the first local device includes a local device display screen and is configured to present the transcript, the method further including, while the transcript is presented by the host device, receiving a command to present the transcript via the first local device display screen, directing the transcript from the host devoice to the first local device and presenting the transcript via the first local device display screen.

21. The method of claim 20 further including halting presentation of the transcription via the host device when the first local device commences presenting the transcript.

22. The method of claim 7 , wherein the communication device is configured to broadcast the remote audio to the user and the host device is not configured to broadcast the remote audio to the user.

23. The method of claim 22 , further comprising:

obtaining, at the host device during the communication session, local audio; and

directing, from the host device during the communication session, the local audio to the remote device.

24. The method of claim 23 , wherein the local audio is obtained from the communication device.

25. The method of claim 5 wherein the remote audio is received at the host device from the remote device over a third network type that is different than the first and second network types.

26. The method of claim 1 wherein the host device is a captioned device that includes a display screen and wherein the communication device is a wireless communication device.

27. The method of claim 26 wherein the host device further transmits the transcript data to the communication device during at least a portion of the communication session.

28. The method of claim 26 wherein the host device transmits the transcript data to the communication device subsequent to receiving a command from the communication device requesting that the transcript data be transmitted to the communication device.

29. The method of claim 28 further including, upon receiving the command to transmit the transcript data to the communication device, the host device ceases presenting the transcript data and the communication device commences presenting the transcript data.

30. The method of claim 1 wherein the communication device is a pad type computer system including a speaker and a display screen.

31. The method of claim 1 wherein the communication device is a wireless television.

32. The host device of claim 8 wherein the host device is a captioned telephone device.

33. The host device of claim 12 wherein the third network link is of a network type that is different than the first and second network types.

34. The method of claim 20 wherein the host device is a captioned telephone device.

35. The method of claim 34 wherein the host device and the first local device communicate via wireless communication.

36. The method of claim 35 wherein the first local device includes a portable computing device.

Continuity (5)
Continuation 17556052 · Dec 20, 2021
Continuation 17489383 · Sep 29, 2021
Continuation 16209675 · Dec 4, 2018
Continuation 15285641 · Oct 5, 2016
Provisional Application 62246905 · Oct 27, 2015
References Cited (71)
US 5392343A · Davitt et al. · 1995 [cited by applicant]
US 5463665A · Millios et al. · 1995 [cited by applicant]
US 5671267A · August et al. · 1997 [cited by applicant]
US 6072860A · Kek et al. · 2000 [cited by applicant]
US 6075842A · Engelke et al. · 2000 [cited by applicant]
US 6430270B1 · Cannon et al. · 2002 [cited by applicant]
US 6603835B2 · Engelke et al. · 2003 [cited by applicant]
US 8331541B1 · Smith · 2012 [cited by applicant]
US 8738072B1 · Messerian · 2014 [cited by applicant]
US 8917821B2 · Engelke et al. · 2014 [cited by applicant]
US 10469660B2 · Engelke et al. · 2019 [cited by applicant]
US 10491746B2 · Engelke et al. · 2019 [cited by applicant]
US 10560574B1 · Engelke et al. · 2020 [cited by applicant]
US 10587751B2 · Engelke et al. · 2020 [cited by applicant]
US 20010005825A1 · Engelke et al. · 2001 [cited by applicant]
US 20020085685A1 · Engelke et al. · 2002 [cited by applicant]
US 20020193076A1 · Rogers et al. · 2002 [cited by applicant]
US 20030045329A1 · Kinoshita · 2003 [cited by applicant]
US 20030063731A1 · Woodring · 2003 [cited by applicant]
US 20030097262A1 · Nelson · 2003 [cited by applicant]
US 20030212547A1 · Engelke · 2003 [cited by examiner]
US 20050063520A1 · Michaelis · 2005 [cited by applicant]
US 20050064899A1 · Angelopoulos et al. · 2005 [cited by applicant]
US 20050129185A1 · McClelland et al. · 2005 [cited by applicant]
US 20050232169A1 · Mclaughlin et al. · 2005 [cited by applicant]
US 20080187108A1 · Engelke · 2008 [cited by examiner]
US 20090187956A1 · Sommer · 2009 [cited by applicant]
US 20090221321A1 · Fields et al. · 2009 [cited by applicant]
US 20100063815A1 · Cloran · 2010 [cited by examiner]
US 20110123003A1 · Romriell · 2011 [cited by examiner]
US 20120076009A1 · Pasko · 2012 [cited by applicant]
US 20120212567A1 · Brooksby et al. · 2012 [cited by applicant]
US 20120245936A1 · Treglia · 2012 [cited by applicant]
US 20130029671A1 · Islam · 2013 [cited by applicant]
US 20130144610A1 · Gordon et al. · 2013 [cited by applicant]
US 20140153705A1 · Moore et al. · 2014 [cited by applicant]
US 20140180667A1 · Johansson · 2014 [cited by applicant]
US 20150081860A1 · Kuehnel et al. · 2015 [cited by applicant]
US 20150094105A1 · Pan · 2015 [cited by examiner]
US 20150341486A1 · Knighton · 2015 [cited by examiner]
US 20160112871A1 · White · 2016 [cited by applicant]
US 20180103136A1 · Holm et al. · 2018 [cited by applicant]
US 20200007671A1 · Engelke et al. · 2020 [cited by applicant]
US 20200329141A1 · Michaelis · 2020 [cited by applicant]
US 20210065717A1 · Dunn et al. · 2021 [cited by applicant]
US 20210266473A1 · Engelke et al. · 2021 [cited by applicant]
US 20210289070A1 · Thomson · 2021 [cited by applicant]
WO 9750222A1 · 1997 [cited by applicant]
Petition for Inter Partes Review for U.S. Pat. No. 10,469,660, [cited by applicant]
Declaration of Benedict J. Occhiogrosso for U.S. Pat. No. 10,469,660, [cited by applicant]
Decision Denying Institution of Inter Partes Review for U.S. Pat. No. 10,469,660, [cited by applicant]
U.S. Appl. No. 60/562,795 Provisional Application to McLaughlin et al., filed Apr. 16, 2004, 126 pages. [cited by applicant]
BlackBerry, Rim Introduces New Color BlackBerry Handheld for CDMA2000 1X Wireless Networks, BlackBerry Press Release, Mar. 22, 2004, 2 pages. [cited by applicant]
BlackBerry Wireless Handheld User Guide, 7750, Mar. 16, 2004, 144 pages. [cited by applicant]
Federal Communications Commission, Telecommunication Relay Services and Speech-to-Speech Services for Individuals With Hearing and Speech Disabilities, 68 Fed. Reg. 50973-50978 (Aug. 25, 2003). [cited by applicant]
PhoneDB, Rim BlackBerry 7750 Device Specs, Copyright 2006-2020 PhoneDB, 6 pages. [cited by applicant]
PhonesData, Nokia 6620 Specs, Review, Opinions, Comparisons, Copyright 2020, 9 pages. [cited by applicant]
Sundgot, Nokia Unveils the 6600, InfoSync World, Jun. 16, 2003, 2 pages. [cited by applicant]
Wikipedia, Dell Axim, https://en.wikipedia.org/wiki/Dell_Axim, Last Edited on Feb. 23, 2020, 4 pages. [cited by applicant]
Wikipedia, Palm Tungsten, https://en.wikipedia.org/wiki/Palm_Tungsten, Last Edited on Oct. 6, 2019, 10 pages. [cited by applicant]
Final Written Decision, U.S. Pat. No. 9,131,045, Case IPR2015-01889, [cited by applicant]
Judgment, U.S. Pat. No. 7,881,441, Case IPR2015-01886, [cited by applicant]
Petition for Inter Partes Review for U.S. Pat. No. 10,491,746, [cited by applicant]
Declaration of Benedict J. Occhiogrosso for U.S. Pat. No. 10,491,746, [cited by applicant]
Decision Denying Institution of Inter Partes Review for U.S. Pat. No. 10,491,746, [cited by applicant]
Arlinger, Negative Consequences of Uncorrected Hearing Loss—A Review, International Journal of Audiology, 2003, 42:2S17-2S20. [cited by applicant]
Petition for Inter Partes Review for U.S. Pat. No. 10,587,751, [cited by applicant]
Declaration of Benedict J. Occhiogrosso for U.S. Pat. No. 10,587,751, [cited by applicant]
Decision Granting Institution of Inter Partes Review for U.S. Pat. No. 10,587,751, [cited by applicant]
Judgment Granting Request for Entry of Adverse Judgment After Institution of Trial for U.S. Pat. No. 10,587,751, [cited by applicant]
Curtis et al., Doctor-Patient Communication on the Telephone, Can Fam Physician, 1989, 35:123-128. [cited by applicant]