IP Library Granted Patent US 12,705,019
Granted Patent B2
US 12,705,019 · App. 18/828,120 · Granted Aug 11, 2026

Automotive infotainment system with spatially-cognizant applications that interact with a speech interface

Inventors: Nils Lenke (Aachen, DE); Prasad Mandge (Pune, IN); Ketan Kankapure (Pune, IN); Aditya Chauhan (Pune, IN); Duygu Kanver (Farmington Hills, MI); Christian Benien (Aachen, DE); Kalpeshkumar Bhanubhai Patel (Pune, IN); Marina Matveevskaia (Aachen, DE); Abbas Ali Vanak (Issaquah, WA)
Assignee: Cerence Operating Company
G06F3/165G01C21/3629G10L15/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,705,019
App. No.
18/828,120
Filed
Sep 9, 2024
Granted
Aug 11, 2026
Kind
B2
Art Unit
2653
USPC
704/257
Abstract

An automotive processing unit includes an infotainment system having a speech interface, an application suite comprising one or more spatially-cognizant applications, and an automotive assistant that is configured to execute one or more of the spatially-cognizant applications. The speech interface is configured to receive a navigation announcement from a navigator and a touring announcement from one of the spatially-cognizant applications and, in response, to cause a spoken announcement to be made audible in a vehicle's cabin through a loudspeaker. The spoken announcement comprising content from at least one of the touring announcement and the navigation announcement.

Claims (44)

1 . A method for using an automotive assistant to use natural language to communicate information to an occupant of a vehicle, said method comprising:

receiving first and second outputs from respective first and second applications, said first and second outputs comprising first text and second text, respectively;

using a natural-language processor, generating hybrid text using said first text and said second text, wherein said hybrid text comprises information to be presented to said occupant; and

communicating said hybrid text to said user of said automotive assistant,

wherein communicating said hybrid text to said occupant comprises processing said hybrid text and wherein processing said hybrid text comprises using a text-to-speech converter to produce hybrid audio, wherein said method further comprises using a loudspeaker to communicate said hybrid audio to said occupant,

wherein said first application is a navigation application and said second application is a touring application,

wherein said first application produces said first text independently of said second application producing said second text, and

wherein generating said hybrid text using said first text and said second text comprises determining an insertion point within said first text and inserting said second text at said insertion point and wherein determining said insertion point comprises determining said grammatical structure of said first text.

2 . The method of claim 1 , wherein generating said hybrid text using said first text and said second text comprises incorporating into said hybrid text at least some text that is missing from both said first text and said second text and wherein said hybrid text represents a combination of a meaning of said first text and a meaning of said second text.

3 . The method of claim 1 , wherein generating said hybrid text using said first text and said second text comprises generating a summary of said first text and using said summary in said hybrid text.

4 . The method of claim 1 , wherein said first output comprises a first constraint, wherein said second output comprises a second constraint, wherein generating said hybrid text comprises generating said hybrid text so as to conform to said first constraint and to said second constraint, wherein said first constraint and said second constraint are selected from the group consisting of a visibility constraint and an interference constraint.

5 . An apparatus comprising

a navigator that provides location information, said location information comprising information that is indicative of a geographic location of said vehicle,

an automotive processing unit that is integrated into a vehicle having a cabin, and a loudspeaker that radiates sound into said cabin, and plural microphones disposed at seats in said vehicle, said automotive processing unit comprising said navigator,

a processor,

an application suite comprising one or more spatially-cognizant applications, wherein said spatially-cognizant applications provide output that depends at least in part on location of said vehicle,

an automotive assistant that is configured to execute one or more of said spatially-cognizant applications,

an infotainment system that comprises said application suite,

a tour-guide application, said tour-guide application being among said spatially-cognizant applications,

a speech interface that is configured:

to receive a navigation announcement from said navigator and a touring announcement from said tour-guide application,

to use said processor to combine content from said navigation announcement and content from said touring announcement to form a hybrid announcement,

and to cause said hybrid announcement to be made audible in said cabin through said loudspeaker, said hybrid announcement comprising content from said touring announcement and content from said navigation announcement, said processor being a natural-language processor that is a constituent of said speech interface.

6 . The apparatus of claim 5 , wherein first and second announcements are selected from said group consisting of said navigation announcement and said touring announcement and wherein said processor identifies, based on grammatical structure of said first announcement, an insertion point for inserting content from said second announcement into said first announcement to form said hybrid announcement.

7 . The apparatus of claim 5 , wherein first and second announcements are selected from the group consisting of said navigation announcement and said touring announcement, wherein said processor identifies a sentence in said second announcement, said sentence having an end, and wherein said natural-language processor is configured to insert content from said first announcement at said end to form said hybrid announcement.

8 . The apparatus of claim 5 , wherein first and second announcements are selected from said group consisting of said navigation announcement and said touring announcement and wherein said processor is configured to insert said second announcement between first and second sentences in said first announcement, thereby forming said hybrid announcement.

9 . The apparatus of claim 5 , wherein first and second announcements are selected from said group consisting of said navigation announcement and said touring announcement, wherein said hybrid announcement includes content from said first and second announcements, wherein said processor that identifies a sentence in said second announcement, selects, as an insertion point, a beginning of said sentence, and inserts content from said first announcement into said second announcement at said insertion point to thereby form said hybrid announcement.

10 . The apparatus of claim 5 , wherein said processor is configured to interleave content from said touring announcement and said navigation announcement to form said hybrid announcement, whereby said hybrid announcement includes content from both announcements.

11 . The apparatus of claim 5 , wherein said processor is configured to form said hybrid announcement by inserting a phrase between said navigation announcement and said touring announcement.

12 . The apparatus of claim 5 , wherein said speech interface causes insertion of a syntactic cue between said navigation announcement and said touring announcement to form said hybrid announcement.

13 . The apparatus of claim 5 , wherein said processor is configured to combine touring content from said touring announcement and navigation content from said navigation announcement to form said hybrid announcement and to deliver said touring content and said navigation content in said hybrid announcement using different voices.

14 . The apparatus of claim 5 , wherein said speech interface comprises a summarizer and wherein said summarizer is configured to receive said touring announcement and to generate a summarized version thereof, wherein said summarized version is interleaved into said navigation announcement to form said hybrid announcement.

15 . The apparatus of claim 5 , wherein said navigation announcement and said touring announcement comprise corresponding first and second sentences and wherein said hybrid announcement comprises a third sentence that incorporates content from said first and second sentences.

16 . An apparatus for causing a natural language hybrid announcement to be spoken within a vehicle having an automotive assistant that is configured to execute one or more applications, said applications being spatially-cognizant applications, each of which provides an announcement that is based at least in part on a location of said vehicle, said applications comprising first and second applications, said apparatus comprising:

a navigator that provides location information, said location information comprising information that is indicative of a geographic location of said vehicle,

an automotive processing unit that is integrated into a cabin of the vehicle, and a loudspeaker that radiates sound into said cabin, and plural microphones disposed at seats in said vehicle, said automotive processing unit comprising said navigator,

a processor,

an application suite comprising the spatially-cognizant applications,

an infotainment system,

a tour-guide application, said tour-guide application being among said spatially-cognizant applications, and

a speech interface that is configured for:

receiving first and second announcements from said first and second applications, respectively, said first announcement comprising text,

forming a hybrid announcement based on said first and second announcements, said hybrid announcement being a natural-language announcement,

causing said hybrid announcement to be output via the said loudspeaker into the said cabin of said vehicle at a time and location that is constrained by said first and second announcements.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2024
From: LENKE, NILS; BENIEN, CHRISTIAN; MANDGE, PRASAD; KANKAPURE, KETAN; CHAUHAN, ADITYA; KANVER, DUYGU; PATEL, KALPESHKUMAR BHANUBHAI; MATVEEVSKAIA, MARINA; VANAK, ABBAS
To: CERENCE OPERATING COMPANY
Reel/Frame 069467/0639 →
Continuity (6)
Division 17539508 · Dec 1, 2021
Provisional Application 63147991 · Feb 10, 2021
Provisional Application 63123119 · Dec 9, 2020
Provisional Application 63123110 · Dec 9, 2020
Provisional Application 63123114 · Dec 9, 2020
Related Publication 20250068384A1 · Feb 27, 2025
References Cited (87)
US 5055939A · Karamon et al. · 1991 [cited by applicant]
US 6243683B1 · Peters · 2001 [cited by applicant]
US 6567775B1 · Maali et al. · 2003 [cited by applicant]
US 7472063B2 · Nefian et al. · 2008 [cited by applicant]
US 7957542B2 · Sarrukh et al. · 2011 [cited by applicant]
US 8700392B1 · Hart et al. · 2014 [cited by applicant]
US 8913103B1 · Sargin et al. · 2014 [cited by applicant]
US 9832583B2 · Cohen et al. · 2017 [cited by applicant]
US 9881610B2 · Connell, II et al. · 2018 [cited by applicant]
US 9922646B1 · Blanksteen · 2018 [cited by applicant]
US 10154361B2 · Tammi et al. · 2018 [cited by applicant]
US 10332515B2 · Kim et al. · 2019 [cited by applicant]
US 10374816B1 · Leblang et al. · 2019 [cited by applicant]
US 11789457B1 · Woo · 2023 [cited by examiner]
US 12125393B2 · Sahoo · 2024 [cited by examiner]
US 20030009281A1 · Whitham · 2003 [cited by examiner]
US 20040220705A1 · Basir et al. · 2004 [cited by applicant]
US 20090015651A1 · Togami et al. · 2009 [cited by applicant]
US 20090055180A1 · Coon et al. · 2009 [cited by applicant]
US 20090150149A1 · Culter et al. · 2009 [cited by applicant]
US 20100194863A1 · Lopes et al. · 2010 [cited by applicant]
US 20100265164A1 · Okuno · 2010 [cited by applicant]
US 20110224978A1 · Sawada · 2011 [cited by applicant]
US 20120069131A1 · Abelow · 2012 [cited by applicant]
US 20130030811A1 · Olleon et al. · 2013 [cited by applicant]
US 20130169801A1 · Martin et al. · 2013 [cited by applicant]
US 20140187219A1 · Yang et al. · 2014 [cited by applicant]
US 20140214424A1 · Wang et al. · 2014 [cited by applicant]
US 20140365228A1 · Ng-Thow-Hing · 2014 [cited by examiner]
US 20140372100A1 · Jeong et al. · 2014 [cited by applicant]
US 20150023256A1 · Liu · 2015 [cited by examiner]
US 20150058004A1 · Dimitriadis et al. · 2015 [cited by applicant]
US 20150112593A1 · Kandangath · 2015 [cited by examiner]
US 20150139426A1 · Tammi et al. · 2015 [cited by applicant]
US 20150154957A1 · Nakadai et al. · 2015 [cited by applicant]
US 20150254058A1 · Klein et al. · 2015 [cited by applicant]
US 20150324636A1 · Bentley et al. · 2015 [cited by applicant]
US 20150340040A1 · Mun et al. · 2015 [cited by applicant]
US 20160006400A1 · Mu · 2016 [cited by applicant]
US 20160100092A1 · Bohac · 2016 [cited by applicant]
US 20160140964A1 · Connell, II et al. · 2016 [cited by applicant]
US 20160358604A1 · Dreuw · 2016 [cited by applicant]
US 20170113627A1 · Ding · 2017 [cited by applicant]
US 20170133036A1 · Cohen et al. · 2017 [cited by applicant]
US 20170309275A1 · Takayanagi et al. · 2017 [cited by applicant]
US 20170309289A1 · Eronen et al. · 2017 [cited by applicant]
US 20170351485A1 · Kohler et al. · 2017 [cited by applicant]
US 20180018964A1 · Reilly et al. · 2018 [cited by applicant]
US 20180033447A1 · Ramprashad et al. · 2018 [cited by applicant]
US 20180077492A1 · Yamada et al. · 2018 [cited by applicant]
US 20180174583A1 · Zhao et al. · 2018 [cited by applicant]
US 20180190282A1 · Mohammad et al. · 2018 [cited by applicant]
US 20180286404A1 · Cech et al. · 2018 [cited by applicant]
US 20190037363A1 · Tzirkel-Hancock et al. · 2019 [cited by applicant]
US 20190073999A1 · Prémont et al. · 2019 [cited by applicant]
US 20190237067A1 · Friedman et al. · 2019 [cited by applicant]
US 20190333508A1 · Rao et al. · 2019 [cited by applicant]
US 20190355352A1 · Kane et al. · 2019 [cited by applicant]
US 20190394339A1 · Seo et al. · 2019 [cited by applicant]
US 20200191595A1 · Chipouras · 2020 [cited by examiner]
US 20200294092A1 · Tong · 2020 [cited by examiner]
US 20210318125A1 · Ahmed · 2021 [cited by examiner]
US 20230401274A1 · Denninghoff · 2023 [cited by applicant]
AU 2005292243A1 · 2006 [cited by examiner]
AU 2008357168A1 · 2009 [cited by examiner]
AU 2010246465A1 · 2011 [cited by examiner]
CA 2897966C · 2023 [cited by examiner]
CN 102117221A · 2011 [cited by examiner]
CN 116734836A · 2023 [cited by examiner]
DE 102013004444A1 · 2014 [cited by examiner]
DE 202016106975U1 · 2017 [cited by examiner]
DE 202017106586U1 · 2018 [cited by applicant]
EP 2068123A2 · 2009 [cited by examiner]
EP 3416153A1 · 2018 [cited by applicant]
JP 3639412B2 · 2005 [cited by examiner]
JP 3834848B2 · 2006 [cited by applicant]
JP 3902483B2 · 2007 [cited by applicant]
JP 4135520B2 · 2008 [cited by applicant]
JP 4348852B2 · 2009 [cited by examiner]
JP 4584434B2 · 2010 [cited by applicant]
JP 2012168243A · 2012 [cited by applicant]
KR 20100003951A · 2010 [cited by applicant]
KR 100988792B1 · 2010 [cited by applicant]
WO 2017138934A1 · 2017 [cited by applicant]
WO WO2018051570A1 · 2018 [cited by examiner]
Algorithm for Genrerating and Visualizing Routes of an Intelligent Tourist Guide (Year: 2020). [cited by examiner]
Enhancing Tourist Experience via Automatic Personalized Route Suggestions (Year: 2024). [cited by examiner]