IP Library › Granted Patent US 12,373,087
Granted Patent B2
US 12,373,087 · App. 17/594,709 · Granted Jul 29, 2025

Coupling of user interfaces

Inventor: Markus Strassberger (Wartenberg, DE)
Assignee: Bayerische Motoren Werke Aktiengesellschaft
G06F3/0484G06F3/0481G06V20/597B60K35/00B60K35/28B60K35/85B60K2360/164B60K2360/166B60K2360/586B60K2360/589
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,087
App. No.
17/594,709
Granted
Jul 29, 2025
Kind
B2
Abstract

A method and system couples a first user interface with a second user interface. The first user interface is implemented in the form of a mobile terminal or one or more back-end components. The second user interface is implemented in the form of a control device of a vehicle. The method includes the steps of: registering one or more elements of the first user interface; determining one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to reproduce at least one portion of the one or more elements; and displaying the one or more display elements on the second user interface. The system has the control device and/or the one or more back-end components, wherein the control device and/or the one or more back-end components are configured to carry out the method.

Claims (70)

1. A method for coupling a first user interface to a second user interface, wherein the first user interface is implemented by way of a mobile terminal or by way of one or more back-end components and the second user interface is implemented by way of a control device of a vehicle, the method comprising:

registering one or more elements of the first user interface;

determining one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to depict at least some of the one or more elements;

displaying the one or more display elements on the second user interface;

registering one or more inputs of a user of the vehicle;

determining an input image of the one or more inputs based on second heuristics;

transmitting the input image to the first user interface;

repeatedly at regular intervals, continuously, or when required:

registering one or more behavior parameters, which characterize a behavior of the user of the vehicle, by directly monitoring the user of the vehicle via an optical sensor; and

determining one or more attention parameters, which characterize a degree of attention of the user of the vehicle relating to the operation of the vehicle, based on the behavior parameters; and

adjusting the first and/or second heuristics based on the determined one or more attention parameters,

wherein the first heuristics comprise personal capabilities of the user of the vehicle,

wherein the first heuristics further comprise relevance-based heuristics for transferring the one or more elements to the one or more display elements,

wherein the relevance-based heuristics correlate a relevance of at least one of the one or more elements with one or more display parameters of the depiction,

wherein the relevance-based heuristics take into account a current relevance of the one or more elements for the user of the vehicle,

wherein the current relevance of an element of the one or more elements is determined based on whether the element is usable by the user of the vehicle for a purpose related to the operation of the vehicle, and

wherein a first element of the one or more elements that is relevant only to mobile use of the mobile terminal is prevented from being displayed on the one or more display elements according to the relevance-based heuristics.

2. The method according to claim 1 , wherein the first heuristics further comprise:

dynamics-based heuristics for transferring the one or more elements to one or more display elements,

wherein the dynamics-based heuristics correlate display dynamics of at least one of the one or more elements with one or more display parameters of the depiction, and

wherein the dynamics-based heuristics take into account a current driving state of the vehicle.

3. The method according to claim 1 , wherein the first heuristics further comprise:

parameter-based heuristics for transferring one or more parameters of the first user interface to one or more parameters of the second user interface, and

wherein the parameter-based heuristics take into account generic depiction rules of the display of the one or more elements on the second user interface.

4. The method according to claim 1 , wherein the second heuristics further comprise:

input-modal heuristics for depicting the one or more inputs of the user on input modalities of the first user interface.

5. The method according to claim 1 , wherein

the steps of registering one or more inputs, of determining the input image, and of transmitting the input image to the first user interface are carried out in real time.

6. The method according to claim 1 , wherein

the steps of registering the one or more elements, of determining one or more display elements and of displaying the one or more display elements on the second user interface are carried out in real time.

7. A system for providing one or more users of a vehicle with information, the system comprising:

a control device; and/or

one or more back-end components; wherein

the control device and/or the one or more back-end components are configured to couple a first user interface to a second user interface, wherein the first user interface is implemented by way of a mobile terminal or by way of the one or more back-end components and the second user interface is implemented by way of the control device of a vehicle, wherein the coupling operates to:

register one or more elements of the first user interface;

determine one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to depict at least some of the one or more elements;

display the one or more display elements on the second user interface;

register one or more inputs of a user of the vehicle;

determine an input image of the one or more inputs based on second heuristics;

transmit the input image to the first user interface;

repeatedly at regular intervals, continuously, or when required:

register one or more behavior parameters, which characterize a behavior of the user of the vehicle, by directly monitoring the user of the vehicle via an optical sensor; and

determine one or more attention parameters, which characterize a degree of attention of the user of the vehicle relating to the operation of the vehicle, based on the behavior parameters; and

adjust the first and/or second heuristics based on the determined one or more attention parameters,

wherein the first heuristics comprise personal capabilities of the user of the vehicle,

wherein the first heuristics further comprise relevance-based heuristics for transferring the one or more elements to the one or more display elements,

wherein the relevance-based heuristics correlate a relevance of at least one of the one or more elements with one or more display parameters of the depiction,

wherein the relevance-based heuristics take into account a current relevance of the one or more elements for the user of the vehicle,

wherein the current relevance of an element of the one or more elements is determined based on whether the element is usable by the user of the vehicle for a purpose related to the operation of the vehicle, and

wherein a first element of the one or more elements that is relevant only to mobile use of the mobile terminal is prevented from being displayed on the one or more display elements according to the relevance-based heuristics.

8. A vehicle, comprising:

a control device, wherein

the control device is configured to couple a first user interface to a second user interface, wherein the first user interface is implemented by way of a mobile terminal or by way of one or more back-end components and the second user interface is implemented by way of the control device,

the control device operating to:

register one or more elements of the first user interface;

determine one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to depict at least some of the one or more elements;

display the one or more display elements on the second user interface;

register one or more inputs of a user of the vehicle;

determine an input image of the one or more inputs based on second heuristics;

transmit the input image to the first user interface;

repeatedly at regular intervals, continuously, or when required:

register one or more behavior parameters, which characterize a behavior of the user of the vehicle, by directly monitoring the user of the vehicle via an optical sensor; and

determine one or more attention parameters, which characterize a degree of attention of the user of the vehicle relating to the operation of the vehicle, based on the behavior parameters; and

adjust the first and/or second heuristics based on the determined one or more attention parameters,

wherein the first heuristics comprise personal capabilities of the user of the vehicle,

wherein the first heuristics further comprise relevance-based heuristics for transferring the one or more elements to the one or more display elements,

wherein the relevance-based heuristics correlate a relevance of at least one of the one or more elements with one or more display parameters of the depiction,

wherein the relevance-based heuristics take into account a current relevance of the one or more elements for the user of the vehicle,

wherein the current relevance of an element of the one or more elements is determined based on whether the element is usable by the user of the vehicle for a purpose related to the operation of the vehicle, and

wherein a first element of the one or more elements that is relevant only to mobile use of the mobile terminal is prevented from being displayed on the one or more display elements according to the relevance-based heuristics.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: STRASSBERGER, MARKUS
To: BAYERISCHE MOTOREN WERKE AKTIENGESELLSCHAFT
Reel/Frame 057929/0817 →
Priority Claims (1)
DE 10 2019 118 189.5 · Jul 5, 2019 · national
Continuity (1)
Related Publication 20220197457A1 · Jun 23, 2022
References Cited (35)
US 9694682B2 · Boss · 2017 [cited by examiner]
US 10251034B2 · Langlois et al. · 2019 [cited by applicant]
US 20080275632A1 · Cummings · 2008 [cited by examiner]
US 20090284476A1 · Bull et al. · 2009 [cited by applicant]
US 20100293462A1 · Bull et al. · 2010 [cited by applicant]
US 20130106750A1 · Kurosawa · 2013 [cited by applicant]
US 20130157607A1 · Paek et al. · 2013 [cited by applicant]
US 20130275899A1 · Schubert · 2013 [cited by examiner]
US 20130335401A1 · Beckmann · 2013 [cited by applicant]
US 20140019913A1 · Newman · 2014 [cited by examiner]
US 20140106726A1 · Crosbie et al. · 2014 [cited by applicant]
US 20140179274A1 · O'Meara et al. · 2014 [cited by applicant]
US 20140181715A1 · Axelrod et al. · 2014 [cited by applicant]
US 20140181751A1 · Won · 2014 [cited by examiner]
US 20140359456A1 · Thiele · 2014 [cited by examiner]
US 20150019967A1 · Gutentag et al. · 2015 [cited by applicant]
US 20160009175A1 · McNew · 2016 [cited by examiner]
US 20180173230A1 · Goldman-Shenhar et al. · 2018 [cited by applicant]
US 20190308639A1 · Ricci · 2019 [cited by examiner]
US 20200241824A1 · Lee · 2020 [cited by examiner]
US 20200290630A1 · Elwart · 2020 [cited by examiner]
CN 104750379A · 2015 [cited by applicant]
CN 108205731A · 2018 [cited by applicant]
DE 102009048178A1 · 2011 [cited by applicant]
DE 102011112445A1 · 2012 [cited by applicant]
DE 102013221867A1 · 2015 [cited by applicant]
DE 102014017173A1 · 2016 [cited by applicant]
DE 102018129801A1 · 2020 [cited by applicant]
WO WO2005004431A2 · 2005 [cited by applicant]
WO WO2005055046A1 · 2005 [cited by applicant]
International Search Report (PCT/ISA/210) issued in PCT Application No. PCT/EP2020/065617 dated Aug. 25, 2020 with English translation (six (6) pages). [cited by applicant]
German-language Written Opinion (PCT/ISA/237) issued in PCT Application No. PCT/EP2020/065617 dated Aug. 25, 2020 (seven (7) pages). [cited by applicant]
German-language Office Action issued in German Application No. 10 2019 118 189.5 dated Apr. 28, 2020 (five (5) pages). [cited by applicant]
Chinese-language Office Action issued in Chinese Application No. 202080034220.X dated Jun. 22, 2024 with English translation (16 pages). [cited by applicant]
Chinese-language Office Action issued in Chinese Application No. 202080034220.X dated Feb. 5, 2024 with English translation (19 pages). [cited by applicant]