IP Library › Granted Patent US 12,159,022
Granted Patent B2
US 12,159,022 · App. 17/644,347 · Granted Dec 3, 2024

Remotely controlling vehicle touchscreen controls

Inventor: Mats Strandberg (Gothenburg, SE)
Assignee: Volvo Car Corporation
G06F3/0484B60K35/00G06F3/0488G06F3/1454H04M1/724098B60K35/10B60K35/65B60K35/80B60K2360/11B60K2360/55H04M1/72412H04M1/72415
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,159,022
App. No.
17/644,347
Granted
Dec 3, 2024
Kind
B2
Abstract

Techniques are described that facilitate remotely interfacing with a vehicle touchscreen. According to an embodiment, a method is provided comprising determining touch controls included in a GUI configured for displaying on a touchscreen of the vehicle, wherein the touch controls provide for controlling functions of the vehicle based on first interaction with the touch controls as displayed on the touchscreen. The method further comprises generating a representation of the GUI for display via an auxiliary display of the auxiliary device, the representation comprising one or more graphical controls corresponding to one or more touch controls of the touch controls, and enabling remote control of one or more functions of the functions of the vehicle by the auxiliary device based on second interaction with the one or more graphical controls as displayed via the auxiliary display.

Claims (31)

1. A system, comprising:

a processor; and

a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:

a remote-control component that enables remote control of one or more functions of a vehicle by auxiliary devices based on user interaction with one or more touch controls of respective graphical user interfaces rendered at the auxiliary devices, wherein the one or more touch controls respectively correspond to the one or more functions; and

a conflict resolution component that:

in response to detecting, within a threshold amount of time, a first reception of a first control command associated with a first user interaction with a first touch control of a first graphical user interface of a first auxiliary device, and a second reception of a second control command associated with a second user interaction with a second touch control of a second graphical user interface of a second auxiliary device, wherein the first touch control and the second touch control are associated with a function of the one or more functions of the vehicle, performs a conflict resolution process to determine whether to execute the first control command or the second control to remotely control the function of the vehicle, wherein the conflict resolution process determines whether to execute the first control command or the second control based on a defined hierarchy of the auxiliary devices, and wherein the defined hierarchy is specified by a driver of the vehicle.

2. The system of claim 1 , wherein the defined hierarchy of the auxiliary devices is specified for the function.

3. The system of claim 1 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a conflict resolution protocol defined by the driver of the vehicle.

4. The system of claim 1 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a context of the vehicle.

5. The system of claim 1 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a first in time protocol.

6. The system of claim 1 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a machine learning process trained to determine preferences for resolving conflicts.

7. The system of claim 1 , wherein the conflict resolution component, after execution of the first control command or the second control command, implements a wait period that prevents accepting additional control commands associated with user interactions for the function during the wait period.

8. A method, comprising:

establishing, by a system comprising a processor, a connection between auxiliary devices and a vehicle;

enabling, by the system, remote control of one or more functions of the vehicle by the auxiliary devices based on user interaction with one or more touch controls of respective graphical user interfaces rendered at the auxiliary devices, wherein the one or more touch controls respectively correspond to the one or more functions; and

in response to detecting, within a threshold amount of time, a first reception of a first control command associated with a first user interaction with a first touch control of a first graphical user interface of a first auxiliary device, and a second reception of a second control command associated with a second user interaction with a second touch control of a second graphical user interface of a second auxiliary device, wherein the first touch control and the second touch control are associated with a function of the one or more functions of the vehicle, performs a conflict resolution process to determine whether to execute the first control command or the second control to remotely control the function of the vehicle, wherein the conflict resolution process determines whether to execute the first control command or the second control based on a defined hierarchy of the auxiliary devices, and wherein the defined hierarchy is specified by a driver of the vehicle.

9. The method of claim 8 , wherein the defined hierarchy of the auxiliary devices is specified for the function.

10. The method of claim 9 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a conflict resolution protocol defined by a driver of the vehicle.

11. The method of claim 9 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a context of the vehicle.

12. The method of claim 9 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a first in time protocol.

13. The method of claim 9 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a machine learning process trained to determine preferences for resolving conflicts.

14. The method of claim 9 , further comprising implementing, by the system, after execution of the first control command or the second control command, a wait period that prevents accepting additional control commands associated with user interactions for the function during the wait period.

15. A non-transitory computer-readable medium having instructions stored thereon that, in response to execution, cause a system including a processor to perform operations comprising:

establish a connection between auxiliary devices and a vehicle;

enable remote control of one or more functions of the vehicle by the auxiliary devices based on user interaction with one or more touch controls of respective graphical user interfaces rendered at the auxiliary devices, wherein the one or more touch controls respectively correspond to the one or more functions; and

in response to detecting, within a threshold amount of time, a first reception of a first control command associated with a first user interaction with a first touch control of a first graphical user interface of a first auxiliary device, and a second reception of a second control command associated with a second user interaction with a second touch control of a second graphical user interface of a second auxiliary device, wherein the first touch control and the second touch control are associated with a function of the one or more functions of the vehicle, performs a conflict resolution process to determine whether to execute the first control command or the second control to remotely control the function of the vehicle, wherein the conflict resolution process determines whether to execute the first control command or the second control based on a defined hierarchy of the auxiliary devices, and wherein the defined hierarchy is specified by a driver of the vehicle.

16. The non-transitory computer-readable medium of claim 15 , wherein the defined hierarchy of the auxiliary devices is specified for the function.

17. The non-transitory computer-readable medium of claim 16 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a conflict resolution protocol defined by a driver of the vehicle.

18. The non-transitory computer-readable medium of claim 16 , wherein the conflict resolution process determines whether to execute the first control command or the second control based on a context of the vehicle.

19. The non-transitory computer-readable medium of claim 16 , wherein the conflict resolution process determines whether to execute the first control command or the second control further based on a machine learning process trained to determine preferences for resolving conflicts.

20. The non-transitory computer-readable medium of claim 16 , wherein the operations further comprise implementing, after execution of the first control command or the second control command, a wait period that prevents accepting additional control commands associated with user interactions for the function during the wait period.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2021
From: STRANDBERG, MATS
To: VOLVO CAR CORPORATION
Reel/Frame 058392/0144 →
Continuity (3)
Continuation 17003199 · Aug 26, 2020
Continuation 16272797 · Feb 11, 2019
Related Publication 20220113852A1 · Apr 14, 2022
Cited By (7)
US 1,067,931 US 1,070,909 US 1,073,723 US 1,074,706 US 1,078,790 US 1,083,981 US 1,113,973