IP Library Granted Patent US 12,097,843
Granted Patent B2
US 12,097,843 · App. 17/535,544 · Granted Sep 24, 2024

Remote park assist augmented reality user engagement with cameraless detection

Inventors: Hamid M. Golgiri (Livonia, MI); Vivekanandh Elangovan (Canton, MI); Tom Nelson (Plymouth, MI); Erick Michael Lovoie (Van Buren Charter Township, MI); Ryan Joseph Gorski (Grosse Pointe Farms, MI)
Assignee: Ford Global Technologies, LLC
B60W30/06B60W50/10B60W50/14G01S19/39G05D1/0016G05D1/0038B60W2050/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,097,843
App. No.
17/535,544
Granted
Sep 24, 2024
Kind
B2
Abstract

A system for a vehicle includes a vehicle processor disposed to control a drive system, and a memory for storing executable instructions. The vehicle processor is programmed to execute the instructions to determine, via the vehicle processor, a localization of a mobile device using a tethered wireless connection between the mobile device and the vehicle, receive, via the processor, an absolute heading of the mobile device, determine, via the vehicle processor, based on the localization of the mobile device, a relative bearing angle from the mobile device to the vehicle. The system may use the tethered wireless connection and the relative bearing angle from the mobile device to the vehicle to determine that a user is actuating a Human Machine Interface (HMI) element indicative of user attention to a remote parking maneuver and complete the remote parking maneuver.

Claims (61)

1. A method for controlling a vehicle, comprising:

determining, via a vehicle processor, a localization of a mobile device using a tethered wireless connection between the mobile device and the vehicle;

determining, via the vehicle processor, an absolute heading of the vehicle;

receiving, from the mobile device, an absolute heading of the mobile device;

determining, via the vehicle processor, based on the localization of the mobile device, the absolute heading of the mobile device, and the absolute heading of the vehicle, a relative bearing angle from the mobile device to the vehicle; and

completing a remote parking maneuver based on the relative bearing angle from the mobile device to the vehicle.

2. The method according to claim 1 , further comprising:

determining that a user is actuating a Human Machine Interface (HMI) element indicative of user attention to the remote parking maneuver; and

determining, via the vehicle processor, that the vehicle is localized at a viewable position proximate to the user.

3. The method according to claim 2 , further comprising:

generating, via the vehicle processor, an HMI output control command executable to cause the mobile device to display a user message indicating a camera positioning instruction; and

transmitting the HMI output control command to the mobile device.

4. The method according to claim 3 , wherein the camera positioning instruction comprises a relative bearing arrow indicating a target mobile device position associated with a viewing plane within a range of viewing planes.

5. The method according to claim 3 , wherein the user message comprises:

a first color indicating an acceptable viewing plane within the range of viewing planes, and

a second color indicating an unacceptable viewing plane that is not within the range of viewing planes.

6. The method according to claim 3 , further comprising:

determining, via the vehicle processor, that the vehicle is within view of the mobile device; and

completing the remote parking maneuver responsive to determining that the vehicle is within view of the mobile device.

7. The method according to claim 3 , wherein the user message comprises:

a written message indicating a user orientation instruction.

8. A system for a vehicle, comprising:

a vehicle processor; and

a memory for storing executable instructions, the vehicle processor programmed to execute the instructions to:

determine, via the vehicle processor, a localization of a mobile device using a tethered wireless connection between the mobile device and the vehicle;

determine an absolute heading of the vehicle;

receive, from the mobile device, an absolute heading of the mobile device;

determine, via the vehicle processor, based on the localization of the mobile device, the absolute heading of the mobile device, and the absolute heading of the vehicle, a relative bearing angle from the mobile device to the vehicle; and

complete a remote parking maneuver based on the relative bearing angle from the mobile device to the vehicle.

9. The system according to claim 8 , wherein the vehicle processor is further programmed to:

determine that a user is actuating a Human Machine Interface (HMI) element indicative of user attention to the remote parking maneuver; and

determine that the vehicle is localized at a viewable position proximate to the user.

10. The system according to claim 9 , wherein the vehicle processor is further programmed to execute the instructions to:

generate an HMI output control command executable to cause the mobile device to display a user message indicating a camera positioning instruction; and

transmit the HMI output control command to the mobile device.

11. The system according to claim 10 , wherein the camera positioning instruction comprises a relative bearing arrow indicating a target mobile device position associated with a viewing plane within a range of viewing planes.

12. The system according to claim 11 , wherein the user message comprises:

a first color indicating an acceptable viewing plane within the range of viewing planes, and

a second color indicating an unacceptable viewing plane that is not within the range of viewing planes.

13. The system according to claim 11 , wherein the vehicle processor is further programmed to execute the instructions to:

determine that the vehicle is within view of the mobile device; and

complete the remote parking maneuver responsive to determining that the vehicle is within view of the mobile device.

14. The system according to claim 11 , wherein the user message comprises: a written message indicating a user orientation instruction.

15. A non-transitory computer-readable storage medium in a vehicle controller, the non-transitory computer-readable storage medium having instructions stored thereupon which, when executed by a processor, cause the vehicle controller to:

determine a localization of a mobile device using a tethered wireless connection between the mobile device and a vehicle;

determine an absolute heading of the vehicle;

receive, from the mobile device, an absolute heading of the mobile device;

determine, based on the localization of the mobile device, the absolute heading of the mobile device, and the absolute heading of the vehicle, a relative bearing angle from the mobile device to the vehicle; and

complete a remote parking maneuver based on the relative bearing angle from the mobile device to the vehicle.

16. The non-transitory computer-readable storage medium according to claim 15 , having further instructions stored thereupon to cause the vehicle controller to:

determine that a user is actuating a Human Machine Interface (HMI) element indicative of user attention to the remote parking maneuver; and

determine that the vehicle is localized at a viewable position proximate to the user.

17. The non-transitory computer-readable storage medium according to claim 15 , having further instructions stored thereupon to cause the vehicle controller to:

generate an HMI output control command executable to cause the mobile device to display a user message indicating a camera positioning instruction; and

transmit the HMI output control command to the mobile device.

18. The non-transitory computer-readable storage medium according to claim 17 , wherein the camera positioning instruction comprises aa relative bearing arrow indicating a target mobile device position associated with a viewing plane within a range of viewing planes.

19. The non-transitory computer-readable storage medium according to claim 17 , having further instructions stored thereupon to:

determine that the vehicle is within view of the mobile device; and

complete the remote parking maneuver responsive to determining that the vehicle is within view of the mobile device.

20. The non-transitory computer-readable storage medium according to claim 17 , wherein the user message comprises:

a written message indicating a user orientation instruction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2022
From: GOLGIRI, HAMID M; ELANGOVAN, VIVEKANANDH; NELSON, TOM; LAVOIE, ERICK MICHAEL; GORSKI, RYAN JOSEPH
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 058741/0270 →
Continuity (1)
Related Publication 20230159019A1 · May 25, 2023
Cited By (1)
US 12,656,121