IP Library › Granted Patent US 12,296,678
Granted Patent B2
US 12,296,678 · App. 18/607,659 · Granted May 13, 2025

Evaluation of a simulated vehicle-related feature

Inventors: Casper Wickman (Öckerö, SE); Mattias Wikenmalm (Torslanda, SE); Timotei Ghiurau (Gothenburg, SE); Jon Seneger (Boulder Creek, CA)
Assignee: Volvo Car Corporation
B60K35/00G02B27/0093G02B27/0172G02B27/0179G06F3/013G06T19/006B60K35/10B60K35/23B60K2360/149B60K2360/31G02B2027/0181G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,296,678
App. No.
18/607,659
Granted
May 13, 2025
Kind
B2
Abstract

A method performed by a vehicle feature evaluation system for enabling evaluation of a simulated vehicle-related feature. The vehicle feature evaluation system determines in relation to a road-driven vehicle, with support from a tracking system, an orientation of a head-mounted display, HMD, adapted to be worn by an occupant on-board the road-driven vehicle or position and gaze direction of the occupant. The vehicle feature evaluation system further determines a simulated vehicle design feature to be evaluated in the road-driven vehicle. Moreover, the vehicle feature evaluation system provides in real-time to a HMD display of the HMD or another display, taking into consideration the HMD orientation or position and gaze direction, a virtual representation of the simulated vehicle design feature superimposed on a real-time surrounding-showing image derived from real-world perception sensor data captured with support from one or more vehicle-attached perception sensors adapted to capture surroundings internal or external to the road-driven vehicle.

Claims (46)

1. A method performed by an evaluation system for enabling evaluation of a simulated vehicle-related feature, the method comprising:

determining in relation to a real vehicle, with support from a tracking system, an orientation of a head mounted display, HMD, adapted to be worn by an occupant positioned in the real vehicle or a position and gaze direction of the occupant positioned in the real vehicle;

determining at least one of a simulated vehicle functionality feature or a simulated object feature to be evaluated in the real vehicle; and

providing to an HMD display of the HMD or another display visible to the occupant, taking into consideration the HMD orientation or the position and gaze direction, a virtual representation of at least one of the simulated vehicle functionality feature or the simulated object feature superimposed on a surrounding-showing image derived from perception sensor data captured with support from one or more vehicle-attached perception sensors adapted to capture surroundings internal or external to the real vehicle, wherein the virtual representation replaces an excluded portion of the surrounding-showing image.

2. The method according to claim 1 , further comprising:

determining a simulated vehicle characteristic to be evaluated in the real vehicle, and

wherein the virtual representation includes the simulated vehicle characteristic.

3. The method according to claim 1 , wherein the virtual representation and the replaced excluded portion of the surrounding-showing image are varied based on the HMD orientation or the position and gaze direction.

4. The method according to claim 1 , wherein the surrounding-showing image is a real-time surrounding-showing image, the perception sensor data is real-world perception sensor data, and the virtual representation superimposed on the real-time surrounding-showing image is provided in real-time.

5. The method according to claim 1 , wherein the virtual representation includes the simulated vehicle functionality feature.

6. The method according to claim 5 , wherein the simulated vehicle functionality feature comprises at least one of:

a simulated vehicle human machine interface, HMI;

a simulated vehicle display;

a simulated vehicle head-up display, HUD;

simulated light characteristics;

a simulated effect resulting from a simulation of the simulated vehicle functionality feature; or

a dynamic simulation.

7. The method according to claim 1 , wherein the virtual representation includes the simulated object feature.

8. The method according to claim 7 , wherein the simulated object feature comprises at least one of a simulated other vehicle, a simulated road user, or a simulated moving or fixed obstacle.

9. An evaluation system for enabling evaluation of a simulated vehicle-related feature, the evaluation system comprising:

an HMD orientation or position and gaze direction determining unit comprising memory storing instructions executed by a processor for determining in relation to a real vehicle, with support from a tracking system, an orientation of a head mounted display, HMD, adapted to be worn by an occupant positioned in the real vehicle or a position and gaze direction of the occupant positioned in the real vehicle;

at least one feature determining unit configured as at least one of:

a functionality feature determining unit comprising memory storing instructions executed by the processor for determining a simulated vehicle functionality feature to be evaluated in the real vehicle; or

an object feature determining unit comprising memory storing instructions executed by the processor for determining a simulated vehicle object feature to be evaluated in the real vehicle; and

an HMD or display providing unit comprising memory storing instructions executed by the processor for providing to a HMD display of the HMD or another display visible to the occupant, taking into consideration the HMD orientation or the position and gaze direction, a virtual representation of at least one of the simulated vehicle functionality feature or the simulated object feature superimposed on a surrounding-showing image derived from perception sensor data captured with support from one or more vehicle-attached perception sensors adapted to capture surroundings internal or external to the real vehicle, wherein the virtual representation replaces an excluded portion of the surrounding-showing image.

10. The vehicle feature evaluation system according to claim 9 , further comprising:

a design feature determining unit comprising memory storing instructions executed by the processor for determining a simulated vehicle characteristic to be evaluated in the real vehicle, and

wherein the virtual representation includes the simulated vehicle characteristic.

11. The vehicle feature evaluation system according to claim 9 , wherein the virtual representation and the replaced excluded portion of the surrounding-showing image are varied based on the HMD orientation or the position and gaze direction.

12. The vehicle feature evaluation system according to claim 9 , wherein the surrounding-showing image is a real-time surrounding-showing image, the perception sensor data is real-world perception sensor data, and the virtual representation superimposed on the real-time surrounding-showing image is provided in real-time.

13. The vehicle feature evaluation system according to claim 9 , wherein the virtual representation includes the simulated vehicle functionality feature.

14. The vehicle feature evaluation system according to claim 9 , wherein the virtual representation includes the simulated object feature.

15. A vehicle, comprising:

an evaluation system for enabling evaluation of a simulated vehicle-related feature, the evaluation system comprising:

an HMD orientation or position and gaze direction determining unit comprising memory storing instructions executed by a processor for determining in relation to a real vehicle, with support from a tracking system, an orientation of a head mounted display, HMD, adapted to be worn by an occupant positioned in the real vehicle or a position and gaze direction of the occupant positioned in the real vehicle;

at least one feature determining unit configured as at least one of:

a functionality feature determining unit comprising memory storing instructions executed by the processor for determining a simulated vehicle functionality feature to be evaluated in the real vehicle; or

an object feature determining unit comprising memory storing instructions executed by the processor for determining a simulated vehicle object feature to be evaluated in the real vehicle; and

an HMD or display providing unit comprising memory storing instructions executed by the processor for providing to a HMD display of the HMD or another display visible to the occupant, taking into consideration the HMD orientation or the position and gaze direction, a virtual representation of at least one of the simulated vehicle functionality feature or the simulated object feature superimposed on a surrounding-showing image derived from perception sensor data captured with support from one or more vehicle-attached perception sensors adapted to capture surroundings internal or external to the real vehicle, wherein the virtual representation replaces an excluded portion of the surrounding-showing image.

16. The vehicle according to claim 15 , wherein the evaluation system further comprises:

a design feature determining unit comprising memory storing instructions executed by the processor for determining a simulated vehicle characteristic to be evaluated in the real vehicle, and

wherein the virtual representation includes the simulated vehicle characteristic.

17. The vehicle according to claim 15 , wherein the virtual representation and the replaced excluded portion of the surrounding-showing image are varied based on the HMD orientation or the position and gaze direction.

18. The vehicle according to claim 15 , wherein the surrounding-showing image is a real-time surrounding-showing image, the perception sensor data is real-world perception sensor data, and the virtual representation superimposed on the real-time surrounding-showing image is provided in real-time.

19. The vehicle according to claim 15 , wherein the virtual representation includes the simulated vehicle functionality feature.

20. The vehicle according to claim 15 , wherein the virtual representation includes the simulated object feature.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2024
From: WICKMAN, CASPER; WIKENMALM, MATTIAS; GHIURAU, TIMOTEI; SENEGER, JON
To: VOLVO CAR CORPORATION
Reel/Frame 066802/0138 →
Priority Claims (1)
EP 18210988 · Dec 7, 2018 · regional
Continuity (3)
Continuation 17574726 · Jan 13, 2022
Continuation In Part 16672756 · Nov 4, 2019
Related Publication 20240217339A1 · Jul 4, 2024
References Cited (10)
US 11113435B2 · Wickman · 2021 [cited by examiner]
US 11257390B2 · Wickman · 2022 [cited by examiner]
US 11938819B2 · Wickman · 2024 [cited by examiner]
US 20190130878A1 · Bradley · 2019 [cited by examiner]
US 20190188912A1 · Kamini · 2019 [cited by examiner]
May 23, 2019 European Search Report issued on international Application No. 18210988. [cited by applicant]
Frund J. et al., “Cooperative design support within automobile advance development using augmented reality technology”, Computer Supported Cooperative Work In Design, 2004. [cited by applicant]
Hobson, “Mini's augmented-reality glasses can make cars transparent” Apr. 24, 2015, pp. 1-10. [cited by applicant]
Toshikazu Ohshima et al., “A Mixed Reality System with Visual and Tangible Interaction Capability—Application to Evaluating Automobile Interior Design”, The second IEEE and ACM international symposium on mixed and augme… [cited by applicant]
Purschke F et al., “Virtual reality-new Methods for Improving and Accelerating the Development Process in Vehicle Styling and Design”, Computer Graphics International, 1998. Jun. 22, 1998, pp. 789-797. [cited by applicant]