IP Library › Granted Patent US 11,113,435
Granted Patent B2
US 11,113,435 · App. 16/672,695 · Granted Sep 7, 2021

Evaluation of a simulated vehicle functionality feature

Inventors: Casper Wickman (Öckerö, SE); Mattias Wikenmalm (Torslanda, SE); Timotei Ghiurau (Gothenburg, SE); Jon Seneger (Boulder Creek, CA)
Assignee: Volvo Car Corporation
G06F30/20G02B27/0093G06F3/14B60K37/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,113,435
App. No.
16/672,695
Granted
Sep 7, 2021
Kind
B2
Abstract

A method performed by a vehicle feature evaluation system ( 1 ) for enabling evaluation of a simulated vehicle functionality feature. The vehicle feature evaluation system determines ( 1001 ) in relation to a road-driven vehicle ( 2 ), with support from a tracking system ( 5 ), an orientation of a head-mounted display ( 4 ), HMD, adapted to be worn by an occupant ( 3 ) on-board the road-driven vehicle. The vehicle feature evaluation system further determines ( 1002 ) a simulated vehicle functionality feature to be evaluated in the road-driven vehicle. Moreover, the vehicle feature evaluation system provides ( 1004 ) in real-time to a HMD display ( 42 ) of the HMD, taking into consideration the HMD orientation, a virtual representation ( 7 ) of the simulated vehicle functionality feature superimposed on a real-time real-world video stream ( 6 ) derived from real-world image data captured with support from one or more forward-facing cameras ( 41 ) provided on the HMD in eye-position of the occupant.

Claims (43)

1. A method performed by a vehicle feature evaluation system for enabling evaluation of a simulated vehicle functionality feature, the method comprising:

determining in relation to a road-driven vehicle, with support from a tracking system, an orientation of a head-mounted display, HMD, adapted to be worn by an occupant on-board the road-driven vehicle;

determining a simulated vehicle functionality feature to be evaluated in the road-driven vehicle;

providing in real-time to a HMD display of the HMD, taking into consideration the HMD orientation, a virtual representation of the simulated vehicle functionality feature superimposed on a real-time real-world video stream derived from real-world image data captured with support from one or more forward-facing cameras provided on the HMD in eye-position of the occupant; and

updating the virtual representation based on a vehicle signal affecting the simulated vehicle functionality feature, derived from the road-driven vehicle, wherein the simulated vehicle functionality feature comprises a simulated effect resulting from a simulation of the simulated vehicle functionality feature.

2. The method according to claim 1 , wherein the simulated vehicle functionality feature comprises:

a simulated vehicle human machine interface, HMI;

a simulated vehicle display;

a simulated vehicle head-up display, HUD;

a simulated interior vehicle section; and/or

simulated light characteristics.

3. The method according to claim 1 , further comprising:

determining a fictive location of the simulated vehicle functionality feature relative the road-driven vehicle;

wherein the providing taking into consideration the HMD orientation comprises providing the virtual representation superimposed on the real-time real-world video stream such that positioning of the virtual representation corresponds to the fictive location.

4. The method according to claim 1 , further comprising:

updating the virtual representation based on a user interaction with the simulated vehicle functionality feature.

5. The method according to claim 4 , wherein the user interaction is based on detection, by means of one or more user interaction sensors, of a user in and/or at a fictive location.

6. The method according to claim 1 , further comprising:

updating the real-time video stream and/or the superimposed virtual representation based on updated captured image data and/or based on updated determined HMD orientation.

7. A vehicle feature evaluation system for enabling evaluation of a simulated vehicle functionality feature, the vehicle feature evaluation system comprising:

a memory storing instructions executed by a processor for providing:

a HMD orientation determining unit for determining in relation to a road-driven vehicle, with support from a tracking system, an orientation of a head-mounted display, HMD, adapted to be worn by an occupant on-board the road-driven vehicle;

a feature determining unit for determining a simulated vehicle functionality feature to be evaluated in the road-driven vehicle;

a HMD providing unit for providing in real-time to a HMD display of the HMD, taking into consideration the HMD orientation, a virtual representation of the simulated vehicle functionality feature superimposed on a real-time real-world video stream derived from real-world image data captured with support from one or more forward-facing cameras provided on the HMD in eye-position of the occupant;

a vehicle signal updating unit for updating the virtual representation based on a vehicle signal affecting the simulated vehicle functionality feature, derived from the road-driven vehicle, wherein the simulated vehicle functionality feature comprises a simulated effect resulting from a simulation of the simulated vehicle functionality feature.

8. The vehicle feature evaluation system according to claim 7 , wherein the simulated vehicle functionality feature comprises:

a simulated vehicle human machine interface, HMI;

a simulated vehicle display;

a simulated vehicle head-up display, HUD;

a simulated interior vehicle section; and/or

simulated light characteristics.

9. The vehicle feature evaluation system according to claim 7 , further comprising:

the memory storing instructions executed by the processor for providing:

a location determining unit for determining a fictive location of the simulated vehicle functionality feature relative the road-driven vehicle;

wherein the HMD providing unit further is adapted for providing the virtual representation superimposed on the real-time real-world video stream such that positioning of the virtual representation corresponds to the fictive location.

10. The vehicle feature evaluation system according to claim 7 , further comprising:

the memory storing instructions executed by the processor for providing:

a user interaction updating unit for updating the virtual representation based on a user interaction with the simulated vehicle functionality feature.

11. The vehicle feature evaluation system according to claim 10 , wherein the user interaction is based on detection, by means of one or more user interaction sensors, of a user in and/or at the fictive location.

12. The vehicle feature evaluation system according to claim 7 , further comprising:

the memory storing instructions executed by the processor for providing:

a continuous updating unit for updating the real-time video stream and/or the superimposed virtual representation based on updated captured image data and/or based on updated determined HMD orientation.

13. A vehicle comprising a vehicle feature evaluation system according to claim 7 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2019
From: WICKMAN, CASPER; WIKENMALM, MATTIAS; GHIURAU, TIMOTEI; SENEGER, JON
To: VOLVO CAR CORPORATION
Reel/Frame 050902/0593 →
Priority Claims (1)
EP 18210997 · Dec 7, 2018 · regional
Continuity (1)
Related Publication 20200184030A1 · Jun 11, 2020
Cited By (1)
US 12,296,678