IP Library Granted Patent US 9,599,819
Granted Patent B2
US 9,599,819 · App. 14/291,854 · Granted Mar 21, 2017

System and method for dynamic in-vehicle virtual reality

Inventors: Arthur Alaniz (Mountain View, CA); Joseph Whinnery (Scotts Valley, CA); Robert Wesley Murrish (Santa Clara, CA); Michael Eamonn Gleeson-May (San Francisco, CA)
Assignee: Honda Motor Co., Ltd.
G02B27/017G06F3/011G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,599,819
App. No.
14/291,854
Granted
Mar 21, 2017
Kind
B2
Abstract

A method for in-vehicle dynamic virtual reality includes receiving vehicle data from one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data and receiving user data from a virtual reality device. The method includes generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data and rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to the vehicle dynamics data.

Claims (27)

1. A computer-implemented method for in-vehicle dynamic virtual reality, comprising:

receiving vehicle data from one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data of the vehicle and an orientation and a location of the vehicle;

receiving user data from a portable device, the user data including at least an orientation and a location of a user and determining an orientation and a location of the user relative to the vehicle based on the vehicle data and the user data;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to the orientation and the location of the vehicle and the orientation and the location of the user relative to the vehicle;

determining a temporal-motion rendering speed based on the vehicle data and the user data, wherein the temporal-motion rendering speed is a correlation of differences between a motion, an orientation, and a location of the user relative to a motion, an orientation, and a location of the vehicle, wherein the motion, the orientation and the location of the user are determined based on the user data and the motion, the orientation, and the location of the vehicle is based on the vehicle data, thereby simulating real-time motion of the vehicle in the virtual view; and

rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to the temporal-motion rendering speed.

2. The computer-implemented method of claim 1 , including determining vehicle motion data based on the vehicle dynamics data.

3. The computer-implemented method of claim 2 , including determining user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

4. The computer-implemented method of claim 3 , wherein augmenting one or more components of the virtual world model is based on at least one of the user motion data and the vehicle motion data.

5. The computer-implemented method of claim 3 , wherein determining the temporal-motion rendering speed is based on the vehicle motion data and the user motion data.

6. The computer-implemented method of claim 1 , wherein the output device is the portable device.

7. The computer-implemented method of claim 1 , wherein the virtual world model includes a group of node classes, the group of node classes including a view node class, a world structure node class, an eventsln node class, and an eventsOut node class, wherein generating the virtual view includes augmenting one or more properties of at least one node in the group of node classes according to the vehicle dynamics data, the orientation and the location of the vehicle, and the orientation and the location of the user relative to the vehicle.

8. The computer-implemented method of claim 1 , wherein the user data includes health data of the user and further including modifying the temporal-motion rendering speed based on the health data.

9. A computing system for in-vehicle dynamic virtual reality, comprising:

a processor operatively connected for computer communication to one or more vehicle systems of a vehicle and a portable device, the processor including:

a virtual reality data module receives vehicle data from the one or more vehicle systems of the vehicle, wherein the vehicle data includes vehicle dynamics data of the vehicle, and receives user data from the portable device, the user data including at least orientation and location information about a user in possession of the portable device;

a dynamic virtual reality module generates the virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

a rendering module determines user motion data representing motion of the user relative to a framework of the vehicle and relative to a speed of the vehicle, determines vehicle motion data based on the vehicle dynamics data, and determines a temporal-motion rendering speed based on the user motion data and the vehicle motion data, wherein the temporal-motion rendering speed is a correlation of differences between a motion, an orientation, and a location of the user relative to a motion, an orientation, and a location of the vehicle, wherein the motion, the orientation and the location of the user are determined based on the user data and the motion, the orientation, and the location of the vehicle is based on the vehicle data, wherein the rendering module, renders the virtual view from the dynamic reality module to an output device by controlling the output device to update display of the virtual view according to the temporal-motion rendering speed thereby minimizing a difference between the vehicle motion data and the user motion data.

10. The system of claim 9 , wherein the dynamic virtual reality module augments one or more properties of one or more of the components of the virtual world model based on the vehicle data and the user data.

11. The system of claim 10 , wherein the one or more properties includes a motion property defining a motion of the component.

12. The system of claim 9 , wherein the dynamic virtual reality module augments one or more properties of one or more of the components of the virtual world model based on the temporal-motion rendering speed.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a vehicle computer, causes the computer to perform the steps comprising of:

receiving vehicle data from one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data of the vehicle and an orientation and a location of the vehicle;

receiving user data from a portable device, the user data including at least orientation and location information of a user and determining an orientation and a location of the user relative to the vehicle based on the vehicle data and the user data;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to the orientation and the location of the vehicle and the orientation and the location of the user relative to the vehicle;

determining a temporal-motion rendering speed based on the vehicle dynamics data and the user data, wherein the temporal-motion rendering speed is a correlation of differences between a motion, an orientation, and a location of the user relative to a motion, an orientation, and a location of the vehicle, wherein the motion, the orientation and the location of the user are determined based on the user data and the motion, the orientation, and the location of the vehicle is based on the vehicle data; and

rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to the vehicle dynamics data and controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2014
From: ALANIZ, ARTHUR; WHINNERY, JOSEPH; MURRISH, ROBERT WESLEY; GLEESON-MAY, MICHAEL EAMONN
To: HONDA MOTOR CO., LTD.
Reel/Frame 033145/0096 →
Continuity (3)
Continuation 14177841 · Feb 11, 2014
Provisional Application 61886240 · Oct 3, 2013
Related Publication 20150097861A1 · Apr 9, 2015