IP Library Granted Patent US 10,460,428
Granted Patent B2
US 10,460,428 · App. 16/126,901 · Granted Oct 29, 2019

Method, head-up display and output system for the perspective transformation and outputting of image content, and vehicle

Inventors: Tobias Bayerl (Olching, DE); Sean Brown (Munich, DE); Christoph Ciesla (Munich, DE)
Assignee: Bayerische Motoren Werke Aktiengesellschaft
G06T5/006B60K35/00G02B27/0101G06T3/00G06T3/005G06T3/0025G06T3/4007G06T3/4038G06T3/608G09G5/006G09G5/363B60K2370/186B60K2370/334G02B2027/011G02B2027/014G02B2027/0123G06T1/20G06T5/002G06T5/50G06T2207/20021G06T2207/20221G09G5/377G09G2360/122G09G2360/18G09G2380/10H04N7/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,460,428
App. No.
16/126,901
Granted
Oct 29, 2019
Kind
B2
Abstract

A method, a head-up display and a display system for the perspective transformation and displaying of rendered image content, as well as a corresponding vehicle, are provided. In the perspective transformation and outputting method, the image content to be displayed is subdivided into a plurality of tiles, and the individual tiles are each transformed in perspective using perspective transformation. The individual tiles that have been transformed in perspective are then combined to form a transformed image content, and the image content transformed in perspective is projected onto a projection area of the head-up display or displayed on a display unit.

Claims (68)

1. A method for perspective transformation and display of a rendered image content by a head-up display, comprising the acts of:

dividing the rendered image content into a plurality of tiles;

transforming individual ones of the plurality of tiles by perspective transformation;

storing the perspectively transformed tiles in a buffer memory;

combining the perspectively transformed tiles into a transformed image content; and

projecting the perspectively transformed image content onto a projection surface assigned to the head-up display,

wherein

only a portion of the individual ones of the plurality of tiles is perspectively transformed,

the portion of the individual ones of the plurality of tiles is perspectively transformed includes individual ones of the plurality of tiles which are changed relative to tiles of a perspectively transformed image previously stored in the buffer memory, and

during the act of combining the individual perspectively transformed tiles, the remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image previously stored in the buffer memory are retrieved from the buffer memory and combined with the portion the individual ones of the plurality of tiles perspectively transformed to form the perspectively transformed image content.

2. The method as claimed in claim 1 , wherein

the perspectively transformed image content is displayed on a display unit.

3. The method as claimed in claim 2 , wherein

the individual ones of the plurality of tiles are transformed such that the perspectively transformed image content is represented by the display unit in an uncompressed manner in at least one first region and in a compressed manner in at least one second region.

4. The method as claimed in claim 1 , wherein

during the transforming act, each of the individual ones of the plurality of tiles is perspectively transformed with regard to one or more of trapezoid shape, curvature, stretching, compression, rotation, and offset.

5. The method as claimed in claim 4 , wherein

adjoining tiles of the plurality of tiles have overlapping image contents.

6. The method as claimed in claim 1 , wherein

the image content is in the form of raster graphics, and

individual pixels of the individual ones of the plurality of tiles are displaced by the perspective transformation.

7. The method as claimed in claim 6 , wherein

during the perspective transforming act, interpolation is performed between at least a portion of adjoining ones of the individual pixels of the individual ones of the plurality of tiles.

8. The method as claimed in claim 6 , wherein

during the perspective transforming act, the individual ones of the plurality of tiles are perspectively transformed by multiplication by a transformation matrix.

9. The method as claimed in claim 8 , wherein

the transformation matrix is chosen from a multiplicity of transformation matrices.

10. The method as claimed claim 1 , wherein

during the perspective transforming act, the perspective transformation of the individual ones of the plurality of tiles is carried out by a graphics module via a graphics programming interface.

11. The method as claimed in claim 1 , wherein

the portion of the individual ones of the plurality of tiles perspectively transformed include the individual ones of the plurality of tiles having elements of the image content changed with respect to image content previously stored in the buffer.

12. The method as claimed in claim 1 , wherein

different portions of the plurality of tiles have different color depths.

13. The method as claimed in claim 1 , wherein

during the perspective transformation act, the plurality of tiles are mirrored by a point or line mirroring, and

during the combining act are combined to form a perspectively transformed, mirrored image content.

14. A head-up display for the perspective transformation and display of a rendered image content, comprising:

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles and to store the perspectively transformed tiles in a buffer memory,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

a projection unit configured to project the perspectively transformed image content onto a projection surface assigned to the head-up display,

wherein

the second module is configured to perspectively transform only a portion of the individual ones of the plurality of tiles,

the portion of the individual ones of the plurality of tiles includes individual ones of the plurality of tiles which are changed relative to tiles of a perspectively transformed image previously stored in the buffer memory, and

the third module is configured to, during the combining of the individual perspectively transformed tiles, retrieve from the buffer memory previously stored remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image, and combine previously stored remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image with the individual ones of the plurality of tiles perspectively transformed to form the perspectively transformed image content.

15. A vehicle, comprising:

a vehicle front window; and

a head-up display including

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles and to store the perspectively transformed tiles in a buffer memory,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

a projection unit configured to project the perspectively transformed image content onto the vehicle front window,

wherein

the second module is configured to perspectively transform only a portion of the individual ones of the plurality of tiles, and

the portion of the individual ones of the plurality of tiles includes individual ones of the plurality of tiles which are changed relative to tiles of a perspectively transformed image previously stored in the buffer memory, and

the third module is configured to, during the combining of the individual perspectively transformed tiles, retrieve from the buffer memory previously stored remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image, and combine previously stored remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image with the individual ones of the plurality of tiles perspectively transformed to form the perspectively transformed image content.

16. A vehicle, comprising:

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles and to store the perspectively transformed tiles in a buffer memory,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

an output unit configured to output the perspectively transformed image content on a display unit in the vehicle,

wherein

the second module is configured to perspectively transform only a portion of the individual ones of the plurality of tiles, and

the portion of the individual ones of the plurality of tiles includes individual ones of the plurality of tiles which are changed relative to tiles of a perspectively transformed image previously stored in the buffer memory, and

the third module is configured to, during the combining of the individual perspectively transformed tiles, retrieve from the buffer memory previously stored remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image, and combine previously stored remaining individual ones of the plurality of tiles which were not changed relative to the perspectively transformed image with the individual ones of the plurality of tiles perspectively transformed to form the perspectively transformed image content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2018
From: BAYERL, TOBIAS; BROWN, SEAN; CIESLA, CHRISTOPH
To: BAYERISCHE MOTOREN WERKE AKTIENGESELLSCHAFT
Reel/Frame 047381/0649 →
Priority Claims (1)
DE 10 2016 204 044 · Mar 11, 2016 · national
Continuity (2)
Continuation PCTEP2017052381 · Feb 3, 2017
Related Publication 20190005608A1 · Jan 3, 2019