IP Library Granted Patent US 9,741,090
Granted Patent B2
US 9,741,090 · App. 14/427,651 · Granted Aug 22, 2017

Graphics display processing device, graphics display processing method, and vehicle equipped with graphics display processing device

Inventors: Tetsuji Yamamoto (Osaka, JP); Masahiko Saito (Osaka, JP); Takuya Kondoh (Kanagawa, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
G06T1/60G06F9/48G06T1/20G09G5/003G09G5/18G09G5/39G09G2360/08G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,741,090
App. No.
14/427,651
Granted
Aug 22, 2017
Kind
B2
Abstract

A graphics display processing device including: a graphics processor that executes GPU instructions based on a primary drawing instruction and a secondary drawing instruction; an acquirer) that acquires the primary drawing instruction and the secondary drawing instruction; an estimator that calculates an estimated GPU processing time required for executing the GPU instructions; a determiner that determines, using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first; an issuance controller that performs a control when the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed; an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and a graphics driver that generates the GPU instructions by executing each drawing instruction issued.

Claims (107)

1. A graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued by the instruction issuer, wherein

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display, and

the determiner

stores a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculates a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

compares the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.

2. A graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the primary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued by the instruction issuer, wherein and

the determiner

stores a start time of the graphics instructions generated based on the primary drawing instruction,

calculates an elapsed time from the start time to a current time,

calculates a remaining graphics processing time by subtracting the elapsed time from the estimated graphics processing time, and

compares the remaining graphics processing time and a priority threshold value assigned to the primary drawing instruction, and when the remaining graphics processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

3. The graphics display processing device of claim 1 , wherein

before graphics instructions based on the primary drawing instruction are executed and within the single frame display unit time in which the graphics instructions are to be executed, execution is completed of the graphics instructions generated based on the tertiary drawing instruction specifying the tertiary graphic requiring immediate display,

the estimator further calculates the estimated graphics processing time for execution of the graphics instructions based on the primary drawing instruction, and

the determiner

compares the total graphics processing time and a priority threshold value assigned to the primary drawing instruction, and when the estimated graphics processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

4. The graphics display processing device of claim 1 , wherein

the estimator further calculates an estimated central processing time for processing by the instruction executor due to execution of the primary drawing instruction and the secondary drawing instruction, and

the determiner uses the estimated central processing time and the estimated graphics processing time when determining which of the primary drawing instruction and the secondary drawing instruction is to be executed first.

5. The graphics display processing device of claim 4 , wherein

before the secondary drawing instruction and the graphics instructions based on the secondary drawing instruction are executed and within the single frame display unit time in which the secondary drawing instruction and the graphics instructions are to be executed, execution is completed of the tertiary drawing instruction and graphics instructions generated based on the tertiary drawing instruction,

the estimator further calculates an estimated CPU central processing time for processing by the instruction executor due to execution of the secondary drawing instruction, and

the determiner

stores a cumulative combined processing time required for execution of the tertiary drawing instruction by the instruction executor and execution of the graphics instructions based on the tertiary drawing instruction by the graphics processor,

calculates a total combined processing time by summing the cumulative combined processing time, the estimated central processing time, and the estimated graphics processing time, and

compares the total combined processing time and the limit value of the acceptable processing time for processing due to drawing instructions and the drawing processing due to the graphics instructions of the graphic not requiring immediate display, and when the total combined processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the single frame display unit time.

6. The graphics display processing device of claim 4 , wherein

the estimator further calculates the estimated graphics processing time due to execution of the graphics instructions based on the primary drawing instruction and further calculates an estimated central processing time for processing by the instruction executor due to execution of the primary drawing instruction, and

the determiner

stores a start time of the primary drawing instruction,

calculates an elapsed time from the start time to a current time,

calculates a sum value that is a sum of the estimated graphics processing time and the estimated central processing time,

calculates a remaining combined processing time by subtracting the elapsed time from the sum time, and

compares the remaining combined processing time and a priority threshold value assigned to the primary drawing instruction and the graphics instructions based on the primary drawing instruction, and when the remaining combined processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

7. The graphics display processing device of claim 4 , wherein

before the primary drawing instruction and the graphics instructions based on the primary drawing instruction are executed and within the single frame display unit time in which the primary drawing instruction and the graphics instructions are to be executed, execution is completed of the tertiary drawing instruction and graphics instructions generated based on the tertiary drawing instruction specifying the tertiary graphic requiring immediate display,

the estimator calculates the estimated graphics processing time due to execution of the graphics instructions based on the primary drawing instruction and further calculates an estimated central processing time for processing by the instruction executor due to execution of the primary drawing instruction, and

the determiner

stores a cumulative combined processing time required for execution of the tertiary drawing instruction by the instruction executor and execution of the graphics instructions based on the tertiary drawing instruction by the graphics processor,

calculates a total combined processing time by summing the cumulative combined processing time, the estimated central processing time, and the estimated graphics processing time, and

compares the total combined processing time and a priority threshold value assigned to the primary drawing instruction and the graphics instructions based on the primary drawing instruction, and when the total combined processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

8. The graphics display processing device of claim 1 , further comprises:

a prioritizer that sets a priority of the primary drawing instruction higher than a priority of the second drawing instruction when the determiner determines that the primary drawing instruction is to be executed first; and

a task scheduler that controls acquisition by the acquirer according to the priority set by the prioritizer.

9. The graphics display processing device of claim 1 installed in a vehicle, wherein

the primary graphic is one of a graphic indicating speed at which the vehicle is travelling, a graphic indicating revolutions of an engine or motor included in the vehicle, a graphic indicating an alert pertaining to a mechanism, equipment, or machinery included in the vehicle, and a graphic indicating an alert pertaining to traffic conditions around the vehicle while the vehicle is in motion, and

the secondary graphic is a map graphic for guiding a driver of the vehicle.

10. A graphics display processing method used in a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device including:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic; and a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction, wherein

the graphics display processing method comprises:

acquiring the primary drawing instruction and the secondary drawing instruction from the program storage;

calculating an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

determining, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

performing a control when determining that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

issuing each drawing instruction according to the control; and

generating the graphics instructions by executing each drawing instruction issued, and

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the graphics display processing method comprises

storing a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculating a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

comparing the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determining that the primary drawing instruction is to be executed first within the frame display unit time.

11. An integrated circuit comprising a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the integrated circuit comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued, wherein

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the determiner

stores a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculates a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

compares the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.

12. A vehicle equipped with a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, wherein

the graphics display processing device comprises:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued, and

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the determiner

stores a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculates a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

compares the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 047914/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2015
From: YAMAMOTO, TETSUJI; SAITO, MASAHIKO; KONDOH, TAKUYA
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 035715/0494 →
Priority Claims (1)
JP 2013-116803 · Jun 3, 2013 · national
Continuity (1)
Related Publication 20150248742A1 · Sep 3, 2015