Intelligent management of application layer rendering
High frames-per-second (FPS) displays are becoming more ubiquitous in devices such as smartphones, laptops, etc. For displaying data on displays, render sync signal and compose sync signal control timings of rendering and composing. Conventionally, there is one render sync signal and one compose sync signal for a display, and both share the same frequency as the HW sync signal of the display hardware. As the FPS of the display becomes faster and faster, i.e., as HW sync signal frequency increases, some application layers may be unable to render fast enough to keep up with the increased frequency. To address this issue, it is proposed to provide multiple render sync signals of differing frequencies and phases, and different render sync signals may be used to control the timings of rendering of different application layers. Through such managing of the application layer rendering, a better user experience can be provided.
1 . A render manager of a display system, comprising:
a render sync receiver configured to receive one or more render sync requests from one or more application layers;
a render sync scheduler configured to choose, for each render sync request, a render sync signal from a plurality of render sync signals, each render sync signal of the plurality of render sync signals defining a render sync event that periodically repeats; and
a render sync responder configured to send, for each render sync request, a render sync response to an application layer which sent that render sync request, the render sync response comprising a render sync signal indicator configured to indicate the chosen render sync signal,
wherein for each application layer, an occurrence of the chosen render sync signal determines a render start time defining a time in which rendering of a surface associated with that application layer is allowed to start, and
wherein the one or more render synch requests are separate from renderings performed by the one or more application layers.
2 . The render manager of claim 1 , wherein each render sync signal of the plurality of render sync signals is different from at least one other render sync signal of the plurality of render sync signals in frequency, in phase, or in both.
3 . The render manager of claim 1 , wherein for each render sync signal of the plurality of render sync signals, a hardware (HW) frequency ratio of that render sync signal is a positive integer, the HW frequency ratio of a render sync signal being a ratio of a frequency of a HW sync signal of a display of the display system to a frequency of the render sync signal.
4 . The render manager of claim 3 , wherein for each render sync signal of the plurality of render sync signals, the HW frequency ratio of that render sync signal is 2 n , n being an integer greater than or equal to zero.
5 . The render manager of claim 3 , wherein the HW frequency ratio of at least one render sync signal of the plurality of render sync signals is one.
6 . The render manager of claim 1 , wherein the plurality of render sync signals comprises at least first and second render sync signals with first and second frequencies and with first and second phases in which the first and second frequencies are same but first and second phases are different.
7 . The render manager of claim 6 , wherein the first and second frequencies are lower than the frequency of the HW sync signal.
8 . The render manager of claim 6 ,
wherein each occurrence of the first render sync signal coincides with each first occurrence of the HW sync signal, and
wherein each occurrence of the second render sync signal coincides with each second occurrence of the HW sync signal.
9 . The render manager of claim 1 , wherein the render sync scheduler is configured to choose the render sync signal for at least one render sync request based on a current operating mode of the display system.
10 . The render manager of claim 9 , wherein the current operating mode of the display system is one of a plurality of operating modes, each operating mode of the plurality of operating modes corresponding to different levels of performance and/or different levels of power consumption.
11 . The render manager of claim 1 , wherein the render sync scheduler is configured to choose the render sync signals such that the render start times of two or more application layers are different.
12 . The render manager of claim 1 , wherein when the render sync receiver receives first and second render sync requests at first and second times from a same application layer, the render sync scheduler is configured to choose first and second render sync signals different from each other.
13 . The render manager of claim 1 ,
wherein at least one render sync request from corresponding at least one application layer includes a MinRenderCycle indicating a minimum time duration in between two render start times of the surface associated with the corresponding at least one application layer, and
wherein the render sync scheduler is configured to choose the render sync signal for the at least one render sync request based on the MinRenderCycle.
14 . A method of a render manager of a display system, the method comprising:
receiving one or more render sync requests from one or more application layers;
choosing, for each render sync request, a render sync signal from a plurality of render sync signals, each render sync signal of the plurality of render sync signals defining a render sync event that periodically repeats; and
sending, for each render sync request, a render sync response to an application layer which sent that render sync request, the render sync response comprising a render sync signal indicator configured to indicate the chosen render sync signal,
wherein for each application layer, an occurrence of the chosen render sync signal determines a render start time defining a time in which rendering of a surface associated with that application layer is allowed to start, and
wherein the one or more render synch requests are separate from renderings performed by the one or more application layers.
15 . The method of claim 14 , wherein each render sync signal of the plurality of render sync signals is different from at least one other render sync signal of the plurality of render sync signals in frequency, in phase, or in both.
16 . The method of claim 14 , wherein for each render sync signal of the plurality of render sync signals, a hardware (HW) frequency ratio of that render sync signal is a positive integer, the HW frequency ratio of a render sync signal being a ratio of a frequency of a HW sync signal of a display of the display system to a frequency of the render sync signal.
17 . The method of claim 16 , wherein for each render sync signal of the plurality of render sync signals, the HW frequency ratio of that render sync signal is 2″, n being an integer greater than or equal to zero.
18 . The method of claim 16 , wherein the HW frequency ratio of at least one render sync signal of the plurality of render sync signals is one.
19 . The method of claim 14 , wherein the plurality of render sync signals comprises at least first and second render sync signals with first and second frequencies and with first and second phases in which the first and second frequencies are same but first and second phases are different.
20 . The method of claim 19 , wherein the first and second frequencies are lower than the frequency of the HW sync signal.
21 . The method of claim 19 ,
wherein each occurrence of the first render sync signal coincides with each first occurrence of the HW sync signal, and
wherein each occurrence of the second render sync signal coincides with each second occurrence of the HW sync signal.
22 . The method of claim 14 , wherein the render sync scheduler is configured to choose the render sync signal for at least one render sync request based on a current operating mode of the display system.
23 . The method of claim 22 , wherein the current operating mode of the display system is one of a plurality of operating modes, each operating mode of the plurality of operating modes corresponding to different levels of performance and/or different levels of power consumption.
24 . The method of claim 14 , wherein the render sync signals are chosen such that the render start times of two or more application layers are different.
25 . The method of claim 14 , wherein when first and second render sync requests are received at first and second times from a same application layer, first and second render sync signals different from each other are chosen.
26 . The method of claim 14 ,
wherein at least one render sync request from corresponding at least one application layer includes a MinRenderCycle indicating a minimum time duration in between two render start times of the surface associated with the corresponding at least one application layer, and
wherein choosing the render sync signal comprises choosing the render sync signal for the at least one render sync request based on the MinRenderCycle.
27 . A render manager of a display system, comprising:
means for receiving one or more render sync requests from one or more application layers;
means for choosing, for each render sync request, a render sync signal from a plurality of render sync signals, each render sync signal of the plurality of render sync signals defining a render sync event that periodically repeats; and
means for sending, for each render sync request, a render sync response to an application layer which sent that render sync request, the render sync response comprising a render sync signal indicator configured to indicate the chosen render sync signal,
wherein for each application layer, an occurrence of the chosen render sync signal determines a render start time defining a time in which rendering of a surface associated with that application layer is allowed to start, and
wherein the one or more render synch requests are separate from renderings performed by the one or more application layers.
28 . The render manager of claim 27 , wherein each render sync signal of the plurality of render sync signals is different from at least one other render sync signal of the plurality of render sync signals in frequency, in phase, or in both.
29 . The render manager of claim 27 , wherein the means for choosing is configured to choose the render sync signal based on
a current operating mode of the display system, each operating mode of the plurality of operating modes corresponding to different levels of performance and/or different levels of power consumption,
a MinRenderCycle included in the render sync request, the MinRenderCycle indicating a minimum time duration in between two render start times of the surface associated with the corresponding application layer,
number of application layers matched to each of the plurality of render sync signals, or
any combination thereof.
30 . A non-transitory computer-readable medium storing computer-executable instructions for a render manager of a display system, the computer-executable instructions comprising:
one or more instructions instructing the render manager to receive one or more render sync requests from one or more application layers;
one or more instructions instructing the render manager to choose, for each render sync request, a render sync signal from a plurality of render sync signals, each render sync signal of the plurality of render sync signals defining a render sync event that periodically repeats; and
one or more instructions instructing the render manager to send, for each render sync request, a render sync response to an application layer which sent that render sync request, the render sync response comprising a render sync signal indicator configured to indicate the chosen render sync signal,
wherein for each application layer, an occurrence of the chosen render sync signal determines a render start time defining a time in which rendering of a surface associated with that application layer is allowed to start, and
wherein the one or more render synch requests are separate from renderings performed by the one or more application layers.