IP Library Granted Patent US 12,249,017
Granted Patent B2
US 12,249,017 · App. 17/794,876 · Granted Mar 11, 2025

Reduced display processing unit transfer time to compensate for delayed graphics processing unit render time

Inventors: Yongjun Xu (Beijing, CN); Nan Zhang (Beijing, CN); Wenkai Yao (Beijing, CN); Long Han (Shanghai, CN)
Assignee: QUALCOMM Incorporated
G06T15/005G06F1/12G06T1/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,249,017
App. No.
17/794,876
Granted
Mar 11, 2025
Kind
B2
Abstract

Devices and methods for reducing a DPU transfer time to compensate for a delayed GPU render time. After completion of rendering a second frame that follows a first frame, a frame processor determines whether the first frame is currently transferring to a display panel or has already been transferred to the display panel. At least one clock is used with a first set of clock speeds when the first frame is determined to be currently transferring and used with a second set of clock speeds when the first frame is determined to have already been transferred, the second set of clock speeds being faster than the first set of clock speeds. After completion of the transfer of the first frame, the second frame is transferred based on the set of clock speeds.

Claims (32)

1. A method of frame processing, comprising:

determining whether a first frame is currently transferring or has been transferred after completion of a rendering of a second frame, the second frame following the first frame;

using, with at least one clock, a first set of clock speeds when the first frame is determined to be currently transferring and a second set of clock speeds when the first frame is determined to have been transferred, the second set of clock speeds being faster than the first set of clock speeds;

transferring the second frame based on the used set of clock speeds after completion of the transfer of the first frame;

extending a vertical synchronization (V SYNC ) period from a first period T to a second period T+a when the first frame has already been transferred, wherein the at least one clock is used with the second set of clock speeds; and

determining the second set of clock speeds based on reducing a transfer completion time of the second frame in order to provide a transfer of the second frame within a third period T−a.

2. The method of claim 1 , wherein the determining whether the first frame is currently transferring or has been transferred comprises determining whether a display processing unit (DPU) line counter indicates that the first frame is being transferred into a display buffer or has been fully transferred into the display buffer.

3. The method of claim 1 , wherein the at least one clock comprises at least one of a display serial interface (DSI) clock or a mobile display processor (MDP) clock.

4. The method of claim 1 , wherein the first set of clock speeds is a set of default clock speeds that provides for a transfer of a frame within a first period T.

5. The method of claim 1 , wherein the second set of clock speeds is based on a variable refresh rate of the second frame.

6. The method of claim 1 , further comprising switching from a command mode to a video mode when a constant display rate is requested.

7. An apparatus for frame processing, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

determine whether a first frame is currently transferring or has been transferred after completion of a rendering of a second frame, the second frame following the first frame;

use, with at least one clock, a first set of clock speeds when the first frame is determined to be currently transferring and a second set of clock speeds when the first frame is determined to have been transferred, the second set of clock speeds being faster than the first set of clock speeds;

transfer the second frame based on the used set of clock speeds after completion of the transfer of the first frame

extend a vertical synchronization (V SYNC ) period from a first period T to a second period T+a when the first frame has already been transferred, wherein the at least one clock is used with the second set of clock speeds; and

determine the second set of clock speeds based on reducing a transfer completion time of the second frame in order to provide a transfer of the second frame within a third period T−a.

8. The apparatus of claim 7 , wherein for the determination of whether the first frame is currently transferring or has been transferred, the at least one processor is further configured to determine whether a display processing unit (DPU) line counter indicates that the first frame is being transferred into a display buffer or has been fully transferred into the display buffer.

9. The apparatus of claim 7 , wherein the at least one clock comprises at least one of a display serial interface (DSI) clock or a mobile display processor (MDP) clock.

10. The apparatus of claim 7 , wherein the first set of clock speeds is a set of default clock speeds that provides for a transfer of a frame within a first period T.

11. The apparatus of claim 7 , wherein the second set of clock speeds is based on a variable refresh rate of the second frame.

12. The apparatus of claim 7 , wherein the at least one processor is further configured to switch from a command mode to a video mode when a constant display rate is requested.

13. The apparatus of claim 7 , wherein the apparatus is a wireless communication device.

14. A non-transitory computer-readable medium storing computer executable code, the code when executed by a processor, causes the processor to:

determine whether a first frame is currently transferring or has been transferred after completion of a rendering of a second frame, the second frame following the first frame;

use, with at least one clock, a first set of clock speeds when the first frame is determined to be currently transferring and a second set of clock speeds when the first frame is determined to have been transferred, the second set of clock speeds being faster than the first set of clock speeds;

transfer the second frame based on the used set of clock speeds after completion of the transfer of the first frame extend a vertical synchronization (V SYNC ) period from a first period T to a second period T+a when the first frame has already been transferred, wherein the at least one clock is used with the second set of clock speeds; and

determine the second set of clock speeds based on reducing a transfer completion time of the second frame in order to provide a transfer of the second frame within a third period T−a.

15. The non-transitory computer-readable medium of claim 14 , wherein for the determination of whether the first frame is currently transferring or has been transferred, the processor is further configured to determine whether a display processing unit (DPU) line counter indicates that the first frame is being transferred into a display buffer or has been fully transferred into the display buffer.

16. The non-transitory computer-readable medium of claim 14 , wherein the first set of clock speeds is a set of default clock speeds that provides for a transfer of a frame within a first period T.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2022
From: XU, YONGJUN; ZHANG, NAN; YAO, WENKAI; HAN, LONG
To: QUALCOMM INCORPORATED
Reel/Frame 060611/0263 →
Continuity (1)
Related Publication 20230073736A1 · Mar 9, 2023
References Cited (123)
US 3691545A · Clark · 1972 [cited by examiner]
US 4349832A · Gallo · 1982 [cited by examiner]
US 4417275A · Harshbarger · 1983 [cited by examiner]
US 4518995A · Harshbarger · 1985 [cited by examiner]
US 4751699A · Tarridec · 1988 [cited by examiner]
US 4805024A · Suzuki · 1989 [cited by examiner]
US 4860283A · Takano · 1989 [cited by examiner]
US 5502511A · Nagel · 1996 [cited by examiner]
US 5555024A · Limberg · 1996 [cited by examiner]
US 5612900A · Azadegan · 1997 [cited by examiner]
US 5717469A · Jennes · 1998 [cited by examiner]
US 5929924A · Chen · 1999 [cited by examiner]
US 6040861A · Boroczky · 2000 [cited by examiner]
US 6097757A · Boice · 2000 [cited by examiner]
US 6674469B1 · Watanabe · 2004 [cited by examiner]
US 7038669B2 · Myers · 2006 [cited by examiner]
US 7091967B2 · Gong · 2006 [cited by examiner]
US 7142187B1 · Kim · 2006 [cited by examiner]
US 7154552B1 · Watanabe · 2006 [cited by examiner]
US 7318002B2 · Kulidjian · 2008 [cited by examiner]
US 7710501B1 · Adams · 2010 [cited by examiner]
US 9717051B2 · Ambapuram · 2017 [cited by examiner]
US 10096080B2 · Kwa · 2018 [cited by examiner]
US 10096302B2 · Roh · 2018 [cited by examiner]
US 20010038387A1 · Tomooka · 2001 [cited by examiner]
US 20020004413A1 · Inoue · 2002 [cited by examiner]
US 20020113904A1 · Champion · 2002 [cited by examiner]
US 20020146023A1 · Myers · 2002 [cited by examiner]
US 20030179221A1 · Nitta · 2003 [cited by examiner]
US 20040174439A1 · Upton · 2004 [cited by examiner]
US 20040207756A1 · Fujii · 2004 [cited by examiner]
US 20060146185A1 · Chen · 2006 [cited by examiner]
US 20070091042A1 · Chung · 2007 [cited by examiner]
US 20070165015A1 · Li · 2007 [cited by examiner]
US 20070169161A1 · Kienzle · 2007 [cited by examiner]
US 20070206018A1 · Bajic et al. · 2007 [cited by applicant]
US 20080129868A1 · Simpson · 2008 [cited by examiner]
US 20080158212A1 · Maruyama · 2008 [cited by examiner]
US 20080225062A1 · Chang · 2008 [cited by examiner]
US 20080239089A1 · Ikeyama · 2008 [cited by examiner]
US 20080284785A1 · Axtman · 2008 [cited by examiner]
US 20090185795A1 · Itani · 2009 [cited by examiner]
US 20090237391A1 · Yanagi · 2009 [cited by examiner]
US 20100188574A1 · Hung · 2010 [cited by examiner]
US 20110032235A1 · Nose · 2011 [cited by examiner]
US 20110043546A1 · Matsumoto · 2011 [cited by examiner]
US 20110305443A1 · Sasaki · 2011 [cited by examiner]
US 20120086832A1 · Ruhman · 2012 [cited by examiner]
US 20120215952A1 · Werner · 2012 [cited by examiner]
US 20120256962A1 · Wen · 2012 [cited by examiner]
US 20120272089A1 · Hatfield · 2012 [cited by examiner]
US 20120287140A1 · Lin · 2012 [cited by examiner]
US 20130016726A1 · Numakura · 2013 [cited by examiner]
US 20130063607A1 · Shimotono · 2013 [cited by examiner]
US 20130093953A1 · Miyashita · 2013 [cited by examiner]
US 20130271621A1 · Lee · 2013 [cited by examiner]
US 20140002465A1 · Kwa · 2014 [cited by examiner]
US 20140085275A1 · Tripathi · 2014 [cited by applicant]
US 20140160136A1 · Kaburlasos · 2014 [cited by examiner]
US 20140223219A1 · Aelion · 2014 [cited by examiner]
US 20150181084A1 · Colenbrander · 2015 [cited by examiner]
US 20150193959A1 · Shah · 2015 [cited by examiner]
US 20150235343A1 · Asai · 2015 [cited by examiner]
US 20150262547A1 · Higashino · 2015 [cited by examiner]
US 20150264298A1 · Colenbrander · 2015 [cited by examiner]
US 20150339994A1 · Verbeure · 2015 [cited by examiner]
US 20160210917A1 · Ishikawa · 2016 [cited by examiner]
US 20160225348A1 · Maiya · 2016 [cited by examiner]
US 20160335737A1 · Shah · 2016 [cited by examiner]
US 20170220062A1 · Shen · 2017 [cited by examiner]
US 20170315652A1 · Pourbigharaz · 2017 [cited by examiner]
US 20170318068A1 · Kikkeri Shivadatta · 2017 [cited by examiner]
US 20180103231A1 · Ahn · 2018 [cited by examiner]
US 20180174551A1 · Ansari · 2018 [cited by examiner]
US 20180300838A1 · Park · 2018 [cited by examiner]
US 20190043448A1 · Thakur · 2019 [cited by examiner]
US 20190057484A1 · Iwamoto · 2019 [cited by examiner]
US 20190325844A1 · Ansari · 2019 [cited by examiner]
US 20200005723A1 · Kim · 2020 [cited by examiner]
US 20200128207A1 · Masuda · 2020 [cited by examiner]
US 20200135149A1 · Lin · 2020 [cited by examiner]
US 20200175644A1 · Chen · 2020 [cited by examiner]
US 20200302848A1 · Lin · 2020 [cited by examiner]
US 20210093960A1 · Cerny · 2021 [cited by examiner]
US 20210093962A1 · Colenbrander · 2021 [cited by examiner]
US 20210093963A1 · Colenbrander · 2021 [cited by examiner]
US 20210280156A1 · Mehta · 2021 [cited by examiner]
US 20210392383A1 · Muthiah · 2021 [cited by examiner]
US 20210400169A1 · Collin · 2021 [cited by examiner]
US 20210407456A1 · Hussain · 2021 [cited by examiner]
US 20220093057A1 · Glen · 2022 [cited by examiner]
US 20220093062A1 · Glen · 2022 [cited by examiner]
US 20220101794A1 · Kim · 2022 [cited by examiner]
US 20220108646A1 · Komanduru, V · 2022 [cited by examiner]
US 20220122545A1 · Hong · 2022 [cited by examiner]
US 20220208145A1 · Glen · 2022 [cited by examiner]
US 20220254320A1 · Choi · 2022 [cited by examiner]
US 20220358881A1 · Chae · 2022 [cited by examiner]
US 20220415282A1 · Li · 2022 [cited by examiner]
US 20230024723A1 · Colenbrander · 2023 [cited by examiner]
US 20230074876A1 · Xu · 2023 [cited by examiner]
US 20230083289A1 · Lee · 2023 [cited by examiner]
US 20230142908A1 · Kim · 2023 [cited by examiner]
US 20230196498A1 · Ranka · 2023 [cited by examiner]
US 20230230534A1 · Koh · 2023 [cited by examiner]
US 20230267871A1 · Zhang · 2023 [cited by examiner]
US 20230290296A1 · Henzen · 2023 [cited by examiner]
US 20230367419A1 · Seo · 2023 [cited by examiner]
US 20230368714A1 · Sharma · 2023 [cited by examiner]
US 20240013704A1 · Kim · 2024 [cited by examiner]
US 20240046842A1 · Lee · 2024 [cited by examiner]
US 20240169953A1 · Marchya · 2024 [cited by examiner]
CN 104620311A · 2015 [cited by applicant]
CN 104917990A · 2015 [cited by applicant]
CN 105185284A · 2015 [cited by applicant]
CN 105225627A · 2016 [cited by applicant]
CN 108449566A · 2018 [cited by applicant]
CN 109196578A · 2019 [cited by applicant]
CN 110444155A · 2019 [cited by applicant]
CN 110520819A · 2019 [cited by applicant]
WO 2019014042A1 · 2019 [cited by applicant]
International Search Report and Written Opinion—PCT/CN2020/076205—ISA/EPO—Nov. 24, 2020. [cited by applicant]
Supplementary European Search Report—EP20919778—Search Authority—Munich—Sep. 8, 2023. [cited by applicant]