IP Library Granted Patent US 9,984,647
Granted Patent B2
US 9,984,647 · App. 15/145,718 · Granted May 29, 2018

Video frame rate compensation through adjustment of vertical blanking

Inventor: Roelof Roderick Colenbrander (Costa Mesa, CA)
Assignee: Sony Interactive Entertainment LLC
G09G5/001G06F3/14G06T1/60H04N5/04H04N7/013G06F3/1423G09G5/395G09G2310/062G09G2310/08G09G2340/02G09G2340/0435G09G2350/00G09G2360/08G09G2360/12G09G2360/127G09G2370/022G09G2370/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,984,647
App. No.
15/145,718
Granted
May 29, 2018
Kind
B2
Abstract

Systems and methods are configured to adjust the timing of source frame compression in response to detected fluctuations in a variable frame rate at which source frames are rendered into a buffer.

Claims (71)

1. A method comprising:

rendering a plurality of source frames into a buffer, each said source frame being rendered sequentially into the buffer at a variable frame rate;

scanning out a plurality of output frames from the buffer with a scanout unit;

compressing a source frame within each said output frame that is scanned out of the buffer;

detecting one or more fluctuations in the variable frame rate; and

adjusting a timing of the compressing of one or more of the source frames in response to the one or more fluctuations.

2. The method of claim 1 , further comprising:

capturing the source frame within each said output frame that is scanned out of the buffer before said compressing the source frame.

3. The method of claim 1 , further comprising:

capturing the source frame within each said output frame that is scanned out of the buffer before said compressing the source frame; and

sending each said compressed frame to one or more remote devices over a network.

4. The method of claim 1 ,

wherein the buffer includes a front frame buffer and at least one back frame buffer,

wherein each said output frame is scanned out of the front frame buffer,

wherein the back frame buffer is swapped with the front frame buffer after scan out of each said output frame from the front frame buffer.

5. The method of claim 1 ,

wherein the one or more fluctuations include one or more downward fluctuations in which the variable frame rate decreases,

wherein said adjusting the timing of the compressing includes delaying a scan out of one or more of the output frames in response to the downward fluctuations.

6. The method of claim 1 , further comprising:

placing a marker into a memory unit after each said frame is rendered into the frame buffer,

wherein said detecting the one or more fluctuations includes tracking a time at which the marker for each said frame is placed into the buffer.

7. The method of claim 1 ,

wherein said adjusting the timing of the compressing includes putting the scanout unit to sleep for a period of time.

8. The method of claim 1 ,

wherein said adjusting the timing of the compressing includes delaying scanout of at least one of the output frames by changing a register value to a value that delays scanout.

9. The method of claim 1 ,

wherein the one or more fluctuations include one or more downward fluctuations in which the variable frame rate decreases,

wherein said adjusting the timing of the compressing includes disabling a display interface in response to the one or more downward fluctuations to prevent transfer of one or more of the output frames.

10. A system comprising:

at least one processor unit;

at least one memory unit coupled to the processor unit; and

a scanout unit coupled to the processor unit, wherein the processor unit is configured to perform a method, the method comprising:

rendering a plurality of source frames into a buffer, each said source frame being rendered sequentially into the buffer at a variable frame rate;

scanning out a plurality of output frames from the buffer with a scanout unit;

compressing a source frame within each said output frame that is scanned out of the buffer;

detecting one or more fluctuations in the variable frame rate; and

adjusting a timing of the compressing of one or more of the source frames in response to the one or more fluctuations.

11. The system of claim 10 , wherein the method further comprises:

capturing the source frame within each said output frame that is scanned out of the buffer before said compressing the source frame.

12. The system of claim 10 , wherein the method further comprises:

capturing the source frame within each said output frame that is scanned out of the buffer before said compressing the source frame; and

sending each said compressed frame to one or more remote devices over a network.

13. The system of claim 10 ,

wherein the buffer includes a front frame buffer and at least one back frame buffer,

wherein each said output frame is scanned out of the front frame buffer,

wherein the back frame buffer is swapped with the front frame buffer after scan out of each said output frame from the front frame buffer.

14. The system of claim 10 ,

wherein the one or more fluctuations include one or more downward fluctuations in which the variable frame rate decreases,

wherein said adjusting the timing of the compressing includes delaying a scan out of one or more of the output frames in response to the downward fluctuations.

15. The system of claim 10 , wherein the method further comprises:

placing a marker into a memory unit after each said frame is rendered into the frame buffer,

wherein said detecting the one or more fluctuations includes tracking a time at which the marker for each said frame is placed into the buffer.

16. The system of claim 10 ,

wherein said adjusting the timing of the compressing includes putting the scanout unit to sleep for a period of time.

17. The system of claim 10 ,

wherein said adjusting the timing of the compressing includes delaying scanout of at least one of the output frames by changing a register value to a value that delays scanout.

18. The system of claim 10 ,

wherein the one or more fluctuations include one or more downward fluctuations in which the variable frame rate decreases,

wherein said adjusting the timing of the compressing includes disabling a display interface in response to the one or more downward fluctuations to prevent transfer of one or more of the output frames.

19. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising

rendering a plurality of source frames into a buffer, each said source frame being rendered sequentially into the buffer at a variable frame rate;

scanning out a plurality of output frames from the buffer with a scanout unit;

compressing a source frame within each said output frame that is scanned out of the buffer;

detecting one or more fluctuations in the variable frame rate; and

adjusting a timing of the compressing of one or more of the source frames in response to the one or more fluctuations.

20. The non-transitory computer readable medium of claim 19 ,

wherein the one or more fluctuations include one or more downward fluctuations in which the variable frame rate decreases,

wherein said adjusting the timing of the compressing includes delaying a scan out of one or more of the output frames in response to the downward fluctuations.

21. The non-transitory computer readable medium of claim 19 ,

wherein the one or more fluctuations include one or more downward fluctuations in which the variable frame rate decreases,

wherein said adjusting the timing of the compressing includes delaying a scan out of one or more of the output frames in response to the downward fluctuations by putting the scanout unit to sleep for a period of time.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded Apr 30, 2018
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC; SONY INTERACTIVE ENTERTAINMENT LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 045673/0057 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2016
From: COLENBRANDER, ROELOF RODERICK
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC (SIEA)
Reel/Frame 039137/0608 →
Continuity (3)
Continuation 14280502 · May 16, 2014
Provisional Application 61951729 · Mar 12, 2014
Related Publication 20160247481A1 · Aug 25, 2016