IP Library Granted Patent US 9,264,661
Granted Patent B2
US 9,264,661 · App. 14/082,852 · Granted Feb 16, 2016

Adaptive post-processing for mobile video calling system

Inventors: Jiefu Zhai (San Jose, CA); Chris Y. Chung (Sunnyvale, CA); Xiaosong Zhou (Campbell, CA); Hsi-Jung Wu (San Jose, CA)
Assignee: Apple Inc.
H04N7/141H04N19/117
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,264,661
App. No.
14/082,852
Granted
Feb 16, 2016
Kind
B2
Abstract

A system may include a receiver, a decoder, a post-processor, and a controller. The receiver may receive encoded video data. The decoder may decode the encoded video data. The post-processor may perform post-processing on frames of decoded video sequence from the decoder. The controller may adjust post-processing of a current frame, based upon at least one condition parameters detected at the system.

Claims (59)

1. A system comprising:

a receiver receiving encoded video data;

a decoder decoding the encoded video data;

a post-processor post-processing on frames of decoded video sequence from the decoder; and

a controller adjusting operation of a post-processor for a current frame based upon at least an estimate of a viewing distance representing a distance from a display that renders post-processed frames to a viewer that observes the rendered post-processed frames.

2. The system of claim 1 , wherein the receiver separates encoded video data from ancillary data streams.

3. The system of claim 1 , wherein the post-processing by the post-processor comprises at least one of applying deblocking filters, applying edge detection filters, and applying ringing filters.

4. The system of claim 1 , wherein the post-processing by the post-processor comprises a transform of a square pixel region based upon a coefficient threshold.

5. The system of claim 4 , wherein a post-processing filter coefficient is adjusted by the controller based upon the estimate of a viewing distance.

6. The system of claim 1 , wherein the controller estimates the estimated viewing distance from an analysis of content of the decoded video sequence.

7. The system of claim 1 , wherein the controller estimates the estimated viewing distance from position sensor data provided at the system.

8. The system of claim 1 , wherein the controller adjusts operation of the post-processor also based on a screen size of the display.

9. The system of claim 1 , wherein the controller adjusts operation of the post-processor also based on a screen resolution of the display.

10. The system of claim 1 , wherein the controller adjusts operation of the post-processor also based on a screen brightness of the display.

11. The system of claim 1 , wherein the controller adjusts operation of the post-processor also based on an ambient light brightness in an environment where the display is located.

12. A method comprising:

receiving, by a receiver, encoded video data;

decoding, by a decoder, the encoded video data;

post-processing, by a post-processor, on frames of decoded video sequence from the decoder; and

adjusting, by a controller, post-processing of a current frame, based upon at least an estimate of a viewing distance representing a distance from a display that renders post-processed frames to a viewer that observes the rendered post-processed frames.

13. The method of claim 12 , wherein the receiver separates encoded video data from ancillary data streams.

14. The method of claim 12 , wherein the post-processing by the post-processor comprises at least one of applying deblocking filters, applying edge detection filters, and applying ringing filters.

15. The method of claim 12 , wherein the post-processing by the post-processor comprises a transform of a square pixel region based upon a coefficient threshold.

16. The method of claim 12 , wherein a post-processing filter coefficient is adjusted by the controller based upon the estimated viewing distance.

17. The method of claim 12 , wherein the estimated viewing distance is estimated from an analysis of content of the decoded video sequence.

18. The method of claim 12 , wherein the estimated viewing distance is estimated from position sensor data provided at the system.

19. The method of claim 12 , wherein the controller adjusts operation of the post-processor also based on a screen size of the display.

20. The method of claim 12 , wherein the controller adjusts operation of the post-processor also based on a screen resolution of the display.

21. The method of claim 12 , wherein the controller adjusts operation of the post-processor also based on a screen brightness of the display.

22. The method of claim 12 , wherein the controller adjusts operation of the post-processor also based on an ambient light brightness in an environment where the display is located.

23. A non-transitory computer readable medium, storing instruction codes, executable by a processor in a system to perform:

receiving, by the processor, encoded video data;

decoding, by the processor, the encoded video data;

post-processing, by the processor, on frames of decoded video sequence from the decoder; and

adjusting, by the processor, post-processing of a current frame, based upon at least an estimate of a viewing distance representing a distance from a display that renders post-processed frames to a viewer that observes the rendered post-processed frames.

24. The non-transitory computer readable medium of claim 23 , wherein the post-processing comprises at least one of applying deblocking filters, applying edge detection filters, and applying ringing filters.

25. The non-transitory computer readable medium of claim 23 , wherein the post-processing comprises a transform of a square pixel region based upon a coefficient threshold.

26. The non-transitory computer readable medium of claim 23 , wherein a post-processing filter coefficient is adjusted based upon the estimated viewing distance.

27. The medium of claim 23 , wherein the estimated viewing distance is estimated from an analysis of content of the decoded video sequence.

28. The medium of claim 23 , wherein the estimated viewing distance is estimated from position sensor data provided at the system.

29. The medium of claim 23 , wherein adjusting comprises adjusting operation of the post-processing also based on a screen size of the display.

30. The medium of claim 23 , wherein adjusting comprises adjusting operation of the post-processing also based on a screen resolution of the display.

31. The medium of claim 23 , wherein adjusting comprises adjusting operation of the post-processing also based on a screen brightness of the display.

32. The medium of claim 23 , wherein adjusting comprises adjusting operation of the post-processing also based on an ambient light brightness in an environment where the display is located.

33. A system comprising:

a receiver receiving encoded video data;

a decoder decoding the encoded video data;

a post-processor post-processing on frames of decoded video sequence from the decoder; comprising a transform of a square pixel region based upon a coefficient threshold, and

a controller adjusting post-processing of a current frame, based upon at least one condition parameters detected at the system.

34. A method comprising:

receiving, by a receiver, encoded video data;

decoding, by a decoder, the encoded video data;

post-processing, by a post-processor, on frames of decoded video sequence from the decoder, comprising transforming a square pixel region based upon a coefficient threshold; and

adjusting, by a controller, post-processing of a current frame, based upon at least one condition parameters detected at a system.

35. A non-transitory computer readable medium, storing instruction codes, executable by a processor in a system to perform:

receiving, by the processor, encoded video data;

decoding, by the processor, the encoded video data;

post-processing, by the processor, on frames of decoded video sequence from the decoder, comprising transforming a square pixel region based upon a coefficient threshold; and

adjusting, by a controller, post-processing of a current frame, based upon at least one condition parameters detected at the system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2013
From: ZHAI, JIEFU; CHUNG, CHRIS Y.; ZHOU, XIAOSONG; WU, HSI-JUNG
To: APPLE INC.
Reel/Frame 031622/0750 →
Continuity (2)
Provisional Application 61832429 · Jun 7, 2013
Related Publication 20140362159A1 · Dec 11, 2014