IP Library › Granted Patent US 11,941,783
Granted Patent B2
US 11,941,783 · App. 17/149,425 · Granted Mar 26, 2024

Scaler de-ringing in image processing circuitry

Inventors: Mahesh B. Chappalli (San Jose, CA); Vincent Z. Young (San Francisco, CA)
Assignee: Apple Inc.
G06T5/002G06T1/20G06T3/4007G06T5/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,941,783
App. No.
17/149,425
Granted
Mar 26, 2024
Kind
B2
Abstract

Methods and systems include receiving, at de-ringing circuitry of a display pipeline of an electronic device, scaled image content based on image data. The de-ringing circuitry also receives a fallback scaler output. The de-ringing circuitry determines whether the image data has a change frequency greater than a threshold. In response to the change frequency being above the threshold, the de-ringing circuitry determines a weight. Based at least in part on the weight, the de-ringing circuitry blends the scaled image content and the fallback scaler output based at least in part on the weight.

Claims (28)

1. A method, comprising:

receiving, at de-ringing circuitry of a display pipeline of an electronic device, scaled image content based on image data, wherein the scaled image content comprises linearly scaled content;

receiving, at the de-ringing circuitry, a fallback scaler output, wherein the fallback scaler output comprises non-linearly scaled content;

determining whether the image data has a change frequency greater than a threshold, wherein the change frequency comprises differences between adjacent pixels using pixel difference circuitry that comprises a plurality of subtractors and absolute value circuitries configured to determine sign-less differences between the adjacent pixels in the image data;

in response to the change frequency being above the threshold, determining a weight based on the linearly scaled content and the non-linearly scaled content; and

blending the scaled image content and the fallback scaler output based at least in part on the weight.

2. The method of claim 1 , wherein the scaled image content is scaled in a scaler of the display pipeline.

3. The method of claim 2 , wherein the scaled image content comprises horizontally scaled image content from the scaler, wherein the scaler comprises a horizontal scaler.

4. The method of claim 2 , wherein the scaled image content comprises vertically scaled image content from the scaler, wherein the scaler comprises a vertical scaler.

5. The method of claim 1 , comprising receiving the image data at the de-ringing circuitry.

6. The method of claim 1 , wherein determining whether the change frequency is greater than the threshold comprises determining whether the change frequency is lower than an additional threshold.

7. The method of claim 6 , wherein determining the weight comprises determining a bin based at least in part on the change frequency being between the threshold and the additional threshold.

8. The method of claim 7 , wherein determining the weight is based at least in part on the bin.

9. A display pipeline system of an electronic device, comprising:

scaler circuitry configured to generate scaled image content by scaling image data using a first scaling process and to generate a fallback scaler output using a second scaling process, wherein the first scaling process comprises linear scaling, and the second scaling process comprises non-linear scaling; and

de-ringing circuitry comprising pixel difference circuitry, coupled to the scaler circuitry and configured to:

receive the scaled image content from the scaler circuitry;

receive the fallback scaler output from the scaler circuitry;

determine a change frequency of the image data, wherein determining the change frequency comprises determining differences in adjacent pixels in the image data using a plurality of subtractors and absolute value circuitries to determine sign-less differences between the adjacent pixels in the image data;

blend the scaled image content and the fallback scaler output using one or more weights based on the change frequency; and

output de-ringed scaled content based on the change frequency, the one or more weights, the scaled image content, and the fallback scaler output.

10. The display pipeline system of claim 9 , wherein the de-ringing circuitry comprises additional scaler circuitry, wherein the scaler circuitry is configured to scale the image data in a vertical direction, and the additional scaler circuitry is configured to scale the image data in a horizontal direction.

11. The display pipeline system of claim 9 , wherein the scaler circuitry uses linear-interpolation-based scaling to generate the scaled image content.

12. The display pipeline system of claim 9 , wherein the de-ringing circuitry is configured to receive the image data.

13. The display pipeline system of claim 9 , wherein the de-ringing circuitry comprises frequency detection circuitry configured to determine the change frequency based at least in part on the sign-less differences between the adjacent pixels.

14. The method of claim 1 , wherein the fallback scaler output corresponds to a first level of scaling, and the scaled image content corresponds to a second level of scaling.

15. The method of claim 14 , wherein the first level of scaling is lower than the second level of scaling.

16. The display pipeline system of claim 9 , wherein the fallback scaler output corresponds to a first level of scaling, and the scaled image content corresponds to a second level of scaling.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: YOUNG, VINCENT Z.
To: APPLE INC.
Reel/Frame 056320/0184 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2021
From: CHAPPALLI, MAHESH B.
To: APPLE INC.
Reel/Frame 054958/0013 →
Continuity (2)
Provisional Application 63072086 · Aug 28, 2020
Related Publication 20220067885A1 · Mar 3, 2022