IP Library Granted Patent US 11,361,477
Granted Patent B2
US 11,361,477 · App. 17/163,325 · Granted Jun 14, 2022

Method for improved handling of texture data for texturing and other image processing tasks

Inventors: Kimball D. Thurston, III (Wellington, NZ); Luca Fascione (Wellington, NZ); Sébastien Nicolas Speierer (Wellington, NZ)
Assignee: Unity Technologies SF
G06T11/001G06T7/40G06T15/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,361,477
App. No.
17/163,325
Granted
Jun 14, 2022
Kind
B2
Abstract

An imagery processing system that combines MIP level filtering with spatial filtering when rendering images. Filtering can be performed in an order that optimizes memory accesses during the rendering process.

Claims (27)

1. A computer-implemented method of processing textures to determine a sample of an image, the method comprising:

under the control of one or more computer systems configured with executable instructions:

receive a filter region representation, wherein the filter region representation comprises computer-readable data corresponding to a sample region of the image;

determining a first texture dataset;

determining a filter kernel for the filter region representation, the filter kernel corresponding to the sample region of the image, wherein the filter kernel comprises one or more kernel weights of the filter kernel over the sample region of the image;

storing the filter kernel;

determining a subset of the first texture dataset upon which the filter kernel is to be applied;

storing a schedule of the subset, wherein the schedule specifies positions of texels within the first texture dataset;

applying the schedule and the filter kernel to the first texture dataset to determine a first texture contribution for the sample region;

determining a second texture dataset;

applying the schedule and the filter kernel to the second texture dataset to determine a second texture contribution for the sample region; and

combining the first texture contribution and the second texture contribution to determine an overall accumulated output for the sample region as the sample of the image.

2. The computer-implemented method of claim 1 , wherein the first texture dataset or the second texture dataset comprises a plurality of levels of varying resolution and the schedule indicates which level or levels apply to the sample region.

3. The computer-implemented method of claim 2 , wherein the plurality of levels of varying resolution comprises a MIP-map structure, a RIP-map structure, and/or a wavelet structure.

4. The computer-implemented method of claim 1 , wherein the first texture dataset and/or the second texture dataset comprises a two-dimensional or a three-dimensional texture.

5. The computer-implemented method of claim 1 , wherein a first subset of the first texture dataset and/or a second subset of the second texture dataset comprises one or more texture tiles of a predetermined size.

6. The computer-implemented method of claim 1 , wherein the sample region is computed based on a mapping of a region a surface in a virtual scene represented by geometrical models.

7. The computer-implemented method of claim 1 , wherein the filter region representation is determined based on a determined impact of applying the filter kernel across a range of tile vertices.

8. The computer-implemented method of claim 1 , further comprising:

accessing one or more texture tiles of one or more levels of varying resolution determined to correspond to a pixel region selected for filtering for the sample region; and

applying at least one fitted filter to the accessed one or more texture tiles.

9. The computer-implemented method of claim 1 , wherein the sample region is an ellipse.

10. The computer-implemented method of claim 1 , wherein a fitted filter is a first fitted filter and a plurality of fitted filters are calculated and accumulated into a representation of the fitted filter in a cache and accumulating one or more tiles of one or more levels of varying resolution to access.

11. The computer-implemented method of claim 10 , further comprising:

accumulating a list of the one or more tiles to access for subsequent access of those one or more tiles.

12. The computer-implemented method of claim 1 , further comprising generating a plurality of samples for a plurality of requests for samples and caching data values across requests.

13. The computer-implemented method of claim 12 , further comprising grouping texture dataset requests across the requests.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: UNITY SOFTWARE INC.
To: UNITY TECHNOLOGIES SF
Reel/Frame 058980/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: WETA DIGITAL LIMITED
To: UNITY SOFTWARE INC.
Reel/Frame 058978/0865 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2021
From: THURSTON, KIMBALL D., III; FASCIONE, LUCA; SPEIERER, SEBASTIEN NICOLAS
To: WETA DIGITAL LIMITED
Reel/Frame 058451/0136 →
Continuity (2)
Provisional Application 62968120 · Jan 30, 2020
Related Publication 20210241502A1 · Aug 5, 2021