IP Library Granted Patent US 10,503,689
Granted Patent B2
US 10,503,689 · App. 15/595,316 · Granted Dec 10, 2019

Image processor I/O unit

Inventors: Asif Khan (Campbell, CA); Jason Redgrave (Mountain View, CA); Neeti Desai (Sunnyvale, CA); David Warren (Campbell, CA)
Assignee: Google LLC
G06F15/78G06F15/7867G06T1/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,503,689
App. No.
15/595,316
Filed
May 15, 2017
Granted
Dec 10, 2019
Kind
B2
Art Unit
2665
USPC
382/276
Abstract

An image processor is described. The image processor includes a storage circuit to store segments of input image data received in a raster scan format from a camera. The image processor further includes a reformatting circuit to convert the segments of input image data into a block image format. The image processor further includes a processor comprising a two-dimensional execution lane array and a two-dimensional shift register array. The two-dimensional shift register array is to store the input image data that has been formatted into the block image format. The execution lane array is to execute instructions that operate on the image data from the two-dimensional shift register array.

Claims (36)

1. An image processor, comprising:

a storage circuit to store segments of input image data received in a raster scan format;

a reformatting circuit to convert the segments of input image data into a block image format, wherein the reformatting circuit comprises register space to keep pointers that point to the segments of the input image data, and wherein the reformatting circuit is configured to recognize when a block of the input image data has been stored in the storage circuit and cause segments within the storage circuit that correspond to the block to be read from the storage circuit by referring to the pointers in the register space;

a processor comprising a two-dimensional execution lane array and a two-dimensional shift register array, the two-dimensional shift register array to store the input image data that has been formatted into the block image format, the execution lane array to execute instructions that operate on the image data from the two-dimensional shift register array.

2. The image processor of claim 1 wherein the pointers are organized in the register space to have a first dimension that corresponds to a row width of the raster scan format and to have a second dimension that corresponds to a pixel height of the block format.

3. The image processor of claim 1 wherein the reformatting circuit supports any of the following:

configurable segment sizes;

configurable raster scan row width sizes;

configurable block pixel height sizes.

4. The image processor of claim 1 wherein the reformatting circuit is also to perform output block image to output image raster scan conversion.

5. The image processor of claim 1 wherein the reformatting circuit supports multiple raster scan to block image conversion channels.

6. A computing system, comprising:

a) one or more general purpose processor cores;

b) a system memory

c) a memory controller coupled to the system memory;

d) an image processor comprising i), ii) and iii) below:

i) a storage circuit to store segments of input image data received in a raster scan format;

ii) a reformatting circuit to convert the segments of input image data into a block image format, wherein the reformatting circuit comprises register space to keep pointers that point to the segments of the input image data, and wherein the reformatting circuit is configured to recognize when a block of the input image data has been stored in the storage circuit and cause segments within the storage circuit that correspond to the block to be read from the storage circuit by referring to the pointers in the register space;

iii) a processor comprising a two-dimensional execution lane array and a two-dimensional shift register array, the two-dimensional shift register array to store the input image data that has been formatted into the block image format, the execution lane array to execute instructions that operate on the image data from the two-dimensional shift register array.

7. The computing system of claim 6 wherein the pointers are organized in the register space to have a first dimension that corresponds to a row width of the raster scan format and to have a second dimension that corresponds to a pixel height of the block format.

8. The computing system of claim 6 wherein the reformatting circuit supports any of the following:

configurable segment sizes;

configurable raster scan row width sizes;

configurable block pixel height sizes.

9. The computing system of claim 6 wherein the reformatting circuit is also to perform output block image to output image raster scan conversion.

10. The computing system of claim 6 wherein the reformatting circuit supports multiple raster scan to block image conversion channels.

11. A method, comprising:

storing input image data received in a raster scan format as segments within a storage circuit;

reformatting the input image data into a block image format by reading certain ones of the segments from the storage circuit, comprising keeping pointers within register space that point to the segments of the input image data, and recognizing when a block of the input image data has been stored in the storage circuit and causing segments within the storage circuit that correspond to the block to be read from the storage circuit by referring to the pointers in the register space; and,

processing the block image formatted input image data with a processor comprising a two-dimensional execution lane array and a two-dimensional shift register array.

12. The method of claim 11 , wherein the pointers are organized in the register space to have a first dimension that corresponds to a row width of the raster scan format and to have a second dimension that corresponds to a pixel height of the block format.

13. The method of claim 11 further comprising performing any of the following to perform the reformatting:

configuring a segment size;

configuring a raster scan row width size;

configuring a block pixel height size.

14. The method of claim 11 further comprising storing block output image data as output segments into the storage circuit and reading certain ones of the output segments from the storage circuit to form raster scan formatted output image data.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2017
From: KHAN, ASIF; REDGRAVE, JASON; DESAI, NEETI; WARREN, DAVID
To: GOOGLE INC.
Reel/Frame 042420/0956 →
Continuity (1)
Related Publication 20180329863A1 · Nov 15, 2018