IP Library Granted Patent US 11,567,765
Granted Patent B2
US 11,567,765 · App. 16/487,766 · Granted Jan 31, 2023

Systems, methods, and apparatuses for tile load

Inventors: Robert Valentine (Kiryat Tivon, IL); Menachem Adelman (Haifa, IL); Milind B. Girkar (Sunnyvale, CA); Zeev Sperber (Zichron Yackov, IL); Mark J. Charney (Lexington, MA); Bret L. Toll (Hillsboro, OR); Rinat Rappoport (Haifa, IL); Jesus Corbal (King City, OR); Stanislav Shwartsman (Haifa, IL); Dan Baum (Haifa, IL); Igor Yanover (Yokneam Illit, IL); Alexander F. Heinecke (San Jose, CA); Barukh Ziv (Haifa, IL); Elmoustapha Ould-Ahmed-Vall (Chandler, AZ); Yuri Gebil (Nahariya, IL)
Assignee: Intel Corporation
G06F9/30036G06F7/485G06F7/4876G06F7/762G06F9/3001G06F9/3016G06F9/30032G06F9/30043G06F9/30109G06F9/30112G06F9/30134G06F9/30145G06F9/30149G06F9/30185G06F9/30196G06F9/3818G06F9/3836G06F17/16G06F2212/454
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,567,765
App. No.
16/487,766
Granted
Jan 31, 2023
Kind
B2
Abstract

Embodiments detailed herein relate to matrix operations. In particular, the loading of a matrix (tile) from memory. For example, support for a loading instruction is described in the form of decode circuitry to decode an instruction having fields for an opcode, a destination matrix operand identifier, and source memory information, and execution circuitry to execute the decoded instruction to load groups of strided data elements from memory into configured rows of the identified destination matrix operand to memory.

Claims (32)

1. A processor comprising:

programmable configuration storage to store configuration information for a multi-dimensional matrix destination operand, the configuration information including a first value corresponding to a number of rows for the multi-dimensional matrix destination operand, a second value corresponding to a number of columns for the multi-dimensional matrix destination operand, and a start row value corresponding to a row of the multi-dimensional matrix destination operand at which to restart execution;

decode circuitry to decode an instance of a single instruction having fields for an opcode, a multi-dimensional matrix destination operand identifier, and source memory information, wherein the opcode is to indicate execution circuitry is to load data elements from memory into configured rows of the identified multi-dimensional matrix destination operand; and

execution circuitry to execute the decoded instance of the single instruction according to the opcode to load data elements from memory into configured rows of the identified multi-dimensional matrix destination operand.

2. The processor of claim 1 , wherein the opcode defines a size of each data element of the destination multi-dimensional matrix destination operand.

3. The processor of claim 2 , wherein the size of each data element of the destination multi-dimensional matrix destination operand is a doubleword.

4. The processor of claim 2 , wherein the size of each data element of the destination multi-dimensional matrix destination operand is a word.

5. The processor of claim 1 , wherein the execution circuitry is to store each configured row into the identified multi-dimensional matrix destination operand and update a counter value as each row is stored.

6. The processor of claim 1 , wherein the identified multi-dimensional matrix destination operand is a plurality of registers configured to represent a matrix.

7. The processor of claim 1 , wherein the source memory information includes a scale, an index, a base, and a displacement.

8. A method comprising:

decoding an instance of a single instruction having fields for an opcode, a multi-dimensional matrix destination operand identifier, and source memory information, wherein the opcode is to indicate execution circuitry is to load groups of strided data elements from memory into configured rows of the identified multi-dimensional matrix destination operand and wherein a stride value is determined by shifting an index value provided by the instance of the single instruction by a scale value provided by the instance of the single instruction; and

executing the decoded instance of the single instruction according to the opcode to load groups of strided data elements from memory into configured rows of the identified multi-dimensional matrix destination operand, wherein programmable configuration storage stores configuration information for the multi-dimensional matrix destination operand, the configuration information including a first value corresponding to a number of rows for the multi-dimensional matrix destination operand, a second value corresponding to a number of columns for the multi-dimensional matrix destination operand, and a start row value corresponding to a row of the multi-dimensional matrix destination operand at which to restart execution.

9. The method of claim 8 , wherein the opcode defines a size of each data element of the multi-dimensional matrix destination operand.

10. The method of claim 9 , wherein the size of each data element of the multi-dimensional destination matrix operand is a doubleword.

11. The method of claim 9 , wherein the size of each data element of the multi-dimensional matrix destination operand is a word.

12. The method of claim 8 , further comprising loading each configured row of the identified multi-dimensional matrix destination operand and update a counter value as each row is loaded.

13. The method of claim 8 , wherein the identified multi-dimensional matrix destination operand is a plurality of registers configured to represent a matrix.

14. The method of claim 8 , wherein the source memory information includes a scale, an index, a base, and a displacement.

15. A non-transitory machine-readable medium storing an instance of an instruction which causes a processor to perform a method, the method comprising:

decoding the instance of a single instruction having fields for an opcode, a multi-dimensional matrix destination operand identifier, and source memory information, wherein the opcode is to indicate execution circuitry is to load groups of strided data elements from memory into configured rows of the identified multi-dimensional matrix destination operand and wherein a stride value is determined by shifting an index value provided by the instance of the single instruction by a scale value provided by the instance of the single instruction; and

executing the decoded instance of the single instruction according to the opcode to load groups of strided data elements from memory into configured rows of the identified multi-dimensional matrix destination operand, wherein programmable configuration storage stores configuration information for the multi-dimensional matrix destination operand, the configuration information including a first value corresponding to a number of rows for the multi-dimensional matrix destination operand, a second value corresponding to a number of columns for the multi- dimensional matrix destination operand, and a start row value corresponding to a row of the multi-dimensional matrix destination operand at which to restart execution.

16. The non-transitory machine-readable medium of claim 15 , wherein the opcode defines a size of each data element of the multi-dimensional matrix destination operand.

17. The non-transitory machine-readable medium of claim 16 , wherein the size of each data element of the multi-dimensional matrix destination operand is a doubleword.

18. The non-transitory machine-readable medium of claim 16 , wherein the size of each data element of the multi-dimensional matrix destination operand is a word.

19. The non-transitory machine-readable medium of claim 15 , wherein the identified multi-dimensional matrix destination operand is a plurality of registers configured to represent a matrix.

20. A system comprising:

a processor including:

programmable configuration storage to store configuration information for a multi-dimensional matrix, the configuration information including a first value corresponding to a number of rows for the multi-dimensional matrix, a second value corresponding to a number of columns for the multi-dimensional matrix, and a start row value corresponding to a row of the multi-dimensional matrix at which to restart execution, and

decode circuitry to decode an instance of a single instruction having fields for an opcode, a multi-dimensional matrix destination operand identifier, and source memory information, wherein the opcode is to indicate execution circuitry is to load data elements from memory into configured rows of the identified multi-dimensional matrix destination operand; and

an accelerator coupled to the processor, the accelerator including:

execution circuitry to execute the decoded instance of the single instruction according to the opcode to load data elements from memory into configured rows of the identified multi-dimensional matrix destination operand.

Continuity (2)
Provisional Application 62473732 · Mar 20, 2017
Related Publication 20200249949A1 · Aug 6, 2020
Cited By (3)
US 12,236,242 US 12,282,525 US 12,293,186