Method and apparatus for performing bulk file system attribute retrieval
Accordingly a method and interface allows an attribute data base used by an Information Manager to be quickly populated and accurately maintained. A single Bulk Attribute Retrieval Request triggers the primary storage device to collect object attribute information. The method allows for selective collection of objects and attributes by providing filters and attribute lists in the Requests. The Request may be used to provide an incremental scan with appropriate time stamp filtering. In addition, the size of the results can be controlled by the IM by eliminating attributes that are not of interest to the IM. The Request is advantageously issued over a FileMover interface, which is an HTTP connection, and encoded in XML, allowing the IM to easily customize the Request as desired.
1. A method comprising:
in a network in which at least one client is coupled to at least one data storage system which utilizes tiered levels of storage associated with different data storage devices, collecting file system metadata in response to a request having a timestamp by:
decoding the request to identify a file system tree;
identifying file system objects associated with the file system tree;
retrieving a checkpoint based on the time stamp;
identifying blocks in the file system that have been modified since the checkpoint;
determining which identified objects are associated with modified blocks;
retrieving metadata including attributes of the identified file objects associated with modified blocks;
selectively storing the retrieved metadata in a result file; and
utilizing the result file for identifying objects for relocation between tiers.
2. The method of claim 1 wherein the request identifies a filtering attribute and a filtering attribute condition for use in filtering identified objects, and wherein the step of selectively storing includes discarding identified objects having values for the filtering attribute that do not satisfy the filtering attribute condition.
3. The method according to claim 1 including designating the timestamp from a group including a modify time stamp, an access time stamp and a change time stamp.
4. The method according to claim 2 wherein the filtering attribute is one of an offline and online status, and wherein the step of selectively storing includes discarding identified objects based on offline and online status.
5. The method according to claim 2 wherein the filtering attribute is a file size, and wherein the step of selectively storing includes discarding identified objects based on file size.
6. The method according to claim 2 wherein the filtering attribute is a file type, and wherein the step of selectively storing includes discarding identified objects based on file type.
7. The method of claim 1 wherein the request includes an attribute list, and wherein the step of selectively storing the retrieved attributes includes discarding attribute types that are not included on the attribute list.
8. The method of claim 7 , wherein the attribute list includes at least one attribute selected from a group of modification time, access control list, off-line status, permission bits, file type, WORM status, access time, change time, owner, group, DOS read-only bit, DOS archive bit, link count, file size, directory size, DOS name, Unix name, Win32 name, or extended attributes.
9. Apparatus comprising:
a server including a computer program stored on a non-transitory computer-readable medium for generating a request having a timestamp; and
a data storage system which utilizes tiered levels of storage associated with different data storage devices, the data storage system being in communication with the server and including a computer program stored on a non-transitory computer-readable medium for collecting file system metadata in response to the request by:
decoding the request to identify a file system tree;
identifying file system objects associated with the file system tree;
retrieving a checkpoint based on the time stamp;
identifying blocks in the file system that have been modified since the checkpoint;
determining which identified objects are associated with modified blocks;
retrieving metadata including attributes of the identified file objects associated with modified blocks; and
selectively storing the retrieved metadata in a result file; and
wherein the server utilizes the result file for identifying objects for relocation between tiers.
10. The apparatus of claim 9 wherein the request identifies a filtering attribute and a filtering attribute condition for use in filtering identified objects, and wherein selectively storing the retrieved metadata includes discarding identified objects having values for the filtering attribute that do not satisfy the filtering attribute condition.
11. The apparatus of claim 9 wherein the timestamp is selected from a group including a modify time stamp, an access time stamp and a change time stamp.
12. The apparatus of claim 10 wherein the filtering attribute is one of an offline and online status, and including discarding identified objects based on offline and online status.
13. The apparatus of claim 10 wherein the filtering attribute is a file size, and including discarding identified objects based on file size.
14. The apparatus of claim 10 wherein the filtering attribute is a file type, and including discarding identified objects based on file type.
15. The apparatus of claim 9 wherein the request includes an attribute list, and including discarding attribute types that are not included on the attribute list.
16. The apparatus of claim 15 wherein the attribute list includes at least one attribute selected from a group of modification time, access control list, off-line status, permission bits, file type, WORM status, access time, change time, owner, group, DOS read-only bit, DOS archive bit, link count, file size, directory size, DOS name, Unix name, Win32 name, or extended attributes.