File system and method for delivering contents in file system
The present invention relates to a file system, an apparatus in the file system thereof, and a method of providing and managing content in the file system thereof. According to the present invention, it may be possible to minimize data loss caused by server failure and to provide the convenience of data (content) management by (1) grouping overall data nodes (servers) to manage with a network server group including several data nodes (servers), (2) defining content management information, (3) storing and duplicating contents in each network server group using the defined content management information to maintain and manage the contents, (4) and maintaining and managing the contents in a file unit without using file chunks.
1. A computer-implemented method of providing contents in a file system, the method comprising:
grouping a plurality of storage servers into a network server group;
receiving a content upload request from a user, the content upload request including content;
generating content management information based on information of the content;
determining the network server group and a specific storage server within the determined network server group to store the content based on the generated content management information;
storing the content in the determined storage server included in the determined network server group, wherein the content is managed by the determined network server group and is stored in a file unit, and is not stored in other storage servers within the determined network server group;
responsive to storing the content in the determined storage server or responsive to a predetermined time period, transmitting the content stored in the determined network server group to one or more different network server groups to duplicate the content in the one or more different network server groups in the file unit;
receiving a request for accessing the content from other users;
calculating traffic for accessing the content, the traffic describing a number of requests for the content during a period of time;
selecting a network server group by considering both traffic among network server groups in which the content is stored and the content management information and delivering the content stored in the selected network server group to the other users;
responsive to the traffic being greater than a threshold:
duplicating the content to an acceleration server in the file unit; and
providing the content in the file unit through the acceleration server in response to requests for accessing the content from the other users,
wherein the content management information includes load information, data group information, file information, and replica state information.
2. The method of claim 1 , wherein the data group information includes a data group where the content is stored, a location of the data group and location of a data node within the data group, operating status of the data group, a time when the content was stored and a data node identifier (ID) for the data node, a data group ID of the data group, or a network ID.
3. The method of claim 1 , wherein the replica state information includes a duplicated count and a time when the content was duplicated, a duplicated file ID, duplicated location information and distribution request information.
4. The method of claim 1 , wherein the determined network server group and the one or more different network server groups maintain same content.
5. A computer-implemented method in a file system, the method comprising:
grouping a plurality of storage servers into a network server group;
receiving a content upload request from a user, the content upload request including content;
generating content management information based on information of the content;
determining the network server group and a specific storage server within the determined network server group to store the content based on the generated content management information;
storing the content in the determined storage server included in the determined network server group, wherein the content is managed by the determined network server group and is stored in a file unit, and is not stored in other storage servers within the determined network server group;
responsive to storing the content in the determined storage server or responsive to a predetermined time period, duplicating the content stored in the determined network server group to one or more different network server groups in the file unit;
calculating traffic for accessing the content, the traffic describing a number of requests for the content during a period of time;
selecting a network server group by considering both traffic among network server groups in which the content is stored and the content management information and providing the content stored in the selected network server group to the other users;
responsive to the traffic being greater than a threshold:
duplicating the stored content to an acceleration server in a file unit; and
providing the content in the file unit through the acceleration server in response to requests for accessing the content from one or more users,
wherein the content management information includes load information, data group information, file information, and replica state information.
6. The content management method of claim 5 , the data group information includes a data group where the content is stored, a location of the data group and location of a data node within the data group, operating status of the data group, a time when the content was stored and a data node identifier (ID) for the data node, a data group ID of the data group, or a network ID.
7. The content management method of claim 5 , wherein the replica state information includes a duplicated count and a time when the content was duplicated, a duplicated file ID, duplicated location information and distribution request information.
8. A file management system, the system comprising:
one or more network server groups, each network server group including a plurality of storage servers; and
a management server comprising:
a processor; and
a non-transitory computer-readable storage medium storing computer instructions configured to perform steps comprising:
receiving a content upload request from a user, the content upload request including content;
generating content management information based on information of the content;
selecting a network server group from the one or more network server groups and a specific storage server within the selected network server group in which to store the content based on the generated content management information,
storing the content in the storage server included in the selected network server group, wherein the content is managed by the selected network server group and is stored in a file unit, and is not stored in other storage servers within the selected network server group;
responsive to storing the content in the selected storage server or responsive to a predetermined time period, duplicating the content stored in the selected network server group to one or more different network server groups to duplicate the content in the one or more different network server groups in the file unit;
receiving a request for accessing the content from other users;
calculating traffic for accessing the content, the traffic describing a number of requests for the content during a period of time;
selecting a network server group by considering both traffic among network server groups in which the content is stored and the content management information and delivering the content stored in the selected network server group to the other users; and
an acceleration server comprising configured for:
a processor; and
a non-transitory computer-readable storage medium storing computer instructions configured to perform steps comprising:
storing the content responsive to the traffic being greater than a threshold in the file unit; and
providing the content in the file unit in response to requests for accessing the content from one or more users,
wherein the content management information includes load information, data group information, file information, and replica state information.
9. The file management system of claim 8 ,
wherein the data group information includes a data group where the content is stored, a location of the data group and location of a data node within the data group, operating status of the data group, a time when the content was stored and a data node identifier (ID) for the data node, a data group ID of the data group, or a network ID.
10. The file management system of claim 8 , wherein the replica state information includes a duplicated count and a time when the content was duplicated, a duplicated file ID, duplicated location information and distribution request information.
11. An apparatus comprising:
a processor; and
a non-transitory computer-readable storage medium storing computer instructions configured to perform a computer-implemented method, the method comprising:
grouping a plurality of storage servers into a network server group;
receiving a content upload request from a user, the content upload request including content;
generating content management information based on information of the content;
determining the network server group and a specific storage server within the determined network server group to store the content, based on the generated content management information;
storing the content in the determined storage server included in the determined network server group, wherein the content is managed by the determined network server group and is stored in a file unit, and is not stored in other storage servers within the determined network server group;
responsive to storing the content in the determined storage server or responsive to a predetermined time period, transmitting the content stored in the determined network server group to one or more different network server groups to duplicate the content in the one or more different network server groups in the file unit;
receiving a request for accessing the content from other users;
calculating traffic for accessing the content, the traffic describing a number of requests for the content during a period of time;
selecting a network server group by considering both traffic among network server groups in which the content is stored and the content management information and delivering the content stored in the selected network server group to the other users;
responsive to the traffic being greater than a threshold:
duplicating the content to an acceleration server in the file unit; and
providing the content in the file unit through the acceleration server in response to requests for accessing the content from the other users,
wherein the content management information includes load information, data group information, file information, and replica state information.
12. A non-transitory recording medium storing computer instructions configured to perform a computer-implemented method, the method comprising:
grouping a plurality of storage servers into a network server group;
receiving a content upload request from a user, the content upload request including content;
generating content management information based on information of the content;
determining a the network server group and a specific storage server within the determined network server group to store the content based on the generated content management information;
storing the content in the determined storage server included in the determined network server group, wherein the content is managed by the determined network server group and is stored in a file unit, and is not stored in other storage servers within the determined network server group;
responsive to storing the content in the determined storage server or responsive to a predetermined time period, transmitting the content stored in the determined network server group to one or more different network server groups to duplicate the content in the one or more different network server groups in the file unit;
receiving a request for accessing the content from other users;
calculating traffic for accessing the content, the traffic describing a number of requests for the content during a period of time;
selecting a network server group by considering both traffic among network server groups in which the content is stored and the content management information and delivering the content stored in the selected network server group to the other users;
responsive to the traffic being greater than a threshold:
duplicating the content to an acceleration server in the file unit; and
providing the content in the file unit through the acceleration server in response to requests for accessing the content from the other users,
wherein the content management information includes load information, data group information, file information, and replica state information.