File storage and computer system that creates new chunks after an update
In file storage, a CPU is configured to: divide a file into a plurality of chunks, execute encoding processing on at least one of the chunks to obtain an encoded chunk, and store in cloud storage a plurality of chunks of the file including the encoded chunk; acquire, when receiving a read command of which target is data of a part of a file stored in the cloud storage, a read target chunk including data, which is a target of the read command, from the cloud storage; and execute, when an encoded chunk is included in the read target chunk, decoding processing on the encoded chunk, identify data that is a read target from the read target chunk including the chunk having been subjected to decoding processing, and hand over the identified data to a command source of the read command.
1. A file storage, which is coupled to a data storage, comprising:
a processor; and
a memory coupled to the processor, the memory storing instructions that when executed by the processor configure the processor to:
manage a file,
divide the file into a plurality of chunks, execute encoding processing on at least one of the chunks to obtain an encoded chunk, and store in the data storage the plurality of chunks of the file including the encoded chunk,
acquire, upon receiving a read command of which a target is data of a part of a file stored in the data storage, a plurality of read target chunks that include data which is a target of the read command, from the data storage,
execute, upon determining an encoded chunk is included in the read target chunk, decoding processing on the encoded chunk, identify data, which is a read target, from the read target chunk including the chunk having been subjected to decoding processing, and transfer the identified data to a command source of the read command,
after acquiring the read target chunks, determine an update difference of the read target chunks and divide the plurality of read target chunks including the updated difference to create a plurality of new chunks and create files respectively corresponding to the new chunks, and
store the new chunks in the data storage to replace the read target chunks.
2. The file storage according to claim 1 , further comprising a storage unit configured to store encoding processing information relating to whether or not encoding processing is to be performed when storing each of the chunks in the data storage, wherein
the processor is configured to determine execution of the encoding processing on the chunk to be stored in the data storage on the basis of the encoding processing information with respect to the chunk.
3. The file storage according to claim 1 , wherein the processor is configured to
divide the file into a plurality of chunks,
store in a storage unit a chunk map indicating positional information that identifies a position of each of the divided chunks in the file, and
identify, when receiving the read command, a read target chunk on the basis of the chunk map and acquire the identified read target chunk from the data storage.
4. The file storage according to claim 1 , wherein the processor is configured to divide the file so that a size of each chunk is within a predetermined range.
5. The file storage according to claim 1 , wherein the processor is configured to store in the data storage each of the chunks constituting the file independently.
6. The file storage according to claim 1 , wherein the processor is configured to couple all of the chunks constituting the file and store the coupled chunks in the data storage.
7. The file storage according to claim 6 , wherein the processor is configured to
identify positional information after the encoding processing on all of the chunks constituting the file, store in a storage unit a chunk map including the positional information after the encoding processing on each of the chunks, and
identify the read target chunk from the coupled chunks on the basis of the chunk map.
8. The file storage according to claim 1 , wherein the encoding processing is at least one of compression processing for compressing data, encryption processing for encrypting data, processing for calculating and adding an error correction code, and processing for calculating and adding an erasure correction code.
9. A computer system, comprising:
a data storage configured to store data;
a file storage including a processor and a memory coupled to the processor, the memory storing instructions that when executed by the processor configure the processor to:
manage a file,
divide the file into a plurality of chunks, execute encoding processing on at least one of the chunks to obtain an encoded chunk, and store in the data storage a plurality of chunks of the file including the encoded chunk,
acquire, upon receiving a read command of which target is data of a part of a file stored in the data storage, a plurality of read target chunks that include data which is a target of the read command, from the data storage,
execute, upon determining an encoded chunk is included in the read target chunk, decoding processing on the encoded chunk, identify data, which is a read target, from the read target chunk including the chunk having been subjected to decoding processing, and transfer the identified data to a command source of the read command,
after acquiring the read target chunks, determine an update difference of the read target chunks and divide the plurality of read target chunks including the updated difference to create a plurality of new chunks and create files respectively corresponding to the new chunks, and
store the new chunks in the data storage to replace the read target chunks.
10. The file storage according to claim 1 ,
wherein at least two of the created plurality of new chunks include updated portions.
11. The computer system according to claim 1 ,
wherein at least two of the created plurality of new chunks include updated portions.