Re: File system for scratch space (in HPC cluster)

From: Boaz Harrosh
Date: Thu Oct 24 2019 - 11:01:12 EST


On 24/10/2019 17:55, Theodore Y. Ts'o wrote:
> On Thu, Oct 24, 2019 at 12:43:40PM +0200, Paul Menzel wrote:
>>
>> In our cluster, we offer scratch space for temporary files. As
>> these files are temporary, we do not need any safety
>> requirements â especially not those when the system crashes or
>> shuts down. So no `sync` is for example needed.
>>
>> Are there file systems catering to this need? I couldnât find
>> any? Maybe I missed some options for existing file systems.
>
> You could use ext4 in nojournal mode. If you want to make sure that
> fsync() doesn't force a cache flush, you can mount with the nobarrier
> mount option.
>

And open the file with O_TMPFILE|O_EXCL so there is no metadata as well.

I think xfs for O_TMPFILE|O_EXCL does not do any fsync, but I'm
not sure

> - Ted
>