Re: [IO-500] mdtest-hard issue

Dear Osama, thanks for pointing this out. I was not aware of this problem. I now made some modifications to mdtest to compensate for this limitation. Now it can limit the number of files per directories creating one extra top-level directory if needed. E.g. with a limit of 50 files and a total of 200 files, one would see in the top-level testing directory: #test-dir.0-0 #test-dir.0-1 #test-dir.0-2 #test-dir.0-3 The subdirectory tree of each directory is the complete tree as before under #test-dir.0-0. There is no synchronization when switching between these trees. I expect that this emulates very well the behavior of a single large directory but well there is no perfect solution. The stuff is already integrated into the testing branch of io-500-dev. To use it: In io-500-dev $ git checkout testing $ ./utilities/prepare.sh in io500.sh Line 85: io500_mdtest_hard_other_options="" Change that to: io500_mdtest_hard_other_options="-I 8000000" Which effectively will create a directory for each batch of 8M files. Note that the number of items (-n) must be a multiple of (-I) Note that that feature cannot be used with stonewalling at the moment! At some point, the mdtest code needs a redesign to allow such changes. Hence, set in L30: io500_stonewall_timer=0 If you want to give it a try, I would welcome it... Best, Julian 2018-07-26 3:05 GMT+01:00 Osamu Tatebe <tatebe(a)cs.tsukuba.ac.jp&gt;: -- Dr. Julian Kunkel Lecturer, Department of Computer Science +44 (0) 118 378 8218 http://www.cs.reading.ac.uk/ https://hps.vi4io.org/