Hi,

 

The deadline extension / BOF postponement is definitely welcome on our end 😊

As has been discussed here and on the slack channel, we were struggling after the official announcement to get the new benchmark running.

We did make it work finally earlier this morning with a bunch of patches to the different layers (io500-app, ior/mdtest, and the respective drivers); however given the nature of production systems, resetting things up there is a different story vs. trying it on a local setup where things are not available on demand.

 

For the concrete action, I think the timelines proposed make a lot of sense, but IMO the 6 week fixed period could be a little longer since production systems don’t have a lot of maintenance windows where the cluster can be reserved fully for a full run. I would prefer to see 2+ months for that period, but I do understand the challenge on the committee members and the community to do the testing that is required to work out all the quirks with the candidate benchmark.

Anyway, having known and fixed dates for the benchmark release, testing phase, and lock phase regardless of the time span in between is a good measure to avoid surprises.

 

Thanks,

Mohamad

 

From: IO-500 <io-500-bounces@vi4io.org> on behalf of committee--- via IO-500 <io-500@vi4io.org>
Reply-To: "committee@io500.org" <committee@io500.org>
Date: Friday, May 29, 2020 at 5:32 PM
To: "io-500@vi4io.org" <io-500@vi4io.org>
Subject: [IO-500] Proposal of possible postponement of ISC20 IO500 BOF

 

Dear IO500 Community,


We have heard your concerns about the late announcement of changes and have already taken one concrete action and are considering a second but we want your feedback about it first.

We are considering postponing our BoF, and our deadline, by one month. Since we are not tied to ISC this year, we have this latitude. Are there any objections from the community to this postponement?

For our concrete action, we will shift future schedules so that three months from an event we release a candidate benchmark and the likely rules set for public testing. Then commit to 6 weeks before the event to finalize the benchmark and rules. Then things are locked until after the event.

Please let us know how you feel about the possible postponement and please do know how deeply we value you all in our community that makes everything we do possible.

Based on the feedback received, we will make and announce our final decision by EOD Sunday AOE.

Thanks,

The IO500 Committee