File:LUG2019-PFL DoM DNE Working Together-Fragalla.pdf

In HPC, when using shared storage, mixed workloads can have a big impact on I/O performance causing considerable slowdown when running small I/O alongside large I/O on the same storage system. With the increase adoption of Flash, and new features in Lustre, such as Progressive File Layout (PFL) and Data on Metadata (DoM), Storage can be tuned to automatically isolate different workloads to different storage media to accelerate small I/O without disrupting large sequential I/O performance, using the right mix of Flash and Disk transparently. In this presentation, Cray will share real benchmark results on the impacts of the “Noisy Neighbor” application has on sequential I/O, and with the right storage tuning and flash capacity, how to optimize the storage to meet the demanding workloads in HPC to accelerate performance for a mixed workload environment.