View source for LFSCK Phase 4 - Performance and Cleanups Scope Statement

=Problem Statement=

This subproject ensures that LFSCK is ready to be used in production environments. It will characterize and optimize the performance of the features implemented in previous phases, ensure that the performance impact of background scrubbing is sufficiently controlled, and determine whether Lustre protocol modifications (e.g. support for aggregate RPCs) are required. Administrative controls and monitoring will be finalized and documentation and procedures will be provided for system administrators.

=Project Goals=

# Ensure performance impact of background scrubbing can be controlled.
# Finalize administrative controls.
# Document procedures for LFSCK Operations.
# Implement performance optimizations.

=In-Scope=

* Improve inode iteration for uninitialized groups.
* Improve OI scrub trigger strategy: do not trigger urgent OI scrub on the whole system if only few inconsistent OI entries are found.
* Optimize ldlm lock used by LFSCK.
* Record linkEA verification history in RAM.
* Update documentation.
* Review command line options.

=Out of Scope=

* '''e2fsck''' characterization and optimization. External development and optimization that has been done on e2fsck since the time the proposal was written have improved e2fsck performance already, and further optimization is expected to be of significant complexity and is unlikely to yield the best return within the project constraints.

=Key Deliverables=

* Solution Architecture
* Fixing previously-reported performance related issues, as well as other performance and stability issues found during this development phase:
** [https://jira.hpdd.intel.com/browse/LU-1452 LU-1452]
** [https://jira.hpdd.intel.com/browse/LU-1453 LU-1453]
** [https://jira.hpdd.intel.com/browse/LU-5682 LU-5682]
** [https://jira.hpdd.intel.com/browse/LU-5820 LU-5820]
** [https://jira.hpdd.intel.com/browse/LUDOC-259 LUDOC-259]
* Performance Benchmarks
[[Category:LFSCK]]