Test Descriptions: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 8: Line 8:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/conf-sanity.sh conf-sanity]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/conf-sanity.sh conf-sanity]
|
|<span style="color:green">Active</span>
|A set of unit tests that verify the configuration tools, and runs Lustre with multiple different setups to ensure correct operation in unusual system configurations.  
|A set of unit tests that verify the configuration tools, and runs Lustre with multiple different setups to ensure correct operation in unusual system configurations.  
|-
|-
Line 16: Line 16:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/insanity.sh insanity]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/insanity.sh insanity]
|
|<span style="color:green">Active</span>
|A set of tests that verify the multiple concurrent failure conditions.  
|A set of tests that verify the multiple concurrent failure conditions.  
|-
|-
Line 24: Line 24:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/lfsck.sh lfsck]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/lfsck.sh lfsck]
|deprecated
|<span style="color:red">Deprecated</span>
|Tests e2fsck and lfsck to detect and fix filesystem corruption. Use sanity-lfsck instead.  
|Tests e2fsck and lfsck to detect and fix filesystem corruption. Use sanity-lfsck instead.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/lnet-selftest.sh lnet-selftest]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/lnet-selftest.sh lnet-selftest]
|
|<span style="color:green">Active</span>
|Runs LNET self test on hosts defined in test configuration.
|Runs LNET self test on hosts defined in test configuration.
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/lustre-rsync-test.sh lustre-rsync-test]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/lustre-rsync-test.sh lustre-rsync-test]
|
|<span style="color:green">Active</span>
|Verifies the lustre_rsync (replication) feature.  
|Verifies the lustre_rsync (replication) feature.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/metadata-updates.sh metadata-updates]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/metadata-updates.sh metadata-updates]
|
|<span style="color:green">Active</span>
| Tests that metadata updates are properly completed when multiple clients create/delete files and modify the attributes of files.
| Tests that metadata updates are properly completed when multiple clients create/delete files and modify the attributes of files.
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/mmp.sh mmp]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/mmp.sh mmp]
|
|<span style="color:green">Active</span>
|Tests for multiple mount protection (MMP) feature.
|Tests for multiple mount protection (MMP) feature.
|-
|-
Line 48: Line 48:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/ost-pools.sh ost-pools]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/ost-pools.sh ost-pools]
|
|<span style="color:green">Active</span>
|A tests that exercises the OST pools feature.
|A tests that exercises the OST pools feature.
|-
|-
Line 56: Line 56:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/racer.sh racer]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/racer.sh racer]
|
|<span style="color:green">Active</span>
|Tests for filesystem race conditions by concurrently creating, moving, deleting, etc. a set of files.  
|Tests for filesystem race conditions by concurrently creating, moving, deleting, etc. a set of files.  
|-
|-
Line 72: Line 72:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/recovery-small.sh recovery-small]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/recovery-small.sh recovery-small]
|
|<span style="color:green">Active</span>
|A set of unit tests that verify RPC replay after communications failure.  
|A set of unit tests that verify RPC replay after communications failure.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-dual.sh replay-dual]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-dual.sh replay-dual]
|
|<span style="color:green">Active</span>
|A set of unit tests that verify the recovery from two clients after server failure.  
|A set of unit tests that verify the recovery from two clients after server failure.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-ost-single.sh replay-ost-single]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-ost-single.sh replay-ost-single]
|
|<span style="color:green">Active</span>
| A set of unit tests that verify recovery after OST failure.  
| A set of unit tests that verify recovery after OST failure.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-single.sh replay-single]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-single.sh replay-single]
|
|<span style="color:green">Active</span>
| A set of unit tests that verify recovery after MDS failure.  
| A set of unit tests that verify recovery after MDS failure.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-vbr.sh replay-vbr]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/replay-vbr.sh replay-vbr]
|
|<span style="color:green">Active</span>
|Verifies version-based recovery feature.  
|Verifies version-based recovery feature.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/runtests runtests]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/runtests runtests]
|
|<span style="color:green">Active</span>
|Simple basic regression test that verifies data persistence across write, unmount, and remount. This is one of the few tests that verifies data integrity across a full filesystem shutdown and remount, unlike many tests which at most only verify the existence/size of files.  
|Simple basic regression test that verifies data persistence across write, unmount, and remount. This is one of the few tests that verifies data integrity across a full filesystem shutdown and remount, unlike many tests which at most only verify the existence/size of files.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity.sh sanity]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity.sh sanity]
|
|<span style="color:green">Active</span>
|A set of regression tests that verify operation under normal operating conditions. This tests a large number of unusual operations that have previously caused functional or data correctness issues with Lustre. Some of the tests are Lustre specific, and hook into the Lustre fault injection framework using the "lctl set_param fail_loc=X" command to activate triggers in the code to simulate unusual operating conditions that would otherwise be difficult or impossible to simulate.  
|A set of regression tests that verify operation under normal operating conditions. This tests a large number of unusual operations that have previously caused functional or data correctness issues with Lustre. Some of the tests are Lustre specific, and hook into the Lustre fault injection framework using the "lctl set_param fail_loc=X" command to activate triggers in the code to simulate unusual operating conditions that would otherwise be difficult or impossible to simulate.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanityn.sh sanityn]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanityn.sh sanityn]
|
|<span style="color:green">Active</span>
|Tests that verify operations from two clients under normal operating conditions. This is done by mounting the same filesystem twice on a single client, in order to allow a single script/program to execute and verify filesystem operations on multiple "clients" without having to be a distributed program itself.
|Tests that verify operations from two clients under normal operating conditions. This is done by mounting the same filesystem twice on a single client, in order to allow a single script/program to execute and verify filesystem operations on multiple "clients" without having to be a distributed program itself.
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-benchmark.sh sanity-benchmark]
|<span style="color:green">Active</span>
|Test basic functionality of the filesystem using simple benchmarks.
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-gss.sh sanity-gss]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-gss.sh sanity-gss]
|
|<span style="color:green">Active</span>
|Verifies GSSAPI features.
|Verifies GSSAPI features.
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-hsm.sh sanity-hsm]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-hsm.sh sanity-hsm]
|
|<span style="color:green">Active</span>
|Sanity test for HSM feature.
|Sanity test for HSM feature.
|-
|-
Line 116: Line 120:
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-lfsck.sh sanity-lfsck]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-lfsck.sh sanity-lfsck]
|
|<span style="color:green">Active</span>
|Sanity test for lfsck
|Sanity test for lfsck
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-quota.sh sanity-quota]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-quota.sh sanity-quota]
|
|<span style="color:green">Active</span>
|A set of tests that verify filesystem quotas.  
|A set of tests that verify filesystem quotas.  
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-scrub.sh sanity-scrub]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-scrub.sh sanity-scrub]
|
|<span style="color:green">Active</span>
|
|
|-
|-
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-sec.sh sanity-sec]
|[http://git.whamcloud.com/fs/lustre-release.git/blob/HEAD:/lustre/tests/sanity-sec.sh sanity-sec]
|
|<span style="color:green">Active</span>
|Verifies Lustre identity features. , including UID/GID mapping
|Verifies Lustre identity features. , including UID/GID mapping
|}
|}
Line 151: Line 155:
|-
|-
|obdfilter-survey
|obdfilter-survey
|<span style="color:green">Active</span>
|
|
|-
|-
|sgpdd-survey
|sgpdd-survey
|<span style="color:green">Active</span>
|
|
|}
|}

Revision as of 06:48, 29 April 2015

The acceptance-small.sh script is a wrapper around auster that runs the test group 'regression' unless a test is specified.

Lustre Regression and Feature Tests

Name Status Test Description
conf-sanity Active A set of unit tests that verify the configuration tools, and runs Lustre with multiple different setups to ensure correct operation in unusual system configurations.
dne_sanity Run sanity parallel on different directories at the same time.
insanity Active A set of tests that verify the multiple concurrent failure conditions.
large-scale Large-scale tests that verify version-based recovery features.
lfsck Deprecated Tests e2fsck and lfsck to detect and fix filesystem corruption. Use sanity-lfsck instead.
lnet-selftest Active Runs LNET self test on hosts defined in test configuration.
lustre-rsync-test Active Verifies the lustre_rsync (replication) feature.
metadata-updates Active Tests that metadata updates are properly completed when multiple clients create/delete files and modify the attributes of files.
mmp Active Tests for multiple mount protection (MMP) feature.
performance-sanity Performance mdsrate tests (small file create/open/delete, large file create/open/delete, lookup rate 10M file dir, lookup rate 10M file 10 dir, getattr small file, and getattr large files).
ost-pools Active A tests that exercises the OST pools feature.
parallel-scale Runs functional tests (connectathon, cascading_rw, write_disjoint, write_append_truncate, parallel_grouplock, statahead), performance tests (IOR, compilebench and metabench), and a stress test (simul).
racer Active Tests for filesystem race conditions by concurrently creating, moving, deleting, etc. a set of files.
recovery-double-scale Failover test for all pair-wise combinations of node failures.
recovery-mds-scale The server failover test: for a duration of 24 hours, repeatedly fail over a random facet (MDS or OST) at 10 minute intervals and verify that no application errors occur.
recovery-random-scale Verifies client failure not affecting other clients.
recovery-small Active A set of unit tests that verify RPC replay after communications failure.
replay-dual Active A set of unit tests that verify the recovery from two clients after server failure.
replay-ost-single Active A set of unit tests that verify recovery after OST failure.
replay-single Active A set of unit tests that verify recovery after MDS failure.
replay-vbr Active Verifies version-based recovery feature.
runtests Active Simple basic regression test that verifies data persistence across write, unmount, and remount. This is one of the few tests that verifies data integrity across a full filesystem shutdown and remount, unlike many tests which at most only verify the existence/size of files.
sanity Active A set of regression tests that verify operation under normal operating conditions. This tests a large number of unusual operations that have previously caused functional or data correctness issues with Lustre. Some of the tests are Lustre specific, and hook into the Lustre fault injection framework using the "lctl set_param fail_loc=X" command to activate triggers in the code to simulate unusual operating conditions that would otherwise be difficult or impossible to simulate.
sanityn Active Tests that verify operations from two clients under normal operating conditions. This is done by mounting the same filesystem twice on a single client, in order to allow a single script/program to execute and verify filesystem operations on multiple "clients" without having to be a distributed program itself.
sanity-benchmark Active Test basic functionality of the filesystem using simple benchmarks.
sanity-gss Active Verifies GSSAPI features.
sanity-hsm Active Sanity test for HSM feature.
sanity-krb5 Verifies Kerberos features.
sanity-lfsck Active Sanity test for lfsck
sanity-quota Active A set of tests that verify filesystem quotas.
sanity-scrub Active
sanity-sec Active Verifies Lustre identity features. , including UID/GID mapping

Benchmark Scripts

Name Status Script Description
bonnie Bonnie++ benchmark for creation, reading, and deleting many small files. (Source HPDD Wiki Auster)
dbench Dbench benchmark for simulating N clients to produce the filesystem load. (Source HPDD Wiki Auster)
iozone Iozone benchmark for generating and measuring a variety of file operations. (Source HPDD Wiki Auster)
obdfilter-survey Active
sgpdd-survey Active

Auxiliary Test

Name Status Script Description
fsx The file system exerciser was developed outside of Lustre and is intended to stress test unusual IO and file operations. It does buffered and mmap reads and writes with random size and offset, truncate, open, close on a file. It verifies data integrity after each step. A lustre-developed extension allows fsx to run against multiple mountpoints to verify distributed IO operation correctness. (Source HPDD Wiki Auster)