Test Groups for Patch Testing: Difference between revisions
(List of test suites run for each test group required for patch landings.) |
(Update test groups and test suites in each) |
||
Line 1: | Line 1: | ||
There are | When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and others may fail, optional test groups. | ||
== Enforced Test Groups == | |||
There are eight test groups that every patch submitted to Lustre must pass in order for a patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch. | |||
The Lustre test suites that compose each test group are listed in the following table and run in the order below every time they are executed. | |||
{| class="wikitable" | {| class="wikitable" | ||
! style="text-align:left;" | review-ldiskfs | ! style="text-align:left;" | review-ldiskfs | ||
!review-zfs | !review-zfs | ||
!review-dne-part-1 | !review-dne-part-1 | ||
!review-dne-zfs-part-1 | |||
!review-dne-part-2 | !review-dne-part-2 | ||
!review-dne-zfs-part-2 | |||
!review-dne-part-3 | !review-dne-part-3 | ||
!review-dne-part-4 | !review-dne-part-4 | ||
|- | |- | ||
|sanity | |sanity | ||
| | |sanity-quota | ||
| | |sanity | ||
|sanity | |sanity | ||
|runtests | |||
|runtests | |runtests | ||
|conf-sanity | |conf-sanity | ||
Line 20: | Line 25: | ||
|- | |- | ||
|lnet-selftest | |lnet-selftest | ||
|sanity | |sanity-flr | ||
| | |sanityn | ||
|sanityn | |sanityn | ||
|ost-pools | |||
|ost-pools | |ost-pools | ||
| | | | ||
Line 28: | Line 34: | ||
|- | |- | ||
|racer | |racer | ||
| | |replay-single | ||
|recovery-small | |recovery-small | ||
|recovery-small | |recovery-small | ||
|sanity-hsm | |||
|sanity-hsm | |sanity-hsm | ||
| | | | ||
Line 36: | Line 43: | ||
|- | |- | ||
| | | | ||
|sanity | |conf-sanity | ||
| | |lustre-rsync-test | ||
|lustre-rsync-test | |lustre-rsync-test | ||
|sanity-scrub | |||
|sanity-scrub | |sanity-scrub | ||
| | | | ||
Line 44: | Line 52: | ||
|- | |- | ||
| | | | ||
|ost- | |replay-ost-single | ||
| | | | ||
| | | | ||
|sanity-lfsck | |||
|sanity-lfsck | |sanity-lfsck | ||
| | | | ||
Line 52: | Line 61: | ||
|- | |- | ||
| | | | ||
| | |insanity | ||
| | | | ||
| | | | ||
|sanity-sec | |||
|sanity-sec | |sanity-sec | ||
| | | | ||
Line 60: | Line 70: | ||
|- | |- | ||
| | | | ||
| | | | ||
| | |||
| | |||
|mds-survey | |||
|mds-survey | |mds-survey | ||
| | | | ||
Line 68: | Line 79: | ||
|- | |- | ||
| | | | ||
| | | | ||
| | | | ||
| | | | ||
|large-scale | |||
|large-scale | |large-scale | ||
| | | | ||
Line 76: | Line 88: | ||
|} | |} | ||
== Optional Test Groups == | |||
In addition to the enforced test groups, there are two optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures. | |||
The Lustre test suites that compose each optional test group are: | |||
{| class="wikitable" | {| class="wikitable" | ||
! style="text-align:left;" |review-dne-zfs-part- | ! style="text-align:left;" |review-dne-zfs-part-3 | ||
!review-dne-zfs-part- | !review-dne-zfs-part-4 | ||
|- | |- | ||
|sanity | |conf-sanity | ||
| | |mmp | ||
|- | |- | ||
| | | | ||
| | |replay-single | ||
|- | |- | ||
| | | | ||
|sanity- | |sanity-pfl | ||
|- | |- | ||
| | | | ||
|sanity- | |sanity-flr | ||
|- | |- | ||
| | | | ||
|sanity- | |sanity-dom | ||
|- | |- | ||
| | | | ||
|sanity- | |sanity-quota | ||
|- | |- | ||
| | | | ||
| | |replay-ost-single | ||
|- | |- | ||
| | | | ||
| | |insanity | ||
|} | |} |
Revision as of 15:54, 28 August 2018
When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and others may fail, optional test groups.
Enforced Test Groups
There are eight test groups that every patch submitted to Lustre must pass in order for a patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch. The Lustre test suites that compose each test group are listed in the following table and run in the order below every time they are executed.
review-ldiskfs | review-zfs | review-dne-part-1 | review-dne-zfs-part-1 | review-dne-part-2 | review-dne-zfs-part-2 | review-dne-part-3 | review-dne-part-4 |
---|---|---|---|---|---|---|---|
sanity | sanity-quota | sanity | sanity | runtests | runtests | conf-sanity | mmp |
lnet-selftest | sanity-flr | sanityn | sanityn | ost-pools | ost-pools | replay-single | |
racer | replay-single | recovery-small | recovery-small | sanity-hsm | sanity-hsm | sanity-pfl | |
conf-sanity | lustre-rsync-test | lustre-rsync-test | sanity-scrub | sanity-scrub | sanity-flr | ||
replay-ost-single | sanity-lfsck | sanity-lfsck | sanity-dom | ||||
insanity | sanity-sec | sanity-sec | sanity-quota | ||||
mds-survey | mds-survey | replay-ost-single | |||||
large-scale | large-scale | insanity |
Optional Test Groups
In addition to the enforced test groups, there are two optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.
The Lustre test suites that compose each optional test group are:
review-dne-zfs-part-3 | review-dne-zfs-part-4 |
---|---|
conf-sanity | mmp |
replay-single | |
sanity-pfl | |
sanity-flr | |
sanity-dom | |
sanity-quota | |
replay-ost-single | |
insanity |