Difference between revisions of "Test Groups for Patch Testing"

From Lustre Wiki
Jump to navigation Jump to search
(List of test suites run for each test group required for patch landings.)
 
(Update test groups and test suites in each)
Line 1: Line 1:
There are seven mandatory test groups that every patch submitted to Lustre, community release, must pass in order for a patch to be considered for landing. In addition, there are two optional test groups that do not influence if a patch can land. These optional test groups will become madatory for patch landing soon and should be reviewed. The Lustre test suites that compose each test group are listed in the following table and run in the exact order below every time they are executed.
+
When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and others may fail, optional test groups.
 +
== Enforced Test Groups ==
 +
There are eight test groups that every patch submitted to Lustre must pass in order for a patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.  
 +
The Lustre test suites that compose each test group are listed in the following table and run in the order below every time they are executed.
  
 
{| class="wikitable"
 
{| class="wikitable"
 
! style="text-align:left;" | review-ldiskfs
 
! style="text-align:left;" | review-ldiskfs
!review-zfs-part-1
+
!review-zfs
!review-zfs-part-2
 
 
!review-dne-part-1
 
!review-dne-part-1
 +
!review-dne-zfs-part-1
 
!review-dne-part-2
 
!review-dne-part-2
 +
!review-dne-zfs-part-2
 
!review-dne-part-3
 
!review-dne-part-3
 
!review-dne-part-4
 
!review-dne-part-4
 
|-
 
|-
 
|sanity  
 
|sanity  
|runtests
+
|sanity-quota
|replay-single
+
|sanity
 
|sanity  
 
|sanity  
 +
|runtests
 
|runtests  
 
|runtests  
 
|conf-sanity  
 
|conf-sanity  
Line 20: Line 25:
 
|-
 
|-
 
|lnet-selftest  
 
|lnet-selftest  
|sanity  
+
|sanity-flr
|conf-sanity
+
|sanityn
 
|sanityn  
 
|sanityn  
 +
|ost-pools
 
|ost-pools  
 
|ost-pools  
 
|  
 
|  
Line 28: Line 34:
 
|-
 
|-
 
|racer  
 
|racer  
|sanityn
+
|replay-single
 
|recovery-small
 
|recovery-small
 
|recovery-small
 
|recovery-small
 +
|sanity-hsm
 
|sanity-hsm
 
|sanity-hsm
 
|
 
|
Line 36: Line 43:
 
|-
 
|-
 
|
 
|
|sanity-quota
+
|conf-sanity  
|replay-ost-single
+
|lustre-rsync-test
 
|lustre-rsync-test
 
|lustre-rsync-test
 +
|sanity-scrub
 
|sanity-scrub
 
|sanity-scrub
 
|
 
|
Line 44: Line 52:
 
|-
 
|-
 
|
 
|
|ost-pools
+
|replay-ost-single
|insanity
+
|
 
|
 
|
 +
|sanity-lfsck
 
|sanity-lfsck  
 
|sanity-lfsck  
 
|
 
|
Line 52: Line 61:
 
|-
 
|-
 
|
 
|
|sanity-lfsck
+
|insanity
|lustre-rsync-test
+
|
 
|
 
|
 +
|sanity-sec
 
|sanity-sec  
 
|sanity-sec  
 
|
 
|
Line 60: Line 70:
 
|-
 
|-
 
|
 
|
|sanity-hsm
 
|large-scale
 
 
|
 
|
 +
|
 +
|
 +
|mds-survey
 
|mds-survey
 
|mds-survey
 
|
 
|
Line 68: Line 79:
 
|-
 
|-
 
|
 
|
|sanity-flr
+
|
|mds-survey
+
|
 
|
 
|
 +
|large-scale
 
|large-scale
 
|large-scale
 
|
 
|
Line 76: Line 88:
 
|}
 
|}
  
The optional test groups that are run for each patch are:
+
== Optional Test Groups ==
 +
In addition to the enforced test groups, there are two optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.
 +
 
 +
The Lustre test suites that compose each optional test group are:
 
{| class="wikitable"
 
{| class="wikitable"
! style="text-align:left;" |review-dne-zfs-part-1
+
! style="text-align:left;" |review-dne-zfs-part-3
!review-dne-zfs-part-2
+
!review-dne-zfs-part-4
 
|-
 
|-
|sanity  
+
|conf-sanity  
|runtests
+
|mmp
 
|-
 
|-
|sanityn
+
|
|ost-pools
+
|replay-single
 
|-
 
|-
|recovery-small
+
|
|sanity-hsm
+
|sanity-pfl
 
|-
 
|-
|lustre-rsync-test
+
|
|sanity-scrub
+
|sanity-flr
 
|-
 
|-
 
|
 
|
|sanity-lfsck
+
|sanity-dom
 
|-
 
|-
 
|
 
|
|sanity-sec
+
|sanity-quota
 
|-
 
|-
 
|
 
|
|mds-survey
+
|replay-ost-single
 
|-
 
|-
 
|
 
|
|large-scale
+
|insanity
 
|}
 
|}

Revision as of 14:54, 28 August 2018

When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and others may fail, optional test groups.

Enforced Test Groups

There are eight test groups that every patch submitted to Lustre must pass in order for a patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch. The Lustre test suites that compose each test group are listed in the following table and run in the order below every time they are executed.

review-ldiskfs review-zfs review-dne-part-1 review-dne-zfs-part-1 review-dne-part-2 review-dne-zfs-part-2 review-dne-part-3 review-dne-part-4
sanity sanity-quota sanity sanity runtests runtests conf-sanity mmp
lnet-selftest sanity-flr sanityn sanityn ost-pools ost-pools replay-single
racer replay-single recovery-small recovery-small sanity-hsm sanity-hsm sanity-pfl
conf-sanity lustre-rsync-test lustre-rsync-test sanity-scrub sanity-scrub sanity-flr
replay-ost-single sanity-lfsck sanity-lfsck sanity-dom
insanity sanity-sec sanity-sec sanity-quota
mds-survey mds-survey replay-ost-single
large-scale large-scale insanity

Optional Test Groups

In addition to the enforced test groups, there are two optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

The Lustre test suites that compose each optional test group are:

review-dne-zfs-part-3 review-dne-zfs-part-4
conf-sanity mmp
replay-single
sanity-pfl
sanity-flr
sanity-dom
sanity-quota
replay-ost-single
insanity