Test Groups for Patch Testing: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
(List of test suites run for each test group required for patch landings.)
 
(Added optional test groups.)
(7 intermediate revisions by the same user not shown)
Line 1: Line 1:
There are seven mandatory test groups that every patch submitted to Lustre, community release, must pass in order for a patch to be considered for landing. In addition, there are two optional test groups that do not influence if a patch can land. These optional test groups will become madatory for patch landing soon and should be reviewed. The Lustre test suites that compose each test group are listed in the following table and run in the exact order below every time they are executed.
When a patch is submitted to be considered for inclusion in Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.
== Enforced Test Groups ==
There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.  
The Lustre test suites that compose each test group are listed in the following table and the test suites in each test group are run in the order below every time they are executed.


{| class="wikitable"
{| class="wikitable"
! style="text-align:left;" | review-ldiskfs
! style="text-align:left;" | review-ldiskfs
!review-zfs-part-1
!review-zfs
!review-zfs-part-2
|-
!review-dne-part-1
|sanity
|sanity-quota
|-
|lnet-selftest
|sanity-flr
|-
|
|replay-single
|-
|
|replay-ost-single
|-
|
|insanity
|}
 
All of the following test groups are run in a Lustre environment with DNE configured; all tests run with 2 MDSs with 2 MDTs each.
{| class="wikitable"
! style="text-align:left;" | review-dne-part-1
!review-dne-zfs-part-1
!review-dne-part-2
!review-dne-part-2
!review-dne-zfs-part-2
!review-dne-part-3
!review-dne-part-3
!review-dne-zfs-part-3
!review-dne-part-4
!review-dne-part-4
!review-dne-zfs-part-4
|-
|-
|sanity  
|sanity  
|runtests
|replay-single
|sanity  
|sanity  
|runtests
|runtests  
|runtests  
|conf-sanity
|conf-sanity  
|conf-sanity  
|mmp  
|mmp  
 
|mmp
|-
|-
|lnet-selftest
|sanityn
|sanity
|conf-sanity
|sanityn  
|sanityn  
|ost-pools
|ost-pools  
|ost-pools  
|  
|  
|
|replay-single
|replay-single  
|replay-single  
|-
|-
|racer
|sanityn
|recovery-small
|recovery-small
|recovery-small
|recovery-small
|sanity-hsm
|sanity-hsm
|sanity-hsm
|
|
|
|sanity-pfl
|sanity-pfl
|sanity-pfl
|-
|-
|
|lustre-rsync-test
|sanity-quota
|replay-ost-single
|lustre-rsync-test
|lustre-rsync-test
|sanity-scrub
|sanity-scrub
|sanity-scrub
|
|
|
|sanity-flr
|sanity-flr
|sanity-flr
|-
|-
|
|
|ost-pools
|insanity
|
|
|sanity-lfsck
|sanity-lfsck  
|sanity-lfsck  
|
|
|
|sanity-dom
|sanity-dom
|sanity-dom
|-
|-
|
|
|sanity-lfsck
|lustre-rsync-test
|
|
|sanity-sec  
|sanity-sec  
|sanity-sec
|
|
|
|sanity-quota
|sanity-quota
|sanity-quota
|-
|-
|
|
|sanity-hsm
|large-scale
|
|
|mds-survey
|mds-survey
|mds-survey
|
|
|
|replay-ost-single
|replay-ost-single
|replay-ost-single
|-
|-
|
|
|sanity-flr
|mds-survey
|
|
|large-scale
|large-scale
|large-scale
|
|
|
|insanity
|insanity
|insanity
|-
|
|
|sanity-pcc
|sanity-pcc
|
|
|
|
|}
|}


The optional test groups that are run for each patch are:
== Optional Test Groups ==
In addition to the enforced test groups, there are four optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.
 
{| class="wikitable"
{| class="wikitable"
! style="text-align:left;" |review-dne-zfs-part-1
! style="text-align:left;" | review-ldiskfs-arm
!review-dne-zfs-part-2
!review-dne-ssk
!review-dne-selinux
!review-dne-selinux-ssk
|-
|-
|sanity
|lnet-selftest
|runtests
|sanity
|-
|sanity
|sanityn
|sanity
|ost-pools
|-
|recovery-small
|sanity-hsm
|-
|-
|lustre-rsync-test
|sanity
|sanity-scrub
|recovery-small
|recovery-small
|recovery-small
|-
|-
|
|
|sanity-lfsck
|sanity-selinux
|sanity-sec
|sanity-selinux
|-
|-
|
|
|sanity-sec
|-
|
|
|mds-survey
|-
|
|
|large-scale
|sanity-sec
|}
|}

Revision as of 15:28, 22 October 2019

When a patch is submitted to be considered for inclusion in Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.

Enforced Test Groups

There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch. The Lustre test suites that compose each test group are listed in the following table and the test suites in each test group are run in the order below every time they are executed.

review-ldiskfs review-zfs
sanity sanity-quota
lnet-selftest sanity-flr
replay-single
replay-ost-single
insanity

All of the following test groups are run in a Lustre environment with DNE configured; all tests run with 2 MDSs with 2 MDTs each.

review-dne-part-1 review-dne-zfs-part-1 review-dne-part-2 review-dne-zfs-part-2 review-dne-part-3 review-dne-zfs-part-3 review-dne-part-4 review-dne-zfs-part-4
sanity sanity runtests runtests conf-sanity conf-sanity mmp mmp
sanityn sanityn ost-pools ost-pools replay-single replay-single
recovery-small recovery-small sanity-hsm sanity-hsm sanity-pfl sanity-pfl
lustre-rsync-test lustre-rsync-test sanity-scrub sanity-scrub sanity-flr sanity-flr
sanity-lfsck sanity-lfsck sanity-dom sanity-dom
sanity-sec sanity-sec sanity-quota sanity-quota
mds-survey mds-survey replay-ost-single replay-ost-single
large-scale large-scale insanity insanity
sanity-pcc sanity-pcc

Optional Test Groups

In addition to the enforced test groups, there are four optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

review-ldiskfs-arm review-dne-ssk review-dne-selinux review-dne-selinux-ssk
lnet-selftest sanity sanity sanity
sanity recovery-small recovery-small recovery-small
sanity-selinux sanity-sec sanity-selinux
sanity-sec
Retrieved from "http://wiki.lustre.org/index.php?title=Test_Groups_for_Patch_Testing&oldid=3697"