Test Groups for Patch Testing - Revision history

Jnunez: Update all test sessions with correct test suites.

2021-11-15T21:41:54Z

Update all test sessions with correct test suites.

Jnunez: Updated review-ldiskfs and review-zfs

2021-11-12T17:54:33Z

Updated review-ldiskfs and review-zfs

← Older revision		Revision as of 10:54, 12 November 2021
Line 1:		Line 1:
	When a patch is submitted to be considered for inclusion in Lustre, automated testing is run against a build of Lustre with the submitted patch. ~~Some~~ of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.		When a patch is submitted to be considered for inclusion in Lustre, automated testing is run against a build of Lustre with the submitted patch. For a patch to land, some of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.
	== Enforced Test Groups ==		== Enforced Test Groups ==
	There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.		There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.
Line 8:		Line 8:
	!review-zfs		!review-zfs
	\|-		\|-
	\|sanity		\|sanity-lnet
	\|sanity-quota		\|sanity-quota
	\|-		\|-
	\|~~lnet-selftest~~		\|sanity
	\|sanity-flr		\|sanity-flr
	\|-		\|-
	\|		\|lnet-selftest
	\|replay-single		\|replay-single
	\|-		\|-
Line 22:		Line 22:
	\|		\|
	\|insanity		\|insanity
			\|-
			\|
			\|sanity-lsnapshot
	\|}		\|}

Jnunez: Added optional test groups.

2019-10-22T22:28:29Z

Added optional test groups.

← Older revision		Revision as of 15:28, 22 October 2019
Line 1:		Line 1:
	When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.		When a patch is submitted to be considered for inclusion in Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.
	== Enforced Test Groups ==		== Enforced Test Groups ==
	There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.		There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.
Line 6:		Line 6:
	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \| review-ldiskfs		! style="text-align:left;" \| review-ldiskfs
	~~!review-ldiskfs-arm~~
	!review-zfs		!review-zfs
	\|-		\|-
	~~\|sanity~~
	\|sanity		\|sanity
	\|sanity-quota		\|sanity-quota
	\|-		\|-
	~~\|lnet-selftest~~
	\|lnet-selftest		\|lnet-selftest
	\|sanity-flr		\|sanity-flr
	\|-		\|-
	\|
	\|		\|
	\|replay-single		\|replay-single
	\|-		\|-
	\|
	\|		\|
	\|replay-ost-single		\|replay-ost-single
	\|-		\|-
	\|
	\|		\|
	\|insanity		\|insanity
	\|}		\|}

	~~Test~~ groups ~~confgured~~ with DNE; all tests run with 2 MDSs with 2 MDTs each.		All of the following test groups are run in a Lustre environment with DNE configured; all tests run with 2 MDSs with 2 MDTs each.
	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \| review-dne-part-1		! style="text-align:left;" \| review-dne-part-1
Line 124:		Line 118:

	== Optional Test Groups ==		== Optional Test Groups ==
	In addition to the enforced test groups, there ~~is one~~ optional test ~~group~~ that ~~does~~ not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.		In addition to the enforced test groups, there are four optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

	~~There are no optional test groups at this time.~~		{\| class="wikitable"
			! style="text-align:left;" \| review-ldiskfs-arm
			!review-dne-ssk
			!review-dne-selinux
			!review-dne-selinux-ssk
			\|-
			\|lnet-selftest
			\|sanity
			\|sanity
			\|sanity
			\|-
			\|sanity
			\|recovery-small
			\|recovery-small
			\|recovery-small
			\|-
			\|
			\|sanity-selinux
			\|sanity-sec
			\|sanity-selinux
			\|-
			\|
			\|
			\|
			\|sanity-sec
			\|}

Jnunez: /* Enforced Test Groups */

2019-08-23T22:25:00Z

Enforced Test Groups

← Older revision		Revision as of 15:25, 23 August 2019
Line 112:		Line 112:
	\|insanity		\|insanity
	\|insanity		\|insanity
			\|-
			\|
			\|
			\|sanity-pcc
			\|sanity-pcc
			\|
			\|
			\|
			\|
	\|}		\|}

Jnunez: Moved optional test group to mandatory

2019-05-28T17:39:56Z

Moved optional test group to mandatory

← Older revision		Revision as of 10:39, 28 May 2019
Line 6:		Line 6:
	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \| review-ldiskfs		! style="text-align:left;" \| review-ldiskfs
			!review-ldiskfs-arm
	!review-zfs		!review-zfs
	\|-		\|-
			\|sanity
	\|sanity		\|sanity
	\|sanity-quota		\|sanity-quota
	\|-		\|-
			\|lnet-selftest
	\|lnet-selftest		\|lnet-selftest
	\|sanity-flr		\|sanity-flr
	\|-		\|-
			\|
	\|		\|
	\|replay-single		\|replay-single
	\|-		\|-
			\|
	\|		\|
	\|replay-ost-single		\|replay-ost-single

	\|-		\|-
			\|
	\|		\|
	\|insanity		\|insanity
Line 112:		Line 117:
	In addition to the enforced test groups, there is one optional test group that does not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.		In addition to the enforced test groups, there is one optional test group that does not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

	~~The Lustre test suites that compose each~~ optional test ~~group are:~~		There are no optional test groups at this time.
	~~{\| class="wikitable"~~
	~~! style="text-align:left;" \|review-ldiskfs-arm~~
	\|-
	~~\|sanity~~
	\|-
	~~\|lnet-selftest~~
	\|-
	\|}

Jnunez: Moved optional test group to mandatory

2019-03-07T17:44:11Z

Moved optional test group to mandatory

← Older revision		Revision as of 10:44, 7 March 2019
Line 1:		Line 1:
	When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and ~~others may fail~~, optional test groups.		When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and other, optional, test groups may fail.
	== Enforced Test Groups ==		== Enforced Test Groups ==
	There are ~~nine~~ test groups that every patch ~~submitted to Lustre~~ must pass in order for a patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.		There are ten test groups that every patch must pass in order for the patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.
	The Lustre test suites that compose each test group are listed in the following table and run in the order below every time they are executed.		The Lustre test suites that compose each test group are listed in the following table and the test suites in each test group are run in the order below every time they are executed.

	{\| class="wikitable"		{\| class="wikitable"
Line 34:		Line 34:
	!review-dne-zfs-part-3		!review-dne-zfs-part-3
	!review-dne-part-4		!review-dne-part-4
			!review-dne-zfs-part-4
	\|-		\|-
	\|sanity		\|sanity
Line 41:		Line 42:
	\|conf-sanity		\|conf-sanity
	\|conf-sanity		\|conf-sanity
			\|mmp
	\|mmp		\|mmp
	\|-		\|-
Line 49:		Line 51:
	\|		\|
	\|		\|
			\|replay-single
	\|replay-single		\|replay-single
	\|-		\|-
Line 57:		Line 60:
	\|		\|
	\|		\|
			\|sanity-pfl
	\|sanity-pfl		\|sanity-pfl
	\|-		\|-
Line 65:		Line 69:
	\|		\|
	\|		\|
			\|sanity-flr
	\|sanity-flr		\|sanity-flr
	\|-		\|-
Line 73:		Line 78:
	\|		\|
	\|		\|
			\|sanity-dom
	\|sanity-dom		\|sanity-dom
	\|-		\|-
Line 81:		Line 87:
	\|		\|
	\|		\|
			\|sanity-quota
	\|sanity-quota		\|sanity-quota
	\|-		\|-
Line 89:		Line 96:
	\|		\|
	\|		\|
			\|replay-ost-single
	\|replay-ost-single		\|replay-ost-single
	\|-		\|-
Line 97:		Line 105:
	\|		\|
	\|		\|
			\|insanity
	\|insanity		\|insanity
	\|}		\|}

	== Optional Test Groups ==		== Optional Test Groups ==
	In addition to the enforced test groups, there ~~are two~~ optional test ~~groups~~ that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.		In addition to the enforced test groups, there is one optional test group that does not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

	The Lustre test suites that compose each optional test group are:		The Lustre test suites that compose each optional test group are:
	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \|review-ldiskfs-arm		! style="text-align:left;" \|review-ldiskfs-arm
	~~!review-dne-zfs-part-4~~
	\|-		\|-
	\|sanity		\|sanity
	~~\|mmp~~
	\|-		\|-
	\|lnet-selftest		\|lnet-selftest
	~~\|replay-single~~
	\|-		\|-
	\|
	~~\|sanity-pfl~~
	\|-
	\|
	~~\|sanity-flr~~
	\|-
	\|
	~~\|sanity-dom~~
	\|-
	\|
	~~\|sanity-quota~~
	\|-
	\|
	~~\|replay-ost-single~~
	\|-
	\|
	~~\|insanity~~
	\|}		\|}

Jnunez: Updated optional and enforced test groups.

2019-01-24T19:20:03Z

Updated optional and enforced test groups.

Show changes

Jnunez: Added review-ldiskfs-arm

2018-12-06T16:31:58Z

Added review-ldiskfs-arm

← Older revision		Revision as of 09:31, 6 December 2018
Line 89:		Line 89:

	== Optional Test Groups ==		== Optional Test Groups ==
	In addition to the enforced test groups, there are ~~two~~ optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.		In addition to the enforced test groups, there are three optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

	The Lustre test suites that compose each optional test group are:		The Lustre test suites that compose each optional test group are:
	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \|review-dne-zfs-part-3		! style="text-align:left;" \|review-ldiskfs-arm
			!review-dne-zfs-part-3
	!review-dne-zfs-part-4		!review-dne-zfs-part-4
	\|-		\|-
			\|sanity
	\|conf-sanity		\|conf-sanity
	\|mmp		\|mmp
	\|-		\|-
			\|lnet-selftest
	\|		\|
	\|replay-single		\|replay-single
	\|-		\|-
			\|
	\|		\|
	\|sanity-pfl		\|sanity-pfl
	\|-		\|-
			\|
	\|		\|
	\|sanity-flr		\|sanity-flr
	\|-		\|-
			\|
	\|		\|
	\|sanity-dom		\|sanity-dom
	\|-		\|-
			\|
	\|		\|
	\|sanity-quota		\|sanity-quota
	\|-		\|-
			\|
	\|		\|
	\|replay-ost-single		\|replay-ost-single
	\|-		\|-
			\|
	\|		\|
	\|insanity		\|insanity
	\|}		\|}

Jnunez: remove racer from review-ldiskfs

2018-09-27T14:34:52Z

remove racer from review-ldiskfs

← Older revision		Revision as of 07:34, 27 September 2018
Line 33:		Line 33:
	\|replay-single		\|replay-single
	\|-		\|-
	\|~~racer~~		\|
	\|replay-single		\|replay-single
	\|recovery-small		\|recovery-small

Jnunez: Update test groups and test suites in each

2018-08-28T22:54:03Z

Update test groups and test suites in each

← Older revision		Revision as of 15:54, 28 August 2018
Line 1:		Line 1:
	There are ~~seven mandatory~~ test groups that every patch submitted to Lustre~~, community release,~~ must pass in order for a patch to be considered for landing. ~~In addition,~~ there ~~are two optional~~ test ~~groups that do not influence if~~ a patch ~~can land. These optional test groups~~ will ~~become madatory for patch landing soon and should~~ be ~~reviewed~~. The Lustre test suites that compose each test group are listed in the following table and run in the ~~exact~~ order below every time they are executed.		When a patch is submitted to Lustre, automated testing is run against a build of Lustre with the submitted patch. Some of these test groups must pass testing, enforced test groups, and others may fail, optional test groups.
			== Enforced Test Groups ==
			There are eight test groups that every patch submitted to Lustre must pass in order for a patch to be considered for landing. If there is a failure in any one of these test sessions, a patch will not be allowed to land to the Lustre branch.
			The Lustre test suites that compose each test group are listed in the following table and run in the order below every time they are executed.

	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \| review-ldiskfs		! style="text-align:left;" \| review-ldiskfs
	!review-zfs~~-part-1~~		!review-zfs
	~~!review-zfs-part-2~~
	!review-dne-part-1		!review-dne-part-1
			!review-dne-zfs-part-1
	!review-dne-part-2		!review-dne-part-2
			!review-dne-zfs-part-2
	!review-dne-part-3		!review-dne-part-3
	!review-dne-part-4		!review-dne-part-4
	\|-		\|-
	\|sanity		\|sanity
	\|~~runtests~~		\|sanity-quota
	\|~~replay-single~~		\|sanity
	\|sanity		\|sanity
			\|runtests
	\|runtests		\|runtests
	\|conf-sanity		\|conf-sanity
Line 20:		Line 25:
	\|-		\|-
	\|lnet-selftest		\|lnet-selftest
	\|sanity		\|sanity-flr
	\|~~conf-sanity~~		\|sanityn
	\|sanityn		\|sanityn
			\|ost-pools
	\|ost-pools		\|ost-pools
	\|		\|
Line 28:		Line 34:
	\|-		\|-
	\|racer		\|racer
	\|~~sanityn~~		\|replay-single
	\|recovery-small		\|recovery-small
	\|recovery-small		\|recovery-small
			\|sanity-hsm
	\|sanity-hsm		\|sanity-hsm
	\|		\|
Line 36:		Line 43:
	\|-		\|-
	\|		\|
	\|sanity~~-quota~~		\|conf-sanity
	\|~~replay~~-~~ost~~-~~single~~		\|lustre-rsync-test
	\|lustre-rsync-test		\|lustre-rsync-test
			\|sanity-scrub
	\|sanity-scrub		\|sanity-scrub
	\|		\|
Line 44:		Line 52:
	\|-		\|-
	\|		\|
	\|ost-~~pools~~		\|replay-ost-single
	\|~~insanity~~		\|
	\|		\|
			\|sanity-lfsck
	\|sanity-lfsck		\|sanity-lfsck
	\|		\|
Line 52:		Line 61:
	\|-		\|-
	\|		\|
	\|~~sanity-lfsck~~		\|insanity
	\|~~lustre-rsync-test~~		\|
	\|		\|
			\|sanity-sec
	\|sanity-sec		\|sanity-sec
	\|		\|
Line 60:		Line 70:
	\|-		\|-
	\|		\|
	~~\|sanity-hsm~~
	~~\|large-scale~~
	\|		\|
			\|
			\|
			\|mds-survey
	\|mds-survey		\|mds-survey
	\|		\|
Line 68:		Line 79:
	\|-		\|-
	\|		\|
	\|~~sanity-flr~~		\|
	\|~~mds-survey~~		\|
	\|		\|
			\|large-scale
	\|large-scale		\|large-scale
	\|		\|
Line 76:		Line 88:
	\|}		\|}

	~~The~~ optional test groups that ~~are run~~ for each ~~patch~~ are:		== Optional Test Groups ==
			In addition to the enforced test groups, there are two optional test groups that do not influence if a patch can land. These optional test groups will become enforced test groups for patch landing in the near future and should be reviewed for failures.

			The Lustre test suites that compose each optional test group are:
	{\| class="wikitable"		{\| class="wikitable"
	! style="text-align:left;" \|review-dne-zfs-part-1		! style="text-align:left;" \|review-dne-zfs-part-3
	!review-dne-zfs-part-2		!review-dne-zfs-part-4
	\|-		\|-
	\|sanity		\|conf-sanity
	\|~~runtests~~		\|mmp
	\|-		\|-
	\|~~sanityn~~		\|
	\|~~ost~~-~~pools~~		\|replay-single
	\|-		\|-
	\|~~recovery-small~~		\|
	\|sanity-~~hsm~~		\|sanity-pfl
	\|-		\|-
	\|~~lustre-rsync-test~~		\|
	\|sanity-~~scrub~~		\|sanity-flr
	\|-		\|-
	\|		\|
	\|sanity-~~lfsck~~		\|sanity-dom
	\|-		\|-
	\|		\|
	\|sanity-~~sec~~		\|sanity-quota
	\|-		\|-
	\|		\|
	\|~~mds~~-~~survey~~		\|replay-ost-single
	\|-		\|-
	\|		\|
	\|~~large-scale~~		\|insanity
	\|}		\|}