OST Pool Quotas - Revision history

Sergey: /* Docs */

2020-10-09T11:29:15Z

Docs

← Older revision		Revision as of 03:29, 9 October 2020
Line 43:		Line 43:

	[[OST Pool Quota Test Plan]]		[[OST Pool Quota Test Plan]]

			[[OST Pool Quotas Test Report]]

	[http://cdn.opensfs.org/wp-content/uploads/2019/07/LUG2019-Introducing_Pool_Quotas-Spitz.pdf Introducing Pool Quotas]		[http://cdn.opensfs.org/wp-content/uploads/2019/07/LUG2019-Introducing_Pool_Quotas-Spitz.pdf Introducing Pool Quotas]

Sergey: landed yes

2020-10-07T14:33:25Z

landed yes

← Older revision		Revision as of 06:33, 7 October 2020
Line 57:		Line 57:
	\|-		\|-
	\| [https://review.whamcloud.com/#/c/35615/ LU-11023 quota: quota pools for OSTs]		\| [https://review.whamcloud.com/#/c/35615/ LU-11023 quota: quota pools for OSTs]
	\| no		\| yes
	\|}		\|}

Sergey: link to Pool Quotas presentation

2020-09-03T09:39:33Z

link to Pool Quotas presentation

← Older revision		Revision as of 01:39, 3 September 2020
Line 43:		Line 43:

	[[OST Pool Quota Test Plan]]		[[OST Pool Quota Test Plan]]

			[http://cdn.opensfs.org/wp-content/uploads/2019/07/LUG2019-Introducing_Pool_Quotas-Spitz.pdf Introducing Pool Quotas]

	=== Tickets ===		=== Tickets ===
	[https://jira.whamcloud.com/browse/LU-11023 LU-11023]		[https://jira.whamcloud.com/browse/LU-11023 LU-11023]

Sergey at 11:18, 25 August 2020

2020-08-25T11:18:44Z

Sergey at 12:36, 17 March 2020

2020-03-17T12:36:15Z

← Older revision		Revision as of 04:36, 17 March 2020
Line 41:		Line 41:
	=== Docs ===		=== Docs ===
	[[OST Pool Quotas HLD]]		[[OST Pool Quotas HLD]]

			[[OST Pool Quota Test Plan]]
	=== Tickets ===		=== Tickets ===
	[https://jira.whamcloud.com/browse/LU-11023 LU-11023]		[https://jira.whamcloud.com/browse/LU-11023 LU-11023]

Sergey: add soft limit example

2020-03-17T08:46:28Z

add soft limit example

← Older revision		Revision as of 00:46, 17 March 2020
Line 4:		Line 4:
	Each Quota Pool(QP) duplicates content of OST pool. Thus QP could be tuned with standard lctl pool_new/add/remove/erase commands.		Each Quota Pool(QP) duplicates content of OST pool. Thus QP could be tuned with standard lctl pool_new/add/remove/erase commands.
	All QPs are subset of a ''global pool'' that includes all OSTs and MDTs(DOM case).		All QPs are subset of a ''global pool'' that includes all OSTs and MDTs(DOM case).

			See more details in [http://wiki.lustre.org/OST_Pool_Quotas_HLD#Use_Cases OST Pool Quotas HLD].

	== DOM and MDT pools ==		== DOM and MDT pools ==
Line 16:		Line 18:
	*:Example: lfs quota -u quota_usr --pool "qpool1" /mnt/lustre		*:Example: lfs quota -u quota_usr --pool "qpool1" /mnt/lustre
	== How To setup QP ==		== How To setup QP ==
			=== Hard limit example ===
	Let's imagine you haven't any OST pool(if you want to setup already existed pool, go to 3):		Let's imagine you haven't any OST pool(if you want to setup already existed pool, go to 3):
	# lctl pool_new qpool1 /mnt/lustre		# lctl pool_new qpool1 /mnt/lustre
Line 23:		Line 26:
	Note, you need to setup wide-system hard limit before setting QP limit. If you don't need to limit user at all OSTs and MDTs at system, only per pool, I would recommend to set some unrealistic big hard limit.		Note, you need to setup wide-system hard limit before setting QP limit. If you don't need to limit user at all OSTs and MDTs at system, only per pool, I would recommend to set some unrealistic big hard limit.
	Without that OSTs don't know that quota for quota_usr is enabled.		Without that OSTs don't know that quota for quota_usr is enabled.

			=== Soft limit example ===
			# lctl pool_new qpool1 /mnt/lustre
			# lctl pool_add qpool1 OST000 /mnt/lustre
			# lfs setquota -u quota_usr -B100T /mnt/lustre /* notify OSTs that to enforce quota for quota_usr */
			# lfs setquota -t -u --block-grace 30 -o qpool1 /mnt/lustre /* set block grace 30 s for all users at qpool1 */
			# lfs setquota -u quota_usr -b10M -o qpool1 /mnt/lustre /* soft limit 10M for quota_usr */
			# /runas -u quota_usr dd if=/dev/urandom of=/mnt/lustre/dir/f1 bs=1M count=15
			# [root@dhcppc3 tests]# lfs quota -u quota_usr --pool qpool1 /mnt/lustre
			Disk quotas for usr quota_usr (uid 60000):
			Filesystem kbytes quota limit grace files quota limit grace
			/mnt/lustre 14336* 10240 107374182400 26s 1 0 0 -
	== Links ==		== Links ==
	=== Docs ===		=== Docs ===

Sergey at 21:09, 16 March 2020

2020-03-16T21:09:50Z

@@ Line 9: / Line 9: @@
 But until we haven't a mechanism to group MDTs in pools, '''Quota Pools support only OSTs'''.
-== Use cases ==
+== New options at lfs quota/setquota ==
+new options were introduced to support QP at lfs quota and setquota:
 == Links ==
 [[OST Pool Quotas HLD]]
+=== Tickets ===
 [https://jira.whamcloud.com/browse/LU-11023 LU-11023]

Sergey at 19:39, 16 March 2020

2020-03-16T19:39:13Z

← Older revision		Revision as of 11:39, 16 March 2020
Line 1:		Line 1:
			== Description ==
			OST Pool Quotas feature gives an ability to limit user's(group's/project's) disk usage at OST pool.

			Each Quota Pool(QP) duplicates content of OST pool. Thus QP could be tuned with standard lctl pool_new/add/remove/erase commands.
			All QPs are subset of a ''global pool'' that includes all OSTs and MDTs(DOM case).

			== DOM and MDT pools ==
			From Quota Master point of view "data" MDTs are regular members together with OSTs.
			But until we haven't a mechanism to group MDTs in pools, '''Quota Pools support only OSTs'''.

			== Use cases ==

			== Links ==
	[[OST Pool Quotas HLD]]		[[OST Pool Quotas HLD]]

			[https://jira.whamcloud.com/browse/LU-11023 LU-11023]

Sergey at 18:57, 16 March 2020

2020-03-16T18:57:14Z

← Older revision		Revision as of 10:57, 16 March 2020
Line 1:		Line 1:
	~~#REDIRECT~~ [[OST Pool Quotas HLD]]		[[OST Pool Quotas HLD]]

Sergey: Sergey moved page OST Pool Quotas to OST Pool Quotas HLD

2020-03-16T18:43:22Z

Sergey moved page OST Pool Quotas to OST Pool Quotas HLD

New page

#REDIRECT [[OST Pool Quotas HLD]]

← Older revision		Revision as of 03:18, 25 August 2020
Line 13:		Line 13:
	== New options at lfs quota/setquota ==		== New options at lfs quota/setquota ==
	2 new options were introduced to support QP at lfs quota and setquota:		2 new options were introduced to support QP at lfs quota and setquota:
	* ''-o "pool_name"'' is new option to be used with lfs setquota to set quota for user/qroup/project per quota pool.		* ''--pool "pool_name"'' is new option to be used with lfs setquota to set quota for user/qroup/project per quota pool.
	*:Example: lfs setquota -u quota_usr -o "qpool1" -B10M /mnt/lustre		*:Example: lfs setquota -u quota_usr --pool "qpool1" -B10M /mnt/lustre
	* ''--pool "pool_name"'' is an option to show quota for user/group/project per quota pool.		* ''--pool "pool_name"'' is an option to show quota for user/group/project per quota pool.
	*:Example: lfs quota -u quota_usr --pool "qpool1" /mnt/lustre		*:Example: lfs quota -u quota_usr --pool "qpool1" /mnt/lustre
Line 23:		Line 23:
	# lctl pool_add qpool1 OST000 /mnt/lustre		# lctl pool_add qpool1 OST000 /mnt/lustre
	# lfs setquota -u quota_usr -B100T /mnt/lustre /* it is a limit for global pool. QPs don't work properly without that */		# lfs setquota -u quota_usr -B100T /mnt/lustre /* it is a limit for global pool. QPs don't work properly without that */
	# lfs setquota -u quota_usr -o "qpool1" -B100M /mnt/lustre		# lfs setquota -u quota_usr --pool "qpool1" -B100M /mnt/lustre
	Note, you need to setup wide-system hard limit before setting QP limit. If you don't need to limit user at all OSTs and MDTs at system, only per pool, I would recommend to set some unrealistic big hard limit.		Note, you need to setup wide-system hard limit before setting QP limit. If you don't need to limit user at all OSTs and MDTs at system, only per pool, I would recommend to set some unrealistic big hard limit.
	Without that OSTs don't know that quota for quota_usr is enabled.		Without that OSTs don't know that quota for quota_usr is enabled.
Line 31:		Line 31:
	# lctl pool_add qpool1 OST000 /mnt/lustre		# lctl pool_add qpool1 OST000 /mnt/lustre
	# lfs setquota -u quota_usr -B100T /mnt/lustre /* notify OSTs that to enforce quota for quota_usr */		# lfs setquota -u quota_usr -B100T /mnt/lustre /* notify OSTs that to enforce quota for quota_usr */
	# lfs setquota -t -u --block-grace 30 -o qpool1 /mnt/lustre /* set block grace 30 s for all users at qpool1 */		# lfs setquota -t -u --block-grace 30 --pool qpool1 /mnt/lustre /* set block grace 30 s for all users at qpool1 */
	# lfs setquota -u quota_usr -b10M -o qpool1 /mnt/lustre /* soft limit 10M for quota_usr */		# lfs setquota -u quota_usr -b10M --pool qpool1 /mnt/lustre /* soft limit 10M for quota_usr */
	# /runas -u quota_usr dd if=/dev/urandom of=/mnt/lustre/dir/f1 bs=1M count=15		# /runas -u quota_usr dd if=/dev/urandom of=/mnt/lustre/dir/f1 bs=1M count=15
	# [root@dhcppc3 tests]# lfs quota -u quota_usr --pool qpool1 /mnt/lustre		# [root@dhcppc3 tests]# lfs quota -u quota_usr --pool qpool1 /mnt/lustre