Lustre Quota Troubleshooting: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
Line 14: Line 14:
To verify the status of space accounting and quota, run the following on every Lustre node that serves an MDT or OST and has the target mounted
To verify the status of space accounting and quota, run the following on every Lustre node that serves an MDT or OST and has the target mounted


  lctl get_param osd-*.fsname-*.quota_slave_*.info | sed "/^osd/c\----------------------------------------"
  lctl get_param osd-*.*.quota_slave_*.enabled


A MDT will display two different output stanza per target: '''dt''' for data/block and '''md''' for metadata/inode.
A MDT will display two different output stanza per target: '''dt''' for data/block and '''md''' for metadata/inode.


  [root@testhost-mds01 ~]# lctl get_param osd-*.*.quota_slave_*.info | sed "/^osd/c\----------------------------------------"|less
  osd-ldiskfs.testfs-MDT0000.quota_slave_dt.enabled=none
  ----------------------------------------
  osd-ldiskfs.testfs-MDT0000.quota_slave_md.enabled=none
target name:    testfs-MDT0000
  osd-ldiskfs.testfs-MDT0001.quota_slave_dt.enabled=none
pool ID:        0
  osd-ldiskfs.testfs-MDT0001.quota_slave_md.enabled=none
type:          dt
quota enabled:  none
  conn to master: setup
space acct:    ugp
user uptodate:  glb[0],slv[0],reint[0]
group uptodate: glb[0],slv[0],reint[0]
project uptodate: glb[0],slv[0],reint[0]
----------------------------------------
  target name:    testfs-MDT0000
pool ID:        0
type:          md
quota enabled:  u
conn to master: setup
space acct:    ugp
user uptodate:  glb[1],slv[1],reint[0]
group uptodate: glb[0],slv[0],reint[0]
project uptodate: glb[0],slv[0],reint[0]


An OST will display only one output stanza per target: '''dt''' for data/block.
An OST will display only one output stanza per target: '''dt''' for data/block.


  [root@testhost-oss01 ~]# lctl get_param osd-*.*.quota_slave.info | sed "/^osd/c\----------------------------------------"|less
  osd-ldiskfs.testfs-OST0000.quota_slave_dt.enabled=none
  ----------------------------------------
  osd-ldiskfs.testfs-OST0001.quota_slave_dt.enabled=none
target name:    testfs-OST0000
pool ID:        0
type:          dt
quota enabled:  none
conn to master: setup
space acct:    ugp
user uptodate:  glb[0],slv[0],reint[0]
group uptodate: glb[0],slv[0],reint[0]
project uptodate: glb[0],slv[0],reint[0]


Closely inspect the values for '''quota enabled:''' and '''space acct:'''. The values can be '''none''' or any combination of the letters '''u''', '''g''' and '''p''', representing user, group and project. The default value for '''quota enabled:''' is '''none''' and the default value for '''space acct:''' is '''ugp'''
Closely inspect the values for '''quota enabled:''' and '''space acct:'''. The values can be '''none''' or any combination of the letters '''u''', '''g''' and '''p''', representing user, group and project. The default value for '''quota enabled:''' is '''none''' and the default value for '''space acct:''' is '''ugp'''

Revision as of 08:41, 30 January 2025

Introduction

This document is based on and tested with Lustre 2.15 and LDISKFS. If your Lustre version is older or you are using ZFS, the content may not be applicable.

Space accounting and project ID tracking are enabled by default on a LDISKFS file system. However, quota restrictions are NOT enabled by default. User, Group and Project quota restrictions must be manually enabled on all targets, as well as configuring data/block and/or metadata/inode limits.

Adding to This Guide

If you have improvements, corrections, or more information to share on this topic please contribute to this page.

Status Verification

To verify the status of space accounting and quota, run the following on every Lustre node that serves an MDT or OST and has the target mounted 

lctl get_param osd-*.*.quota_slave_*.enabled

A MDT will display two different output stanza per target: dt for data/block and md for metadata/inode. 

osd-ldiskfs.testfs-MDT0000.quota_slave_dt.enabled=none
osd-ldiskfs.testfs-MDT0000.quota_slave_md.enabled=none
osd-ldiskfs.testfs-MDT0001.quota_slave_dt.enabled=none
osd-ldiskfs.testfs-MDT0001.quota_slave_md.enabled=none

An OST will display only one output stanza per target: dt for data/block. 

osd-ldiskfs.testfs-OST0000.quota_slave_dt.enabled=none
osd-ldiskfs.testfs-OST0001.quota_slave_dt.enabled=none

Closely inspect the values for quota enabled: and space acct:. The values can be none or any combination of the letters u, g and p, representing user, group and project. The default value for quota enabled: is none and the default value for space acct: is ugp

Quota Modification

User, group and project quota can be modified on a per target basis. Typically, it is desirable to have all target's quota configuration set the same.

References and Links

Retrieved from "http://wiki.lustre.org/index.php?title=Lustre_Quota_Troubleshooting&oldid=5089"